JP2022147379A - Voice management device and program - Google Patents

Abstract

To provide a voice management device and a program that can use more appropriate voice data depending on an attribute including preference of a user or a situation including characteristics of voice data for the voice data output by an electronic product such as a cleaner.SOLUTION: In a system, a voice management device 10 that manages voice data output by a cleaner 30, comprises: an input unit 11 that receives selection for the voice data output by the cleaner 30 from a user terminal 20 used by a user of the cleaner 30; and a voice management unit 13 that performs streaming distribution of the voice data 143 stored in a storage unit 14 as audition data to the user terminal 20 using an output unit 12 according to the selection, identifies the voice data according to a download instruction of the voice data received from the user terminal 20 through the input unit 11, and performs download distribution of the identified voice data using the output unit 12.SELECTED DRAWING: Figure 1

Description

TECHNICAL FIELD The present invention relates to an electronic product having an audio function for outputting audio and a technique for realizing this audio function.

Currently, electrical products that output sound are in use. For example, guidance such as operation guidance, alerts calling attention to operations and operations, and operation results are output by voice. In particular, for electronic products that operate autonomously, such as autonomously traveling vacuum cleaners, communication with users is more important, and the need for voice functions is increasing.

In such voice functions, it is required to customize the volume and range for each user. For example, Patent Literature 1 describes "an electric vacuum cleaner that allows selection of volume and light intensity modes corresponding to a user's personality and lifestyle." For this reason, in Patent Document 1, "A vacuum cleaner that includes an electric blower, a motor-drivable drive wheel, and a motor-drivable main brush, and can execute an automatic operation mode in which the drive wheel is driven while being autonomously driven It is possible to execute a low operation mode with a lower volume than the automatic operation mode and a quiet operation mode with a lower volume than the low operation mode, and the automatic operation mode, the low operation mode, and the silent operation mode has a mode designating section for receiving from the user a designation of which of In the silent operation mode, the sound of messages and sound effects is suppressed.

In addition, Patent Document 2 describes a voice guidance device that "enables voice guidance that is easy to hear even for elderly people with reduced hearing and hearing-impaired people." For this reason, Japanese Patent Laid-Open No. 2002-200001 discloses that "sound data of a plurality of guidance voices with different sound ranges are stored in advance in the memory 5, and the sound mixing device 4 selects three voice data with different sound ranges from the stored sound data. Mixed voice data is generated by selecting and synthesizing voice data.Voice production device 12 converts the mixed voice data into voice and outputs the guidance voice through speaker 13. Voice measuring device 7 receives the voice from the passenger. characteristics (frequency, loudness, speed of pronunciation) of the response voice are measured, and the voice mixer 4 generates and outputs mixed voice data of the guidance voice having the measured characteristics.

JP 2020-39454 A JP-A-2006-38929

Here, the audio function needs to be customized according to the user's preference, hearing ability, and other characteristics. However, Japanese Patent Laid-Open No. 2004-100000 controls whether or not to suppress pronunciation, and does not change the range or voice itself according to preferences and characteristics.

Further, in Patent Document 2, a mixed voice is generated according to the response voice from the passenger, but the voice of the passenger does not necessarily match his or her taste.

Therefore, an object of the present invention is to make it possible to use more appropriate voice data according to the situation including attributes including user preferences and voice data characteristics.

In order to solve the above-mentioned problems, the present invention is configured so that the audio data can be distributed by streaming and listened to, and the audio data can be set to the home electric appliance according to the user's selection result.

More specifically, in a voice management device for managing voice data output by an electrical product, an input for accepting a selection of voice data output by the electrical product from a user terminal used by a user of the electrical product. and, in accordance with the selection, the audio data stored in the storage unit is streamed to the user terminal using the output unit as audition data using the output unit, and the use is performed through the input unit. a voice management unit that specifies voice data according to an instruction to download voice data received from a user terminal, downloads and distributes the specified voice data using the output unit, and downloads and distributes the voice data is set in the storage unit of the electrical product, and the electrical product can output the audio data. The present invention also includes a voice management method using this voice management device.

The present invention also includes programs used in user terminals. Furthermore, the present invention also includes the electronic product capable of changing voice data. Furthermore, the present invention also includes a system including a voice management device, a user terminal, an appliance, or a subcombination including at least two of these. Furthermore, a voice data management method using these is also included.

According to the present invention, it becomes possible to use more appropriate audio data in accordance with the user's situation in the electronic product.

1 is a system configuration diagram in an embodiment of the present invention; FIG. 1 is a hardware configuration diagram of a voice management device according to an embodiment of the present invention; FIG. FIG. 2 is a hardware configuration diagram of a user terminal in one embodiment of the present invention; 1 is a functional block configuration diagram of a vacuum cleaner according to an embodiment of the present invention; FIG. The figure which shows the user information used by one Example of this invention. FIG. 4 is a diagram showing voice management information used in one embodiment of the present invention; 4 is a flow chart showing a processing flow in one embodiment of the present invention; The figure which shows an example of the selection screen in one Example of this invention. The figure which shows an example of the summary change instruction screen in one Example of this invention.

An embodiment of the present invention will be described below with reference to the drawings. Note that, in this embodiment, an autonomously traveling vacuum cleaner is used as an example of an electric product, but the present invention can also be applied to other electric products.

<Configuration>
FIG. 1 is a system configuration diagram in this embodiment. In this embodiment, a voice management device 10 , a user terminal 20 , an autonomously traveling cleaner (hereinafter simply referred to as a cleaner 30 ), and a router 40 are connected to each other via a network 50 . Vacuum cleaner 30 and user terminal 20 can also be connected to network 50 via router 40 . Also, the network 50 may be composed of a home network and the Internet, or may be composed of one network. Although each device is shown in FIG. 1 as one unit, it is also possible to use a plurality of units.

Next, the configuration of each device will be described. First, the voice management device 10 is realized by a so-called computer device, and has an input unit 11, an output unit 12, and a voice management unit 13 for executing various calculations. The voice management device 10 also has a storage unit 14 that stores various information. The input unit 11 and the output unit 12 implement communication with other devices via the network 50 .

The voice management unit 13 executes processing for delivering voice data according to instructions from the user terminal 20 . User information 141 , voice management information 142 and voice data 143 are stored in the storage unit 14 . The user information 141 is information about the user such as attributes of the user of the vacuum cleaner 30 . Here, the user indicates the user of at least one of the user terminal 20 and the cleaner 30 . The voice management information 142 is information for managing the voice data 143 and is information for specifying an output message indicated by the voice data 143 and the like. As the voice data 143, voice data of each output message is prepared for each type of voice. The details of each of these pieces of information will be described later.

Next, FIG. 2 shows a hardware configuration diagram when the functions of the voice management device 10 are implemented by a program. The voice management device 10 has a processing section 101, a communication section 102, a main storage section 103 and a sub storage section 104, which are connected to each other via a communication path.

The processing unit 101 can be realized by a processor such as a CPU (Central Processing Unit), and executes calculations according to a voice management program 130 developed in the main storage unit 103, which will be described later. That is, the processing unit 101 executes the processing of the voice management unit 13 according to the voice management program 130 .

The main storage unit 103 can be realized by a so-called memory, and the voice management program 130 stored in the sub-storage unit 104 and information necessary for processing are developed. The sub-storage unit 104 can be realized by a storage such as a hard disk drive, and stores the voice management program 130 and various information described with reference to FIG. Thus, the main storage section 103 and the sub storage section 104 correspond to the storage section 14 . Also, the various information in the sub-storage unit 104 may be stored in a database system in a separate housing from the voice management device 10 .

Note that the voice management device 10 may further include an input unit for receiving input from the operator and a display unit for outputting various information. Also, these may be used as terminal devices. Furthermore, each program of each device may be implemented as one program, or may be further subdivided. The description of the voice management device 10 ends here.

Next, FIG. 3 shows a hardware configuration diagram of the user terminal 20. As shown in FIG. The user terminal 20 is realized by a so-called computer device such as a smart phone. Therefore, the user terminal 20 has a touch panel 21 , a processing section 22 , a communication section 23 , a speaker 24 and a storage section 25 .

The touch panel 21 receives input from the user and displays various information. Note that the touch panel 21 may be configured by being divided into an input section for receiving input and a display section for displaying.

The processing unit 22 can be realized by a processor such as a CPU, and executes calculations according to each program (application) described later. The communication unit 23 connects with other devices via the network 50 and the router 40 . Moreover, the communication unit 23 may further have a short-range wireless communication function for connecting with the vacuum cleaner 30 .

The speaker 24 outputs various information by voice (sound) according to the processing of the processing unit 22 . The storage unit 25 also stores a vacuum cleaner operating program 251 and user voice management information 252 . The cleaner operating program 251 implements instructions and controls related to the operation of the cleaner 30. The user voice management information 252 manages voice data used by the cleaner 30, which is controlled by the cleaner operating program 251. Information.

Vacuum cleaner operation program 251 is also referred to as an application. Also, the cleaner operation program 251 only needs to implement the functions described later, and does not necessarily need to have a function to implement instructions and controls relating to the operation of the cleaner 30 . Note that the user terminal 20 includes a tablet terminal and a PC. Here, the PC may be a so-called notebook type or a desktop type. The description of the configuration of the user terminal 20 ends here.

Next, the configuration of cleaner 30 will be described. Vacuum cleaner 30 operates autonomously according to a control program. That is, the cleaner 30 runs and performs cleaning. A functional block diagram of cleaner 30 for performing this function is shown in FIG. The cleaner 30 has a communication unit 31, a touch panel 32, a storage unit 33, a control unit 34, and a speaker 39 for control. The cleaner 30 has a traveling mechanism 35, a brush mechanism 36 and a suction mechanism 37 which are controlled.

The communication unit 31 has a function of communicating with the network 50, the router 40, or the user terminal 20. FIG. Note that the communication unit 31 may be provided with a short-range wireless communication function, like the communication unit 23 of the user terminal 20 .

The touch panel 32 displays various information to the user under the control of the control section 34 . Further, the touch panel 32 receives user operations and outputs various commands to the control unit 34 . Note that the touch panel 32 may be configured by being divided into an input section for receiving operations and a display section for displaying.

The storage unit 33 stores a control program for controlling operation, operation range, operation schedule information, and voice data delivered from the voice management device 10 . The control unit 34 controls the operation of the vacuum cleaner 30 according to a control program, and can be realized by a processor such as a CPU. More specifically, the controller 34 controls operations of the travel mechanism 35 , the brush mechanism 36 and the suction mechanism 37 . Further, the control unit 34 can also follow operation instructions received by the communication unit 31 and the touch panel 32 . Also, the control unit 34 outputs the audio data of the storage unit 33 through the speaker 39 .

The traveling mechanism 35 moves the cleaner 30 and has a driving part such as a motor and a driven part such as wheels. The brush mechanism 36 collects dust on the floor near the suction port. The suction mechanism 37 also sucks dust near the suction port and moves the dust to a dust collection box (not shown).

Then, the speaker 39 outputs the corresponding audio data as sound according to the processing of the control unit 34 .

Here, each program and application described above can be distributed to each device via the network 50 or distributed via a storage medium. In other words, it can be distributed as a program product. This is the end of the description of the configuration of this embodiment.

<Information>
Next, information used in this embodiment will be described. First, FIG. 5 shows user information 141 . This user information 141 is information about users and includes their attributes. Specifically, the user information 141 has a user ID, name, address, sex, age, preferences/preferences, voice data ID, and vacuum cleaner ID for each user.

The user ID is information that identifies the user of cleaner 30 . The name and address are the user's name and address. Moreover, sex and age also indicate the sex and age of the user. Also, preferences/tastes indicate user's hobbies and listening characteristics. These address, gender, age and preferences/preferences are used as user attributes.

The voice data ID indicates information identifying voice data set in the vacuum cleaner 30 used by the user. Although the voice data ID is used in this embodiment, other information may be used. For example, information for identifying a message type or a voice group (hereinafter referred to as voice G), which will be described later, may be used.

Furthermore, the cleaner ID is information for identifying the cleaner 30 itself or the model used by the user.

Next, FIG. 6 shows the voice management information 142. As shown in FIG. The voice management information 142 is information for managing the voice data 143 . The voice management information 142 has a voice data ID, an output message, a message type, and a voice G for each voice data that is an output unit from the cleaner 30 . The voice data ID identifies voice data in vacuum cleaner 30 .

The output message indicates what is to be output by cleaner 30, that is, what is to be emitted as sound. The message type is obtained by classifying the output message according to its type, and has "alert", "guidance", and "notification" in this embodiment. The reason for such classification is that the necessity and importance of each type of output message differ. Due to different needs and importance, some users may wish to change the characteristics for each type. In order to deal with this, in this embodiment, the voice management information 142 is provided with message types. "Alert" used in this embodiment indicates audio data that calls the user's attention. "Guidance" indicates voice data that provides guidance to the user on how to use the vacuum cleaner 30 and the like. "Notification" indicates operation information (such as the end of cleaning) of cleaner 30 to the user. Although classified into these three in this embodiment, the classification method is not limited to these. Further, it is desirable to provide a message type ID (such as 01A) for identifying the voice data included in the message type, in addition to the type such as "alert".

Voice G is a classification (group) of voice data including a plurality of voice data having common characteristics such as language and speaker. It is desirable that the voice data set in the vacuum cleaner 30 by default be the same voice G for each output message. Furthermore, it is desirable to provide the voice G with a voice GID (01, etc.) for identifying the voice data or the message type included therein in addition to the classification such as "Kansai dialect/female/slowly".

Next, the voice data 143 is stored as file data in correspondence with the voice data ID for each output message. Note that the voice data 143 may be managed as file data for each message type or voice G. FIG. In this case, it is desirable to provide both file data for each output message and file data for each message type or voice G. FIG.

Next, the user voice management information 252 held by the user terminal 20 will be explained. User voice management information 252 records information for identifying voice data set in vacuum cleaner 30 . That is, information similar to the audio data ID of the audio management information 142 is recorded. Furthermore, the user voice management information 252 also includes information for identifying the message type and voice G corresponding to the voice data ID. As shown in FIGS. 5 and 6, when the voice data ID includes information for identifying the message type and voice G (01A, 01, etc.), the voice data ID can be used.

Furthermore, it is desirable that the user voice management information 252 include attributes of the voice management information 142 and the like. Note that the user voice management information 252 may include the history of voice data set in the vacuum cleaner 30 and the like. This completes the description of the information used in this embodiment.
<Processing>
Next, FIG. 7 shows a flow chart showing the processing flow in this embodiment. In addition, in this flowchart, the processing subject of the voice management apparatus 10 will be described using the constituent elements shown in FIG. The function of each step will be described below.

First, in step S1, the user terminal 20 outputs a voice output instruction to the vacuum cleaner 30 according to the user's operation. For this reason, the touch panel 21 accepts user operations including identification of output messages. Then, the processing unit 22 uses the communication unit 23 to output a voice output instruction according to the vacuum cleaner operating program 251 . It should be noted that hereinafter, the processing of the processing unit 22 is executed according to the vacuum cleaner operation program 251 unless otherwise specified.

Next, in step S2, vacuum cleaner 30 outputs sound in response to the sound output instruction. For this purpose, the control unit 34 identifies audio data corresponding to the audio output instruction from the storage unit 33 . Then, the control unit 34 uses the speaker 39 to output (speak) the audio of the specified audio data.

Next, in step S3, the processing unit 22 of the user terminal 20 accepts a correction request via the touch panel 21 (Yes), and the process proceeds to step S4. If the correction request is not accepted (No), the process is terminated.

Next, in step S4, the processing section 22 specifies the output message of the voice data to be corrected and the user ID of the user. For this reason, the processing unit 22 identifies the voice data ID that identifies the voice output message output in step S2 from the voice output instruction in step S1.

The processing unit 22 also identifies the user ID using the user voice management information 252 or the information about the user stored in the storage unit 25 .

Note that steps S1 and S2 may be omitted. For example, the user may start changing the sound after listening to the sound emitted when the vacuum cleaner 30 is in operation. In this case, specification of the output message in this step can be realized by designation from the user.

Next, in step S<b>5 , the processing unit 22 uses the communication unit 23 to notify the audio management device 10 of a trial listening request. This audition request includes the output message and user ID specified in step S3.

Next, in step S<b>6 , the audio management unit 13 of the audio management device 10 searches the storage unit 14 for audio data corresponding to the audition request received by the input unit 11 . At this time, the voice management unit 13 uses the voice management information 142 to specify at least one of the message type including the output message included in the trial listening request and the voice G. FIG.

In addition, the voice management unit 13 uses the user information 141 to specify the attribute of the user corresponding to the user ID. The voice management unit 13 then identifies the voice data ID corresponding to this attribute from the voice management information 142 . For this reason, when the attribute indicates hearing loss or elderly, the speech G is specified that includes more audible characteristics such as "slowly" and "clearly." For this reason, it is desirable to set a rule indicating the correspondence between the attribute and the voice G.

As a result, the voice management unit 13 specifies the output message, message type, voice G, and voice data ID corresponding to the attribute. Audio data identified by this audio data ID is referred to as audition candidate data.

Next, in step S<b>7 , the sound management device 10 uses the output unit 12 to notify the audition candidate data. Then, according to step S7, in step S8, the processing section 22 of the user terminal 20 outputs to the touch panel 21 a selection screen for selecting audition candidate data.

An example of this selection screen is shown in FIG. This selection screen is a screen for changing the voice data of the output message specified in step S4. The touch panel 21 displays options indicating characteristics of audio data. Therefore, the user can select by checking the radio button on the selection screen. Here, as the characteristics of each option, it is desirable to use the characteristics shown in the voice G of the voice management information 142. FIG.

Furthermore, it is desirable to set the presentation order of the options according to the situation such as the attributes of the user and the characteristics of the voice data. Therefore, in step S<b>6 described above, the voice management unit 13 identifies the voice data set in the cleaner 30 based on the voice data included in the user information 141 . Then, the voice management unit 13 identifies voice data having different characteristics from the voice data set in the vacuum cleaner 30 . For this purpose, the voice management unit 13 uses the characteristics recorded in the voice G of the voice management information 142 . At this time, it is desirable that the voice management unit 13 determines the similarity of the characteristics according to a predetermined rule and uses the result. This order of presentation includes, for example, presentation in order of closest approximation. In this way, changes can be presented to the user in order of priority according to circumstances such as user attributes and voice data characteristics.

Next, in step S<b>9 , the processing unit 22 receives selections from the user input via the touch panel 21 . In response to this, the processing unit 22 transmits the selection result, that is, the voice data ID of the washed trial listening candidate data via the communication unit 23 . By accepting selections from the user in this way, the user's preferences can be reflected.

Next, in step S10, the audio management unit 13 specifies the audio data of the audio data ID indicated by the selection result received by the input unit 11 as audition data. Then, the audio management unit 13 distributes the specified audition data by streaming distribution via the output unit 12 .

Next, in step S<b>12 , the processing unit 22 outputs the audio of the audition data received via the communication unit 23 from the speaker 24 . In response to this, the user can judge whether he/she likes the audition data. Then, in step S13, the processing section 22 accepts the judgment result from the user via the touch panel 21 as to whether or not to change to the audition data. When changing (Yes), it changes to step S14, and when not changing (No), it returns to step S9. Here, if it is not changed (No) and the process returns to step S9, the processing unit 22 receives another selection from the user.

Then, in step S14, the processing unit 22 uses the touch panel 21 to receive an instruction as to whether to collectively change the voice data. For this purpose, the processing unit 22 first outputs a group change instruction screen to the touch panel 21 . This summary change instruction screen is shown in FIG. In FIG. 9, the touch panel 21 displays a screen for selecting a change unit for changing voice data. That is, the following three options are displayed.
Audio data of the audio output in step S12, that is, "this message only"
"Consolidate and change by message type" including audio data of the audio output in step S12
"Batch change" to collectively change with voice G" including the voice data of the voice output in step S12
The processing unit 22 receives a selection from the user via the touch panel 21 for this output content. Specifically, it accepts a check on a radio button provided for each option, and accepts a change instruction.

Then, in step S<b>15 , the processing unit 22 uses the communication unit 23 to notify the voice management device 10 of a download instruction for the voice data to be changed. This download instruction includes the voice data ID of the voice data specified to be changed in step S13 and the collective change specified in step S14. It should be noted that the specific contents of the collective change instructed in step S14 are the three options described above.

Here, by including the contents of the collective change in this download instruction, it becomes possible to collectively download a plurality of audio data, and network resources can be used more efficiently. Of course, the configuration may be such that voice data is downloaded for each change instruction. In other words, the download instruction only needs to specify the audio to be downloaded.

Next, in step S<b>16 , the voice management unit 13 of the voice management device 10 identifies voice data corresponding to the download instruction received via the input unit 11 . Then, the voice management unit 13 executes aggregation processing for transmitting them. Aggregation processing includes audio data compression processing and the like. Also, the voice management unit 13 updates the voice data ID of the user information 141 . That is, the voice management unit 13 changes the voice data ID of the user information 141 to the voice data ID to be downloaded.

Then, in step S17, the voice management unit 13 uses the output unit 12 to distribute the voice data aggregated in step S16 to the user terminal 20 by download distribution. In other words, the audio management unit 13 downloads and distributes the audio data in change units. This distribution may be performed to the cleaner 30 .

Next, in step S18, the processing unit 22 of the user terminal 20 updates the user voice management information 252 with respect to the download-delivered voice data. In other words, the processing unit 22 updates the audio data set in the vacuum cleaner 30 to information for identifying the downloaded audio data. Then, in step S<b>19 , the downloaded voice data is transferred to cleaner 30 using communication unit 23 . Parallel processing may be performed regardless of the processing order of steps S18 and S19.

Finally, the controller 34 of the cleaner 30 uses the communication unit 31 to receive the transferred audio data. Then, the control unit 34 stores the transferred audio data in the storage unit 33 . At this time, it is desirable that the control unit 34 overwrite the stored audio data such as the default audio data with the transferred audio data. As described above, the sound data is set, and the vacuum cleaner 30 can output this sound data. By performing the above-described processing, in this embodiment, the vacuum cleaner 30 can use the sound according to the user's preference, hearing ability, etc., while efficiently using network resources.

Although the description of the present embodiment is completed above, the present invention is not limited to the contents of this description, and various modifications and applications are possible. For example, it is applicable to electric appliances other than vacuum cleaners. A washing machine, a microwave oven, a refrigerator, etc. can be assumed as an electric product. Furthermore, the processing of the user terminal 20 may be executed by an electrical product.

DESCRIPTION OF SYMBOLS 10... Voice management apparatus 11... Input part 12... Output part 13... Voice management part 14... Storage part 141... User information 142... Voice management information 143... Voice data 20... User terminal 30... vacuum cleaner, 40... router, 50... network

Claims (8)

In a voice management device that manages voice data output by electrical products,
an input unit that receives a selection of audio data output by the electrical product from a user terminal used by a user of the electrical product;
streaming the audio data stored in the storage unit as audition data to the user terminal using the output unit according to the selection;
specifying audio data according to an instruction to download audio data received from the user terminal via the input unit;
an audio management unit that downloads and distributes the specified audio data using the output unit;
A voice management device that sets the downloaded and distributed voice data in a storage unit of the electric product, and enables the electric product to output the voice data. A voice management device according to claim 1, wherein
the download instruction includes a change unit of the audio data;
The voice management unit is a voice management device that downloads and distributes the voice data in units of the change. The voice management device according to claim 2,
The change unit includes an output message in voice data, an output message type indicating a type of the output message, and a voice group including a plurality of voice data having characteristics common to the voice data. The voice management device according to any one of claims 1 to 3,
The voice management unit
receiving a trial listening request including the attribute of the user from the user terminal;
identifying audition candidate data corresponding to the attribute from the audio data stored in the storage unit;
An audio management device that identifies the trial data from the trial candidate data. on the user terminal, which is a computer,
A function to accept selection of audio data output by electrical products;
a function of receiving, as audition data, audio data streamed according to the selection;
a function of accepting a download instruction for the streamed audio data;
a function of receiving audio data downloaded and distributed according to the download instruction;
Realizing a function of transferring the received audio data to the electrical product,
A program for setting the transferred audio data in a storage unit of the electrical product, and for outputting the audio data set in the electrical product. In the program according to claim 5,
the download instruction includes a change unit of the audio data;
The function of receiving the download-distributed audio data is a program for executing the reception in units of the change. In the program according to claim 6,
The change unit includes an audio group including an output message in audio data, an output message type indicating a type of the output message, and a plurality of audio data having characteristics common to the audio data. In the program according to any one of claims 5 to 7,
a function of identifying a trial request including attributes of a user of the electronic product;
A program for further executing a function of accepting selection of the trial data from the trial candidate data corresponding to the attribute.

Images