JP2002304285A - Operation support system using voice - Google Patents

Abstract

PROBLEM TO BE SOLVED: To support a user by means of voice to facilitate operation even in the case of complicated operation or settings of operating equipment such as electric equipment. SOLUTION: When the user operates an operating device 4 such as electric equipment, the file creating means 19 of a support device 3 creates an operation information file based on this operation and transmits it to a server 1 through a network 2. From the equipment database 25 and the voice database 26 of a storage means 7, the server 1 obtains voice data about the next operation to be done by the user, in the form of an expression selected by the user; the editing means 33 of the server 1 then creates a support information file including the voice data and transmits it to the support device 3. The support device 3, on receiving the support information file, reproduces the voice data to support the user's operation using voice.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an operation support system for supporting a user's operation of an electric device or the like by transmitting voice through a network.

[0002]

2. Description of the Related Art With the advancement of technology, home electric appliances, information devices, and industrial devices having various functions have been developed. Here, the user who uses these operation devices learns the operation method by making full use of an operation manual printed on a paper medium attached to the operation device and a guide function built in the operation device, The operating device was being operated. Here, the operation manual has been devised so that the user can easily understand the operation method of the operation device by providing an index or adding a heading, and the guide function is to convert the operation manual from a paper medium. It is replaced with an electronic device, and enables retrieval on a screen provided in the operation device and display of explanatory text.

As an example of such a guide function, there is a support method disclosed in Japanese Patent Application Laid-Open No. H10-154181. In this support method, a message including an identifier for identifying a device and an identification symbol indicating a failure is transmitted to the mail device.
Then, the mail device accesses the management server to obtain the address of the corresponding maintenance information server. Furthermore, the mail device accesses the obtained address, obtains corresponding explanation information, and accumulates it as mail. The user takes necessary measures by reading the explanation information acquired by the mail device.

[0004]

However, in such a support method, since it is necessary to exchange data between the mail device and various servers a plurality of times in order to obtain one piece of explanation information, a quick response can be made. Did not. In addition, this support method has a problem that the initial setting of the mail device must be performed by itself, and even a beginner can easily and surely receive support. The development of a suitable support means was desired. Further, if the explanation information is created for each device, the amount of information that must be stored in the maintenance information server becomes enormous. This requires an expensive large-capacity memory and associated control means, which causes an increase in the size of the operating device and an increase in price. In particular, in the case of assisting operation by voice, only limited functions are supported due to a problem of memory capacity. From the viewpoint of user friendliness, there has been a demand for the development of operation support using easy-to-understand and friendly sounds. Therefore, a problem to be solved by the present invention is to enable an operation device having various functions to be easily operated without imposing a burden on a user. Another object of the present invention is to provide operation support using voice of an expression that matches the user's preference.

[0005]

According to a first aspect of the present invention for solving the above-mentioned problems, a storage means for storing a plurality of types of support voices for supporting a user operation by voice is provided. A search unit for searching for voice data composed of a support voice based on an expression selected by the user based on operation data corresponding to an operation performed by the user; and receiving the operation data via a network; Operation support using a voice having a communication means for transmitting a message.

With this configuration, it is possible to support the operation of the operation device that the user intends to operate via the network. In particular, by accumulating a large amount of voice data in a large-capacity storage means, it is possible to provide appropriate operation support to the user, and it is possible to provide quick support by using a high-performance server or the like. Becomes In addition, by accumulating a plurality of types of expressions, it is possible to provide support that matches the user's preference. Note that “a plurality of types of expressions” means that there are a plurality of variations of expressions caused by endings, intonations or dialects, wording, differences in persons who inject sounds, and the like.

[0007] The invention according to claim 2 of the present invention provides:
2. The operation support system using voice according to claim 1, wherein the search unit is configured to generate the voice based on operation data, device data that is information on an operation device operated by a user, and data on a type of voice expression. 3. We decided to search the data.

[0008] With this configuration, it is possible to provide assistance for one operation with voices having different expressions, so that it is possible to provide fine-grained operation assistance to the user. In addition, by handling voices composed of a plurality of types of expressions, even if the amount of voice data stored in the storage unit becomes enormous, specific voice data can be obtained from operation data, device data, and data relating to types of voice expressions. , The search process can be performed efficiently.

According to a third aspect of the present invention, in the operation support system using voice according to the second aspect of the present invention, there is provided an apparatus database for storing an operation procedure of the operating apparatus, and the search means includes an apparatus database. The operation to be performed by the user can be retrieved from the device database based on the operation data.

With this configuration, the operation stored in the device database can be searched by the search means, so that the operation data sent from the user and the operation stored in the operation database can be compared. It is possible to determine whether they match or not (correctness determination), thereby enriching the operation support. In addition, if the operation data and the voice data are associated with each other in the device database, it is possible to efficiently search for the voice data.

Further, the invention according to claim 4 of the present invention is characterized in that:
The operation support system using voice according to claim 3, wherein a history management unit for managing the history of the operation performed by the user and a history database for storing the history created by the history management unit are provided. .

With this configuration, it is possible to manage the history of operations performed by the user. This history can be utilized when the user's operation is judged to be correct or incorrect, or when the user requests to resend the audio data of the same content, so that the operation support can be further enhanced.

According to a fifth aspect of the present invention, there is provided an operation support system using voice, comprising: an acquisition unit for acquiring information based on a user operation as operation data; A file creation unit for creating an information file, a network control unit for obtaining, via a network, a support voice for supporting an operation to be performed next by the user as a support information file based on the operation information file, and selecting a representation of the support voice And a selection means for performing the selection.

[0014] With this configuration, the user can receive support for voice operation via the network. Therefore, even a complicated operation device can be easily and accurately operated. Also,
As a result, with the advancement of the functions of the operating device, there is almost no need to prepare on the operating device the manual of a paper medium which has conventionally become a huge amount and the operation information stored in the memory of the operating device. Therefore, the configuration of the operating device can be simplified and the price can be reduced. Further, by making it possible to select the expression of the voice in the support received by the user, it is possible to provide the support according to the user's preference. Note that the “expression” here refers to variations that occur due to differences in endings, intonations or dialects, wordings, differences in persons who blow sound, and the like.

Further, the invention according to claim 6 of the present invention provides:
6. The operation support system using voice according to claim 5, further comprising: a support selection unit that allows the user to select whether or not voice support is provided, and an operation data storage unit that stores the operation data in the order in which the operation was performed. The means is configured to attach the operation data stored in the operation data storage unit to the operation information file when the user requests assistance by voice. With such a configuration, the user can select the presence or absence of operation support by voice at the initial stage of the operation or during the operation. Then, by storing the operation history during the period of not receiving the voice support in the operation data storage unit, even if there is any inconvenience in the operation during this period,
Appropriate voice assistance can be received.

According to a seventh aspect of the present invention, there is provided an operation support system using voice, wherein a selection means for selecting an expression of a support voice for supporting a user operation from a plurality of voice samples, A network control unit that acquires, via a network, audio data corresponding to the audio sample that has been obtained, and an acquisition unit that acquires, as operation data, a user's operation using support audio reproduced from the audio data.

The operation support system using the voice enables the user to select the support voice while listening to the voice sample, which is the actual voice. In addition,
"Expression" means endings, intonations or dialects,
The variation is caused by a difference in wording, a difference in a person who injects the voice, and the like. The voice data corresponding to the voice sample is data including a support voice having the same expression as the voice sample.

The invention according to claim 8 of the present invention provides:
In the operation support system using voice according to claim 7, a configuration is provided that includes a change unit that changes a voice sample that can be selected by a user according to a selection frequency.

The operation support system using the voice, when periodically updating the support voice selectable by the user,
By updating the voice sample stored in the memory of the user's operation device by the change means, the user can be notified of the support voice that can be selected.

[0020]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A first embodiment of the present invention will be described in detail with reference to the drawings. As shown in FIG. 1, the operation support system according to the present embodiment includes a server 1,
The server 1 is configured to be connectable to an operation device 4 such as a home appliance provided with the support device 3 via a network 2. Note that the network 2 means a line such as the Internet, a general telephone, or a cable television.

Here, the operating device 4 provided with the supporting device 3 used in the operation supporting system expresses the device control unit 11 composed of an electric circuit and the like, the operating unit 12, and the inherent functions of the operating device 4. And a unique part 13 for performing the operation. If the operation device 4 is a video, the unique portion 13 corresponds to a recording / reproducing head, a cassette loading mechanism, and the like. The operating device 4 is a television, a video, a microwave oven or the like if it is a home appliance, a personal computer or a PDA (Personal Data Assistant) if it is an information device, or an NC (Number Control) if it is an industrial machine. Examples include a processing machine and a semiconductor processing device. Further, the operating device 4 can be any electric / electronic or mechanically operated device such as a water heater.

Next, the support device 3 will be described. The support device 3 includes an interface 14 that is an acquisition unit that enables transmission and reception of an electric signal with the device control unit 11 of the operation device 4;
A support control unit 15 for controlling the support device 3; a recording device 16 such as a memory; a network control unit 17 including a modem or the like for connecting to the network 2;
And an audio reproducing unit 18 having an amplifier and a speaker for reproducing the audio data obtained via the PC, and a selection unit 22 for selecting an announcer for generating a sound to be supported. Since the audio reproduction unit 18 reproduces the audio data obtained via the network 2 in real time and near the operation device 4,
The user can operate while listening to the actual support voice near the operation device 4. The audio playback unit 18 is not an essential component. For example, when the operation device 4 itself has an audio playback unit, such as when the operation device 4 is a television device, a support that does not include the audio playback unit 18 is provided. The device 3 can also be used. Note that the support device 3 can be handled integrally with the operation device 4, but the support device 3 can also be configured to be detachable. In addition, the support device 3
May be an existing computer such as a PC (Personal Computer) independent of the operation device 4, and the operation data of the operation device 4 may be taken into the computer through a cable.

The interface 14 of the support device 3 acquires an operation signal transmitted from the operation unit 12 to the device control unit 11 of the operation device 4 as operation data when the user operates the operation unit 12 of the operation device 4. And is connected to a connection port provided on the operation device 4 side. Also,
The support control unit 15 includes a CPU (Central Processing Uniform).
t), having memory and predetermined electric and electronic circuits,
Various processes are performed by expanding a predetermined program on a PU or a memory. In the present embodiment, the support control unit 15 includes a file creation unit 19 that creates an operation information file for transmitting a user's operation to the server 1 via the network 2 and information on an operation to be performed by the user. It functions as audio signal creation means 20 that extracts audio data from the supported information file and outputs an audio signal to the audio reproduction unit 18.

File creation means 19 of support control unit 15
Is the operation data obtained from the interface 14,
An operation information file is created by adding the device data as information of the operation device 4, the communication protocol and the address of the server 1 as a header file. Also, the audio signal creation means 20 of the support control unit 15
7, audio data is extracted from the support information file received from the server 1 and, for example, D / A (Digital / An)
alog) The audio data is converted from a digital signal to an analog signal by a converter. If the audio reproducing unit 18 can handle digital data, the D / A converter need not be possessed.

The selection means 22 of the support apparatus 3 reproduces the audio samples stored in a memory (not shown) or the storage device 16 by the audio reproduction unit 18 in advance, and determines the type of announcer who sounds the support voice by the user. It is used when doing. Here, the voice sample is data such as a simple greeting made by the announcer. The selection means 22 is composed of predetermined circuits and buttons, and display means such as liquid crystal if necessary. The voice sample is changed when a selectable announcer is changed due to a change in the frequency of use of a specific announcer's voice or a setting change on the administrator side. This change is performed when the support control unit functions as a change unit.

Next, the server 1 will be described. Server 1
Is a communication unit 5 having a communication interface for receiving information transmitted from the support device 3, a processing unit 6 for processing the information received by the communication unit 5, and a storage configured to be accessible from the processing unit 6. Means 7. Further, the server 1 includes a display unit 8 such as a display, an operation unit 9 such as a keyboard, an output unit 10 such as a printer, and an external recording device (not shown) for writing to a predetermined recording medium. Is also possible. In addition, a configuration that can be connected to a LAN (Local Area Network) as needed can be adopted.

Here, the storage means 7 of the server 1 includes a device database 25 storing operation procedures of the operation device 4, an audio database 26 for storing audio data for supporting the operation of the operation device 4, 4 and a user database 28 for recording user information.

The device database 25 contains, for each operating device 4, a model number indicating the classification of the operating data and the corresponding voice transmitted from the support device 3, and the operating device 4
The next operation to be performed is recorded. The device database 25 has, for example, a configuration as shown in FIG. 2. When time is set for a video, the device data is M001 and the operation data is P102. By searching the database 25, it is possible to obtain a result that the type number of the corresponding audio data is V012 and the operation to be performed next is P211. Although not shown in FIG. 2, in the device database 25, the next operation for one operation may be branched into a plurality of operations. In such a case,
A correct operation is searched for in consideration of a history of operations performed by the user until then.

The voice database 26 stores voice data for supporting the operation of the operation device 4. Here, the voice data is a description of the operation procedure performed by the user as voice, and in the present embodiment, the voice database 26 stores the type number (V001) of one voice data as shown in FIG. , A plurality of voice data A001, A002,... Input by a plurality of announcers are stored as variations. If the type number of the voice data specified by the device database 25 is V012 and the announcer data, which is information relating to the selection of the announcer selected by the user, is A001, the voice data 26 is to be transmitted to the support device 3. "Press the time setting button" of V012A1 is selected. The selection of the voice of the announcer can be set on the user side by the processing described later, and the selection of the announcer corresponds to the selection of the expression of the voice in the claims, and the announcer data is “voice sound”. Expression data ”.

Further, the history database 27 is for temporarily storing a history of operations performed by the user. The history database 27 stores voices that the user has performed erroneously or that the user has reproduced on the support device 3. If the voice data has not been heard, the voice data already transmitted to the support device 3 can be referred to when transmitting again. As a structure of the history database 27, for example, a table or the like in which operation data transmitted from the support device 3 are arranged in a time series with user data as an identifier is cited. The user database 28 stores information on the user who uses the operation support system, and is used when charging a service usage fee to the user or providing information related to the system.

The processing unit 6 of the server 1 has a CPU (Ce
It has a central processing unit), a memory, and an electric / electronic circuit, and various processing can be performed by loading a predetermined program on the CPU or the memory. In the present embodiment, the processing unit 6 extracts the operation data and device data and the announcer data from the received operation information file, and extracts the operation data and device data and the announcer data as addresses. Search means 32 for obtaining voice data for support
An editing unit 33 that adds a header file related to a communication protocol and an address assigned to the operation device 4 to the voice data obtained by the search unit 32 to create a support information file; and stores the history data in the history database 22. History management means 34 for writing and checking the history
Function as The details of the processing by each of the units 31 to 34 will be described later in the processing procedure.

Here, a case where the voice data of a specific announcer is changed according to the frequency of use will be described. In this case, it is desirable that the server 1 be provided in the storage means 7 in a usage frequency database. The use frequency database records an announcer who has input voice data and the number of times the user has used the voice data of the announcer (the number of times of use). When the server 1 obtains operation data when the announcer's voice is selected from the user, the server 1 increments the use frequency of the corresponding announcer in the use frequency database. If the number of uses within a certain period is less than the set number,
The voice data of the announcer is changed to voice data of a different expression such as another announcer. As a result, only the voice data of the announcer popular with the user remains.
The voice sample of the new announcer is transmitted to each support device 3 as voice sample data (voice data), and is exchanged with the voice sample of the announcer that is no longer usable by the changing means. Here, the search means 32 also functions as a means for searching an announcer with a small number of uses or an announcer with a large number of uses from the use frequency database.

Next, a description will be given, with reference to the flowchart of FIG. 4, of operation support by voice performed when the user operates the operation device 4. In order to facilitate understanding, an example in which video initialization is performed will be described.
It is also assumed that the support device 3 is in a state where it can be connected to the network 2 via a communication cable. First, when the user turns on the video and the support device 3, the support device 3 automatically connects to the network 2 (step S1). Next, the process proceeds to step S2. Since the setting of the announcer has not been performed at this stage, the support device 3 reproduces the audio data stored in the storage device 16 in advance and sets the announcer for the user. Urge you to At this time, if the voice of the announcer that can be set (selected) by the user is stored in the memory as a voice sample, the user can set the announcer while listening to the sample voice.

When the user sets an announcer using the selection means 22, the support device 3 creates an operation information file using the announcer setting as operation data.
Acquire the corresponding audio data from the server 1. Details of the processing during this time will be described later with reference to FIG. Then, in step S <b> 3, a voice (support voice) indicating “let's start the initial setting” or “please press the time setting button” is output from the voice reproducing unit 18 of the support device 3.

The user listens to the support voice and confirms the operation (step S4). If the user hears a support voice, for example, "Please press the time setting button" and recognizes the operation to be performed next, the process proceeds to step S5,
If it cannot be recognized, press the repeat button and listen to the support voice until it can be recognized. The details of the process in step S4 will be described later with reference to FIG. Then, in step S5, when the user actually presses the time setting button of the video, the file creation means 19 of the support device 3 creates an operation information file using the operation of pressing the time setting button as operation data, and transmits the operation information file to the server 1. I do. And server 1
Transmits a support information file indicating that it is necessary to perform processing for adjusting the set time of the video to the current time, and returns from step S6 to step S3, where the support device 3
Reproduces the support voice instructing the operation of adjusting the set time of the video to the current time.
After confirming the operation of step 4, the time button is pressed a predetermined number of times in step S5, and the set time of the video is adjusted to the current time. Further, while listening to the support voice, "minute setting", "channel setting", etc. are performed. When all the initial settings are completed, the server 1 sends a support information file indicating the end of the initial settings. The process proceeds from step S6 to step S7, in which the support device 3 disconnects the connection to the network 2, and all the processing ends.

By using such an operation support system, the user can reliably operate the operation device 4 having a complicated operation without feeling stress. In particular, since most of the storage of voice data and the processing of various data are performed on the server 1 side, the support device 3 and the operation device 4 do not require a high-performance CPU or a large-capacity storage device. Therefore, the support device 3 and the operation device 4 can be reduced in size and cost.

The setting of the announcer is not limited to the beginning of the operation, but can be performed a plurality of times at any stage. In this case, until the user first sets the announcer, the operation is supported by the sound of the announcer in the initial setting. In addition, the user is not limited to the operation of the initial setting, and can perform the operation while listening to the support voice as needed even during the normal use. in this case,
If necessary, the user can turn on the support device 3 or provide a support request button or the like on the support device 3 or the operation device 4 so as to operate without receiving the voice operation support mode and voice support. It is preferable that the mode and the mode can be switched.

Here, the processing performed by the support apparatus 3 and the server 1 in setting the announcer in step S2 will be described below with reference to the flowcharts of FIGS. 2, 3, and 5. Note that the operation of the operation device 4 in step S5 is a similar process, and a detailed description thereof will be omitted. As shown in FIG. 5, when the announcer is set by the user in step S2, the support device 3
Creates an operation information file by the file creation means 19 of the support processing unit 15 as step S21. The operation data at this time is P101 (see FIG. 2), and the announcer data is A001 (see FIG. 3). When the file creation unit 19 creates the operation information file, the process proceeds to step S22, and the support device 3 transmits the operation information file from the network control unit 17 to the server 1.

Here, the server 1 receives the operation information file by the communication means 5 (step S23). At step S24, the extraction means 31 transmits the device data M001 (see FIG. 2) from the operation information file to the announcer data. A001 (see FIG. 3) and operation data P1
01 is extracted. Next, as step S25, the server 1 performs an operation determination (correctness determination). The determination of the operation means that the search unit 32 compares the device data M001 and the operation data P101 with the operation procedure stored in the device database 25 and, if necessary, checks the user's operation history recorded in the history database 27. This refers to determining whether the operation performed by the user is correct while referring to the information. In this case, since it is an announcer setting, the user operation is correct and the process proceeds to the next step. For example, when the channel setting button is pressed where the time setting button should be pressed, as shown in FIG. Since the operation data P211 of the time setting button is different from the operation data P103 of the channel setting, it is determined that the user has made an operation error. In addition, as a result of searching the device database 25, if there is no operation data corresponding to the device data, it is also determined that the user has made an operation error.

In step S26, the voice database 26 is searched from the model number V001 of the voice data determined based on the device data M001 and the operation data P101 and the announcer data A001, and the corresponding voice data V001A1 is obtained. (See FIG. 3),
The editing means 33 adds a header file to create a support information file. Further, in step S27, the support information file is transmitted to the support device 3.

When the support information file transmitted from the server 1 is received by the support device 3 (step S28), in step S29, the audio signal creating means 20 extracts the audio data V001A1 from the support information file, and Data processing is performed so that V001A1 can be output from the speaker. Thereafter, step S3 shown in FIG.
And the operation support by voice, that is, the support voice is reproduced. Here, the support device 3 acquires the acquired audio data V
001A1 can be temporarily stored in the storage data file 22 of the storage device 16.

If it is determined in step S25 that the operation is not correct, the editing means 3
3 is again instructed to transmit a support information file having the same contents as the previous support information file. Then, the editing unit 33 creates a support information file having the same contents while referring to the history data as necessary, and transmits the same to the support device 3.
Note that the operation can be determined in the support device 3, but it is desirable that the server 1 determine the operation in order to simplify the configuration of the support device 3.

Next, the processing performed by the support apparatus 3 in confirming the operation in step S4 will be described with reference to FIG.
The confirmation of the operation in step S4 means that the support device 3 determines whether or not the user has made a repeat request in step S31. That is, if the user can recognize the operation to be performed next, the repeat request is not made (No), so that this process is finished as it is, and the process proceeds to step S5 in FIG. On the other hand, if the user cannot recognize the operation to be performed next, the user presses the repeat button (Yes).
At 5, it is determined whether or not the audio data to be repeatedly reproduced is in the stored data stored in the stored data file 21 of the storage device 16. When audio data to be reproduced repeatedly is stored as stored data (Ye
In step s), in step S33, audio data to be repeatedly reproduced is obtained from the stored data file 21, and the process proceeds to step S35. On the other hand, if it is determined in step S32 that the audio data to be reproduced is not stored as stored data (No), the process proceeds to step S34, and the corresponding audio data is acquired from the server 1 according to the procedure shown in the flowchart of FIG. Here, a repeat request is attached as operation data to the operation information file transmitted to the server 1, and the server 1 searches the history database 27 to obtain the previous operation data, and based on this, the support information file Create Then, in step S35, the support voice based on the voice data is reproduced, and the process returns to step S31. If there is no repeat request from the user, the process is terminated. Steps S31 to S35
Is repeated as appropriate.

As described above, the operation support system according to the present embodiment can support a user's operation using voice. In particular, the conventional operation support system required setting of the operation support system itself and learning the operation of the operation support system itself. 4 has an advantage that the support voice can be easily obtained.
The connection between the operation device 4 and the support device 3 is achieved by purchasing the support device 3 that is handled as an integral unit or virtually as a unit with the operation device 4 at the same time as the operation device 4 so that even a user unfamiliar with the device can easily connect the operation device 4 and the support device 3. An operation support system can be used. In addition, even if the server is of various types, the server 1
Side categorizes the voices used for operation support,
By using the two tables (databases) shown in FIG. 3 and FIG. 3, necessary voice data is quickly searched for and transmitted to the user. Therefore, the user can receive voice assistance almost in real time without feeling stress. This also enables the server 1 to reduce the capacity of the storage unit 7 by reducing the number of voice data, and to reliably support the new operation device 4. The history management unit 34 of the server 1 manages the operation history of the user to facilitate the retransmission of the voice data, performs the right / wrong determination of the operation performed by the user, and prompts the user to perform the operation again. This realizes a friendly operation support system.

Next, a second embodiment of the operation support system will be described with reference to FIG. The same components as those in FIG. 1 are denoted by the same reference numerals, and description thereof will be omitted.

The operation support system has a server 51,
The server 51 is configured to be connectable to an operation device 54 including a support device 53 via the network 2. Here, the support device 53 includes an auxiliary data acquisition unit 55. The auxiliary data acquisition unit 55 is composed of a video camera, a temperature sensor, and the like. For example, when the operation device 54 is a microwave oven and the auxiliary data acquisition unit 55 is a video camera, the state in the microwave oven and the An image is acquired by a video camera, an operation information file in which the image data is added to the operation data as auxiliary data is created by the file creating means 19, and transmitted to the server 51. It is possible to obtain from. In this case, the server 51 includes the auxiliary data processing unit 35 in the processing unit 6 and the auxiliary database 29 in the storage unit 7. The auxiliary data processing unit 35 performs, for example, image processing of image data, and compares the image data with image information stored in the auxiliary database 29. It is possible to make a judgment such as "too long."

When the operating device 54 is a water heater and the auxiliary data acquiring means 55 is a temperature sensor, the file creating means 19 creates an operation information file containing the temperature of the hot water acquired by the temperature sensor as temperature data. I do. The auxiliary database 2 is stored in the storage unit 7 of the server 51.
As 9, the temperature profile of the water heater is stored, and the auxiliary data processing means 35 of the processing unit 6 compares the temperature data obtained by the temperature sensor with the temperature data based on the temperature profile stored in the auxiliary database 29. If the temperature difference between the two is greater than or equal to the predetermined value, the voice data indicating that the temperature is abnormal is transmitted to the support device 53.

As described above, by adding the auxiliary data obtained by the auxiliary data obtaining means 55 to the operation information file,
The server 51 determines the state of the operation device 54 and the operation device 5
The state of an object to be processed by, for example, cooking or hot water can be grasped in more detail. Therefore, it is possible to more accurately support the user's operation. In particular, by performing processing requiring high processing capability such as image recognition on the server 51 side, it is possible to improve the data processing speed. Here, the auxiliary data acquisition unit 55 may be provided on the operation device 54 side. In this case, the auxiliary data from the auxiliary data acquisition unit 55 is transmitted to the support control unit 15 via the interface 14.
It is configured to be input to.

Further, a third embodiment of the present invention will be described with reference to the drawings. The same components as those in FIG. 1 are denoted by the same reference numerals, and description thereof will be omitted. The operation support system includes an operation data storage unit 61 that stores operation data acquired by the support device 63 when the user operates the operation device 4 in the storage device 16 of the support device 63. The operation data storage unit 61 acquires operation data of all operations performed by the user through the interface 14 and stores the operation data in time series. The data stored in the operation data storage unit 16 is used when the user wants to receive voice support from the middle of the operation or when skipping the support voice related to the specific operation. The support device 63 is provided with a support selection unit 65 for selecting (including skipping) whether or not voice support is necessary. Note that the support selection unit 65 includes buttons, a liquid crystal panel, a predetermined electric circuit, and the like.

In such an operation support system, voice support is not performed in an initial stage of a user operation. When the user does not understand the operation of the operation device 4 and operates the support selection unit 65 (ON), it is possible to receive voice support for the first time. That is, the support selection unit 65
The file creation means 19 of the support control unit 15 creates an operation information file with the operation of the as a trigger.
Then, the created operation information file is transmitted to the server 1, and voice data for providing necessary support voice is acquired.

At this time, a list of operation data stored in the operation data storage unit 61 of the support device 63 is attached to the operation information file transmitted to the server 1 until the user operates the support selection unit 65. . Extraction means 31 of server 1
Uses the received list of operation data as the operation data table shown on the right side of FIG. 9, and first searches the device database 25 of M001, which is the number of the operation device 4. Then, the device database 25 with the number M001 of the operation device 4 shown on the left side of FIG. 9 is read, and thereafter, the operation of the user is compared with the operation procedure registered in the operation device database 25, and the operation error of the user is performed. Find out.

First, the extracting means 31 extracts P101 which is the first operation performed by the user from the operation data stored in the operation data table.
The device database 25 is searched using P101 as an address, and operation data P102 as the next operation is obtained. Next, the search unit 32 compares P102 of the search result with the operation data stored second in the operation data table, and determines whether the operation performed by the user is correct. In FIG. 9, the second operation performed by the user is P102
Is equal to the search result. Therefore, the search means 32 searches the device database 25 using this P102 as an address, and obtains P211 which is the next operation. The P211 thus obtained is compared with the third operation data P311 in the operation data table.
At this stage, it is determined that the user has made an operation error. Then, a support voice prompting the user to perform the operation P211 as the original operation is transmitted to the support device 63 on the user side. on the other hand,
If the user's operation is correct, the support data including the support voice for the next operation is transmitted.

The user listens to the support voice transmitted from the server 1 and performs a correct operation. If the subsequent support is necessary, the user operates the same without any change. The creation and transmission of the operation information file in the file creation means 19 are stopped. Even when the operation information file is not created and transmitted, the operation data is stored in the operation data storage unit 61 in the same manner as described above. At this time, the operation data storage unit 61
Is the wrong operation (in FIG. 9, the third operation P31
Overwrite 1) with the correct operation data.

When a user who is operating while receiving voice assistance does not need assistance while performing a predetermined operation from a certain operation to another operation, that is, skips the support voice. When the support is no longer needed, the support selection unit 66 is turned off, and when it is needed, the support selection unit 66 is turned on. At this time, the server 1
After the user's operation while skipping the voice assistance is searched for and determined to be correct / wrong in the same manner as described above, a support voice relating to the operation to be performed next by the user is transmitted. In either case, the operation data table searches all the operations performed by the user in chronological order to determine even if the next operation for one operation is branched into a plurality of operations. This is to perform appropriate processing.

The present invention can be widely applied without being limited to the above embodiments. For example, the selection unit 22 and the change unit of the first embodiment can be provided in the support device 3 of the second embodiment,
The server 1 may include the usage frequency database and the auxiliary database 29. Further, the support device 3 may include the operation data storage unit 61, the support selection unit 65, and the auxiliary data acquisition unit 55 according to the second embodiment. In the case where the operation devices 4 and 54 are information devices, personal computers and PDAs, the user can surely listen to the support voice at the time of initial setting, operation, software installation, hardware change, etc. Each operation can be performed. When the operating devices 4 and 54 are machine tools, the user can select appropriate processing conditions while listening to the support voice when processing a complicated shape or processing a special material. Further, the auxiliary data acquisition unit 55 is provided with an operating device 5 such as an optical sensor, a potentiometer, a torque sensor, or the like.
Any means can be used as long as it is means for acquiring information for grasping the state of 4 and the state of the object to be processed.

Further, in the first embodiment, the case where the voice sample is provided on the support device 3 side has been described. However, the server 1 has a sample database for storing the voice sample, and the request from the support device 3 (from the user). In response to the request), the voice sample data may be transmitted to the corresponding support device 3. In this case, the memory of the support device 3 can be minimized. For the user who has selected the announcer that has become unusable due to the change, a notification of the change is sent by e-mail, or the fact is displayed on the operation screen of the support device 3 or the operation device 4. It is desirable to take the following measures. Here, when transmitting the audio sample data from the server 1 to the support device 3, it is desirable to use a time zone in which the traffic volume of the network 2 is small, for example, midnight or early morning. Even when the number of voice samples is large and the volume of voice sample data is large, voice sample data can be transmitted smoothly and economically. And the voice database 26
Accumulates voice data consisting of various variations (expressions), such as differences in endings, intonations, dialects, and phrases, in addition to differences in announcers who have input voice, and allows these to be selected by the user. Can also. In this case, a voice sample having the same expression as the voice data stored in the voice database 26 is also prepared, and the selecting unit 22 of the support device 3 selects a support voice from voice samples having different expressions. Functions as a means.

[0057]

According to the present invention, when assisting a user's operation based on a support voice selected from a plurality of expressions, voice data for providing such support voice is based on operation data corresponding to an operation performed by the user. Since the search and transmission are performed, the user can quickly and appropriately support the operation of the operation device to be operated. In addition, by accumulating a plurality of types of expressions, it is possible to provide support that matches the user's preference. If a server database that stores the operation of the operating device is provided on the server side, or a history database that stores the history of user operations, and a history management unit that manages this is provided,
It is possible to determine whether the user's operation is correct or not, and to efficiently search for voice data. Therefore, operation support can be further enhanced.

In addition, when the user's operation is supported based on the support voice selected from a plurality of expressions, the configuration is provided with a selecting means for selecting the expression of the voice data included in the support information file. Even in this case, the operation can be performed easily and accurately. Also, the user can receive support that suits his or her preference. Here, if the operation history is stored in the operation data storage unit, it is possible to receive appropriate support for an operation for which support has not been received. Furthermore, by providing a selection means for selecting the expression of the support voice that supports the user's operation from a plurality of voice samples, the user can select the support voice according to his / her preference while listening to the sample voice that is the actual voice. , And a user-friendly support system can be realized. Here, if the audio sample selectable by the user is configured to be changeable according to the selection frequency, it is possible to always provide a support audio that matches the user's preference.

[Brief description of the drawings]

FIG. 1 is an overall configuration diagram of an operation support system according to an embodiment of the present invention.

FIG. 2 is a diagram illustrating an example of a configuration of a device database.

FIG. 3 is a diagram showing an example of a configuration of a voice database.

FIG. 4 is a flowchart of operation support by the operation support system.

FIG. 5 is a flowchart showing a procedure from operation of the operation device by the user to reception of voice data.

FIG. 6 is a flowchart illustrating a procedure of a user's operation confirmation in the support device.

FIG. 7 is an overall configuration diagram of another operation support system according to the embodiment of the present invention.

FIG. 8 is an overall configuration diagram of another operation support system according to the embodiment of the present invention.

FIG. 9 is an explanatory diagram illustrating a process on the server side when the assistance by voice is restarted.

[Explanation of symbols]

 1, 51 server 2 network 3, 53, 63 support device 4, 54 operation device 5 communication means 7 storage means 14 interface (acquisition unit) 17 network control unit 19 file creation means 22 selection means 25 device database 26 voice database 27 history database 32 search means 34 history management means 61 operation data storage section 65 support selection section

Continued on the front page (72) Inventor Tei Abe 1-2-1, Sanno, Akita-shi, Akita Japan Broadcasting Corporation Akita Broadcasting Station (72) Inventor Junichi Higuchi 2-2-1, Jinnan, Shibuya-ku, Tokyo Japan Broadcasting Inside the Association Broadcasting Center (72) Inventor Toru Toki 1-10-11 Kinuta, Setagaya-ku, Tokyo Japan Broadcasting Corporation Within the Broadcasting Research Institute (72) Inventor Tadaaki Yoko 2-2-1 Jinnan, Shibuya-ku, Tokyo Japan Inside the Broadcasting Corporation Broadcasting Center (72) Inventor Hideaki Yoshimoto 2-2-1 Jinnan, Shibuya-ku, Tokyo F-term in the Japan Broadcasting Corporation Broadcasting Center (reference) 5H223 DD07 EE01 EE06 EE08 FF04

Claims (8)

[Claims] 1. A method according to claim 1, wherein a support voice for supporting the operation of the user by voice is selected by the user based on storage means for storing a plurality of types of expressions and operation data corresponding to the operation performed by the user. A search unit for searching for voice data composed of the support voice based on the expression, and a communication unit for receiving the operation data via a network and transmitting the voice data. Operation support system using. 2. The apparatus according to claim 1, wherein the search unit includes: the operation data; and apparatus data that is information on an operation apparatus operated by the user.
The operation support system using voice according to claim 1, wherein the voice data stored in the storage unit is searched from data on voice expression. 3. A device database comprising an operation database for storing operation procedures of the operation device, wherein the search means can search the device database for an operation to be performed by the user based on the device data and the operation data. The operation support system using voice according to claim 2, wherein 4. The apparatus according to claim 3, further comprising: history management means for managing a history of operations performed by said user; and a history database storing said history created by said history management means. An operation support system using the voice of the user. 5. An acquisition unit for acquiring information based on a user operation as operation data; a file creation unit for creating an operation information file including the acquired operation data; An operation support system using a voice, comprising: a network control unit that obtains a support voice for supporting an operation to be performed as a support information file via a network; and a selection unit that selects an expression of the support voice. 6. A support selection unit for selecting whether or not the user provides voice support, and an operation data storage unit for storing the operation data in an operation order, wherein the file creation unit is configured to control the user by using a voice. When requesting assistance from
The operation support system using voice according to claim 5, wherein the operation data stored in the operation data storage unit is attached to the operation information file. 7. A selecting means for selecting from a plurality of voice samples a representation of a support voice for supporting a user's operation, and a network control unit for acquiring the voice data corresponding to the selected voice sample via a network. An acquisition unit for acquiring, as operation data, an operation of the user with the support audio reproduced from the audio data, an operation support system using audio. 8. The operation support system using voice according to claim 7, further comprising changing means for changing the voice sample selectable by the user according to a selection frequency.