JP3275840B2 - Device operation system and method, and recording medium - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a device operation system and method for inputting a target device operation in a natural language by a user and executing the device operation based on the input , and a program recording medium therefor. The present invention relates to a data recording medium on which data is recorded.

[0002]

2. Description of the Related Art When operating devices such as home appliances such as televisions and videos, there are cases where other operations must be performed in order for the user to perform the intended operation of the device. . For example, in order to turn on one channel of a television, it is necessary to change the channel to 1 after turning on the television. Conventionally, a system that performs such a plurality of operations with a single instruction has been desired.

[0003] As a first prior art, there is an apparatus in which one button is provided with a function of a series of operations and the series of operations is executed by one instruction. For example, it is a device having a function capable of defining a button for grouping a series of operations of turning on the television and setting the channel to 1.

[0004] As a second conventional technique, in a computer application having many function items, in order to reduce the labor for searching for an operation desired by a user, a natural technique described in Japanese Patent Application Laid-Open No. 6-103052 has been proposed. 2. Description of the Related Art Devices that can instruct an operation using a natural language, such as a language operation support device, have been considered.

[0005]

However, the above-mentioned prior art has the following problems. First, the first
In the related art, when the user wants to perform a series of operations by one operation, it is necessary to make the device remember the series of operations in advance. As such a series of operations, there are many operations based on dependencies between functions unique to each device such that the television must be turned on in order to set the television channel to 1. Nevertheless, the system must be remembered one by one by the operation of the user, and the procedure is complicated, requiring the user to perform a complicated operation.

Further, in the second conventional technique, this technique only saves the trouble of selecting the operation desired by the user by following the menu format from the operation group organized by the menu format. It was not possible to execute a series of operations that depend on the operation of a single instruction. Such a series of operations may include an operation for bringing the state that has already been realized. In that case, if you execute all of the series of operations,
The already implemented operation is also performed again, and there is a possibility that a problem such as a malfunction may occur.

Further, if a series of operations are directly executed, there is a danger that the system will automatically execute an irreversible operation such as recording a video that newly overwrites the current information on a video tape. There is. Alternatively, if the system is instructed to turn off the power while recording a TV program, for example, the current processing is forcibly stopped depending on the instruction so that the recording operation of the TV program is stopped by the power off. There is also a danger of being done. However, in the above-mentioned conventional technology, there is a problem that the user does not have a function to confirm before performing such an operation, and the original information cannot be recovered.

In addition, there are some devices that can be operated only by the user. For example, to play a videotape, a video cassette must be inserted, but only a human can insert the video cassette. However, in the above-described conventional technique, there is no function that requires an operation in such a case.

Further, there is a case where the user may want to know the current state of the device to be operated. In such a case, conventionally, the user has to check the state by looking at the pilot lamp of the device to be operated. However, such pilot lamps are not always clearly displayed, and
Since the user had to approach the device to be operated, it was relatively difficult to confirm the current state of the device to be operated.

[0010] A first object of the present invention is to store knowledge such as dependencies between functions in a system in advance, and use this to input a natural language to a user to operate a device. An object of the present invention is to provide a device operation system capable of automatically executing a series of operations necessary for performing the operation.

A second object of the present invention is to provide a device operation which can prevent a malfunction of a device to be operated without re-executing an operation for bringing the device to be operated into a state already realized. It is to provide a system.

A third object of the present invention is to request the user from the system to perform such an operation by storing in advance in the system a knowledge of whether or not each operation related to the function can be performed only by the user. It is an object of the present invention to provide a device operation system capable of performing such operations.

A fourth object of the present invention is to provide a device operation system capable of executing a predetermined operation of a series of operations after confirming with a user.

A fifth object of the present invention is to provide a device operation system which allows a user to easily confirm the current state of a device to be operated.

[0015]

In order to achieve the first object, an apparatus operation system according to a first aspect of the present invention has a plurality of functions, and has a dependency relation between operations corresponding to each function.
To operate a device having a staff
A fit of the system, corresponding to said first input means for an operation instruction to the operation subject to equipment for inputting a natural language, the operation corresponding to each function of the device to be the operation target, and each operation A dictionary storage unit that stores words in association with each other, an inter-function dependency storage unit that stores a dependency relationship between operations according to each function of the device to be operated, and the dictionary storage unit. Analyzing the operation instruction input from the first input means, deriving an operation corresponding to the operation instruction input in the natural language, and referring to the inter-function dependency storage means, An operation procedure deriving unit that derives a series of operations until the device to be operated performs the operation derived by the natural language analysis unit, and a series of operations derived by the operation procedure deriving unit is the operation target. Equipment Characterized in that it comprises operating means for following done.

In the above device operation system, when an operation instruction for a device to be operated is input in a natural language, the operation is derived by natural language analysis means, and the operation is transmitted to the device to be operated by the operation procedure derivation means. A series of operations to be performed is derived. Then, the operation means sequentially executes this series of operations. That is, when a user inputs an operation instruction in a natural language, a series of operations up to the operation can be automatically performed on a device to be operated.

In order to achieve the second object, the device operation system may further include a current state storage means for storing a current state of the device to be operated. In this case, the operation means includes means for determining whether the device to be operated is in a state corresponding to the operation derived by the operation procedure derivation means, and the means is derived by the operation procedure derivation means. When it is determined that the operation is in a state corresponding to the operation, the operation may not be performed by the device to be operated.

In this case, in the series of operations derived by the operation procedure deriving means, the operation for realizing the state which has been already realized by the device to be operated is not executed again. As a result, malfunction of the device to be operated can be prevented.

In the device operation system, the operation unit may include a response generation unit that generates a response in a natural language corresponding to an operation performed by the device to be operated. In this case, the device operation system may further include an output unit that outputs the response generated by the response generation unit to the outside.

Here, in order to attain the third and fourth objects, the operating means causes the response generating means to generate the response before operating the device to be operated and outputs the response. The device may be output, and when a predetermined input is made in response to the response output from the output device, an operation may be performed on the device to be operated. In this case, the device operation system may further include a second input unit for performing the predetermined input for causing the operation unit to perform a process on the device to be operated.

In this case, the inter-function dependency relationship storage means may store, for example, a state that cannot be performed unless the user performs an operation, including a predetermined attribute. Then, when the operation means is to perform an operation of bringing the device to be operated into a state including the predetermined attribute, before performing an operation on the device to be operated,
The response generation unit generates the response and outputs the response from the output unit, and performs an operation on the device to be operated when a predetermined input is input to the response output from the output unit. And it is sufficient.

That is, when performing an operation for bringing the state indicated by this attribute, that is, an operation that can be performed only by the user, the user can be requested as a response output from the output means. You can do this by achieving your goals.

Further, for example, the inter-function dependency storage means refers to a constraint indicating that the operation of the device to be operated in another state must be stopped by performing an operation to be in a certain state. The constraints may be further stored. The operation unit attempts to perform the operation with the reference restriction, and when it is indicated that the operation of the device to be operated in the current state is stopped by the reference restriction, And causing the response generating means to generate the response and outputting the response from the output means, and performing an operation on the device to be operated when a predetermined input is made to the response output from the output means. do it.

That is, when an operation to stop the current operation is performed on the device to be operated, the user can be confirmed as a response output from the output device. The goal can be achieved.

Further, for example, the inter-function dependency storage means may store a state in which a previous state cannot be recovered by performing an operation, including a predetermined attribute. Then, the operating means causes the response generating means to generate the response and output the output from the output means when the operating device is to be operated to bring the device to be operated into a state including the predetermined attribute. At the same time, when a predetermined input is made in response to the response output from the output unit, an operation on the device to be operated may be performed.

That is, in the case where an irreversible operation in which the previous state cannot be recovered by performing the operation is attempted, the user can be confirmed as a response output from the output device. Can achieve the purpose.

[0027] In order to achieve the fifth object, in the device operation system described above, the first input means inputs a question concerning the current state of the device to be operated in a natural language. The dictionary storage means further stores a word corresponding to each of a question and an operation instruction in association with each other, and the natural language analysis means refers to the dictionary storage means and stores the first word. Means for determining whether the natural language input from the input means is a question or an operation instruction, and wherein the response generating means determines that the current state is present when the language analyzing means determines that the question is a question. With reference to the storage unit, a response relating to a current state of the device to be operated can be generated.

In this case, the user inputs a question regarding the current state of the device to be operated from the first input means in a natural language, and the response to the question regarding the current state of the device to be operated is answered by the user. Is shown in
Thus, the user can easily check the state of the device without checking the device itself to be operated.

In the above-mentioned device operation system,
The first input means may include means for inputting the operation instruction as a sound of a natural language, and means for recognizing the sound input from the means. The output means may include means for generating a natural language sound corresponding to the response, and means for outputting the sound generated by the means.

Further, in the above-mentioned device operation system,
The first input unit may be configured by a first communication unit that receives the operation instruction from a remote place via a communication line and supplies the operation instruction to the natural language analysis unit.
The second input unit may be configured by a second communication unit that receives the response from the response generation unit and transmits the response to a remote place via a communication line.

In order to achieve the first object, a recording medium according to a second aspect of the present invention has a plurality of functions.
Devices that have dependencies between operations according to functions
As a recorded program for operating the device
A recording medium, corresponding to the first input function an operation instruction to the operation subject to equipment for inputting a natural language, according to the functions of the device to be the operation target operation, and each operation With reference to a dictionary that stores words in association with each other,
A natural language analysis function for analyzing an operation instruction input by the first input function to derive an operation corresponding to the operation instruction input in the natural language, and a function corresponding to each function of the device to be operated An operation procedure derivation function for deriving a series of operations until the device to be operated performs the operation derived by the natural language analysis function, with reference to a dependency relationship between the operations, and an operation procedure derivation function derived by the operation procedure derivation function. A program for realizing an operation function of causing a device to be operated to sequentially perform a series of operations is recorded.

Here, the operation function includes a function of determining whether or not the device to be operated is in a state corresponding to the operation derived by the operation procedure derivation function. When it is determined that the state is in accordance with the operation derived from the above, it is possible to prevent the operation target device from performing the operation.

Further, the operation function may include a response generation function for generating a response in a natural language corresponding to the operation performed by the device to be operated.
The recording medium may further record a program for realizing an output function of outputting a response generated by the response generation function to the outside.

In this case, the operation function is configured to generate the response by the response generation function, output the response by the output function, and output the response by the output function before operating the device to be operated. When a predetermined input is made to a response, an operation may be performed on the device to be operated. In this case, the recording medium may further record a program for realizing a second input function for performing the predetermined input for causing a device to be operated by the operation function to perform processing.

In order to achieve the first object, a device operation method according to a third aspect of the present invention is a method for operating a device having a plurality of functions and having a dependency between operations corresponding to each function. A method for operating the device,
An input step of inputting an operation instruction to the device to be operated in a natural language, an operation corresponding to each function of the device to be operated, and a dictionary storing words corresponding to each operation in association with each other. Referring to the natural language analysis step of analyzing the operation instruction input in the input step and deriving an operation corresponding to the operation instruction input in the natural language, and according to each function of the device to be operated The operation procedure deriving step of deriving a series of operations until the device to be operated performs the operation derived in the natural language analysis step with reference to the dependency relation between the operations, and the operation procedure deriving step. An operation step of causing a device to be operated to perform a series of operations sequentially.

[0036]

Embodiments of the present invention will be described below with reference to the accompanying drawings. In the following embodiments, a case where a video deck is applied to a device to be operated will be described as an example.

[First Embodiment] FIG. 1 is a block diagram showing the configuration of a device operation system according to this embodiment. 1, the device operation system includes an input device 1, a data processing device 2, a storage device 3, and an operation device 4.

The operation device 4 is an electronic device to be operated by a user in this system, and a video deck is applied in this embodiment. The input device 1 is configured by a keyboard or the like,
Is input as a character string of a natural language in code information.

The data processing device 2 is constituted by a processor that operates under program control, and includes a natural language analysis unit 21, an operation procedure derivation unit 22, and a command execution unit 23. The storage device 3 is configured by a magnetic disk device or the like, and includes a dictionary storage unit 31, an inter-function dependency storage unit 32, and a current state storage unit 33.

The dictionary storage unit 31 stores a natural language dictionary corresponding to the internal operation of the video deck as the operation device 4 as shown in FIG. 2 in a table format. The dictionary storage unit 31 also stores a dictionary relating to the device name of the operation device 4 as shown in FIG. 3, a natural language dictionary relating to operation instructions for the device independent of the device itself as shown in FIG. 4, and the like. ing.

The inter-function dependency storage section 32 stores the inter-function dependencies of the operating device 4 as shown in FIG. In FIG. 5, a node surrounded by a double line indicates a function of the VCR, and a node surrounded by a single line below the node surrounded by the double line indicates the state of the function. The relationship between the node enclosed by a single line representing the state and the node representing the function enclosed by a double line below it is that the function depends on the state above it, that is, the function is operated Indicates that the state above it needs to be realized.

For example, referring to FIG. 5, the function of “channel” depends on the state of “on” of the function of “power”. Must be "on". Also, by referring to the dictionary of FIG. 2 stored in the dictionary storage unit 31, words corresponding to the respective clauses of the dependency relationship storage unit 32 shown in FIG. 5 can be found.

The current state storage unit 33 stores the current operation state of the operating device 4, and stores any function of the node surrounded by a single line in FIG. 5 as the operation state. In addition, the current state storage unit 33 includes, when there is a function of a node surrounded by a double line under the stored operation state,
Further, the function of the lower hierarchy is also stored as the operation state. The contents stored in the current state storage unit 33 are, for example,
The result is as shown in FIG.

The natural language analyzing means 21 interprets the character string input from the input device 1 with the code information by referring to the dictionary storage unit 31.

The operation procedure deriving means 32 is based on the result interpreted by the natural language analyzing means 21 and operates as a dependency storage unit 32.
, An operation group necessary for realizing the operation instruction input from the input device 1 is derived.

The command execution unit 23 refers to the current state storage unit 33, determines a necessary operation from the operation group derived by the operation procedure deriving unit 22, and executes a command for the determined required operation. The operation device 4 is operated.

Hereinafter, the processing in this embodiment will be described with reference to the flowchart of FIG. Here, the contents stored in the dictionary storage unit 31 are as shown in FIGS.
It is assumed that the storage contents of the inter-function dependency storage unit 32 conform to FIG. 5 described above.

First, the user inputs a character string, for example, "set the video channel to 1" in the input device 1 in a natural language. This character string is supplied to the natural language analysis unit 21 of the data processing device 2 as code information, and the natural language analysis unit 21 receives this natural language character string as an operation instruction to the operation device 4 (step A1).

Next, the natural language analysis means 21 refers to the dictionary storage section 31 and interprets this character string. In the example of this input, “the channel of the video is set to 1”, it is understood that the operation device 4 is a video with reference to FIG. 3 and that the “channel” of the video is “1” with reference to FIG. It is understood that it is related to. Furthermore, referring to the dictionary of function words in FIG. 6, it can be seen that "shi" represents "operation". As a result, the natural language analysis unit 21 performs step A1.
Is interpreted as a command for setting the function of the video "channel" to "1" (step A2).

Next, this operation command is supplied from the natural language analyzing means 21 to the operation procedure deriving means 22, and the operation procedure deriving means 22 refers to the inter-function dependency storage unit 32 and expresses the operation command. Search for a set of functions and states. In this example, a set of the function "channel" and the state "1" of the function is searched (step A3).

Further, the operation procedure deriving means 22 derives an operation command necessary for setting the video channel to the state 1 using the result searched in step A3.
Here, the pair on which the pair of “channel” and “1” depends is “power” and “on”. Thus, the operation procedure deriving unit 22 derives an operation command “turn on the power” as an operation command to be executed before the operation command “set the channel to 1” (step A).
4).

The operation procedure deriving means 22 supplies the command sequence thus derived to the command executing means 23. The command execution unit 23 refers to the command sequence supplied from the operation procedure deriving unit 22 and the current state of the video stored in the current state storage unit 33, and deletes the operation command realized as the current state. For example, in FIG. 6, since the “power” of the video is “on”, the “power on” operation command is deleted (step A).
5).

Finally, the command execution means 23 sets the “channel” to “1” for the operation device 4 (video deck).
(Step A)
6). Thus, a series of operations on the operating device 4 corresponding to the character string input by the user is completed.

If "power" is "off" when the current state storage section 33 is referred to, an operation command for turning "power" on is executed, and "channel" is further turned off.
An operation command for setting the state of “1” to “1” is executed.

As described above, in the device operation system according to this embodiment, the natural language analyzing means 21
According to the dictionary stored in the dictionary storage unit 31, the operation instruction input in the natural language from the input device 1 is analyzed, and the operation procedure deriving unit 22 stores the analysis result and the inter-function dependency storage unit 22. According to the dependencies between the features
An operation procedure for the operation device 4 is derived. Then, the command execution unit 23 can sequentially execute the derived operation procedure, and can cause the operation device 4 to perform a series of necessary operations.

Further, the command execution means 23 refers to the current state of the operating device 4 stored in the current state storage unit 33 and does not repeatedly execute the command already in that state. It is possible to prevent a malfunction due to re-execution of the operation that has been performed.

[Second Embodiment] FIG. 8 is a block diagram showing a configuration of a device operation system according to the second embodiment. This device operation system includes an output device 5 in addition to the configuration of the device operation system (FIG. 1) according to the first embodiment. Further, the command execution means 23 is provided with functions in addition to those of the first embodiment.

The command execution means 23 generates a natural language response sentence corresponding to the operation to be further executed, and supplies the character code to the output device 5. The output device 5 is constituted by a display device, and displays a response sentence supplied as a character code from the command execution means 23 to show it to the user.

The processing in this embodiment is almost the same as that in the first embodiment (FIG. 7), but in step A6 in FIG. The response is sent to the output device 5. As a result, the response sentence is displayed on the output device 5 and is shown to the user.

As described above, according to the device operation system according to this embodiment, the user operates the input device 1
Not only the operation of the operation device 4 but also how the system interpreted the operation instruction input in natural language from
It can be known by a character string of a natural language displayed on the output device 5.

[Third Embodiment] The configuration of a device operation system according to this embodiment is almost the same as that of the second embodiment (FIG. 8). However, in this embodiment, the dictionary storage unit 31 further stores a dictionary of words meaning “yes” and “no” as shown in FIG.

Hereinafter, the processing in this embodiment will be described. First, the same processing as in the first embodiment is performed from steps A1 to A5 in FIG. Next, FIG.
In step A6, the command execution unit 23 first executes the operation command to execute the operation device 4 operation.
Without operating, "Set the video channel to 1."
Is generated and output from the output device 5. Then, the command execution unit 23 waits for a response from the user to the response sentence.

When the command execution means 23 sends such a process and waits for a response from the user, it is assumed that the user has input “yes” from the input device 1. Next, the natural language analysis unit 21 refers to the dictionary of FIG. 9 in the dictionary storage unit 21, determines that the meaning corresponding to “Yes” is “Yes”, and issues a command via the operation procedure derivation unit 22. Execution means 2
Send to 3.

Then, the command execution means 23 executes an operation command of “setting the video channel to 1”, and operates the operation device 4 as such. Further, the command execution means 23 generates a response sentence “Set the video channel to 1.” and causes the output device 5 to display it.

When "no" is input from the input device 1, the command execution means 23 does not execute the operation command, and for example, "executes the operation of setting the video channel to 1". A response sentence "I will cancel." Is generated and displayed on the output device 5.

As described above, according to the device operation system according to this embodiment, the user can control whether to actually execute the operation command interpreted by the system.

[Fourth Embodiment] The configuration of a device operation system according to this embodiment is almost the same as that of the third embodiment (FIGS. 8 and 9). However, in this embodiment, as shown in FIG. 10, an attribute such as “system operation disabled” or “irreversible operation” is added to the status of each function stored in the inter-function dependency relationship storage unit 32. ing.

The attribute of "system operation disabled" means that a function to which the attribute is attached, such as "insert a cassette (into a video deck)", requires user's operation, and the system is left as it is. Indicates that the function cannot be performed.

The attribute of “irreversible operation” is such that if a function with that attribute, such as “record (overwrite) a tape”, is executed, the state before execution is restored. Indicates that the function cannot be performed.

Hereinafter, processing in this embodiment will be described. Here, first, in step A1 in FIG. 7, the user inputs a character string “Record video” from the input device 1. Next, similarly to the first embodiment, steps A2 to A4 in FIG.
The operation procedures of "turn on the power", "insert the cassette", and "record the tape" are derived.

Next, the command executing means 23 sequentially compares the current state stored in the current state storage unit 33 with the operation procedure to be executed (step A5). Here, if the current state of the power supply is “off”, the command execution means 23 executes the command which is the first operation procedure to turn on the power supply, and if the current state of the power supply is “on”, Proceed to the next operation procedure "Insert cassette".

Here, referring to FIG. 10, the state “in” has an attribute of “system operation disabled”. Then, the command execution means 23 generates a response sentence “Please insert a video cassette.” And causes the output device 5 to display it. Then, the command execution means 23
When the cassette is inserted by the user's operation and the status of the cassette in the current status storage unit 33 becomes “in”, the process proceeds to the next operation procedure “recording a tape”.

Here, referring to FIG. 10, the attribute of the irreversible operation is attached to the state “recording”. At this time, the command execution unit 23 does not immediately execute the operation command, but, for example, asks "Do you really want to record?"
Is generated and displayed on the output device 5. Then, when there is further input of “yes” from the input device 1, the command execution means 23 executes an operation command of “recording a tape”.

As described above, according to the device operation system according to this embodiment, the function in the inter-function dependency relationship storage unit 32 is provided with the attribute “system operation disabled”, and this attribute is When executing the operation of the attached function, a response sentence is displayed on the output device 5. As a result, the system can request the user for an operation that cannot be directly performed by the system and can be performed only by the user.

The function in the inter-function dependency storage unit 32 is provided with an attribute “irreversible operation”, and when the operation of the function with this attribute is performed, the output unit 5
Displays a response sentence. Thus, the system does not execute the irreversible operation without permission, but can execute the operation after confirming with the user.

[Fifth Embodiment] The configuration of a device operation system according to this embodiment is substantially the same as that of the third embodiment (FIGS. 8 and 9). However, in this embodiment, a reference constraint shown by a broken line in FIG. 11 is provided between the functions stored in the inter-function dependency storage unit 32.

This reference constraint indicates that when a certain function is executed in the direction indicated by the broken arrow in FIG. 4, the execution of the other functions following the arrow is stopped. The following functions are restricted from being executed.

The processing in this embodiment is almost the same as that in the fourth embodiment. However, in step A6, the command execution means 23 sets the function according to the operation to be executed to another function. When the function being referred to and the current state of the operating device 4 stored in the current state storage unit 33 is the function being referred to, a response sentence is generated and displayed on the output device 5.

For example, when “turn off the power” is input from the input device 1 and “recording” is stored as the current state of the operating device in the current state storage unit 33, the function “off” is set to the function “off”. See "Recording." In this case, the command execution unit 23 generates, for example, a response sentence “Do you really want to turn off the power?”
Is displayed, and the power of the operating device 4 is turned off after waiting for the input of “yes” from the input device 1.

As described above, according to the device operation system according to this embodiment, the dependence between the functions stored in the inter-function dependence storage unit 32 is further provided with a reference constraint, and the execution is executed. When the function corresponding to the operation to be performed refers to the current state of the operation device, a response sentence is displayed on the output device 5. As a result, the operation being executed by the operation device 4 is not interrupted by the system, and an operation that interrupts the currently executed operation can be executed after the user confirms. .

[Sixth Embodiment] The configuration of a device operation system according to this embodiment is almost the same as that of the second embodiment (FIG. 8). However, in this embodiment, as shown in FIG. 4, the dictionary for function words independent of the operating device 4 stored in the dictionary storage unit 31 is “Issuka” or “ And "Is it?"

Hereinafter, the processing in this embodiment will be described with reference to the flowchart in FIG. First, the user asks, for example, "Is the video powered on?"
Is input from the input device 1. This input character string is supplied to the natural language analysis means 21 and accepted as a question or an operation instruction to the operation device 4 (step A1).

The natural language analysis means 21 includes a dictionary storage 31
To interpret this string. Here, since the word "?" Is included at the end of the character string, this character string is interpreted as a question command for asking whether the "power" of the VCR is "ON" (step A).
2).

Next, the natural language analysis means 21 determines whether the type of the interpreted command is an operation command or a question command (step A10).

When interpreted as a question command,
The natural language analysis unit 21 supplies the query command to the command execution unit 23 as it is. Command execution means 2
3 compares the question command supplied from the natural language analysis means 21 with the current state of the operation device 4 stored in the current state storage unit 33, and determines whether the state in the question command is currently realized ( Step A5 ').

The command executing means 23 generates a response command according to the comparison result and causes the output device 5 to display the response command. In this example, when the power is turned on as the current state, a response command such as "video is turned on" is displayed, and when the power is turned off, "video is not turned on."
Is generated and displayed on the output device 5 (step A6 '). As described above, the question and answer regarding the operation device 4 corresponding to the input character string from the user are made.

If it is determined in step A10 that the type of command is an operation command, the same processing as in the second embodiment is performed (step A3).
~ A6 ').

As described above, according to the device operation system according to this embodiment, when the user inputs a question concerning the status of the device from the input device 1, the command execution means 23 responds to the question. A response sentence relating to the current state of the operation device 4 is generated and displayed on the output device 5.
Thus, the user can easily know the state of the operation device 4 without checking the operation device 4 itself.

[Modification of Embodiment] In the above-described second embodiment, a series of designated operations are executed continuously without confirming to the user. On the other hand, in the above-described third to fifth embodiments, a predetermined operation included in a series of operations is checked by the user by outputting to the output device 5 and re-inputting from the input device 1. Was running. On the other hand, depending on the setting of the operation mode, switching of the operation is performed such that a series of operations are continuously performed without confirming to the user in the device operation system or a predetermined operation is performed while confirming to the user. You can also.

In the first to sixth embodiments, a natural language is input as code information from the input device 1 and the output device 5
Natural language was output as code information. On the other hand, as shown in FIG. 13, the voice input in the natural language from the voice input device 61 is recognized by the voice recognition device 62 and converted into code information, and supplied to the natural language analysis means 21.
The code information output from the command execution unit 23 may be converted into natural language voice data by the voice conversion device 71 and output from the voice output device 72 such as a speaker.

In the first to sixth embodiments, the input device 1 and the output device 5 are installed near the data processing device 2, the storage device 3, and the operating device 4 (in the same room or the like). . On the other hand, as shown in FIG.
May be provided to input and output natural language data from a remote personal computer (PC) via a communication line. In the case of input / output by voice, as shown in FIG. 15, the voice received by the communication device 8 such as a telephone device is supplied to the voice recognition device 62, and the voice data converted by the voice conversion device 71 is transmitted to the communication device. 8 and output to a remote location. Thus, the user can operate the operation device 4 in a natural language from a remote place, and can confirm the operation result in a natural language even in a remote place.

In the above-described first to sixth embodiments, the operation device 4 has been described as a video deck. However, the present invention is not limited to this, and all kinds of devices that operate according to input, such as home electric appliances and commercial electric appliances, can be applied to the operation appliance 4.

In the first to sixth embodiments, the functions of the natural language analysis means 21, the operation procedure derivation means 22, and the command execution means 23 are realized on the data processing device 2 controlled by a program. Was. On the other hand, a program for realizing these functions is stored in the data processing device 2.
Alternatively, the program may be stored in a computer-readable recording medium such as a CD-ROM or a floppy disk and distributed.

In the first to sixth embodiments, the dictionary storage unit 31 and the inter-function dependency storage unit 32 are implemented in the storage device 3 like the current state storage unit 33. In contrast, the dictionary storage unit 31 and the inter-function dependency storage unit 32
May be realized in a memory that is separate from the current state storage unit 33 and that is detachable from the data processing device 2. Accordingly, for example, even between regions having different channel configurations of television broadcasting, appropriate device operation can be performed only by exchanging such a memory. Note that such a dictionary storage unit 3
1 and a memory realizing the inter-function dependency storage unit 32 are:
It may be a readable medium.

[0095]

As described above, according to the present invention,
When a user inputs an operation instruction in a natural language,
A series of operations up to the operation can be automatically performed on the device to be operated.

Further, during a series of operations derived by the operation procedure deriving means, an operation for realizing a state already realized by the device to be operated is prevented from being executed again so that the operation is performed again. Malfunction of the target device can be prevented.

Depending on the contents stored in the inter-function dependency relationship storage means, when an operation that can only be performed by the user is to be performed, the operation is requested to the user, or after confirmation of the user in a predetermined case, the operation is performed. The device can be operated.

Further, a question regarding the current state of the device to be operated is input in a natural language, it is determined whether or not the natural language is a question. If the question is a question, the current state of the device to be operated is determined. By outputting a response regarding the device, the user can easily confirm the state of the device to be operated.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of a device operation system according to a first embodiment of the present invention.

FIG. 2 is a diagram illustrating an example of a dictionary relating to the inside of a device stored in a dictionary storage unit of FIG. 1;

FIG. 3 is a diagram illustrating an example of a dictionary related to device names stored in a dictionary storage unit of FIG. 1;

FIG. 4 is a diagram illustrating an example of a dictionary related to words independent of devices stored in the dictionary storage unit of FIG. 1;

FIG. 5 is a diagram illustrating an example of a dependency relationship between functions of a device stored in a function dependency storage unit of FIG. 1;

FIG. 6 is a diagram illustrating an example of a current state of a device stored in a current state storage unit of FIG. 1;

FIG. 7 is a flowchart illustrating a process according to the first embodiment of the present invention.

FIG. 8 is a block diagram illustrating a configuration of a device operation system according to a second embodiment of the present invention.

FIG. 9 is a diagram showing an example of a dictionary related to a response sentence further stored in a dictionary storage unit in the third embodiment of the present invention.

FIG. 10 is a diagram illustrating an example of a dependency relationship between functions of a device stored in an inter-function dependency storage unit according to the fourth embodiment of this invention.

FIG. 11 is a diagram showing an example of a dependency relationship between functions of a device stored in an inter-function dependency storage unit according to the fifth embodiment of the present invention.

FIG. 12 is a flowchart illustrating a process according to the sixth embodiment of the present invention.

FIG. 13 is a block diagram showing a configuration of a device operation system according to a modification of the embodiment of the present invention.

FIG. 14 is a block diagram showing a configuration of a device operation system according to a modification of the embodiment of the present invention.

FIG. 15 is a block diagram illustrating a configuration of a device operation system according to a modification of the embodiment of the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Input device 2 Data processing device 21 Natural language analysis means 22 Operation procedure derivation means 23 Command execution means 3 Storage device 31 Dictionary storage unit 32 Inter-function dependency relationship storage unit 33 Current state storage unit 4 Operating device 5 Output device 61 Voice input device 62 voice recognition device 71 voice conversion device 72 voice output device 8 communication device

──────────────────────────────────────────────────続 き Continued on the front page (58) Field surveyed (Int.Cl. ⁷ , DB name) G06F 3/16 G06F 17/27 G10L 15/00

Claims (16)

(57) [Claims] 1. A system for operating a device having a plurality of functions and having a dependency relationship between operations corresponding to each function as an operation target, wherein a system for operating the device is provided. A first input unit for inputting an operation instruction in a natural language; an operation corresponding to each function of the device to be operated; and a dictionary storage unit for storing words corresponding to each operation in association with each other; An inter-function dependency relationship storage unit for storing a dependency relationship between operations corresponding to each function of a target device; and an operation instruction input from the first input unit by referring to the dictionary storage unit. A natural language analyzing unit that derives an operation corresponding to an operation instruction input in the natural language; and a device that refers to the inter-function dependency relationship storage unit and performs the operation derived by the natural language analyzing unit as the operation target. Until Device operation system, characterized in that it comprises between the operating procedure deriving means for deriving a series of operations, a series of operations that the operation procedure deriving means is derived, and an operation means for sequentially performed to the device to be the operation target. 2. The apparatus according to claim 1, further comprising a current state storage unit configured to store a current state of the device to be operated, wherein the operation unit responds to the operation of the device to be operated by the operation procedure deriving unit. Means for determining whether or not the apparatus is in a state, and when the means determines that the apparatus is in a state corresponding to the operation derived by the operation procedure deriving means, the apparatus does not allow the operation target device to perform the operation. The device operation system according to claim 1, wherein: 3. The operation means includes response generation means for generating a response in a natural language corresponding to an operation to be performed by the device to be operated, and an output for outputting the response generated by the response generation means to the outside. 3. The method according to claim 1, further comprising means.
The device operation system according to 1. 4. The operation means, before performing an operation on the device to be operated, causes the response generation means to generate the response and output the response from the output means, and the response output from the output means. A second input means for performing an operation on the device to be operated when a predetermined input is made to the device, and performing the predetermined input for causing the operation means to perform processing on the device to be operated The device operation system according to claim 3, further comprising: 5. The function-dependency storage means stores a state that cannot be performed unless the user performs an operation, including a predetermined attribute, and the operation means stores the device to be operated in the predetermined condition. If you are trying to perform an operation that includes attributes,
Before performing an operation on the device to be operated, the response generation unit generates the response and outputs the response from the output unit, and when a predetermined input is input to the response output from the output unit. 5. The device operation system according to claim 4, wherein an operation is performed on the device to be operated. 6. The inter-function dependency relationship storage means stores a reference constraint indicating that an operation to be performed in a certain state must be stopped in another state of the operation target device. Further, it is shown that the operation means attempts to perform the operation with the reference restriction, and the operation of the device to be operated in the current state is stopped by the reference restriction. In this case, the response generation unit generates the response and outputs the response from the output unit, and when a predetermined input is made to the response output from the output unit, an operation on the device to be operated is performed. The apparatus operation system according to claim 4, wherein the operation is performed. 7. The inter-function dependency relationship storage means stores a state in which a previous state cannot be recovered by performing an operation with a predetermined attribute included therein, and the operation means stores the device to be operated as the device to be operated. If you want to perform an operation that includes a predetermined attribute,
Causing the response generation means to generate the response and output the response from the output means, and performing an operation on the device to be operated when a predetermined input is made to the response output from the output means. The device operation system according to claim 4, wherein: 8. The first input means is also for inputting a question regarding the current state of the device to be operated in a natural language, and the dictionary storage means is further for inputting a question or an operation instruction. Another,
And the natural language analysis unit refers to the dictionary storage unit and determines whether the natural language input from the first input unit is a question or an operation instruction. Means for determining whether or not there is, when the language analysis means determines that there is a question, the response generation means refers to the current state storage means and relates to a current state of the device to be operated. The device operation system according to claim 3, wherein a response is generated. 9. The apparatus according to claim 1, wherein said first input means comprises means for inputting said operation instruction as natural language voice, and means for recognizing voice input from said means. 3. The device operation system according to 2. 10. The first input means includes means for inputting the operation instruction as a voice in a natural language, and means for recognizing the voice input from the means. The device operation system according to claim 3, further comprising: means for generating a sound of a corresponding natural language; and means for outputting a sound generated by the means. 11. The first input means comprises first communication means for receiving the operation instruction from a remote place via a communication line and supplying the received operation instruction to the natural language analysis means. 9. The apparatus according to claim 3, wherein said means comprises a second communication means for receiving said response from said response generation means and transmitting said response to a remote place via a communication line. 11. The device operation system according to any one of items 10 to 10. 12. A recording medium storing a program for operating a device having a plurality of functions and having a dependency relationship between operations corresponding to each function as an operation target, wherein: A first input function for inputting an operation instruction to a device to be operated in a natural language, an operation corresponding to each function of the device to be operated, and a dictionary storing words corresponding to each operation in association with each other. A natural language analysis function for analyzing an operation instruction input by the first input function and deriving an operation corresponding to the operation instruction input in the natural language; An operation procedure deriving function for deriving a series of operations until the device to be operated performs the operation derived by the natural language analysis function by referring to a dependency relationship between operations according to functions; and Guided by function A computer-readable recording medium for recording a program for realizing an operation function of causing a series of issued operations to be sequentially performed by a device to be operated. 13. The operation function includes a function of determining whether or not the device to be operated is in a state corresponding to an operation derived by the operation procedure derivation function. 13. The computer-readable recording medium according to claim 12, wherein when it is determined that the state is in accordance with the derived operation, the operation is not performed by the device to be operated. 14. The operation function includes a response generation function for generating a response in a natural language corresponding to an operation performed by the device to be operated, and an output for outputting the response generated by the response generation function to the outside. 14. The computer-readable recording medium according to claim 12, further comprising a program for realizing a function. 15. The operation function according to claim 1, wherein the response generation function generates the response and outputs the response by the output function before operating the device to be operated. And performing an operation on the device to be operated when the predetermined input is performed, and performing the predetermined input for causing the device to be operated to be processed by the operation function. The computer-readable recording medium according to claim 14, further recording a program for realizing the input function of (1). 16. A method for operating a device having a plurality of functions and having a dependency relationship between operations corresponding to each function as an operation target, the method comprising: An input step of inputting an operation instruction in a natural language; and an operation corresponding to each function of the device to be operated, and a dictionary that stores words corresponding to each operation in association with each other. A natural language analysis step of analyzing the input operation instruction and deriving an operation corresponding to the operation instruction input in the natural language, and referring to a dependency relationship between operations according to each function of the device to be operated. An operation procedure derivation step of deriving a series of operations until the operation to be performed by the device to be operated, the operation derived in the natural language analysis step, and a series of operations derived in the operation procedure derivation step. An operation step of causing the operation target device to sequentially perform the operation.