JP2003179983A - Support equipment for device operation - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To simply operate devices to be connected by managing information relating to the operation and the purposes of use of each of the devices and generating an operation interface by utilizing this. <P>SOLUTION: The equipment is provided with a means for storing the operation information of the devices to be operated, a means for generating and executing the interface based on the operation information, and a means for controlling the devices. Specifically, composite function information for compiling and using the functions of a plurality of devices are dealt with to realize the operation interface of the composite function, and a fault diagnosis retrieving means for dealing with malfunction diagnosis knowledge is provided to enable interactive diagnosis of malfunction. The knowledge is supplied by an operation information medium, and a device capable of reading the information from the medium is provided. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a device operation support device for the purpose of making the operation of various electronic devices easier and easier to understand, and in particular, the use of functions realized by cooperation between a plurality of devices. Device for supporting the

[0002]

2. Description of the Related Art Demands for improving the operability of electronic devices in the home are increasing with the improvement of their functions. As the chances of handling information centered on video and audio have increased, the number of settings that need to be increased has increased, and the complexity of operations has increased, such as when it is necessary to link multiple devices.

Various technologies have been proposed to cope with such a tendency and to support interlocking operation between devices. For example, in Japanese Patent Laid-Open No. 14968/1993, there is a concept that an audio / video interconnection control system is provided with a system state storage means and a proper operation for an input is executed by judging from the function of the equipment and the system state stored in the system state storage means. It is shown. Also, in the field of home bus control, a configuration has been announced in which devices automatically cooperate with each other by automatically controlling loads. However, these do not take into consideration the aspects related to the operation of system-configured equipment.

If devices used in the home are controlled by a microcomputer based on a complicated control logic, it becomes a problem to cope with a trouble. As a technique for dealing with troubles, automatic failure diagnosis is also performed. This is because a list of failures that are likely to occur is prepared in advance according to the status of the equipment, and when a failure occurs, "diagnosis" is performed by matching the status of the equipment with this list, and what kind of failure occurs It displays what you have done.

On the other hand, in the field of computer software, it is generally used to realize a manual electronically and to refer to it online.
It has been clarified that the electronic realization of the manual facilitates the operations such as searching and referring to relevant parts while using the software.

However, in the technique relating to the operation of the composite equipment represented by the above-mentioned conventional technique, even if an attempt is made to integrate the operation among a plurality of equipment, there is not enough consideration regarding the operation, so that the function is not provided. I can't show it enough. Information about the operation of the device exists only inside each device, and commands can be given from the outside only in a form corresponding to the logic of each device. Therefore, on the controller side, it is only possible to realize the range of simply providing a set of commands for each device as a one-touch button. Alternatively, it could be implemented as a fully automatic function, but this would not be the operator's freedom.

[0007]

The technique relating to the operation of the composite equipment represented by the above-mentioned conventional techniques has the following problems.

Information transmission through mutual connection between devices is an important function centering on AV devices, but it is handled with the trend of digitalization and introduction of communication devices such as FAX into homes. The number of types of information that can be expressed is increasing. If mutual conversion between various expression formats can be performed naturally, information can be transferred smoothly between devices, and users can use each device more effectively. I can. In this sense, it can be said that it is important to support aspects related to operation.

Although the effectiveness of automatic determination of a fault is evaluated, it is mainly from the viewpoint of improving serviceability, and the operator himself has not yet utilized it effectively. The reason for this is that many devices cannot display a lot of information because the display channel is narrow, and it is not practical to allocate a lot of memory just in case of a failure because the cost becomes high. . Further, when the operator needs to make judgments and actions, simply presenting the diagnosis is not sufficient.

All of the above problems are caused by the fact that the information regarding the use of the device is not used. Since only information about how a device operates in response to a certain operation is managed, even if centralized control is performed, the operation of each device can only be concentrated in one place. After all, it is necessary for the operator to understand the operation of each device and develop his or her own purpose into the operation for each device.
In order to effectively utilize the functions of the combined equipment, the information on the usage of each equipment is concentrated on the equipment that controls,
A mechanism is needed to utilize this.

[0011]

In order to solve the above problems, the present invention uses the following means.

Although there are various kinds of information, in order to convert between many kinds of information, information for judging the expression format of information input / output between the device operation support device and the controlled device is used. The format determining means, the information format converting means for performing mutual conversion between the combinations of the two types of information, the input / output information format given by the information format determining means, and the capability of the information format converting means are interconnected. The information format compatibility determining means for determining the possibility and the composite function information searching means for searching the effective function from the possible connection provided by the information format compatibility determining means are provided, and the format of the information that can be input / output is provided. By converting the information in accordance with the connection mode, it is possible to realize the combined function of the devices even if the information format handled by the connected devices is different.

Further, by having the evaluation of the function to be realized in the composite function information storage means and using this information, when there are a plurality of methods for a given purpose, the method which is most suitable from the methods. Can be configured to be selected.

Further, for the purpose of making it easier to deal with the failure of the equipment and improving the serviceability, it is possible to accumulate the status of the failure of each electronic equipment and execute the control or obtain the status by a control signal from the outside. In addition to the above, the device operation support apparatus further comprises a failure diagnosis knowledge storage means for holding a collection of diagnoses and countermeasures corresponding to an assumed failure state, and the failure diagnosis knowledge storage means according to an operator's input. And a failure diagnosis search means for searching for a diagnosis and a countermeasure from the device, and is configured to utilize the interface of the equipment operation support device for the diagnosis and the countermeasure of the failure of the controlled equipment.

As a mechanism for concentrating the information on the usage of each device on the controlling device and utilizing this, an operation information medium for reading a storage medium containing information on the operation provided for each controlled device A reading device, an operation information storage unit that stores the operation information read by the reading device for a plurality of target devices, and an operation interface that executes an operation of the controlled device according to the operation information stored in the operation information storage unit. Executing means and dialogue managing means for providing information to the operator requested by the operation interface executing means and inputting operator's instructions;
A device operation support device comprising an inter-device communication means for performing communication of control signals with a controlled device is provided, and a device operation support is provided by centrally managing a manual and information related to the operation of each device. It is realized that the device executes the operation interface based on this information. Even if the combination of the operation information medium reading device and the operation information storage means is replaced with the operation information medium storage means, and the device is registered by storing the operation information medium in the operation support device, the same operation is performed. It becomes possible to execute the operation interface.

Further, as an actual realization form of the operation support device, there is a large part in common with the components for exerting other functions such as display means, input means, storage means, etc. With this configuration, the operation support device can be realized at a lower cost as a whole.

In the operation support device, the information format compatibility determining means determines the compatibility of the type of information transferred with the controlled equipment, and if necessary, the information format converting means communicates with the controlled equipment. By converting the format of the information passed in, the information is handed over even if the format of the information handled by the connected devices is different from each other, and the combined functions are used. You will be able to realize it.

Further, failure diagnosis knowledge storage means for holding a collection of diagnoses and countermeasures corresponding to assumed failure states, and failure for retrieving diagnosis and countermeasures from the failure diagnosis knowledge storage means according to an operator's input. With the function of the diagnostic retrieval means, the fault condition is diagnosed based on both the fault condition of the device and the user's judgment, and the diagnostic result is dealt with. This allows the operator to diagnose and deal with equipment faults without resorting to instruction manuals.

The information for exerting the above-mentioned actions can be divided into a general part relating to the operation interface and information relating to the purpose of use, function or failure analysis specific to each device. Of these, a mechanism for collecting information of a portion unique to each device is realized by a combination of an operation information medium reading device and operation information storage means or an operation information storage device.

As a result, unlike the conventional operation support device which has not been aware of the purpose of operating the controlled device or the possibility of the linked operation with other devices, the above-described advantage is to utilize the controlled device more effectively. The operation interface of can be provided.

[0021]

BEST MODE FOR CARRYING OUT THE INVENTION This embodiment will be described.

First, for the purpose of constructing an interface on the premise of exchanging information between a plurality of devices, a composite function information storage holding a list of functions realized by integrating the functions of at least two or more devices. Means, interconnect management means for managing the state of the connection between the equipment operation support device and the controlled equipment or between the controlled equipment, and the composite function information stored in the composite function information storage means. It is provided with a composite function information retrieval means for retrieving a possible function according to the connection status provided from the interconnection management means, and is configured to execute the operation interface according to the retrieved contents.

Although there are various types of information, in order to convert between many types of information, the expression format of information input / output between the device operation support device and the controlled device is determined. Information format determining means, information format converting means for performing mutual conversion between combinations of two types of information, input / output information formats given by the information format determining means, and capabilities of the information format converting means. The information format compatibility determining means for determining the possibility of connection and the composite function information searching means for searching the effective function from the possible connections provided by the information format compatibility determining means are provided, and By converting the information according to the format and its connection mode, it is possible to realize the combined functions of the equipment even if the format of the information handled by the connected equipment is different. In addition, the evaluation of the function to be realized is stored in the composite function information storage means, and by using this information, when there are a plurality of methods for a given purpose, the method that most suits the purpose is selected. Can be configured as.

Further, for the purpose of simplifying the treatment of equipment failure and improving serviceability, it is possible to accumulate the status of failure of each electronic equipment and execute control or acquire the status by a control signal from the outside. In addition to the above, the device operation support apparatus further comprises a failure diagnosis knowledge storage means for holding a collection of diagnoses and countermeasures corresponding to an assumed failure state, and the failure diagnosis knowledge storage means according to an operator's input. And a failure diagnosis search means for searching for a diagnosis and a countermeasure from the device, and is configured to utilize the interface of the equipment operation support device for the diagnosis and the countermeasure of the failure of the controlled equipment.

As a mechanism for concentrating the information on the usage of each device on the controlling device and utilizing this, an operation information medium for reading a storage medium containing information on the operation provided for each controlled device A reading device, an operation information storage unit that stores the operation information read by the reading device for a plurality of target devices, and an operation interface that executes an operation of the controlled device according to the operation information stored in the operation information storage unit. Executing means and dialogue managing means for providing information to the operator requested by the operation interface executing means and inputting operator's instructions;
A device operation support device comprising an inter-device communication means for performing communication of control signals with a controlled device is provided, and a device operation support is provided by centrally managing a manual and information related to the operation of each device. It is realized that the device executes the operation interface based on this information. Even if the combination of the operation information medium reading device and the operation information storage means is replaced with the operation information medium storage means, and the device is registered by storing the operation information medium in the operation support device, the same operation is performed. It becomes possible to execute the operation interface.

Further, as an actual realization form of the operation support device, there is a large part in common with the constituent elements for exerting other functions such as display means, input means, storage means, etc. With this configuration, the operation support device can be realized at a lower cost as a whole.

The operation of this embodiment will be described.

The composite function information retrieving means collects the functions of the controlled equipment based on the information about the type of information input / output and the connection status of the information among the controlled equipment collected in the composite function information storage means. By searching for a useful function based on the combination of the above and presenting it to the operator, the function realized by the combination of a plurality of devices can be presented to the operator in addition to the operation interface for each device. I can. As a result, it is possible to realize an operation using a plurality of devices, which has been complicated in the past, without imposing a mental burden on the operator.

Further, in the operation support device, the information format compatibility determination means determines the compatibility of the type of information transferred with the controlled equipment, and if necessary, the information format conversion means communicates with the controlled equipment. By converting the format of the information passed between the terminals, and then passing the information, even if the formats of the information handled by the connected devices are different from each other, these are matched and the combined function is provided. It becomes possible to use it.

Further, a failure diagnosis knowledge storage means for holding a collection of diagnoses and countermeasures corresponding to an assumed failure state, and a failure for retrieving diagnosis and countermeasures from the failure diagnosis knowledge storage means according to an operator's input. With the function of the diagnostic retrieval means, the fault condition is diagnosed based on both the fault condition of the device and the user's judgment, and the diagnostic result is dealt with. This allows the operator to diagnose and deal with equipment faults without resorting to instruction manuals.

The information for exerting the above-mentioned actions can be divided into a general part related to the operation interface and information related to the purpose of use, function, or failure analysis specific to each device. Of these, a mechanism for collecting information of a portion unique to each device is realized by a combination of an operation information medium reading device and operation information storage means or an operation information storage device. Due to these, unlike the conventional operation support device that has not been aware of the purpose of operating the controlled device or the possibility of a linked operation with other devices, an operation interface for more effectively utilizing the controlled device is provided. Can be provided.

[0032]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A first embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a schematic configuration diagram of the operation support device of the present embodiment. The composite function information accumulating unit 5 holds a list of functions that can be realized by passing information between a plurality of devices (devices to be controlled) that the operation support device supports as an operation target. The interconnection management means 7 is
The operation support device manages the input / output state of information between the devices to be operated support and the input / output state of information between the controlled device and the operation support device, and retrieves the interconnection information from the composite function information. Give to means 4. The composite function search means 4 searches for a feasible function from the composite function information provided by the composite function information storage means 5 and the interconnection information provided by the interconnection management means 7. The dialogue management means 3 has a dialogue with the user via the function presentation means 1 and the function designation means 2. The function presenting means 1 presents the operator with a possible composite function searched by the composite function information searching means 4 by a screen display device such as a TV screen or an output by voice, and the function specifying means 2 responds thereto. Whether the function is executed or not, or when there are a plurality of execution methods, the operator has a function to specify a selection, and a button or a touch panel can be used. The function executing means 6 has a function of executing the function determined by the dialogue managing means 3. Therefore, means for communicating with the controlled equipment, means for giving a command to the controlled equipment via this communication, etc. are included in the function executing means 6.

The operation of the operation support device of this embodiment will be described more specifically below. FIG. 2a is an example of information stored in the composite function information storage means 5. In this,
A composite function is stored in a form in which a function is associated with a set of an information source and its output format. This information may be prepared in the operation support device,
It may be supplied for each controlled device in the form described in another embodiment of the present application. In addition to this, it is also possible for the operator to set it separately. Further, information about the nature of the information handled by each controlled device shown in FIG. 2b is also stored in this composite function information storage means 5.

The information managed by the interconnection management means 7 is as shown in FIG. 2c, for example. Here, what is connected as a controlled device and the connection state of signals between them are obtained. The input / output status of signals between devices is managed by a set of output devices and terminals and input side devices and terminals. Do this for all connections between devices. It is desirable to manage the connection status automatically on the system side due to ID transmission and connector shape restrictions, but if the controlled device does not support this, it may be manually entered during installation. It is possible. Combined function information retrieval means 4
Then, in response to the operator's request, based on this information, the system searches for a composite function that can be realized.

For example, it is assumed that when the function "print" is selected on the operation support device during reproduction of a still image on the VTR, the VTR alone does not have a function of making a hard copy. At this time, if you search for a composite function related to the printing of video images,
The section "Video tape → hard copy, video printing" applies. Furthermore, from the information on each device, VTR: video tape → out1 {video} VP (video printer): in1 → hard copy
{Video} In addition, the information of VTR / out1 → VP (video printer) / in1 is obtained from the connection information, and the reproduced image of the video tape is hard-copied by the video printer through the connection path from the VTR to the video printer from these information. It is determined that output is possible.

The dialogue management means 3 is a composite function information retrieval means 4
This information is obtained from the device and the function presenting means 1 is requested to confirm the operator. Display the message “Do you want to output to video printer?” On the screen and request the operator's confirmation.
More generally, although a plurality of routes and methods may be applicable as a result of the search, a list display is made on the screen and the function is selected by the operator's designation.

As described above, by accumulating knowledge about the usage of each function in the operation support device that cannot be executed by each device alone, and presenting the composite function to the operator in accordance with this, it becomes easier and easier. You will be able to use advanced features.

Next, a second embodiment of the present invention will be described with reference to the drawings. FIG. 3 is a schematic configuration diagram of the operation support device of the present embodiment. In the figure, the components having the same operations as those of the first embodiment are designated by the same reference numerals and the description thereof is omitted. The information format determination means 10 determines the type of information input to the operation support device through the interconnection management means 7, and sends this to the compatibility determination means 9. Compatibility determination means 9
Determines the input / output state of information passing through the operation support device based on the interconnection information provided by the interconnection management means 7 and the information format provided by the information format determination means 10. This includes the possibility that compatibility will arise due to the conversion of information formats. Further, the information format conversion means 8 cooperates with the interconnection management means 7 and the function execution means 6 to convert the format of the information input / output via the operation support device.

Hereinafter, the operation of the operation support device of this embodiment will be described more specifically. 4a and 4b are examples of information stored in the composite function information storage means 5,
It is similar to that of the first embodiment. The composite function information storage means 5 holds the functions enabled by the combination of devices in such a form. Also, the information managed by the interconnection management means 7 shown in FIG. 4c is almost the same as that shown in the first embodiment, but in this example, the connection between the operation support device (CS) and the device is made. The difference is that is added.

FIG. 5 shows the features of this embodiment.
This is information managed by the compatibility determination means 9. For the combination of information to be input and output, whether or not mutual conversion between them is possible is managed by the capability of the information format conversion means 8. The information format determination means determines the type of information input or output to the operation support device by analyzing the knowledge given in advance or the input information itself, and informs the compatibility determination means 9 of this. For information given as digital data such as text information,
By analyzing the information itself, a more detailed information format can be set. The compatibility determining means 9 informs the composite function information searching means 4 of the possibility of conversion between the information formats based on the knowledge as shown in FIG.

For example, for printing a video signal, G
It is understood that it is possible to mutually convert between the 3FAX format. If this information is used by the composite function information retrieval means 4, it will be understood from the already given information that the VTR video signal can be printed by two methods.
One is a method of outputting a hard copy by the video printer through the connection path from the VTR to the video printer as in the first embodiment, and the other is information on the format of the video signal input from the VTR to the operation support device. Is converted into a FAX format by the information format conversion means 8, then output to the FAX, and this is printed using the capacity of the hard copy of the FAX.

Based on this search result, the dialogue management means 3 requests the function presentation means 1 to confirm the operator. As shown in FIG. 6, possible methods are presented to the operator and the operator is asked which method to select. Here, the operator
When "Use AX" is selected and the execution of printing is instructed, the function is executed by the function execution means 6. The operation support device receives the information from the VTR, converts the information format from the video signal to the FAX format by the function of the information format conversion means 8, and sends this to the FAX machine for printing. In this way, by accumulating knowledge about the usage of each function in the operation support device that cannot be executed by each device alone, and presenting the composite function to the operator in accordance with the function, the advanced function can be more easily implemented. Will be available.
In addition, by providing the information format conversion function, it is possible to realize combined operation of devices even between devices having different information input / output formats.

In the above embodiments, the type of information to be handled is a video signal as an example, but it is possible to handle voice and text data in the same manner. For example, if a voice synthesizer is connected, use this to convert text to voice and send it to the telephone line,
It is possible to provide a function such as defining the format of information such as an address book and sharing it among devices together with an easy operation interface.

Further, in the present embodiment, all retrieved functions are displayed, but if there are many possibilities to realize the same function, it is not appropriate to present them to the operator. ， It is necessary to select a better method on the system side. For this purpose, the composite function information retrieval means can select the most appropriate realization method by assigning a score such as cost and quality to each individual function of the system and using it for evaluation. . In this case, as in the example shown in the present embodiment, the cost is advantageous when output by FAX and the quality is good when output by the video printer, and the advantages of the two are different. You can ask which one to choose. Furthermore, although the conversion of the information format is shown as included in the function of the operation support device, it can be configured as another device, and one of the target devices has the function of this conversion. Is also good.

Next, a third embodiment of the present invention will be described. FIG. 7 is a diagram showing a schematic configuration of this embodiment. The lower electronic device in the figure diagnoses the fault of the target electronic device, and the upper operation support device diagnoses the fault of the target electronic device. The control means 18 has a function of performing system control of electronic equipment. It receives a command given from the operation support device through the communication means 17 and an input from the operation unit or the sensor of the electronic device itself, and executes a predetermined operation. Normally, a microcomputer controls this function. The failure detection means 20 is a sensor that detects an abnormal state of the device or hardware or software that has a function of determining an abnormality based on information from the sensor. When an abnormality is detected, the state at the time of failure is stored in the failure status storage means 19 by the function of the control means 18. The control unit 17 communicates with the operation support device and other electronic devices. Wired communication or infrared or radio wave communication may be used as long as digital data can be transmitted.

The communication means 16 on the side of the operation support device communicates with at least one electronic device, receives the failure status of the electronic device to be operated, and controls the electronic device to take measures against the failure. If necessary, send control signals. The fault diagnosis knowledge accumulating unit 14 stores a set of knowledge about a fault condition of an electronic device to be operated and a diagnosis and countermeasure for the fault condition. The failure diagnosis search means 13 outputs a failure diagnosis and a countermeasure based on the failure status of the electronic device given from the communication means 16 and the failure diagnosis knowledge given by the failure diagnosis knowledge storage means 14. The dialogue management means 3 includes the failure diagnosis search means 13
Based on the failure diagnosis output by the operator, the dialog with the operator is performed via the failure countermeasure display means 11 and the input means 12. The fault countermeasure display means 11 has a capability of presenting the operator with a method of dealing with the fault such as output by a graphic screen of a TV or voice, or requesting the operator for information that is insufficient in the judgment. is there. The display device can be provided in the operation support device itself, or the operation support device itself can only output to the screen of the television receiver, and the display device can use another device. The input means 12 gives the intention of the operator such as a button or a keyboard to the operation support device. Regarding the input means, it is also possible to use a case where the operation support device itself has this or a remote instruction device such as a remote controller. The failure countermeasure execution means 15 executes the countermeasures determined by the dialogue management means 3 and the failure diagnosis search means 13. This countermeasure is transmitted to the electronic device via the communication means 16.

Next, the operation of this embodiment will be described more specifically. Here, a microwave oven is assumed as the target electronic device, and a case where a failure occurs in the microwave oven is shown as an example. First, when some kind of failure occurs on the electronic equipment side, for example, when an abnormal rise in the internal temperature is detected, the failure detection means 20 and the control means 18 cause the internal state of the equipment at the time of occurrence of the failure to be the failure status storage means. Recorded at 19. This internal state includes the state of the equipment detected by the sensor, the operation sequence before and after the occurrence of an abnormality, the time of occurrence, and the like. The control means 18 displays the occurrence of an abnormality using a display means (not shown). The operator knows the failure of the electronic device by the malfunction of the device or the indicator, and selects "Fault diagnosis of microwave oven" from the processing menu of the operation support device. The contents of the processing menu are stored in the failure diagnosis knowledge accumulating means 14, are displayed by the failure countermeasure display means via the failure diagnosis searching means 13 and the dialogue managing means 3, and the operator makes a selection using the input means 12. .
When the failure diagnosis menu is selected, the operation support device inquires the target electronic device (microwave oven in this case) about the failure status via the communication means 16. The electronic device receives an inquiry from the operation support device from the communication unit 17, the control unit 18 extracts the abnormal condition from the failure condition storage unit 19, and again communicates the failure condition to the operation support device via the communication unit 17. On the side of the operation support device, the fault diagnosis retrieval means 13 retrieves a necessary portion from the fault diagnosis knowledge storage means 14 based on the fault situation, and the fault countermeasure display means 1
1 displays this. In this case, for example, in the fault diagnosis knowledge accumulating means 14, two causes, "the ventilation port is blocked" or "the control circuit is abnormal", are caused as the cause of the "abnormal temperature rise in the refrigerator" together with the countermeasure. Has been done. The dialogue management means 3 organizes the information given from the failure diagnosis search means 13 and outputs the information for prompting the operator's judgment to the failure countermeasure display means 11. This is shown in FIG.
The screen as shown in Fig. 2 is used to inquire about the situation around the device that cannot be judged from the state of the sensor and system. This makes it possible to identify the cause of the failure and take countermeasures, taking into consideration the operator's judgment. If the operator recognizes that there is not enough margin around the equipment, the operator presents the necessary margin around the equipment based on the knowledge stored in the failure diagnosis knowledge accumulating means 14 and requests a countermeasure. Further, as another case, when it is determined that the device needs to take some measures, the failure countermeasure executing means 15 directly controls the electronic device through the communication means to recover from the failure.

Next, a fourth embodiment of the present invention will be described. FIG. 9 is a diagram showing a schematic configuration of the operation support device of the present embodiment. Since some of the constituent elements in this embodiment are common to those in the third embodiment, common parts are designated by the same reference numerals and description thereof is omitted. In FIG. 9, the failure diagnosis request transmission means 22 requests diagnosis to the operation support device via the communication means 17 when the failure detection means 20 detects a failure and the control means 18 of the electronic device cannot judge. . Further, the failure diagnosis request reception means 21 of the operation support device receives the diagnosis request from the failure diagnosis request transmission means 22 of the electronic device and requests the dialogue management means 3 to interrupt.

The operation of this embodiment will be described below. As in the third embodiment, the microwave oven is an electronic device to be controlled. When the electronic device detects a failure by the failure detection means 20, the control means 18 records the failure status and internal status in the failure status storage means 19. Along with this, the failure diagnosis request transmission means 22 makes a failure diagnosis request to the operation support device via the communication means 17. The contents of this communication include a signal identifying the device that is the transmission source and the failure status accumulated in the failure status accumulating means 19.

In the operation assisting device which has received this failure diagnosis request via the communication means 16, the failure diagnosis request receiving means 21 judges this request and requests the dialogue management means 3 to interrupt.

In response to this interrupt request, the dialogue management means 3 displays on the display device of the device being operated by the operator that an abnormality has occurred in a specific electronic device and the operator's response is required. . For example, if it is determined that the operator is watching the TV from the time series of the operation and the diagnosis operation is possible on the TV screen, the operation is interrupted on the screen of the TV being received as shown in FIG. Request a response. After the operator responds to the diagnosis process, the diagnosis work proceeds and countermeasures are taken as in the third embodiment. Unlike the case of the third embodiment, when the failure diagnosis request is issued from the electronic device, the failure status is communicated, and the operation support device knows the status, so that the status of the electronic equipment is notified. The process of making an inquiry and the electronic device responding to this is not done.

In the third and fourth embodiments described above, when a failure occurs, the means for indicating the occurrence of the failure to the operator is the display device of the failed electronic device itself, or Although the display means of the operation support device is used,
These can be used together to enhance the effect. If the electronic device that the operator is paying attention to cannot be identified from the operation sequence, etc., and the degree of urgency of the failure that has occurred is high, it is possible to issue a warning using the display devices of multiple electronic devices. If the degree is low, it is possible to hold it until there is an inquiry from the operator.

Further, in the third and fourth embodiments, only the operation supporting device and the electronic equipment to be controlled communicate with each other through the communication means, and the actual form of the communication will be described in detail. Although not performed, this shows that the present invention can be applied regardless of the means for realizing communication. In the case of a composite device in which the operation support device and the electronic device to be controlled are integrally formed, communication for operation support can be realized by inexpensive means such as serial communication between control microcomputers, and operation is optimized by a unique protocol. There is an advantage that can be realized.
This form is applicable to audio components and the like. Further, a configuration in which the operation support device is configured as an independent device and communicates with an external device through a wired or wireless communication network can be realized on various communication standards such as a home bus standard. In this case, there is an advantage that functions for operation support and devices for display and input can be concentrated in one device.

Next, a fifth embodiment of the present invention will be described. FIG. 11 is a diagram showing a schematic configuration of the operation support device of the present embodiment. In FIG. 11, display means 23 and input means 24
Is a portion that is a direct contact with the operator, and the display means 23 may only have a display screen for displaying an operation interface, a graphic display, or a function for outputting to the television screen in the form of a video signal. The input means 24 works for the purpose of inputting the intention of the operator in response to the operation request presented by the display means 23, and its implementation form such as an operation button on the operation support device main body or a remote controller does not matter. The dialogue management means 3 manages the flow of processing for requesting the information provision to the operator and the operator's intention input via the display means 23 and the input means 24.

The operation information accumulating means 27 stores knowledge about how to use the electronic device to be operated by the operation support device. The information accumulated here is information on usage that links the function of the device and its purpose of use, information on analysis and response to abnormalities and troubles in the use of the device, and by presenting these to the operator and inputting by the operator. Is information about the screen interface for requesting. Since this operation information storage means requires a large capacity, a storage device capable of recording with a large capacity such as a magnetic disk or an optical disk is suitable, but a semiconductor memory may be used together for improving the processing speed. This operation information is read from the operation information medium reading device 26. This operation information medium reading device is typically a CD-ROM drive, and is a device capable of reading the medium in which the operation information as described above is digitally recorded. The operation information medium read here is a digital recording medium such as a CD-ROM and is supplied as an accessory to each electronic device. In addition, for operations performed over a plurality of devices, it is possible to supply only operation information. This operation information medium reading device may be a floppy (registered trademark) disk drive or a means for communication through a telephone line, depending on the type of medium provided.

The operation interface execution means 25 generates and executes an equipment operation interface using the display means 23 and the input means 24 based on the operation information of each equipment stored in the operation information storage means 27. Then, the device-related communication means 28 communicates with the device to be controlled regarding the control, and acquires the state of the device and executes the operation according to the request from the operation interface execution means 25.

The operation of the operation support device of this embodiment will be described below. The operation of the present embodiment is divided into two parts, that is, the operation support and the operation information medium handling. First, the operation is executed in the following steps. The operation interface execution means 25 generates an operation screen according to the state of the device and the operation flow at that time. This screen is the main screen that displays a list of devices to be controlled at startup,
It also includes a screen for fault diagnosis. The dialogue management means 3 organizes the flow of information between the operation interface execution means 25 and the display means 23 and input means 24. The display means 23 outputs the generated screen to the operator. This screen contains menus for performing operations, icons to be selected, and buttons for confirmation. Next, the operator inputs the operation intention using the input means 24 in response to the inquiry given via the display means 23. The actual operation depends on selection of buttons on the remote control, pointing and selection using a tablet or touch panel, etc. This input is processed by the dialogue management means 3, and the processed result is sent as a command to the operation interface execution means 25.

The operation interface executing means 25 performs necessary processing based on this command. If the command can be directly executed by the device, the command is communicated with the device to be controlled through the inter-device communication means 28 to execute the control. In other cases, the operation interface executing means 25 retrieves the operation information corresponding to the command given from the operation information accumulating means 27 and executes it. If the operation information is an operation screen, the process returns to the step of generating an operation screen, and if it is device control, this is sent to the device via the inter-device communication means 28 to execute control or obtain a state. Do. By repeating the above-mentioned operation, the execution of the operation by the operation support device of the present embodiment proceeds.

Next, the flow of accumulation of operation information will be described. The operation information is given in the form of software in which the operator's purpose of using the device is specified through the interaction with the operator as described above and the knowledge for executing the operation is described. This operation information is typically provided on a medium such as a CD-ROM capable of recording and reproducing digital data, and is attached to each electronic device to store information about a manual and an operation interface. Although the operation information includes information that handles a composite function by linking multiple devices, information about the composite function that does not depend on each device is provided in advance in the operation support device or a part of the composite function is stored. Supplied with the equipment. In addition, regarding the functions that are predefined composite functions and the protocol is decided,
It is also possible to collectively supply the equipment separately from the equipment. When introducing a new device, the operation information medium storing the operation information about the new device is loaded into the operation information medium reading device 26.
And read it according to the menu of the operation support device. The read operation information is stored in the operation information storage means 27.

FIG. 12 shows an external view of this embodiment.

A CD-ROM drive 101 for reading a CD-ROM 103 as an operation information medium is provided as an operation information reading means, and a remote controller 102 having a screen cursor control key is provided as an input means. The back surface is provided with terminals (not shown), which include terminals for outputting video and audio to another display device and terminals for communicating with the controlled object. According to this embodiment, there is an advantage that the operation information medium attached to each device can be manufactured relatively inexpensively.

Next, a sixth embodiment of the present invention will be described. FIG. 13 is a diagram showing a schematic configuration of the operation support device of the present embodiment. Since some of the constituent elements in this embodiment are common to those in the fifth embodiment, common parts are designated by the same reference numerals and description thereof is omitted. The operation information medium storage means 29 has the same effect as that achieved by the combination of the operation information medium reading device and the operation information storage device in the fifth embodiment. In this embodiment, the operation information is supplied for each device to be controlled and recorded on a medium capable of storing digital information. Unlike the fifth embodiment, the operation information medium is always stored in the operation information medium storage means 29. Typically, it is supplied in the form of a ROM cartridge, and therefore the operation information medium storage means 29 is constructed as a slot capable of storing this cartridge. FIG. 14 shows a first embodiment of the operation information medium storage means.
It shows one. In the embodiment shown in FIG. 14, the operation information is supplied in the form of a memory card 105, and the operation information medium storage means is a memory card slot 104 capable of accommodating this memory card. This slot is necessary for the number of models for which the operation support device supports the operation, and it is necessary to provide a sufficient number. By using a bus format and providing an address on each card, it is possible to recognize the newly installed operation support device simply by inserting the card.

As another form, a daisy chain type operation information medium storage means as shown in FIG. 15 is also possible. In this format, each of the memory cards 105 has an input terminal and an output terminal. Insert the output terminal of the first card into the memory card terminal 106 of the operation support device, and
The cards after the first one are connected by sequentially inserting them into the input terminals of the previous card. By using this method, it is possible to avoid unnecessary installation of hardware in order to previously provide a sufficient number of slots in the operation support device.

Next, a seventh embodiment of the present invention will be described. FIG. 16 is a diagram showing a schematic configuration of the operation support device of the present embodiment. Since some of the constituent elements in this embodiment are common to those in the fifth embodiment, common parts are designated by the same reference numerals and description thereof is omitted. The operation information storage means 30 has a function similar to that exerted by the combination of the operation information medium reading device and the operation information storage means in the fifth embodiment, and the implementation form thereof does not matter here. The document management means 31 and the document input means 32 function as a normal word processor. Of these, the document input means 32 has a function of creating and shaping a document consisting of characters and pictures using the input means 24, and the document management means 3
1 saves and reads the document. These are constructed using conventional techniques used in ordinary word processors.

Since the display means 23 and the input means 24 are used both as a component for performing an operation support function and a component for performing a document processing function, a switching means 33 for controlling the flow of operation is provided. One of the keyboards of the input means 24 is used as a switch for switching, and each time the key is pressed, the display means 23 and the input means 24 are switched between the operation support function and the document creation function.

Regarding the operation of this embodiment, the flow of the operation support part is almost the same as that shown in the fifth embodiment, and the part of the document processing function is known as the prior art. There is no change. The function of the switching means 33 will be mainly described.

FIG. 17 is a diagram showing an image of the use state of the operation support device of this embodiment. In FIG. 17, 107
Is a notebook type operation support device that also serves as a word processor, 108 is a remote control transmitter / receiver (corresponding to an inter-device communication device) for operation support connected thereto, and 109 is a device to be controlled. The disk drive for document storage can be used as it is as an operation information medium reading device of the operation support function, and a display and a keyboard can be used as display means and input means. Communication with controlled devices
As shown in the figure, it may be performed via a dedicated remote control signal transmitter / receiver, or a mode in which direct communication with a target device is possible.

The advantages obtained by constructing the operation support device in this way are as follows. The operation support function and the document processing function share most of the necessary components, and both can be used in a time-sharing manner. Therefore, by configuring them as an integrated device, there is less waste in the components. In addition, it is possible to increase the frequency of use as a whole and effectively use the device.

Next, an eighth embodiment of the present invention will be described. FIG. 18 is a diagram showing a schematic configuration of the operation support device of the present embodiment. Since some of the constituent elements in this embodiment are common to those in the fifth embodiment, common parts are designated by the same reference numerals and description thereof is omitted. In FIG. 18, the television broadcast receiving means 34 includes an antenna terminal, a television tuner, a channel selecting means, etc., and has the same configuration as an element constituting a normal television receiver, and has a video signal overlay means 35.
Is output to. In this embodiment, the display means 23 outputs the same video signal as the television broadcast receiving means 34. The television monitor 38 receives a video signal and outputs it to a display device such as a CRT or a liquid crystal panel. As in the seventh embodiment, in this embodiment, two different functions, that is, the device operation support function and the television broadcast receiving function are integrally configured.
There is a need for a means to properly use the two. In the present embodiment, this switching is performed by means for selecting a television channel. By assigning a mode for executing the operation support function to one of the TV channels or input switching, the operation support function can be called up in a simple manner.

The overlay means 35 is the display means 2
The screen of the operation interface output by 3 and the screen output by the television broadcast receiving means 34 are combined. Since the operation interface of the TV itself is also supported by the operation support function, it is necessary to watch the TV screen and the operation screen at the same time. In addition, the small screen function of the TV is added to the overlay means 35.
With the above, the operation screen and the television broadcast can be viewed at the same time, as shown in FIG.

Various effects can be obtained by configuring the device for assisting the operation as described above.

First, there is an advantage that the operation of the device is centralized from one operation support device. By storing information about connected devices and generating an operation interface for multiple functions from this information, collecting the functions of devices that exhibit multiple partial functions and providing more advanced functions. Can be done. In particular, if attention is paid to the flow of information between devices and a means for managing the input / output of information is provided, it is possible to share and effectively utilize the information between the devices centering on image and audio information. Furthermore, by providing a means for converting the format of information, it is possible to handle various information including text and data, and an interface for operating this can be generated from the function of each device to facilitate the operation. Can be done.

By providing a means for diagnosing a failure by a dialogue with the operator when a failure occurs in the equipment, the failure detection means provided in the equipment and the judgment of the person who is the operator are integrated. Can make a diagnosis. Further, by providing a function of requesting a diagnosis from the device to be controlled to the operation support device, it becomes possible to perform prompt processing even in an emergency.

The above effects cannot be realized without knowledge of the operation method and purpose of use of the equipment to be controlled, knowledge of fault diagnosis, etc. on the operation support equipment. The solution to this is a means for reading or storing the medium in which the operation information is recorded. By integrating the operation information for a plurality of devices, determining the method for recording the information about the operation of each device, and providing the interface execution means for executing the interface according to the method, the various interfaces can be operated by the unified interface. Become.

Further, by constructing the constituent elements of the operation support function integrally with the elements of the other functions,
The common components can be shared, and it becomes possible to configure the operation support device at a low cost as a whole.

[0076]

Various effects can be obtained by constructing the device for assisting the operation as described above.

There is an advantage that the device is intensively operated from the operation support device. It is possible to handle various types of information including text and data by providing means for converting the format of information, and it is possible to perform operations easily by generating an interface for operating this from the function of each device. .

[Brief description of drawings]

FIG. 1 is a schematic configuration diagram of a first embodiment.

FIG. 2 is a diagram showing information handled in the first embodiment.

FIG. 3 is a schematic configuration diagram of a second embodiment.

FIG. 4 is a diagram showing information handled in a second embodiment.

FIG. 5 is a diagram showing compatibility information handled in the second embodiment.

FIG. 6 is a diagram showing an example of a screen display of the second embodiment.

FIG. 7 is a schematic configuration diagram of a third embodiment.

FIG. 8 is a diagram showing an example of a screen display of the third embodiment.

FIG. 9 is a schematic configuration diagram of a fourth embodiment.

FIG. 10 is a diagram showing an example of screen display according to a fourth embodiment.

FIG. 11 is a schematic configuration diagram of a fifth embodiment.

FIG. 12 is an external view of a fifth embodiment.

FIG. 13 is a schematic configuration diagram of a sixth embodiment.

FIG. 14 is a diagram showing a configuration example of operation information storage means of the sixth embodiment.

FIG. 15 is a diagram showing another configuration example of the operation information storage means of the sixth embodiment.

FIG. 16 is a schematic configuration diagram of a seventh embodiment.

FIG. 17 is an image diagram of usage of the seventh embodiment.

FIG. 18 is a schematic configuration diagram of an eighth embodiment.

FIG. 19 is an image of use of the eighth embodiment.

[Explanation of symbols]

1 Function presentation means 2 Function designation means 3 Dialog management means 4 Multi-function information search means 5 Multi-function information storage means 6 Function execution means 7 Mutual connection management means 8 Information format conversion means 9 Compatibility determination means 10 Information format determination means 11 Failure measures display means 12 Input means 13 Fault diagnosis search means 14 Failure diagnosis knowledge storage means 15 Failure countermeasure execution means 16 Communication means 17 Communication means 18 Control means 19 Failure status accumulation means 20 Failure detection means 21 Failure diagnosis request receiving means 22 Failure diagnosis request transmission means 23 Display means 24 Input means 25 Operation interface execution means 26 Operation information medium reader 27 Operation information medium storage means 28 Inter-device communication means 29 Operation information medium storage means 30 Operation information storage means 31 Document management means 32 document input means 33 switching means 34 Television broadcasting receiving means 35 overlay 36 TV monitor 101 CD-ROM drive 102 remote control 103 Manual disc 104 memory card slot 105 memory card 106 Memory card terminal 107 Operation support device 108 Remote control transceiver 109 Controlled device

Continued front page    (72) Inventor Mitsuteru Kataoka             1006 Kadoma, Kadoma-shi, Osaka Matsushita Electric             Sangyo Co., Ltd. (72) Inventor Atsushi Tanaka             1006 Kadoma, Kadoma-shi, Osaka Matsushita Electric             Sangyo Co., Ltd. F-term (reference) 5C025 AA30 BA28 BA30 CA09 CB10                       DA05 DA08 DA10                 5K048 AA04 BA12 DA02 DA07 EB02                       EB12 GC06 HA01 HA03

Claims (14)

[Claims] 1. A device operation support device which communicates with a plurality of devices and provides an operation interface for integrating and using the functions of the plurality of devices by integrating the functions of at least two or more devices. A composite function information storage unit that holds a list of feasible functions, an interconnection management unit that manages the state of connection between the device operation support device and the controlled device, and a device operation support device and the controlled device An information format determining means for determining the expression format of information input and output between the two;
Information format conversion means for performing mutual conversion between combinations of two types of information, and information for judging the possibility of interconnection from the input / output information format given by the information format determination means and the capability of the information format conversion means. A format compatibility determination unit, a composite function information search unit that searches an effective function from a possible connection provided by the information format compatibility determination unit, and a function presentation unit that presents the searched function,
An apparatus operation support device comprising: a function designating means for designating a specific function from the presented functions, and a function executing means for instructing execution of the function designated by the function designating means. 2. A function capable of being executed by selecting a combination of devices according to a connection state of the device to the device operation support device and a format of input / output information, and supporting the execution thereof. The device operation support device according to claim 1. 3. A controlled device having the functions of an information format determining means and an information format converting means, and an equipment operation for supporting equipment operation based on an interconnection status / information format and composite function information issued from the controlled equipment. The device operation support device according to claim 1 or 2, which is configured by connection with the support device. 4. The composite function information accumulating means manages function evaluation information such as quality, speed, and cost of realized functions, and the connection status of devices, information format and information given by the search by the composite function information searching means. The device operation according to any one of claims 1 to 3, characterized in that, when a plurality of possible functions for the composite function information are searched, an optimum realization is selected or presented based on the function evaluation information. Support device. 5. A device operation support device which communicates with a plurality of devices and provides an operation interface for integrating and using the functions of the plurality of devices, the device operation support device and the controlled device. Information format determining means for determining the expression format of information input / output, information format converting means for performing mutual conversion between combinations of two information formats, and input / output information format provided by the information format determining means And an information format compatibility judging means for judging the possibility of mutual connection from the information format converting means and the capability of the information format converting means, and a composite function information search for searching an effective function from the possible connections provided by the information format compatibility judging means. Means, a function presenting means for presenting the searched function, a function designating means for designating a specific function from the presented functions, and a machine designated by the function designating means. Equipment operation support apparatus characterized by comprising a function executing unit for instructing the execution of. 6. A failure detection means for detecting a failure in use of a device, a failure status storage means for storing a status of the device at the time of failure, and a function for responding to an operation request from the outside. At least one electronic device including control means for executing and transmitting a state, and failure diagnosis request sending means for sending a failure diagnosis request to the operation support device when the failure detection means detects a failure, Fault diagnosis request receiving means for receiving a fault diagnosis request issued from the electronic device, fault diagnostic knowledge accumulating means for holding a collection of diagnoses and countermeasures corresponding to an assumed fault state, and a fault diagnostic request for receiving the fault diagnostic request. Fault diagnosis search means for retrieving diagnosis and countermeasures from the fault diagnosis knowledge storage means, and a fault for displaying the retrieved diagnosis and countermeasures on the display means and requesting operator input. A bet display means, equipment operation support device comprising an operation support apparatus having a failure countermeasure execution unit to continue to perform countermeasures against failures or diagnosis according to the input by the operator given to the display. 7. A failure detecting means for detecting a failure in use of the device, a failure status accumulating means for saving the status of the device at the time of failure, and a function for responding to an operation request from the outside. At least one electronic device including control means for executing and transmitting status, failure diagnosis knowledge storage means for holding a collection of diagnoses and countermeasures corresponding to the assumed failure status, and an operator's input Fault diagnosis search means for retrieving diagnosis and countermeasures from the fault diagnosis knowledge accumulating means, fault countermeasure display means for displaying the retrieved diagnosis and countermeasures on the display means, and requesting operator's input, and this display A device operation support device including an operation support device including a failure countermeasure execution unit that executes a countermeasure against a failure or continues diagnosis according to an input given by an operator. 8. The device operation support apparatus according to claim 6, which is integrally formed with the operation support device and at least one electronic device controlled by the operation support device. 9. The device according to claim 6, wherein the operation support device and at least one electronic device controlled by the operation support device are configured as separate devices, and communication between them is performed by a wired or wireless network. Operation support device. 10. While communicating with a plurality of devices,
A device operation support device for providing an operation interface for using the functions of a plurality of devices, comprising: an operation information medium reading device for reading a storage medium containing information related to an operation provided for each controlled device; Operation information storage means for storing the read operation information for a plurality of target devices, operation interface execution means for executing the operation of the controlled device according to the operation information stored in the operation information storage means, and the operation interface execution Recorded on a medium, it comprises an interaction management means for providing information to the operator requested by the means and inputting an operator's instruction, and an inter-device communication means for communicating a control signal with a controlled device. The operation interface related to the controlled device is implemented by reading the stored operation information related to the controlled device and storing it. And, device operation support apparatus and performing through dialogue with the operator to execute the control. 11. A storage medium for recording operation information is a CD-R.
11. The device operation support device according to claim 10, which is a disc-shaped optical recording / reproducing medium such as OM, and the operation information medium reading device is an optical medium reproducing device such as a CD transport. 12. While communicating with a plurality of devices,
A device operation support device that provides an operation interface for using the functions of a plurality of devices, stores a storage medium containing information regarding an operation provided for each controlled device for a plurality of target devices, and reads the contents. An operation information medium storage device, an operation interface execution means for executing the operation of the controlled device according to the operation information accumulated in the operation information storage device, and an operator requested by the operation interface execution means. A medium including interaction management means for providing information and inputting an operator's instruction and inter-device communication means for communicating a control signal with a controlled device, and storing a medium storing operation information about the controlled device. By storing it and making it readable at any time, an operation interface for controlled devices is realized,
An apparatus operation support device characterized in that control is executed through a dialogue with an operator. 13. An operation information storage device capable of storing information about an operation provided for each controlled device and reading the contents, and the controlled device according to the operation information accumulated in the operation information storage device. Of the control signal between the controlled device and the operation interface executing means for executing the operation of 1., the dialogue managing means for providing information to the operator requested by the operation interface executing means, and inputting the operator's instruction. It has a device operation support function composed of inter-device communication means for communication, a character input means for inputting characters by operator's operation, and a document processing function for shaping, editing and storing sentences, It is characterized in that a switching means for switching between the support function and the document processing function is provided, and both the device operation support function and the document processing function are switched and used. That equipment operation support apparatus. 14. An operation information storage device capable of storing information related to an operation provided for each controlled device and reading the contents, and the controlled device according to the operation information accumulated in the operation information storage device. Of the control signal between the controlled device and the operation interface executing means for executing the operation of 1., the dialogue managing means for providing information to the operator requested by the operation interface executing means, and inputting the operator's instruction. A device operation support function including inter-device communication means for performing communication, a television broadcast receiving means, and a television image display device are provided, and the device operation support function and the television receiver are configured as an integrated device. Equipment operation support device.