JP2005267641A - Device for supporting apparatus operation - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To manage information on the purpose of the operation and usage of each apparatus in order to easily perform the operation of the connected apparatus, so as to generate an operation interface using the information. <P>SOLUTION: The device comprises: a means for storing the operation information of the apparatus to be operated; a means for generating and performing the interface in response to the operation information; and a means for controlling the apparatus. Combined function information for using a plurality of apparatus functions by combination is treated especially, so as to achieve the operation interface with the combined function. Interactive fault diagnosis is performed by arranging a fault diagnosis retrieving means for treating fault diagnosis knowledge. The knowledge is supplied by an operation information medium. Equipment for reading the information from the medium is arranged. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a device operation support device for the purpose of making operations of various electronic devices easier to understand and more particularly relates to an apparatus that supports use of a function realized by cooperation between a plurality of devices.

  The demand for improving the operability of electronic devices in the home is increasing with the improvement of the functions. As the opportunity for handling information centered on video and audio increases, the number of settings increases, and the complexity of operations increases, for example, when coordinated operations between multiple devices are required.

  In response to this trend, various technologies have been proposed to support linked operation between devices. For example, Japanese Patent Application Laid-Open No. 2003-228561 discloses an idea that an audio / video interconnection control system is provided with a system state storage unit, and an appropriate operation for an input is executed based on a device function and a system state stored therein. ing. Also, in the field of home bus control, a configuration has been announced in which devices automatically cooperate with each other by automatic load control. However, these do not take into consideration aspects related to the operation of system-configured equipment.

  When devices used in the home are controlled based on complex control logic by using microcomputers, how to deal with troubles becomes a problem. As a technique for dealing with troubles, automatic failure diagnosis is also performed. This is because a list of failures that are likely to occur is prepared in advance in correspondence with the device status, and what kind of failure occurs by “diagnosis” by matching the device status with this list when a failure occurs. Is displayed.

  On the other hand, in the field of computer software, it has become common to implement a manual electronically and make it available online. It has become clear that the electronic implementation of manuals facilitates tasks such as searching and referring to relevant locations while using software.

  However, in the technology related to the operation of the composite device represented by the above-mentioned conventional technology, even if the operation is integrated among a plurality of devices, there is not enough consideration for the operation. Can not. Information on the operation of the device exists only inside each device, and commands can be given from the outside only in a form corresponding to the logic possessed by each device. Therefore, on the controller side, it is only possible to realize a range in which commands for each device are simply provided as a one-touch button. Alternatively, it can be realized as a function that works completely automatically, but this does not give the operator freedom.

JP-A-5-14968

  The technology related to the operation of the composite device represented by the above prior art has the following problems.

  The transmission of information through interconnection between devices is an important function, mainly for AV devices. However, with the introduction of digital communication and communication devices such as FAX to homes, The types of expression formats are increasing. If mutual conversion between various representation formats can be performed naturally, it will be possible to more smoothly exchange information between devices, and users will be able to use each device more effectively. I can do it. In this sense, it is important to support the operational aspects.

  The effectiveness of automatic determination of failures has been evaluated, but mainly from the viewpoint of improving serviceability, and the operator has not yet made effective use of it. The reason for this is that many devices cannot display so much information because the display channel is narrow, and it is not practical to allocate a lot of memory just for a failure because the cost is high. . In addition, it is not sufficient to simply present a diagnosis when operator judgment or treatment is required.

  All of the above problems are caused by the fact that information about the use of the device is not used. Since only information on how a device operates in response to a certain operation is managed, even if centralized control is performed, the operation of each device can only be concentrated in one place. Eventually, it is necessary for the operator to understand the action of each device and to develop his / her purpose to the operation on each device. In order to make effective use of the functions of the combined devices, it is necessary to have a mechanism for concentrating information on how to use each device in the device that controls it and utilizing it.

  In order to solve the above problems, the present invention uses the following means.

  There are various types of information, but in order to convert between many types of information, information format determination means for determining the expression format of information input / output between the device operation support device and the controlled device Information format conversion means for performing mutual conversion between combinations of two information formats, the input / output information format provided by the information format determination means, and the capability of the information format conversion means Information format compatibility determination means for determining, and composite function information search means for searching for an effective function from possible connections given by the information format compatibility determination means, and a format of information that can be input and output and its connection form By converting the information according to the above, it is possible to realize a function by combining devices even if the information format handled by the connected device is different.

  In addition, when there is multiple methods for a given purpose, the method that best suits the purpose is selected by using the function information storage means that evaluates the function to be realized and using this information. It can be constituted as follows.

  In addition, for the purpose of simplifying measures against device failures and improving serviceability, it is possible to accumulate the failure status of each electronic device so that control can be executed or the status can be acquired by an external control signal. And further comprising an apparatus operation support device for diagnosing and diagnosing fault diagnosis knowledge storing means for holding a collection of diagnoses and countermeasures corresponding to an assumed fault state, from the fault diagnosis knowledge storing means in response to an operator input. A failure diagnosis search means for searching for a countermeasure is provided, and the interface of the device operation support device is configured to be used for the diagnosis and countermeasure of the failure of the controlled device.

  As a mechanism for concentrating information on the usage of each device to the device that performs control and utilizing this, an operation information medium reading device that reads a storage medium that includes information about operations provided for each controlled device, and , Operation information storage means for storing operation information read by the reader for a plurality of target devices, and operation interface execution means for executing an operation of the controlled device according to the operation information stored in the operation information storage means , A dialogue management means for providing information to the operator requested by the operation interface execution means and inputting an operator instruction, and an inter-device communication means for communicating a control signal with the controlled device. Device operation support devices are provided, and the device operation information is managed centrally by managing the manual and operation information related to each device. The operation support device is implemented to execute an operation interface based on this information. Further, it is also possible to change the combination of the operation information medium reading device and the operation information storage means to the operation information medium storage means and store the operation information medium in the operation support device to register the device. It is possible to execute the operation interface.

  Furthermore, as an actual implementation form of the operation support device, there is a large part in common with components for displaying other functions such as display means, input means, storage means, etc., and they are configured integrally with other functions. As a result, the operation support device can be realized at a lower cost as a whole.

  In the operation support device, the information format compatibility judging means judges the compatibility of the type of information passed to and from the controlled device, and if necessary, the information format conversion means is passed to and from the controlled device. By converting the format of the information to be transferred and transferring the information, even if the formats of the information handled by the connected devices are different from each other, this is matched and the combined function is realized. Will be able to.

  Also, fault diagnosis knowledge storage means for holding a collection of diagnoses and countermeasures corresponding to the assumed fault states, and fault diagnosis search means for searching for diagnoses and countermeasures from the fault diagnosis knowledge storage means in response to operator input With the function, the failure status is diagnosed based on both the failure status of the device and the user's judgment, and the diagnosis result is dealt with. As a result, the operator can diagnose and deal with the failure of the device without relying on the instruction manual.

  Information for exerting the above actions can be divided into a general part related to the operation interface and information related to the purpose of use, function or failure analysis specific to each device. Of these, a mechanism for collecting information unique to each device is realized by a combination of an operation information medium reader and operation information storage means, or an operation information storage device.

  In contrast to conventional operation support devices that did not know the purpose of operation of the controlled device and the possibility of linking operation with other devices, the operation interface for using the controlled device more effectively. Can be provided.

  As described above, various effects can be obtained by configuring a device that supports the operation.

  There is an advantage that the operation of the device is performed intensively from the operation support device. By providing information format conversion means, it is possible to handle various types of information including text and data, and it is possible to operate easily by generating an interface for operating this from the functions of each device. .

  This embodiment will be described.

  First, for the purpose of configuring an interface based on the exchange of information between a plurality of devices, a composite function information storage means for holding a list of functions realized by integrating the functions of at least two devices, Interconnect management means for managing the connection status between the device operation support device and the controlled device or between the controlled devices, and the interconnect management from the composite function information stored in the composite function information storage means And a composite function information search means for searching for possible functions according to the connection status provided by the means, and configured to execute an operation interface according to the searched contents.

  Also, there are various types of information, but in order to convert between many types of information, an information format that determines the representation format of information that is input and output between the device operation support device and the controlled device Interconnection is possible based on determination means, information format conversion means for performing mutual conversion between combinations of two information formats, input / output information format provided by the information format determination means, and the capability of the information format conversion means Information format compatibility determining means for determining the functionality, and composite function information searching means for searching for an effective function from the possible connections given by the information format compatibility determining means. By converting the information according to the connection form, it is configured so that a function based on the combination of devices can be realized even if the format of information handled by the connected device is different. In addition, when there is multiple methods for a given purpose, the method that best suits the purpose is selected by using the function information storage means that evaluates the function to be realized and using this information. It can be constituted as follows.

  In addition, for the purpose of simplifying measures against device failures and improving serviceability, it is possible to accumulate the failure status of each electronic device so that control can be executed or the status can be acquired by an external control signal. And further comprising an apparatus operation support device for diagnosing and diagnosing fault diagnosis knowledge storing means for holding a collection of diagnoses and countermeasures corresponding to an assumed fault state, from the fault diagnosis knowledge storing means in response to an operator input. A failure diagnosis search means for searching for a countermeasure is provided, and the interface of the device operation support device is configured to be used for the diagnosis and countermeasure of the failure of the controlled device.

  As a mechanism for concentrating information on the usage of each device to the device that performs control and utilizing this, an operation information medium reading device that reads a storage medium that includes information about operations provided for each controlled device, and , Operation information storage means for storing operation information read by the reader for a plurality of target devices, and operation interface execution means for executing an operation of the controlled device according to the operation information stored in the operation information storage means , A dialogue management means for providing information to the operator requested by the operation interface execution means and inputting an operator instruction, and an inter-device communication means for communicating a control signal with the controlled device. Device operation support devices are provided, and the device operation information is managed centrally by managing the manual and operation information related to each device. The operation support device is implemented to execute an operation interface based on this information. Further, it is also possible to change the combination of the operation information medium reading device and the operation information storage means to the operation information medium storage means and store the operation information medium in the operation support device to register the device. It is possible to execute the operation interface.

  Furthermore, as an actual implementation form of the operation support device, there is a large part in common with components for displaying other functions such as display means, input means, storage means, etc., and they are configured integrally with other functions. As a result, the operation support device can be realized at a lower cost as a whole.

  The operation of this embodiment will be described.

  Based on the information about the type of information input / output and the connection status of the information between the controlled devices collected in the multifunction function information storage means, the composite function information search means performs the function combination between the controlled devices. By searching for useful functions and presenting them to the operator, functions realized by combining a plurality of devices can be presented to the operator in addition to the operation interface for each device. As a result, the operation using a plurality of devices, which has been complicated in the past, can be realized without placing a mental burden on the operator.

  Further, in the operation support device, the information format compatibility judging means judges the compatibility of the type of information passed to and from the controlled device, and if necessary, the information format conversion means receives from the controlled device. By converting the format of the information to be passed and transferring the information, even if the formats of the information handled by the connected devices are different from each other, this is matched and the combined function is realized. It will be possible.

  Also, fault diagnosis knowledge storage means for holding a collection of diagnoses and countermeasures corresponding to the assumed fault states, and fault diagnosis search means for searching for diagnoses and countermeasures from the fault diagnosis knowledge storage means in response to operator input With the function, the failure status is diagnosed based on both the failure status of the device and the user's judgment, and the diagnosis result is dealt with. As a result, the operator can diagnose and deal with the failure of the device without relying on the instruction manual.

  Information for exerting the above actions can be divided into a general part related to the operation interface and information related to the purpose of use, function or failure analysis specific to each device. Of these, a mechanism for collecting information unique to each device is realized by a combination of an operation information medium reader and operation information storage means, or an operation information storage device. In contrast to conventional operation support devices that did not know the purpose of operation of the controlled device and the possibility of linking operation with other devices, the operation interface for using the controlled device more effectively. Can be provided.

  A first embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a schematic configuration diagram of an operation support apparatus according to the present embodiment. The multi-function information storage unit 5 holds a list of functions that can be realized by passing information between a plurality of devices for devices (controlled devices) that are targeted for operation support by the operation support device. The interconnection management means 7 manages the input / output state of information between the devices that are supported by the operation support device and the information input / output state between the controlled device and the operation support device. The connection information is given to the composite function information search means 4. The composite function search means 4 searches for a realizable function from the composite function information given by the composite function information storage means 5 and the interconnection information given by the interconnection management means 7. The dialogue management means 3 performs a dialogue with the user via the function presentation means 1 and the function designation means 2. The function presenting means 1 presents a possible composite function searched by the composite function information searching means 4 to the operator by a screen display device such as a TV screen or output by voice, and the function designating means 2 responds to this. When there is a plurality of execution methods, whether the function is executed or not, the operator designates a selection from among them, and buttons and a touch panel can be used. The function execution unit 6 has a function of executing the function determined from the dialogue management unit 3. Accordingly, means for performing communication with the controlled device, means for giving a command to the controlled device via this communication, and the like are included in the function execution means 6.

  Hereinafter, the operation of the operation support apparatus according to the present embodiment will be described more specifically. FIG. 2 a is an example of information stored in the composite function information accumulating means 5. In this, composite functions are stored in a form in which a certain function is associated with a set of an information source and its output format. This information may be prepared in the operation support device, or may be supplied in the form described in another embodiment of the present application for each controlled device. In addition to this, it is also possible for the operator to set it separately. Further, information about the nature of information handled by each controlled device shown in FIG.

  Information managed by the interconnection management means 7 is, for example, as shown in FIG. Here, what is connected as a controlled device and the connection state of signals between them are obtained. The signal input / output status between devices is managed by a set of output devices and terminals, and input devices and terminals. This is done for all connections between devices. It is desirable to manage the connection status automatically on the system side due to ID transmission and connector shape restrictions. However, if the controlled device does not support this, it can be manually input at the time of installation. Is possible. In response to the operator's request, the composite function information search means 4 searches for a composite function that can be realized by the system based on such information.

For example, when the function “print” is selected on the operation support device during playback of a still image on the VTR, it is assumed that the VTR alone has no function for making a hard copy. At this time, if you search for composite functions related to video image printing, the section "Video tape-> hard copy, video printing" applies. In addition, from information about individual devices,
VTR: Videotape → out1 {Video}
VP (video printer): in1 → hard copy {video}
In addition, VTR / out1 → VP (video printer) / in1 information is obtained from the connection information, and from this information, the playback image of the video tape can be hard-copy output by the video printer through the connection path from the VTR to the video printer. It is judged that there is.

  The dialogue management means 3 obtains this information from the composite function information retrieval means 4 and requests the function presentation means 1 for operator confirmation. Display the message “Do you want to output to a video printer?” On the screen and request operator confirmation. More generally, a plurality of routes and methods may be applicable as a result of the search, but a list is displayed on the screen and a function is selected according to the operator's designation.

  In this way, the functions that cannot be executed by each device alone are accumulated in the operation support device, and knowledge about each usage is accumulated, and the complex functions are presented to the operator accordingly. Can be used.

  Next, a second embodiment of the present invention will be described with reference to the drawings. FIG. 3 is a schematic configuration diagram of the operation support apparatus of the present embodiment. In the figure, components having the same operations as those of the first embodiment are denoted by the same reference numerals and description thereof is omitted. The information format determination unit 10 determines the type of information input to the operation support apparatus through the interconnection management unit 7 and sends it to the compatibility determination unit 9. Based on the interconnection information provided by the interconnection management means 7 and the information format provided by the information format determination means 10, the compatibility determination means 9 determines the input / output state of information via the operation support device. This includes the possibility of compatibility arising from information format conversion. Further, the information format conversion means 8 cooperates with the interconnection management means 7 and the function execution means 6 to convert the format of information input / output via the operation support device.

  Hereinafter, the operation of the operation support apparatus according to the present embodiment will be described more specifically. 4a and 4b are examples of information stored in the multi-function information storage means 5, and are the same as those in the first embodiment. The composite function information accumulating means 5 holds functions enabled by the combination of devices in this way. Also, the information managed by the interconnection management means 7 shown in FIG. 4c is almost the same as that shown in the first embodiment, but in this example, the connection between the operation support device (CS) and the device is performed. The point that is added is different.

  FIG. 5 shows information managed by the compatibility determination means 9, which is a feature of this embodiment. It is managed whether or not the information format conversion means 8 is capable of mutual conversion between combinations of information to be input and output. The information format determination means determines the type of information input or output to the operation support apparatus by analyzing the knowledge given in advance or the input information itself, and transmits this to the compatibility determination means 9. For information given as digital data such as text information, a more detailed information format can be set by analyzing the information itself. Based on the knowledge shown in FIG. 5, the compatibility determination means 9 informs the multifunction function information search means 4 of the possibility of conversion between information formats.

  For example, regarding the printing of a video signal, it can be understood that it is possible to mutually convert between the G3 FAX format. When this information is used in the multi-function information search means 4, it can be seen from the already given information that the VTR video signal can be printed by two methods. One is a method of outputting a hard copy by a video printer through a connection path from the VTR to the video printer as in the first embodiment, and the other is information on the format of the video signal input from the VTR to the operation support device. Is converted to a FAX format by the information format conversion means 8 and then output to a FAX, which is printed using the capability of FAX hard copy.

  Based on this search result, the dialogue management means 3 requests the function presenting means 1 for operator confirmation. As shown in FIG. 6, possible methods are presented to the operator, and the operator is requested to select which method. Here, when the operator selects “use FAX” and gives an instruction to execute printing, the function is executed by the function execution means 6. The information from the VTR is received by the operation support device, and the information format conversion means 8 converts the information format from the video signal to the FAX format, which is sent to the FAX machine for printing. In this way, the functions that cannot be executed by each device alone are accumulated in the operation support device, and knowledge about each usage is accumulated, and the complex functions are presented to the operator accordingly. Can be used. In addition, by providing an information format conversion function, it is possible to realize a combined operation of devices between devices having different information input / output formats.

  In the above embodiment, the type of information to be handled is shown as an example of a video signal, but it is also possible to handle voice and text data in the same way. For example, when a speech synthesizer is connected, text can be converted into speech using it and sent to the telephone line, or the format of information such as an address book can be determined and used between devices. It is possible to provide functions such as sharing with a simple operation interface.

  In this embodiment, all the searched functions are displayed. However, when there are many possibilities of realizing the same function, it is not appropriate to present all to the operator, and the system side You need to choose a better method. For this purpose, it is possible to select the most appropriate realization method by the multi-function information retrieval means by assigning a score such as cost and quality to each individual function of the system and using it for evaluation. . In this case, as in the example shown in this embodiment, the cost is advantageous when output by FAX, and the quality is good when output by a video printer. You can ask which one to choose. Furthermore, although the conversion of the information format is shown as being included in the function of the operation support device, it can be configured as another device, and one of the target devices has this conversion function. Also good.

  Next, a third embodiment of the present invention will be described. FIG. 7 is a diagram showing a schematic configuration of the present embodiment. The lower electronic device in the figure diagnoses a failure of the target electronic device, and the upper operation support device diagnoses the failure of the target electronic device. The control means 18 has a function of performing system control of the electronic device. A predetermined operation is executed in response to an instruction given from the operation support device via the communication means 17 and an input of the operation unit or sensor of the electronic device itself. A microcomputer usually controls this function. The failure detection unit 20 is a sensor that detects an abnormal state of the device or hardware or software having a function of determining an abnormality based on information of the sensor. When an abnormality is detected, the state at the time of failure is stored in the failure state storage unit 19 by the operation of the control unit 18. The control means 17 communicates with the operation support device and other electronic devices. As long as digital data is available, wired communication or infrared or radio wave communication may be used.

  The communication means 16 on the side of the operation support device communicates with at least one electronic device, receives the status of the failure of the electronic device to be operated, and needs control of the electronic device as a countermeasure against the failure , Send a control signal. The failure diagnosis knowledge storage means 14 stores a set of knowledge about the failure status and the diagnosis and countermeasures for the electronic device to be operated. The failure diagnosis search means 13 outputs a failure diagnosis and countermeasure based on the failure status of the electronic device given from the communication means 16 and the failure diagnosis knowledge given by the failure diagnosis knowledge accumulation means 14. The dialogue management unit 3 performs dialogue with the operator via the failure countermeasure display unit 11 and the input unit 12 based on the failure diagnosis output by the failure diagnosis search unit 13. The failure countermeasure display means 11 has the ability to present to the operator a method for dealing with the failure, such as a graphic screen of a TV or the like, output by sound, etc., or to request the operator for information that is insufficient in judgment. is there. The display device can be provided in the operation support device itself, or the operation support device itself has only the ability to output to the screen of the television receiver, and another device can be used as the display device. The input means 12 gives an operator's intention such as buttons and a keyboard to the operation support device. Regarding the input means, it is possible to use a case where the operation support apparatus itself includes this, and a remote instruction device such as a remote controller. The fault countermeasure execution means 15 executes the countermeasure determined by the dialogue management means 3 and the fault diagnosis search means 13. This countermeasure is transmitted to the electronic device via the communication means 16.

  Next, the operation of the present embodiment will be described more specifically. Here, a microwave oven is assumed as a target electronic device, and a case where a failure occurs in the microwave oven is shown as an example. First, when any failure occurs on the electronic device side, for example, when an abnormal rise in the internal temperature is detected, the failure detection means 20 and the control means 18 cause the internal state of the device at the time of the failure to be a failure status storage means. 19 is recorded. This internal state includes the state of the device detected by the sensor, the operation sequence before and after the occurrence of an abnormality, the occurrence time, and the like. The control means 18 displays the occurrence of abnormality using a display means (not shown). The operator knows the failure of the electronic device from the malfunction of the device, an indicator, etc., and selects “diagnosis of microwave oven failure” from the processing menu of the operation support device. The contents of the processing menu are stored in the fault diagnosis knowledge storage means 14 and are displayed by the fault countermeasure display means via the fault diagnosis search means 13 and the dialog management means 3, and the operator makes a selection using the input means 12. . When the failure diagnosis menu is selected, the operation support device makes an inquiry about the failure status to the target electronic device (in this case, the microwave oven) via the communication means 16. The electronic device receives an inquiry from the operation support device from the communication unit 17, the control unit 18 extracts the abnormal state from the failure state storage unit 19, and communicates the failure state to the operation support device again through the communication unit 17. On the side of the operation support device, the fault diagnosis search means 13 searches for a necessary part from the fault diagnosis knowledge storage means 14 based on the fault status, and the fault countermeasure display means 11 displays this. For example, in this case, two causes, “the vent is blocked” or “control circuit abnormality”, are stored in the fault diagnosis knowledge accumulating means 14 together with the countermeasures as the cause of the situation “abnormal rise in the internal temperature”. Has been. The dialogue management unit 3 organizes the information given from the failure diagnosis search unit 13 and outputs information for prompting the operator's judgment to the failure countermeasure display unit 11. This is, for example, a screen as shown in FIG. 8 and inquires about the situation around the device that cannot be determined from the state of the sensor and the system. As a result, the cause of the failure can be identified and countermeasures can be taken in consideration of the operator's judgment. If the operator recognizes that there is no sufficient margin around the device, the operator presents the necessary margin around the device based on the knowledge stored in the fault diagnosis knowledge storage means 14 and requests a response. As another case, when it is found that some kind of response is necessary on the device side, the failure countermeasure execution means 15 directly controls the electronic device via the communication means to recover the failure.

  Next, a fourth embodiment of the present invention will be described. FIG. 9 is a diagram showing a schematic configuration of the operation support apparatus of the present embodiment. Since some of the components in the present embodiment are common to the third embodiment, common portions are denoted by the same reference numerals and description thereof is omitted. In FIG. 9, the failure diagnosis request sending means 22 requests the operation support device to make a diagnosis via the communication means 17 when the failure detection means 20 detects the failure and the electronic device control means 18 cannot make a judgment. . The fault diagnosis request receiving means 21 of the operation support device receives a diagnosis request from the fault diagnosis request transmitting means 22 of the electronic device and requests an interruption to the dialog management means 3.

  The operation of this embodiment will be described below. As in the third embodiment, the microwave oven is the electronic device to be controlled. When the electronic device detects a failure by the failure detection means 20, the control means 18 records the failure status and internal state in the failure status storage means 19. Further, along with this, the fault diagnosis request sending means 22 sends a fault diagnosis request to the operation support device via the communication means 17. The contents of this communication include a signal that identifies the source device and the failure status stored in the failure status storage means 19.

  In the operation support device that has received this fault diagnosis request via the communication means 16, the fault diagnosis request receiving means 21 determines this request and requests an interruption to the dialog management means 3.

  Upon receiving this interrupt request, the dialog management means 3 displays that an abnormality has occurred in a specific electronic device on the display device of the device being operated by the operator, and that the operator is required to respond. For example, if it is determined from the time sequence of operations that the operator is watching TV, and a diagnostic operation is possible on the TV screen, the operator can interrupt the receiving TV screen as shown in FIG. Request action. After the operator enters the diagnosis process accordingly, the diagnosis work proceeds as in the third embodiment, and measures are taken. Unlike the case of the third embodiment, when the failure diagnosis request is issued from the electronic device, the failure state is communicated, and the operation support device grasps the state. The process of making an inquiry and responding to the electronic device is not performed.

  In the third and fourth embodiments described above, when a failure occurs, the means for indicating the occurrence of the failure to the operator is the display device of the electronic device itself in which the failure has occurred or the operation support device. However, these can be used at the same time to enhance the effect. If the electronic device that the operator is interested in cannot be identified from the operation sequence, etc., and the degree of urgency of the failure that occurred is high, a warning can be issued using the display device of multiple electronic devices. If the degree is low, it is possible to hold it until there is an inquiry from the operator.

  In the third and fourth embodiments, only the operation support apparatus and the controlled electronic device communicate with each other via communication means, and the actual form of the communication is not described in detail. However, this indicates that the present invention is applicable regardless of the means for realizing communication. In the case of a composite device in which the operation support device and the electronic device to be controlled are integrally formed, communication for operation support can be realized by inexpensive means such as serial communication between control microcomputers, and the operation is optimized using a unique protocol. There is an advantage that can be realized. This form is applicable to an audio component or the like. In addition, a configuration in which the operation support device is configured as an independent device and communicates with an external device via a wired or wireless communication network can be realized based on various communication standards such as a home bus standard. In this case, there is an advantage that a function for operation support and a device for display and input can be concentrated on one device.

  Next, a fifth embodiment of the present invention will be described. FIG. 11 is a diagram showing a schematic configuration of the operation support apparatus of the present embodiment. In FIG. 11, the display means 23 and the input means 24 are portions that are direct contact points with the operator, and the display means 23 outputs to the television screen in the form of a display screen or graphic display that displays the operation interface. It is sufficient to have a function to The input unit 24 works for the purpose of inputting the operator's intention in response to the operation request presented by the display unit 23, and any form of implementation such as an operation button or a remote control on the operation support device main body may be used. The dialogue management means 3 manages the flow of processing for requesting provision of information to the operator and input of the will of the operator via the display means 23 and the input means 24.

  The operation information accumulating unit 27 stores knowledge about how to use an electronic device to be operated by the operation support device. The information stored here includes information on usage that links the functions of the equipment and the purpose of use, information on the analysis and response to equipment abnormalities and troubles, and input to the operator by presenting them to the operator. This is information on the screen interface for requesting. Since this operation information storage means requires a large capacity, a storage device capable of recording with a large capacity such as a magnetic disk or an optical disk is suitable. However, a semiconductor memory may be used in combination for improving the processing speed. This operation information is read from the operation information medium reader 26. This operation information medium reader is typically a CD-ROM drive, and is an apparatus capable of reading a medium in which operation information as described above is digitally recorded. The operation information medium read here is a digital recording medium such as a CD-ROM, and is supplied with each electronic device. In addition, operations performed across a plurality of devices can be supplied using only operation information. The operation information medium reading device may be a floppy (registered trademark) disk drive or a means for communication through a telephone line depending on the type of medium provided.

  The operation interface execution unit 25 generates and executes a device operation interface using the display unit 23 and the input unit 24 based on the operation information of each device stored in the operation information storage unit 27. The device-related communication unit 28 performs control-related communication with the device to be controlled, and acquires the device state and executes the operation according to the request from the operation interface execution unit 25.

  Hereinafter, the operation of the operation support device of this embodiment will be described. The operation of the present embodiment is divided into two parts: operation support and handling of an operation information medium. First, the operation is executed in the following steps. The operation interface execution means 25 generates an operation screen according to the state of the device and the operation flow at that time. This screen is, for example, a main screen that displays a list of devices to be controlled at startup, and a failure diagnosis screen. The dialogue management means 3 organizes the flow of information between the operation interface execution means 25, the display means 23 and the input means 24. The display means 23 outputs the generated screen to the operator. This screen includes a menu for executing the operation, an icon to be selected, a confirmation button, and the like. Next, the operator inputs an operation intention using the input unit 24 in response to an inquiry given through the display unit 23. The actual operation depends on the selection of buttons on the remote control, pointing and selection using a tablet or touch panel. This input is processed by the dialog management means 3 and the processed result is sent as a command to the operation interface execution means 25.

  The operation interface execution means 25 performs necessary processing based on this command. If the command can be directly executed by the device, it communicates with the device to be controlled via the inter-device communication means 28 and executes control. In other cases, the operation interface execution means 25 searches for operation information corresponding to the command given from the operation information storage means 27 and executes it. If the operation information is an operation screen, the process returns to the operation screen generation step. If the operation information is device control, the control information is sent to the device via the inter-device communication means 28 to execute control or acquire the status. To do. By repeatedly performing the operations described above, the execution of the operation by the operation support apparatus of the present embodiment proceeds.

  Next, the operation information accumulation flow will be described. The operation information is given in the form of software in which the operator's purpose of using the device is specified through the dialogue with the operator as described above and the knowledge for performing the operation is described. This operation information is typically provided by a medium capable of recording / reproducing digital data such as a CD-ROM, and stores information related to a manual and an operation interface attached to each electronic device. Operation information includes information that handles multiple functions by linking multiple devices. However, information on complex functions that do not depend on individual devices may be provided in the operation support device in advance or part of the combined functions. Supplied with the equipment. It is also possible to supply functions that are predefined complex functions and protocols are determined separately from the devices. When a new device is introduced, an operation information medium storing operation information related to the new device is placed on the operation information medium reader 26 and read according to the menu of the operation support device. The read operation information is stored in the operation information storage means 27.

  In FIG. 12, the external view of a present Example is shown.

  A CD-ROM drive 101 for reading a CD-ROM 103 as an operation information medium is provided as operation information reading means, and a remote control 102 provided with a key for screen cursor control is provided as input means. A terminal (not shown) is provided on the back surface, and this includes a terminal for outputting video and audio to another display device, and a terminal for communicating with a controlled object. According to this embodiment, there is an advantage that an operation information medium attached to each device can be manufactured at a relatively low cost.

  Next, a sixth embodiment of the present invention will be described. FIG. 13 is a diagram showing a schematic configuration of the operation support apparatus of the present embodiment. Since some of the components in the present embodiment are common to those in the fifth embodiment, common portions are denoted by the same reference numerals and description thereof is omitted. The operation information medium storage means 29 has the same effect as that exhibited by the combination of the operation information medium reading device and the operation information storage device in the fifth embodiment. In this embodiment, the operation information is supplied for each device to be controlled and is recorded on a medium capable of storing digital information. Unlike the fifth embodiment, the operation information medium is always stored in the operation information medium storage means 29. Typically, it is supplied in the form of a ROM cartridge. Therefore, the operation information medium storage means 29 is configured as a slot capable of storing this cartridge. FIG. 14 shows one embodiment of the operation information medium storage means. In the implementation shown in FIG. 14, the operation information is supplied in the form of a memory card 105, and the operation information medium storage means is a memory card slot 104 that can store this memory card. As many slots as the number of models for which the operation support device supports the operation are necessary, and it is necessary to provide enough slots. By adopting a bus format and providing an address for each card, the operation support device can recognize the newly introduced device simply by inserting the card.

  As another form, a daisy chain type operation information medium storing means as shown in FIG. 15 is also possible. In this format, each of the memory cards 105 includes an input terminal and an output terminal. The output terminal of the first card is connected to the memory card terminal 106 of the operation support device, and the second and subsequent cards are sequentially inserted into the input terminals of the previous card for connection. By using this method, it is possible to avoid unnecessary installation of hardware in order to provide a sufficient number of slots in advance in the operation support apparatus.

  Next, a seventh embodiment of the present invention will be described. FIG. 16 is a diagram showing a schematic configuration of the operation support apparatus of the present embodiment. Since some of the components in the present embodiment are common to those in the fifth embodiment, common portions are denoted by the same reference numerals and description thereof is omitted. The operation information storage means 30 has the same function as that exhibited by the combination of the operation information medium reading device and the operation information storage means in the fifth embodiment, and its implementation form is not limited here. The document management means 31 and the document input means 32 fulfill the functions of a normal word processor. Among these, the document input means 32 has a function of creating and shaping a document composed of characters and pictures using the input means 24, and the document management means 31 stores and reads out the document. These are constructed using conventional techniques used in ordinary word processors.

  Since the display means 23 and the input means 24 are used as both a component that performs the operation support function and a component that performs the document processing function, a switching means 33 is provided for controlling the operation flow. One of the keyboards of the input means 24 is used as a switch for switching, and each time this key is pressed, the display means 23 and the input means 24 are switched between the operation support function and the document creation function.

  Regarding the operation of this embodiment, the flow of the operation support portion is almost the same as that shown in the fifth embodiment, and the document processing function portion is the same as that known in the prior art. . The operation of the switching means 33 will be mainly described.

  FIG. 17 is a diagram illustrating an image of a usage state of the operation support apparatus of the present embodiment. In FIG. 17, 107 is an operation support device that also serves as a notebook word processor, 108 is a remote control transmitter / receiver for operation support (corresponding to an inter-device communication device) connected thereto, and 109 is a device to be controlled. The document storage disk drive can be used as it is as an operation information medium reader of an operation support function, and a display and a keyboard can be used as display means and input means. As shown in the figure, communication with the control target device may be performed via a dedicated remote control signal transmitter / receiver, or a form of direct communication with the target device is possible.

  Advantages obtained by configuring the operation support device in this way are as follows. The operation support function and the document processing function share most of the necessary components, and both can be used in a time-sharing manner. Therefore, by configuring them together as an integrated device, waste on the components is reduced. Moreover, the frequency of use can be increased as a whole, and the device can be used effectively.

  Next, an eighth embodiment of the present invention will be described. FIG. 18 is a diagram showing a schematic configuration of the operation support apparatus of the present embodiment. Since some of the components in the present embodiment are common to those in the fifth embodiment, common portions are denoted by the same reference numerals and description thereof is omitted. In FIG. 18, a television broadcast receiving means 34 includes an antenna terminal, a television tuner, a channel selecting means, etc., and outputs a video signal to the overlay means 35 with the same configuration as the elements constituting a normal television receiver. Is. The display means 23 outputs the same video signal as the television broadcast receiving means 34 in this embodiment. The television monitor 38 receives a video signal and outputs it to a display device such as a CRT or a liquid crystal panel. Similar to the seventh embodiment, in the present embodiment, two different functions of the device operation support function and the television broadcast receiving function are integrally configured, and means for using these two functions is necessary. In this embodiment, this switching is performed by means for selecting a television channel. By assigning a mode for executing the operation support function to one of the TV channels or input switching, the operation support function can be called in a simple manner.

  The overlay unit 35 combines the screen of the operation interface output from the display unit 23 and the screen output from the television broadcast receiving unit 34. Since the operation interface of the TV itself is also supported by the operation support function, it is necessary to watch the TV screen and the operation screen at the same time. Furthermore, by providing the overlay means 35 with a television small screen function, the operation screen and the television broadcast can be viewed simultaneously as shown in FIG.

  As described above, various effects can be obtained by configuring a device that supports the operation.

  First, there is an advantage that the operation of the device is concentrated from one operation support device. Collecting the functions of devices that exhibit multiple partial functions by storing information related to connected devices and generating a composite function operation interface from this information to provide more advanced functions I can do it. In particular, paying attention to the flow of information between devices and providing means for managing input / output of information enables the sharing and effective use of information between devices centered on image and audio information. Furthermore, by providing information format conversion means, it is possible to handle a variety of information including text and data, and to easily operate by generating an interface for operating this from the functions of each device. I can do it.

  When a failure occurs in a device, the failure detection means provided in the device and the judgment of the human operator are diagnosed by providing a means for diagnosing the failure through dialogue with the operator. I can do it. Furthermore, by providing a function for requesting diagnosis to the operation support device from the device to be controlled, it becomes possible to perform quick processing even in an emergency.

  The above effects cannot be realized unless the operation support device has knowledge about the operation method and purpose of use of the device to be controlled, knowledge about fault diagnosis, and the like. A solution to this is a means for reading or storing a medium on which operation information is recorded. A method for aggregating operation information for multiple devices and recording information related to the operation of each device has been established, and by providing an interface execution means for executing the interface accordingly, various devices can be operated with a unified interface. Become.

  Also, by configuring the components that make up the operation support function together with the elements that make up the other functions, common components can be shared, and operation support equipment can be configured at low cost as a whole. .

  In the present invention, there is an advantage that the operation of the device is concentrated from the operation support device. By providing information format conversion means, it is possible to handle various types of information including text and data, and it is possible to operate easily by generating an interface for operating this from the functions of each device. .

Schematic configuration diagram of the first embodiment The figure which shows the information handled by the 1st Example Schematic configuration diagram of the second embodiment The figure which shows the information handled by 2nd Example The figure which shows the compatibility information handled by 2nd Example The figure which shows the example of the screen display of 2nd Example Schematic configuration diagram of the third embodiment The figure which shows the example of the screen display of 3rd Example Schematic configuration diagram of the fourth embodiment The figure which shows the example of the screen display of 4th Example Schematic configuration diagram of the fifth embodiment External view of the fifth embodiment Schematic configuration diagram of the sixth embodiment The figure which shows the structural example of the operation information storage means of 6th Example. The figure which shows another structural example of the operation information storage means of 6th Example. Schematic configuration diagram of the seventh embodiment Image of using the seventh embodiment Schematic configuration diagram of the eighth embodiment Image of use of the eighth embodiment

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Function presentation means 2 Function designation | designated means 3 Dialog management means 4 Compound function information search means 5 Compound function information storage means 6 Function execution means 7 Interconnection management means 8 Information format conversion means 9 Compatibility determination means 10 Information format determination means 11 Failure Countermeasure display means 12 Input means 13 Fault diagnosis search means 14 Fault diagnosis knowledge storage means 15 Fault countermeasure execution means 16 Communication means 17 Communication means 18 Control means 19 Fault status storage means 20 Fault detection means 21 Fault diagnosis request reception means 22 Fault diagnosis request Transmission means 23 Display means 24 Input means 25 Operation interface execution means 26 Operation information medium reader 27 Operation information medium storage means 28 Inter-device communication means 29 Operation information medium storage means 30 Operation information storage means 31 Document management means 32 Document input means 33 Switching means 34 Television broadcast receiving means 35 Barei 36 TV monitor 101 CD-ROM drive 102 remote controller 103 documentation disc 104 memory card slot 105 a memory card 106 for the memory card terminal 107 operation support apparatus 108 remote control transceiver 109 control target device

Claims (3)

A device operation support apparatus that communicates with a plurality of devices and provides an operation interface for integrating and using the functions of the plurality of devices,
A composite function information storage means for holding a list of functions that can be realized by integrating the functions of at least two or more devices;
Information format determination means for determining an expression format of information input / output between the device operation support apparatus and the device;
Information format conversion means for performing mutual conversion between combinations of two information formats input and output between a plurality of devices;
Information format compatibility determination means for determining the possibility of interconnection of a plurality of devices from the input / output information format given by the information format determination means and the conversion capability of the information format conversion means,
Composite function information search means for searching for an effective function from the composite function information held in the composite function information storage means and possible connection information given by the information format compatibility determination means;
Function presenting means for presenting the retrieved function;
A function designating means for designating a specific function from the presented functions;
A device operation support apparatus comprising: function execution means for instructing execution of a function designated by the function designation means. The apparatus further comprises an interconnection management means for managing a connection state between the equipment operation support apparatus and the equipment, and the information format compatibility determination means further connects the equipment to the equipment operation support apparatus obtained by the interconnection management means. The apparatus operation support apparatus according to claim 1, wherein the possibility of mutual connection of a plurality of apparatuses is determined based on the state of the apparatus. A device operation support method for communicating with a plurality of devices and providing an operation interface for integrating and using the functions of the plurality of devices,
An information format determination step for determining an expression format of information input / output between the device operation support apparatus and the device;
An information format conversion step for performing mutual conversion between combinations of two information formats input / output between a plurality of devices;
An information format compatibility determination step for determining the possibility of interconnection of a plurality of devices from the input / output information format given by the information format determination step and the conversion capability of the information format conversion means;
Effective from the composite function information held in the composite function information storage means that holds a list of functions that can be realized by integrating the functions of at least two devices and possible connection information given by the information format compatibility determination step Multiple function information search step to search for various functions,
A function presenting step for presenting the retrieved function;
A function designating step for designating a specific function from the presented functions;
And a function execution step for instructing execution of the function specified by the function specifying means.

Images