JP2011150606A - Apparatus operation system, operation terminal, apparatus to be operated, apparatus operation method, apparatus operation program, and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a GUI having uniformity between apparatuses to be operated while suppressing mounting costs. <P>SOLUTION: An apparatus operation system 100 includes an operation terminal 1 and an apparatus 2 to be operated which is connected to the operation terminal 1 via a network. A communication part 21 in the apparatus 2 to be operated transmits controlled side GUI material data whose data volume is increased as the versatility of functions of the apparatus is lower. In the operation terminal 1, GUI configuration interpretation parts 12a to 12c generate function-based GUI configuration data expressing the GUI by using information received from the apparatus 2 to be operated and the operation side GUI material data whose data volume is increased in proportion to the versatility of the functions, and a GUI configuration part 13 generates the GUI by using the function-based GUI configuration data. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a device operation system in which an operation terminal operates one or more operated devices connected via a network.

  In recent years, there has been a demand for a system in which a plurality of devices in a home are connected to a network and the plurality of devices are collectively operated through an operation terminal that is the center of the network. In such a system, for example, when a television is used as an operation terminal, a graphic user interface (GUI) for operating a connected device is displayed on the television screen, and a user operation is performed by a television remote control device. The device is controlled by inputting.

  However, there are many types of devices connected to the network, and models with new functions appear over time. In addition, these connected devices differ greatly in operability in order to make the characteristics of each device. For this reason, it is difficult to prepare a GUI for all devices that may be connected on the operation terminal side, and the mounting cost is biased toward the operation terminal side, which is not practical.

  Therefore, Patent Document 1 discloses a technique in which an operated device connected to a network transmits a GUI corresponding to the device itself, and the operation terminal receives and displays the GUI.

  Patent Document 2 discloses a technique in which the operation terminal constructs a GUI for operating the operated device from the operated device information acquired from the operated device and a template corresponding to the operated device. Has been. According to the technique disclosed in Patent Document 2, the operation terminal can dynamically provide a GUI by selecting a template corresponding to each operated device.

JP 2000-333269 A (published on November 30, 2000) JP 2007-114888 A (published on May 10, 2007)

  However, Patent Documents 1 and 2 have the following problems.

  First, in Patent Document 1, all GUIs are configured on the operated device side. For this reason, since the GUI displayed on the operation terminal is different for each device, it lacks uniformity and the operability is degraded.

  Moreover, in patent document 2, the operation terminal must prepare all the templates corresponding to a to-be-operated apparatus. For this reason, for a GUI for an extremely simple operation (startup control or the like) of the operated device, an excessive mounting cost for constructing it is required.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to provide a device control system capable of providing a GUI in which operation terminals have uniformity while suppressing mounting costs in the operation terminals and operated devices. Is to provide.

  In order to solve the above problems, an apparatus operating system according to the present invention is an apparatus operating system including an operation terminal and an operated apparatus connected to the operation terminal through a communication network and operated through the operation terminal. The operated device transmits the function information related to the function operable in the operated device to the operation terminal, and the function required for generating a graphic user interface for operating the function. The operation side GUI material data having a larger amount of data the lower the versatility of is provided with transmission means for further transmitting to the operation terminal when the versatility is lower than the maximum, Receiving means for receiving the function information and the operated-side GUI material data, the function information, and the graphic user interface The operation side GUI material data having a larger amount of data as the versatility of the function required for generating the case is at least used, and when the operated side GUI material data is received, the operated side GUI Generating means for generating functional GUI configuration data representing the graphic user interface using material data; and GUI generating means for generating the graphic user interface using the functional GUI configuration data. It is a feature.

  In the above configuration, the function information related to the functions that can be operated on the operated device is classified into arbitrary stages based on versatility. According to the above configuration, the graphic user interface for operating the function is configured such that the operated device is more dominant as the versatility of the function is lower. On the other hand, the higher the versatility of the function, the more the operation terminal is configured.

  Therefore, even when the operation terminal operates various operated devices, it is possible to make the GUI provided by the operation terminal uniform while suppressing the implementation cost of the operation terminal and the operated device. Further, in the device operation system according to the present invention, it is possible to flexibly expand the operated device to be connected and its operation function.

  In the device operation system according to the present invention, the operated device has a plurality of the functions having different versatility, and the GUI generation unit generates each of the functions generated for each function. It is preferable to generate one operation screen including all the graphic user interfaces for each function by using a combination of different GUI configuration data.

  According to the above configuration, graphics for various operation functions can be displayed together on one GUI screen.

  In the device operating system according to the present invention, it is preferable that the generation unit includes a plurality of individual generation units individually corresponding to any one of the plurality of different versatility.

  For example, even if it is not possible to pay the implementation cost for all the generation means in the operation terminal and the operated device, more basic functions can be realized if they are installed in order of higher versatility. Therefore, according to the above configuration, since the division according to the high versatility is provided, it is easy to prioritize the mounting.

  Further, in the device operating system according to the present invention, the operated device is more versatile for the operated side GUI material data necessary for generating a graphic user interface for operating the function. It is preferable to further include generating means for generating the data amount so that the lower the data amount is.

  According to the above-described configuration, the operated-side GUI material data can be appropriately generated as necessary for a function that is particularly low in versatility.

  In the device operation system according to the present invention, the most versatile function may be at least one of a power supply operation function and a status display function.

  In the device operating system according to the present invention, the function having the lowest versatility may be a function unique to the operated device.

  An operation terminal according to the present invention is an operation terminal for operating an operated device connected through a communication network, and obtains function information related to a function operable in the operated device and operates the function. Obtaining means for further obtaining the operated-side GUI material data required for generating a graphic user interface, wherein the lower the versatility of the function is, the larger the amount of data is, when the versatility is lower than the maximum; , Using at least the function-side GUI material data required for generating the graphic user interface and the operation-side GUI material data having a larger amount of data as the versatility of the function is higher, and receiving the operated-side GUI material data The graphic user interface using the operated-side GUI material data. Generating means for generating to Functional GUI configuration data, by using the function-specific GUI configuration data, it is characterized by and a GUI generation unit for generating the graphical user interface.

  According to the said structure, an appropriate operation terminal can be implement | achieved in the above-mentioned apparatus operation system.

  Further, an operated device according to the present invention is an apparatus operating system including an operating terminal and an operated device connected to the operating terminal via a communication network and operated through the operating terminal. In order to generate a graphic user interface for operating the function while the functioning device transmits function information about the function operable by the operated device to the operation terminal. A transmission step of further transmitting the operated-side GUI material data, which requires a larger amount of data as the required versatility of the function is lower, to the operation terminal when the versatility is lower than the maximum, and the operation terminal Receiving the function information and the operated-side GUI material data, and the operation terminal includes the function information and the operation information. If at least the operation-side GUI material data required for generating a rough user interface is used and the operation-side GUI material data having a larger amount of data is received and the operation-side GUI material data is received, the operation target A generating step of generating GUI function data by function representing the graphic user interface using the side GUI material data, and a GUI generating step of generating the graphic user interface by the operation terminal using the GUI setting data by function It is characterized by having.

  According to the said method, there exists an effect similar to the apparatus operating system which concerns on this invention.

  Further, the device operation system may be realized by a computer. In this case, a device operation program for realizing the device operation system in the computer by operating the computer as each of the above means and a computer-readable recording medium recording the device operation program are also included in the scope of the present invention.

  An apparatus operation system according to the present invention is an apparatus operation system including an operation terminal and an operated apparatus that is connected to the operation terminal through a communication network and is operated through the operation terminal. The amount of data required to transmit the function information related to the function operable in the operated device to the operation terminal and to generate a graphic user interface for operating the function is lower as the function is less versatile. If the versatility is lower than the maximum, the operation side GUI material data is further provided to the operation terminal, and the operation terminal includes the function information and the operation side GUI. Receiving means for receiving material data, the function information, and the graphic user interface necessary for generating the graphic data If the operation side GUI material data is received at least, the graphic data using the operated side GUI material data is also used when the operated side GUI material data is received. Since it comprises a generating means for generating function-specific GUI configuration data representing a user interface and a GUI generating means for generating the graphic user interface using the function-specific GUI configuration data, the operation target can be reduced while suppressing the mounting cost. A GUI having unity between devices can be provided.

It is a block diagram which shows the principal part structure of the apparatus operating system which concerns on one Embodiment of this invention. It is a figure which shows an example of the operation function in the to-be-operated apparatus classified into each general purpose level. (A) is a figure for demonstrating the GUI screen structure method, (b) is a figure which shows the example of a GUI screen structure. (A) is a figure for demonstrating the GUI screen structure method, (b) is a figure which shows the example of a GUI screen structure. It is a flowchart which shows an example of the flow of the apparatus control process in the said apparatus operation system.

  An embodiment of the present invention is described below with reference to the drawings.

(Control system configuration)
First, a device operation system 100 according to the present embodiment will be described below with reference to FIG.

  FIG. 1 is a block diagram illustrating a main configuration of a device operation system 100 according to the present embodiment. As shown in FIG. 1, the device operation system 100 includes an operation terminal 1 and operated devices 2 and 3. In the present embodiment, the operated devices 2 and 3 are used as specific examples for explanation, but the number of operated devices included in the device operating system 100 is not limited, and more operated devices are included. It may be connected to the operation terminal 1.

  The operation terminal 1 and the operated devices 2 and 3 are configured to be able to transmit and receive various data to each other through wired and / or wireless communication. Examples include communication standards such as HDMI CEC (HDMI is a registered trademark), Ethernet (registered trademark), and ZigBee (registered trademark).

  The operation terminal 1 is preferably a device including a display device (for example, a liquid crystal display) and a user operation interface (for example, a remote control or a touch panel). For example, a digital television can be used. The user can input operation information for each of the operated devices 2 and 3 by operating a GUI (graphic user interface) provided by the operation terminal 1 via the user operation interface. The operation terminal 1 transmits the input operation information (or control command) to each of the operated devices 2 and 3, whereby each device can be remotely operated.

  The operated devices 2 and 3 have a function that can be operated by the user. In the following description, the term “function” simply means the above function in the operated devices 2 and 3.

  The operated devices 2 and 3 can be realized as various devices installed in a home, for example, and specifically include AV devices, air-conditioning devices, FAX, and home solar panels. Each of the operated devices 2 and 3 receives operation information (or a control command) transmitted from the operation terminal 1 and performs an operation corresponding thereto.

(Operation terminal 1)
The main configuration of the operation terminal 1 will be described below with reference to FIG.

  As shown in FIG. 1, the operation terminal 1 includes a user operation receiving unit 10, a communication unit 11 (11 a, 11 b,...), GUI configuration interpretation units 12 a to 12 c (generation means), and a GUI configuration unit 13 (GUI generation). Means), a GUI component storage unit 14, an OSD generation unit 15, a screen display unit 16, a video processing unit 17, an audio processing unit 18, and an audio output unit 19. The operation terminal 1 includes a user operation interface (not shown).

  The user operation reception unit 10 receives an operation signal transmitted from the user operation interface and transmits it to the GUI configuration unit 13.

  The communication unit 11 transmits and receives data between the operation terminal 1 and the operated devices 2 and 3 via an arbitrary communication unit. For example, the operation terminal 1 includes a plurality of communication units 11 (11a, 11b,... Corresponding to communication standards such as HDMI CEC (HDMI is a registered trademark), Ethernet (registered trademark), and ZigBee (registered trademark). ).

  The GUI configuration interpretation units 12a to 12c are based on the function information regarding the functions that can be operated in the operated devices 2 and 3 received via the communication unit 11, the operated-side GUI material data, the operated-side GUI material data, and the like. Then, function-specific GUI configuration data is generated. As will be described in detail later, in the present embodiment, the functions of the operated devices 2 and 3 are classified into levels A to C based on versatility, and the GUI configuration interpretation units 12a to 12c are Corresponding to each of levels A to C.

  Further, the GUI configuration interpretation units 12a to 12c generate communication data corresponding to a user operation and select an appropriate communication unit when a user operation is performed on the GUI.

  The GUI configuration unit 13 combines the function-specific GUI configuration data generated by each of the GUI configuration interpretation units 12a to 12c to generate a final GUI.

  The GUI component storage unit 14 stores operated-side GUI material data held on the operation terminal 1 side.

  The OSD generation unit 15 generates an OSD (On Screen Display) image based on the GUI. In addition, when there is a separate video other than the OSD image, a superimposition process for superimposing the GUI on the video signal output from the video processing unit 17 is performed.

  The screen display unit 16 displays the generated OSD image or the like, and includes a display device such as a liquid crystal display, for example.

  The voice processing unit 18 synthesizes the internal voice or voice information acquired from the communication unit 11 and outputs the voice from a voice output unit 19 (for example, a speaker).

  Note that the GUI configuration interpretation units 12a to 12c, the GUI configuration unit 13, the OSD generation unit 15, the video processing unit 17, and the audio processing unit 18 in FIG. 1 have a CPU (central processing unit) such as a ROM (read only memory). It is a functional block that can be realized by reading a program stored in a storage device into a random access memory (RAM) and executing the program.

(Operated equipment 2)
A schematic configuration of the operated device 2 will be described below with reference to FIG. In the following, for the sake of simplicity of explanation, the operated device 2 will be mainly described, but the same description can be applied to other operated devices.

  The operated device 2 includes a device control command processing unit 20, a communication unit 21 (21 a, 21 b,...), A GUI configuration generation unit 22 (device side generation means), and a GUI component storage unit 23.

  The device control command processing unit 20 performs internal processing according to the communication data transmitted from the operation terminal 1 and, as a result, reflects the user operation on the GUI of the operation terminal 1.

  Similar to the communication unit 11, the communication unit 21 transmits and receives data between the operation terminal 1 and the operated device 2 via an arbitrary communication unit. When a plurality of communication means with the operation terminal 1 are secured, a plurality of communication units 21 (21a, 21b,...) Corresponding to different communication standards may be provided.

  The GUI configuration generation unit 22 generates operated-side GUI material data necessary for generating a GUI for operating the above functions. As will be described in detail later, in the present embodiment, the functions of the operated device 2 are classified into levels A to C based on versatility, and the GUI configuration generation unit 22 is operated side GUI material. The data is generated so that the amount of data increases as the versatility of the function is lower.

  The GUI component storage unit 23 stores operated-side GUI material data prepared on the operated device 2 side.

  The device control command processing unit 20, the GUI configuration generation unit 22, the video processing unit 24, and the audio processing unit 25 in FIG. 2 are stored in a storage device such as a ROM (read only memory) with a CPU (central processing unit). This is a functional block that can be realized by reading a program stored in a RAM (random access memory) or the like and executing it.

  In addition, the member enclosed with the dotted line in FIG. 1 is not essential, and the to-be-operated apparatus 2 does not need to be provided with the GUI structure production | generation part 22, the GUI component storage part 23 grade | etc.,. When these are not provided, it is desirable that the operated device 2 is a device having only a highly versatile function, or includes a storage unit that stores the operated-side GUI material data in advance.

(Functions that can be operated on the operated device)
In the device operation system 100, the operable functions in the operated devices 2 and 3 are classified in advance into respective levels based on versatility.

  In the present specification, the term “universality” is not limited to the versatility between the operated devices 2 and 3 already provided in the device operating system 100, and various types of objects that the device operating system 100 may have in the future. It means the commonality of functions between operating devices (for example, home appliances). For example, “low versatility” means high device uniqueness.

  Below, the versatility level of the functions in the operated devices 2 and 3 will be described with reference to FIG. FIG. 2 is a diagram illustrating an example of functions in the operated devices 2 and 3 classified into each general-purpose level.

  In the present embodiment, as a specific example for explanation, the versatility level is divided into three levels A to C. Assume that level A is the most versatile level and level C is the least versatile level. As a specific example for explanation, it is assumed that the operated device 2 is a recorder manufactured by A company and the operated device 3 is an air conditioner manufactured by B company.

  As shown in FIG. 2, the operation functions in the operated devices 2 and 3 are classified into levels A to C on the basis of versatility.

  At level A, which is the most versatile, common household electrical appliances such as “power ON / OFF” (power operation function) and “device status acquisition” (status display function) are common to the operated devices 2 and 3. General-purpose functions 101 are classified.

  Level B, which is medium versatility, is classified into device-specific general-purpose functions 201, 202,. Specifically, various functions such as “general function 201 for each device common to various AV devices, such as“ playback operation ”that the operated device 2 has, and“ temperature setting ”and“ wind direction setting ”that the operated device 3 have. The device-specific general-purpose function 202 common to the air-conditioning devices is classified as level B.

  Level C, which has the lowest versatility, is classified into device-specific operations 301, 302,. Specifically, the device-specific function 301 that only the recorder manufactured by A company has, such as “setting for mobile phone recording” that the operated device 2 has, the “operation schedule setting” that the operated device 3 has, etc. The device-specific function 302 that only the air conditioner has is classified as level C.

  In this embodiment, the versatility level is divided into three levels, but the present invention is not limited to this. That is, the number of versatility levels can be arbitrarily set by using the number of operated devices included in the device operating system 100, the number of operating functions thereof, and the overall mounting cost as indices.

(Framework)
In the device operation system 100, as the versatility of the operable functions in the operated devices 2 and 3 decreases, the main body constituting the GUI corresponding to the function is transferred from the operation terminal 1 to each of the operated devices 2 and 3. The framework to be migrated is set in advance.

  For example, the operation terminal 1 mainly configures a GUI corresponding to a highly versatile function. On the other hand, as the device-specific function is less versatile (has higher device dependency), the operated devices 2 and 3 have more information out of the information necessary for generating the GUI corresponding to the function. I will provide a.

  Hereinafter, a framework related to a GUI constituent entity will be described with reference to FIG. In addition, below, it demonstrates using the to-be-operated apparatus 2 for description. FIG. 2 is a diagram illustrating an example of a framework related to a GUI constituent entity of a function in the operated device 2.

  As shown in FIG. 2, in the framework in this embodiment, the GUI screen composition method for each versatility level, and what kind of processing each of the operation terminal 1 and the operated device 2 performs according to the GUI screen composition method. A processing method for determining whether or not to perform the process is defined.

  Specifically, as a GUI screen configuration method at level A, a method of “displaying an operation button at a fixed position” is adopted. In this case, the operated devices 2 and 3 do not perform GUI screen configuration processing, and the operation terminal 1 displays operation button graphics (operation-side GUI material data) corresponding to each function of the operated device 2 at fixed positions. .

  As a GUI screen configuration method at level B, a method of “displaying an operation button at a designated position on the screen” is adopted. In this case, the operated device 2 provides a list of operation buttons for each function in its own device and display position information on how to arrange the operation buttons as operated-side GUI material data. On the other hand, based on the display position information acquired from the operated device 2, the operation terminal 1 arranges the operation button graphics (operation side GUI material data) of each function in the operated device 2 in the prepared framework. .

  As a GUI screen configuration method at level C, a method of “displaying GUI based on MarkUP Language such as XHTML” is adopted. In this case, the operated device 2 provides GUI configuration data described in XHTML or the like as operated-side GUI material data. The operation terminal 1 provides a display area (operation side GUI material data), and configures a GUI screen by analyzing the operation side GUI material data acquired from the operation target device.

(Concrete example)
Next, the GUI screen configuration method will be described more specifically with reference to FIGS.

  First, for example, a GUI screen configuration method of the operated device 2 which is a recorder manufactured by Company A will be described.

  FIG. 3A is a diagram illustrating a GUI screen configuration method when the operation target is the operated device 2 (recorder manufactured by A company). The left side of FIG. 3A shows a combination example of the operation function, GUI screen configuration method, and communication means at each level, and the right side of FIG. 3A shows the screen of the function-specific GUI configuration data at each level. A configuration example is shown. FIG. 3B shows an operation screen in which function-specific GUI configuration data is combined.

  As shown in FIG. 3A, the general-purpose operation functions “power control” and “apparatus status acquisition” are classified into the level A having the highest versatility. The GUI corresponding to these functions is generated mainly by the operation terminal 1 (specifically, the GUI configuration interpretation unit 12a). As a result, the GUI screen 110 shown on the right side of FIG.

  Note that HDMI CEC is set as the communication method with the operated device 2 when a user operation is received for the level A function.

  In level B, general-purpose operation functions for each device such as “playback operation”, “media switching”, and “channel selection” are classified. The GUI corresponding to these functions is generated by arranging a graphic of each function after determining a grid-like framework (grid arrangement).

  Specifically, the operated device 2 provides graphic layout information (operated side GUI material data) for each function. Next, the operation terminal 1 (specifically, the GUI configuration interpretation unit 12b) interprets the arrangement information, and provides graphic of each operation function (operation side GUI material data), thereby generating function-specific GUI configuration data. . Based on the data generated in this way, the GUI screen 210 shown on the right side of FIG.

  Note that HDMI CEC is set as a communication method with the operated device 2 when a user operation is received for the level B function.

  In level C, specific operation functions such as “recording title editing”, “chapter combination”, “mobile phone recording setting”, and “recording group setting” are classified. The GUI corresponding to these functions is generated mainly by the operated device 2. Specifically, the operated device 2 provides XHTML data (operated side GUI material data) for each function. On the other hand, the operation terminal 1 (specifically, the GUI configuration interpretation unit 12c) provides a display area (operation-side GUI material data), and interprets the XHTML data provided from the operated device 2 to provide a function-specific display. Generate GUI configuration data. Based on the data generated in this way, the GUI screen 310 shown on the right side of FIG.

  Note that Ethernet (registered trademark) is set as a communication means with the operated device 2 when a user operation is received for the level C function.

  The GUI configuration unit 13 of the operation terminal 1 combines the function-specific GUI configuration data of each level generated as described above to configure the operation screen 410 illustrated in FIG.

  Next, a GUI screen configuration method of the operated device 3 which is an air conditioner manufactured by Company B, for example, will be described.

  FIG. 4A is a diagram illustrating a GUI screen configuration method when the operation target is the operated device 3 (air conditioner manufactured by B company). The left side of FIG. 4A shows a combination example of the operation function, GUI screen configuration method, and communication means at each level, and the right side of FIG. 4A shows the screen of the function-specific GUI configuration data at each level. A configuration example is shown. FIG. 4B shows an operation screen in which function-specific GUI configuration data is combined.

  As shown in FIG. 4A, the most versatile level A includes general operation functions “power control” and “apparatus status acquisition”. The GUI corresponding to these functions is generated mainly by the operation terminal 1. Based on this data, the GUI screen 120 shown on the right side of FIG.

  Note that ZigBee (registered trademark) is set as the communication method with the operated device 3 when a user operation is received for the level A function.

  In level B, operation functions for each device such as “temperature adjustment” and “wind direction setting” are classified. The GUIs for these functions are generated by a method (grid arrangement) of filling the contents after determining a grid-like framework. A specific processing method is the same as the method described with respect to the operated device 2, and according to the method, the GUI screen 220 shown on the right side of FIG.

  Note that ZigBee (registered trademark) is set as a communication method with the operated device 3 when a user operation is received for the level B function.

  In level C, a unique operation function called “driving reservation” is classified. The GUI corresponding to this function is generated mainly by the operated device 2. The specific processing method is the same as the method described with respect to the operated device 2, and according to the method, the GUI screen 320 shown on the right side of FIG.

  Note that Ethernet (registered trademark) is set as a communication method with the operated device 3 when a user operation is received for the level C function.

  The GUI configuration unit 13 in the operation terminal 1 configures the operation screen 420 shown in FIG. 4B by combining the function-specific GUI configuration data of each level generated as described above.

(Example of control processing in device operation system 100)
An example of device operation processing in the device operation system 100 will be described below with reference to FIG. FIG. 5 is a flowchart showing a flow of processing when the operated device 2 is controlled using the operation terminal 1.

  In addition, in FIG. 5, an example at the time of operating the to-be-operated apparatus 2 is shown for description. FIG. 5 illustrates processing after the user inputs an instruction to display a GUI for operating the operated device 2 to the operation terminal 1.

  First, the operation terminal 1 detects the operated device 2 to which the communication unit 11a can be connected, and establishes a mutual communication path with the communication unit 21a of the operated device 2 (steps S11 and S21).

  Next, the operation terminal 1 requests information regarding control compatibility from the operated device 2 via the communication unit 11a (step S12). In response to this request, the operated device 2 transmits information regarding control compatibility to the operation terminal 1 via the communication unit 21a (step S22).

  Note that the information regarding control compatibility (hereinafter referred to as compatibility information) specifies function information regarding functions operable in the operated device 2, information regarding GUI screen configuration methods, information regarding communication formats, or these information. For example, information including a version number.

  In the operation terminal 1, the communication unit 11a receives the compatibility information transmitted from the operated device 2 and stores it in a storage unit (not shown). Moreover, functional information is divided | segmented for every versatility level AC among the received compatibility information, and it outputs to corresponding GUI structure interpretation parts 12a-12c, respectively.

  The GUI configuration interpretation units 12a to 12c perform processing corresponding to each level for generating function-specific GUI configuration data based on the input function information.

  At this time, the GUI configuration interpretation units 12b and 12c can complete the function-specific GUI configuration data generation processing only by using the function information and the operation-side GUI material data stored in the GUI component storage unit 14. Can not. Therefore, the GUI configuration interpretation units 12b and 12c request the operated device 2 for the operated-side GUI material data of the operated device 2 via the communication unit 11 in addition to the compatibility information (step S13). In response to this request, the operated device 2 transmits the generated operated-side GUI material data to the operating terminal 1 via the communication unit 21 (step S23). The operation terminal 1 receives the operated-side GUI material data transmitted from the operated device 2 through the communication unit 11, and receives the received information for each versatility level of the corresponding function. To 12c.

  Therefore, the GUI configuration interpretation units 12b and 12c generate function-specific GUI configuration data based on the input function information, operated-side GUI material data, and operating-side GUI material data. On the other hand, the GUI configuration interpretation unit 12a generates function-specific GUI configuration data based on the input function information and operation-side GUI material data (step S14).

  Next, in step S <b> 14, the GUI configuration interpretation units 12 a to 12 c output the generated function-specific GUI configuration data to the GUI configuration unit 13. The GUI configuration unit 13 generates one operation screen including a plurality of GUIs for each function by combining the function-specific GUI configuration data input from each of the GUI configuration interpretation units 12a to 12c.

  Here, the GUI configuration unit 13 may selectively combine the function-specific GUI configuration data at each level in order to form one operation screen.

  Next, in step S <b> 14, the GUI configuration unit 13 outputs the generated GUI to the OSD generation unit 15. The OSD generation unit 15 generates an OSD image based on the input GUI and outputs it to the screen display unit 16. The screen display unit 16 provides the user with a GUI by displaying the OSD image.

  Here, when there is another video other than the OSD image, a superimposition process for superimposing the GUI on the video signal output from the video processing unit 17 is performed. When there is audio information, the audio processing unit 18 synthesizes the internal audio or audio information acquired from the communication unit 11 and outputs the audio from an audio output unit 19 (for example, a speaker).

  Thereafter, when the user operation receiving unit 10 receives a user operation on the GUI (step S15), the received user operation information is sent to any of the GUI configuration interpreting units 12a to 12c corresponding to the level of the function that has received the user operation. Output. For example, when the user operation information is input to the GUI configuration interpretation unit 12b, the GUI configuration interpretation unit 12b generates communication data corresponding to the user operation based on the level-B function-specific GUI configuration data, and sets the level to the level. A corresponding communication means is selected (step S16). The communication data is data including a control command or user operation information.

  Step S17 is preferably performed as necessary, and details will be described later.

  Next, the GUI configuration interpretation unit 12b transmits the communication data to the operated device 2 via the communication unit 11 (any one of 11a, 11b,...) Corresponding to the selected communication unit (step S18). The same applies to the case where the user operation information is input to the other GUI configuration interpretation units 12a and 12c.

  The operated device 2 receives the communication data transmitted from the operation terminal 1 via the communication unit 21 (any one of 21a, 21b,...) Corresponding to the communication format of the communication data, and receives a device control command. Output to the processing unit 20. The device control command processing unit 20 performs internal processing according to the input communication data (step S24). As a result, the operated device 2 performs an operation reflecting the user operation.

  Step S25 is preferably performed as necessary, and details will be described later.

  Thereafter, when the user operation is performed again on the GUI, the process returns to step S14.

(Other processing)
In the operation process in the device operation system 100 described above, the following process may be further performed.

  For example, with respect to an operation function that has received a user operation on the GUI, when the subject that configures the GUI of the operation function is the operation terminal 1 (for example, level A), after step S15 in FIG. A process of changing the configuration of the GUI may be performed in accordance with a user operation (step S17).

  Further, regarding the operation function that has received a user operation on the GUI, when the subject that constitutes the GUI of the operation function is the operated device 2 (for example, level C), after the step S24 in FIG. May transmit change data for changing the configuration of the GUI according to the user operation to the operation terminal 1 (step S25).

  The GUI configuration change includes, for example, a change in which a more detailed selection item appears when a user selects a specific item on the GUI.

(Communication data for device operation)
In step S16 mentioned above, it is preferable that the GUI structure interpretation parts 12a-12c each produce | generate appropriate communication data.

  For example, for a function that has undergone a user operation in step S15, when the constituent entity of the GUI corresponding to the function is on the operation terminal 1 side (eg, level A), in step S16, the operation terminal 1 (eg, GUI configuration interpretation unit a) It is preferable that a control command corresponding to the user operation is generated and included in the communication data. In this case, the operated device 2 is controlled according to the control command.

  On the other hand, for the function that has been subjected to the user operation in step S15, when the GUI constituent corresponding to the function is on the operated device 2 side (for example, level C), in step S16, the operation terminal 1 (for example, the GUI configuration interpretation unit) c) preferably includes the user operation information as it is in the communication data. In this case, in step S24, the operated device 2 performs a process according to the user operation information, and is controlled based on the processing result.

  According to such a processing method, the mounting cost in the operation terminal 1 which operates various apparatuses can be reduced.

(Selection of communication means)
In step S <b> 16 described above, the GUI configuration interpretation units 12 a to 12 c are set to the versatility level of the function subjected to the user operation among the corresponding communication means (communication standards) of the operated devices 2 and 3 that are the operation partners. It is preferable to select an appropriate communication means based on this.

  For example, even in the same operated device, when the versatility level of the function in the operated device is different, the format of communication data to be transmitted to the operated device may be different as described above. For this reason, if the GUI structure interpretation parts 12a-12c select an appropriate communication means based on the versatility level of an operation function, the communication data according to user operation can be transmitted appropriately.

  Specifically, the communication means to be selected may be set in advance in the framework as shown in FIGS.

(Additional notes)
The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope shown in the claims. That is, embodiments obtained by combining technical means appropriately modified within the scope of the claims are also included in the technical scope of the present invention.

  Finally, each block included in the device operation system 100 may be configured by hardware logic. Or you may implement | achieve by software using CPU as follows.

  That is, the device operation system 100 includes a CPU (central processing unit) that executes instructions of a control program that realizes each function, a ROM (read only memory) that stores the program, and a RAM (random access memory) that expands the program. And a storage device (recording medium) such as a memory for storing the program and various data. An object of the present invention is a recording medium on which a program code (execution format program, intermediate code program, source program) of a control program of the device operating system 100, which is software that implements the functions described above, is recorded so as to be readable by a computer. This can also be achieved by supplying the device operating system 100 and reading and executing the program code recorded on the recording medium by the computer (or CPU or MPU).

  Examples of the recording medium include a tape system such as a magnetic tape and a cassette tape, a magnetic disk such as a floppy (registered trademark) disk / hard disk, and an optical disk such as a CD-ROM / MO / MD / DVD / CD-R. Card system such as IC card, IC card (including memory card) / optical card, or semiconductor memory system such as mask ROM / EPROM / EEPROM / flash ROM.

  Further, the device operation system 100 may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication. A net or the like is available. Further, the transmission medium constituting the communication network is not particularly limited. For example, even in the case of wired such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL line, etc., infrared rays such as IrDA and remote control, Bluetooth ( (Registered trademark), 802.11 wireless, HDR, mobile phone network, satellite line, terrestrial digital network, and the like can also be used. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  The present invention can be widely used as a device operation system including an operated device and an operation terminal for operating the operated device.

DESCRIPTION OF SYMBOLS 1 Operation terminal 2, 3 Operated apparatus 10 User operation receiving part 11 Communication part (receiving means, acquisition means)
12a to 12c GUI configuration interpretation unit (generating means, individual generating means)
13 GUI component (GUI component means)
14 GUI component storage unit 15 OSD generation unit 16 Screen display unit 20 Device control command processing unit 21 Communication unit (transmission means)
22 GUI configuration generation unit (device-side generation means)
23 GUI component storage unit 100 Device operation system

Claims (10)

A device operation system comprising an operation terminal and an operated device connected to the operation terminal through a communication network and operated through the operation terminal,
The operated device is
The amount of data required to transmit the function information related to the function operable in the operated device to the operation terminal and to generate a graphic user interface for operating the function is lower as the function is less versatile. More operation side GUI material data is provided, and when the versatility is lower than the maximum, there is provided a transmission means for further transmitting to the operation terminal,
The operation terminal
Receiving means for receiving the function information and the operated-side GUI material data;
Using the function information and the operation side GUI material data having a larger amount of data as the versatility of the function required for generating the graphic user interface is higher, and further receiving the operated side GUI material data In some cases, the operation means GUI material data is also used to generate function-specific GUI configuration data representing the graphic user interface, and
A device operation system comprising: GUI generation means for generating the graphic user interface using the function-specific GUI configuration data. The operated device has a plurality of the functions different from each other in versatility,
The GUI generation means includes:
The operation screen including a plurality of the graphic user interfaces for each function is generated by using a combination of the individual GUI configuration data for each function generated for each function. The device operation system described.   The apparatus operation system according to claim 1, wherein the generation unit includes a plurality of individual generation units individually corresponding to any one of the plurality of versatility different from each other.   The operated device generates the operated-side GUI material data necessary for generating a graphic user interface for operating the function such that the lower the versatility of the function, the larger the data amount. The device operation system according to claim 1, further comprising a device-side generation unit that performs the operation.   The apparatus operation system according to any one of claims 1 to 4, wherein the function having the highest versatility is at least one of a power supply operation function and a status display function.   6. The device operating system according to claim 1, wherein the function having the lowest versatility is a function unique to the operated device. An operation terminal for operating an operated device connected through a communication network,
The function information related to the functions that can be operated on the operated device is acquired, and the more versatile the functions necessary for generating the graphic user interface for operating the functions, the larger the data amount. Acquisition means for further acquiring operation side GUI material data if the versatility is lower than the maximum;
Using at least the operation-side GUI material data having a larger amount of data as the general versatility of the function required for generating the graphic user interface is higher, and further obtaining the operated-side GUI material data In some cases, the operation means GUI material data is also used to generate function-specific GUI configuration data representing the graphic user interface, and
An operation terminal comprising GUI generation means for generating the graphic user interface using the function-specific GUI configuration data. In a device operation system comprising an operation terminal and an operated device connected to the operation terminal through a communication network and operated through the operation terminal, a device operation method for operating the operated device,
The versatility of the functions necessary for the operated device to transmit function information regarding the functions operable on the operated device to the operation terminal and to generate a graphic user interface for operating the functions. The operation side GUI material data with a larger amount of data the lower the is, the transmission step of further transmitting to the operation terminal when the versatility is lower than the maximum,
A receiving step in which the operation terminal receives the function information and the operated-side GUI material data;
The operation terminal uses at least the function information and operation side GUI material data having a larger amount of data as the general versatility of the function required for generating the graphic user interface is higher. When receiving the material data, using the operated-side GUI material data as well, a generation step of generating functional GUI configuration data representing the graphic user interface;
A device operating method, wherein the operation terminal includes a GUI generation step of generating the graphic user interface using the function-specific GUI configuration data.   A device operation program for operating the device operation system according to any one of claims 1 to 6, wherein the computer operates the computer as each of the above means.   A computer-readable recording medium in which the device operation program according to claim 9 is recorded.

Images