JP5002192B2 - Control device and control method thereof - Google Patents

Description

  The present invention relates to a technique capable of configuring operation screen information for a composite device when a plurality of devices function as the composite device.

  2. Description of the Related Art Conventionally, a technique for controlling a plurality of devices connected to a network using a controller that is also connected to the network is known. For example, the controller has control means corresponding to the above-described plurality of devices in advance, and the controller and the plurality of devices identify each other via a network. Then, the controller selects a controllable device among the recognized devices, and presents the user with UI means for controlling the device corresponding to each selected device, so that the device via the network Can be operated.

  FIG. 10 is a diagram showing a specific example of a remote control system for realizing the above configuration. Here, an example is shown in which a camera device connected to a network, a pan head device, and a controller capable of controlling these devices are configured.

  These devices exist on the network as a control point serving as a control-side terminal, a device that appears as a controlled device, and a service that is a variety of functions possessed by each device. The mechanism of discovery, search, capability exchange, control, response, and display functions in these devices and terminals is represented by UPnP (see http://www.upnp.org/ for details). This is possible by using a standard mechanism.

  In the above configuration, the UI means presented in the controller corresponding to the individual device to be controlled has a one-to-one correspondence. FIG. 11 shows a situation in which the camera device 1101 and the pan head device 1102 are connected to the network. In this case, UI units corresponding to individual devices to be operated are individually divided into parts where UIs of the controller 1103 are presented as indicated by 1108 and 1109, respectively.

  At this time, in order to construct a UI corresponding to each device, the controller lays out UI component groups 1202 and 1207 for each device and the above-described UI component group as shown in FIG. The UI layout information 1203 and 1206 are held.

  Also, as shown in FIG. 13, by simultaneously controlling a plurality of devices via a network, the functions of the individual devices to be controlled are combined, and a new function is provided to the user by performing some kind of cooperative operation. Things are also done. For example, the scanner device 1301 and the printer device 1302 existing on the network 1304 are combined and operated by the control device 1303 to function as if one copier 1305.

  In such a case, first, a UI operation of the controller 1303 regarding the scan of the scanner device 1301 is performed, and then a UI operation for setting an output destination for the scanned data is performed on the scanner device 1301. Independently of this, a UI operation of the controller 1303 is performed on the printer device 1302 designated as the output destination of the previously scanned data, and an operation related to output setting is performed.

  When the above operations are completed, a document is set on the scanner device 1301 and a scanner execution operation is performed, whereby a copy of the document is output to the printer device 1302.

  In addition, as a means for eliminating the trouble of performing operations on individual devices as described above, a number of techniques for easily handling devices on a network as composite devices are disclosed.

  For example, in the invention disclosed in Patent Document 1, a plurality of devices that input, output, and relay images connected to a network announce each other's device information via the network. Any device that can operate as a composite device based on the announcement information can perform cooperative control. The invention disclosed in Patent Document 1 can operate as if it were a virtual copying machine, for example, by performing an operation on one device.

  In the invention disclosed in Patent Document 2, information on devices connected to a network is acquired by a management server on the network, and a function that can be performed by a combination of devices is determined by the management server. The invention disclosed in Patent Literature 2 can present only functions that can be used at that time to the user, and can provide functions according to the use and purpose of the user.

JP 2001-257827 A JP 2000-47771 A

  In the first remote control system mentioned above, the controller has only the function to control the individual devices to be operated, so that it is the user's responsibility to operate the individual devices even for complex functions. Combined operation is possible by combining. However, the operation method is more complicated than the original operation of the composite function.

  In other words, in order to realize the composite function, settings related to input / output cooperation of individual devices are necessary, and the operation flow is also unsatisfactory because operations on individual devices go back and forth from device to device. It will be continuous. Therefore, it is difficult to use compared with an operation designed as a multi-function operation from the beginning.

  Furthermore, when the camera device and the pan head device exist on the network, the pan head device is assumed to be used together with the camera device. Therefore, as shown in FIG. 11, even if the camera device 1101 and the pan head device 1102 are laid out from different independent operation screens in the controller 1103, it is difficult to use as a composite function. That is because the operation direction of the camera platform device 1102 with respect to the monitor screen of the camera device 1101 is not linked.

  Further, the invention disclosed in Patent Document 1 operates other devices by using any one of the operation means of individual devices for realizing the composite function and devices for relaying. In this case, there is a problem in that there is no dedicated UI component, and an operation as a composite function is a limited operation that can be completed by only one operation means.

  Furthermore, in the invention disclosed in Patent Document 2, the management server manages conditions and operation means of a composite device realized by combining individual devices. Therefore, the management server needs to hold the conditions and operation means of individual devices as many as the number of types of device combinations that can be combined devices. As a result, the management server has a problem that it has a wasteful resource or cannot cope with a new combination of devices that the management server does not know.

  Accordingly, an object of the present invention is to provide operation screen information unique to a composite device while saving resources for holding operation screen information.

The control device according to the present invention is a control device that controls a plurality of devices via a network, and the operation screen component group corresponding to each of the plurality of devices and the plurality of devices cooperate with each other. holding means for holding a layout information for configuring the operation screen when functioning as a composite device having the functions of a plurality of devices, said plurality of devices functions as the composite device, When detecting that the plurality of devices are functioning as the combined device by the detecting unit that detects based on the notification from the combined device, the layout information is acquired from the holding unit , based on said layout information, by laying out the component group of the operation screen of the plurality of devices, screen configuration unit for configuring the operation screen for the composite device And when the plurality of devices do not function as the composite device, the plurality of devices are controlled in accordance with operations on the operation screens corresponding to the plurality of devices, respectively. The multifunction device is controlled according to an operation on the operation screen for the multifunction device.

  In the present invention, when a plurality of devices function as a composite device, the composite information is obtained using a plurality of operation screen information corresponding to the plurality of devices held in advance and layout information corresponding to the composite device. The operation screen information for the device is configured. Therefore, according to the present invention, it is possible to provide operation screen information specific to a composite device while saving resources for holding operation screen information.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments to which the invention is applied will be described in detail with reference to the accompanying drawings.

-First embodiment-
First, a first embodiment of the present invention will be described. FIG. 1 is a block diagram showing a configuration of a remote control system according to the first embodiment of the present invention.

  In FIG. 1, reference numeral 101 denotes a camera device connected to a network that can take an image. Reference numeral 102 denotes a pan / tilt head device connected to a network that can change the shooting direction of the camera device 101 in an arbitrary direction by setting the camera device 101. Reference numeral 103 denotes a controller that can control various services provided by known devices connected to the network using a UI displayed on the screen.

  A camera device module 104 indicates a set of services provided to the network. Reference numeral 105 denotes a pan / tilt head device module indicating a set of services provided to the network.

  An imaging service 106 exists in the camera device module 104. Reference numeral 107 denotes a reproduction service similar to the photographing service 106. Reference numeral 108 denotes a combining service for providing a combining function, similar to the photographing service 106. Reference numeral 109 denotes a pan head control service existing in the pan head device module 105.

  Reference numeral 110 denotes a line indicating that the camera device module 104 is connected to the network. Reference numeral 111 denotes a line indicating a state in which the pan head device module 105 is connected to the network.

  Reference numeral 112 denotes a dedicated composite service control point for controlling the composite service built in the pan head device 102. Reference numeral 113 denotes a line indicating a state in which the composite service control point 112 communicates with and controls the composite service 108 of the camera device module 104.

  Reference numeral 114 denotes a device list of devices that provide services on the network displayed on the controller 103. Reference numeral 115 denotes a pan / tilt camera device module that is activated when the composite service control point 112 detects the composite service 108 and determines that the composite service 108 can be provided. The platform camera device module is a set of services of a camera platform camera device that is a composite device of the platform device 102 and the camera device 101.

  Reference numeral 116 denotes a photographing service that exists in the pan head camera device module 115, which is a proxy service for the photographing service 106 of the camera device module 104 by the network connection unit 119. Similarly, reference numeral 117 denotes a reproduction service existing in the pan / tilt head camera device module 115, which is also a proxy service for the reproduction service 107 by the network connection unit 120.

  Reference numeral 118 denotes a pan head control service existing in the pan head camera device module 115, which is also a proxy service of the pan head control service 109 of the pan head device module 105 through the connection unit 121. Reference numeral 122 denotes a line indicating that the activated camera platform camera module 115 is connected to the network. Reference numeral 123 denotes a control point which is a connection point on the network of the controller 103 which is a control device. Reference numeral 124 denotes a selected device indicating a device selected from the device list 114.

  126 is a UI component group corresponding to the selection device 124. 125 is UI layout information for configuring a GUI screen using the UI component group 126 corresponding to the selected device 124. Reference numeral 127 denotes a UI construction module that constructs a UI based on the UI component group 126 and the UI layout information 125. Reference numeral 128 denotes UI presenting means for presenting the UI constructed by the UI construction module 127 to the user.

  FIG. 4 is a diagram showing the appearance of an actual network-connected device and controller corresponding to the block diagram of FIG. Here, 401 is a camera device connected to the network 404. Reference numeral 402 denotes a pan head device that is also connected to the network 404. Reference numeral 408 denotes communication for information exchange between devices capable of functioning as a composite device, and shows a line corresponding to 113 in FIG.

  Reference numeral 403 denotes a controller. On the display screen, a device list 405 that displays a list of devices (406, 407, 409) that are connected to the network and can be controlled by the controller 403 as icons, and devices selected by the selection mark 410 are displayed. An operation screen 411 is displayed.

  2 and 3, after each device configured in the remote control system according to the present embodiment is connected to the network (broken arrows 210 and 211 in FIG. 2), information is exchanged between the devices (FIG. 3). The solid line arrow 313) is a diagram showing a change in the configuration up to FIG.

  FIG. 5 is a diagram showing a data structure for configuring a UI screen presented to the user in the controller (103 or 403). Here, reference numeral 501 denotes a frame indicating a data structure for configuring a UI screen corresponding to the camera device. The UI screen 504 of the camera device includes a camera UI component 502 that is a UI component group for the camera device, and camera UI layout information 503 that is UI layout information for the camera device.

  Reference numeral 505 denotes a frame indicating a data structure for configuring a UI screen corresponding to the pan head device. The UI screen 508 of the pan head device includes a pan head UI component 507 that is a UI component group for the pan head device and a pan head UI layout information 506 that is UI layout information for the pan head device.

  Reference numeral 509 denotes a frame indicating a data structure for configuring the UI screen 511 corresponding to the pan / tilt head camera device whose function is newly activated as a composite device on the network in the controller. The UI screen 511 of the camera platform camera device includes both a camera UI component 502 of the camera device that is the base of the composite device and a camera platform UI component 507 of the camera platform device as a UI component group of the camera platform camera device. Furthermore, the camera platform has UI camera layout information 510 that is UI layout information for the camera platform device.

  FIG. 6 shows a flow of processing for configuring a device having a function for newly expressing the function of the composite device on the network among devices that can configure the composite device in the remote control system according to the present embodiment. It is a flowchart. Here, the flow of the process which comprises the proxy apparatus performed with a pan head apparatus is shown.

  In FIG. 6, S601 to S609 indicate each operation step. First, step S601 is a step of starting processing for configuring a proxy device. In S602, it is determined whether or not the pan / tilt head device has a composite service 108 that can configure a composite device in another device on the network by using the composite service control point 112 dedicated to the composite service. It is a step to search. S603 is a step of determining whether or not the search of S602 has succeeded. If unsuccessful, there is no device constituting the composite device, so the configuration of the proxy device is terminated in S604.

  If the search succeeds in S603, the detailed information of the device having the composition service 108 is acquired in S605. In S606, whether or not the function as a composite device with the own device, here, the pan head device can be expressed. Is determined. If it is determined that the composite device is not established, the process proceeds to S604 and the process is terminated. In S606, if it is determined that the function of the pan head camera device can be expressed as a composite device of the pan head device and the camera device, the process proceeds to S607.

  In S <b> 607, the service functions of the imaging service 116 and the reproduction service 117, which are services constituting the pan / tilt head camera device that is a composite device, are configured as proxy services. In this case, each service function is passed through the network connection of the photographing service 106 and the reproduction service 107 and 119 and 120 of the camera device module 104. At the same time, the service function of the pan head control service 118 is configured as a proxy service through the internal connection of the pan head control services 109 and 121 of the pan head device module 105.

  Next, in step S608, the pan head camera device module 115, which is a composite device, is started up by starting up the service functions 116 to 118. In subsequent S609, the camera platform camera module 115 as a composite device is notified on the network, and the process ends in S604.

  FIG. 7 is a flowchart showing a processing flow when the controller 103 finds a composite device in the remote control system according to the present embodiment.

  In FIG. 7, S701 to S710 indicate each operation step. First, when processing when a composite device is found in S701 is started, a search for composite devices that can be controlled by the controller 103 is performed from the found composite devices in S702. In S703, it is determined whether or not a composite device that can be handled is found. If the controller 103 finds no composite device that can be controlled, the process proceeds to S710 and the process is terminated. If a composite device that can be controlled in step S703 is found, the process advances to step S704, and the icon of the found composite device is displayed on the controller 103.

  Next, in S705, it is determined whether or not the composite device has been selected as a control target by a user operation on the controller 103. If not selected, the process proceeds to S710 and the process is terminated.

  If it is selected as a control target by the user, information about the composite device is acquired in S706, and here, the types, names, and the like of a plurality of devices before the composite device is combined are acquired.

  In step S707, UI component groups 502 and 507 prepared for a plurality of devices before being combined, which are found in step S706, are acquired. In subsequent S708, the pan / tilt camera UI layout information 510 for the composite device is acquired. In S708, the UI corresponding to the composite device is constructed, and the process ends in S710.

  Hereinafter, the present embodiment will be described in detail with reference to FIGS. In this embodiment, a standard such as UPnP is used for a mechanism including basic discovery, search, capability exchange, control, response, display function, and the like of individual devices and controllers on the network. The detailed description is omitted.

  Assume that a camera device 201 and a pan head device 202 as shown in FIG. 2 are connected to a controller 203 that can control the camera device 201 and the pan head device 202 with respect to the network. The camera device 201 has a composition service 208 for functioning as a composite device. The pan / tilt head device 202 has a merging service control point 212 dedicated to the merging service, and performs various proxy services for functioning as a pan / tilt camera device by merging with the specific camera device 201.

  At this time, the camera point of the camera device 201 and the pan head device of the pan head device 202 that can be controlled by the controller 203 are recognized by the control point 223 that is the network end point of the controller 203. As a result, only the icons of the detected camera device and pan head device are displayed on the display screen of the controller 203.

  At this time, only the camera device icon 406 and the pan head device icon 407 are displayed in the controller icon display area 405 of FIG. Next, in the pan head device 202 of FIG. 2, the composite service control point 212 starts the processing of FIG. 6 by being connected to the network, and is combined with another device having the composite service, that is, the pan head device 202. The search for a device that can be a composite device is started.

  When the composition service 208 of the camera device 201 is found in S602, as shown in FIG. 3, the composition service 308 and the composition service control point 312 exchange capabilities as shown in 313, and detailed information on the device is acquired (S605). . Information exchange at this time may be performed via a network to which a previous device is connected, or may be performed by another communication means.

  As a result of the capability exchange, in S606, a description that the camera device 301 holding the composite service can function as a composite device by being combined with the pan head device 302 is detected in the detailed information. It is determined whether or not. If it is detected, in S607, various services 316 to 318 prepared in advance as services of a new composite device are started. That is, the shooting service 316 is set to function as a proxy service for the shooting service 306 of the camera device 301. Similarly, the playback service 317 is set to function as a proxy service for the playback service 307 of the camera device 301. The pan head service 318 is set to function as a proxy service for the platform control service 309 of the pan head device 302. At this time, even when the imaging service 316 is used, commands and responses are exchanged so that the original imaging service 306 is actually used.

  Next, in step S608, the composite device on the network including the services 316 to 318 and the pan head camera device 315 are started up, and in step S609, notification to the network is performed. At this time, on the network, it looks as if the camera platform is connected to the network.

  FIG. 1 shows the configuration of the remote control system when the camera platform device appears on the network at this time.

  When a new device is connected to the network and its presence is notified to the network, the control point 123 existing on the network is also notified. At the control point 123 existing in the controller 103 of FIG. 1, the processing shown in FIG. 7 is started.

  In S702 of FIG. 7, a search for a composite device that can be controlled by the controller 103 is performed. If a camera platform camera device that is a composite device that can be controlled by the controller 103 is found in step S703, the process advances to step S704. In step S <b> 704, the icon of the camera platform camera device that is a composite device is displayed in the icon display area 405 of the controller 103 as 409.

  In step S705, it is determined whether or not the icon 409 displayed in step S704 has been selected as a control target by the user. If the user has made a selection, the process proceeds to step S706. In S706, information on individual devices constituting the composite device is acquired, and in S707, UI component information prepared in advance for the individual devices acquired in S706 is acquired. Here, since the pan head camera device is recognized as the composite device, the camera UI part information 502 and the pan head UI part information 507 are acquired as the UI part information.

  In step S708, layout information 510 for the pan / tilt head camera device, which is a composite device, is selected and acquired. In step S <b> 709, a camera platform UI screen 511 is constructed from the camera UI component information 502, the platform UI component information 507, and the platform camera UI layout information 510 as a UI screen for operating the composite device.

  As described above, the UI screen constructed by the UI construction module 127 is presented by the UI presenting means 128. As a result, a UI screen of the pan head camera device having a layout different from 1108 and 1109 which are the UI screens of the conventional individual devices as shown in 411 of FIG. 4 is displayed.

  As described above, in the present embodiment, devices having a structure that can function as a composite device recognize each other in advance and function as a composite device. When operating a composite device from the controller, the UI screen can be displayed using layout information that demonstrates the convenience of the composite device while diverting the UI parts of the UI screen prepared for each device. It is composed. As a result, there is an effect that it is possible to provide a UI screen having a layout for an easy-to-use composite device at the same time as providing UI components familiar to the user.

  In the present embodiment, as a method for causing the composite device to appear on the network, a service for realizing the composition is arranged on one device constituting the composite device, and the composite service control dedicated to the service is provided on the other device. Point is placed. However, there is no problem even if other mechanisms are used as long as the individual devices can recognize each other and can function as a composite device.

  Furthermore, in the present embodiment, an example in which two individual devices are combined as a composite device has been described as an example. However, the composite device may have a configuration in which two or more individual devices are combined. .

  For example, FIG. 8 is a diagram illustrating a state in which three devices, here a camera device 801, a pan head device 802, and a recorder device 803 are connected to the controller 804 via the network 805. At this time, when individual devices are independently selected and operated as a UI screen on the controller 804, a UI screen 806 for a camera device, a UI screen 807 for a pan head device, and a UI screen 807 for a recorder device. Are displayed independently.

  In this case, as in the previous conventional example, even if the UI screen of the pan / tilt head device is operated to control the direction of the camera device, the operation direction does not coincide with the direction on the monitor screen. Further, in order to record the video of the camera device on the recorder device, it is necessary to set the input setting of the recorder device to the output of the camera.

  On the other hand, when the above-described three devices can be linked as a composite device as shown in FIG. 9, a composite type operation screen as shown at 910 in FIG. 9 can be laid out on the controller. In this composite device, since the UI parts of the pan head device are laid out corresponding to the pan and tilt directions, the operation direction of the UI component of the pan head device matches the direction on the monitor screen. Since the layout information in the present embodiment includes the operation screen arrangement information corresponding to the operation direction of the UI component (here, the adjustment knob), such an arrangement state can be obtained. Further, it is possible to record the video of the camera simply by operating the recording button of the recorder device, which can greatly improve the convenience for the user.

    As described above, in the present embodiment, UI components for individual devices held by the controller are diverted to save component resources, and furthermore, using optimum layout information for composite devices. Configures the operation screen for multifunction devices. Therefore, it is possible to provide an operation screen having an easy-to-use layout suitable for a function unique to the composite device while providing UI parts familiar to the user.

-Second Embodiment-
Next, a second embodiment of the present invention will be described. In the first embodiment described above, with respect to individual devices constituting the composite device, the controller that controls them holds the UI component information and UI layout information of the individual devices. Furthermore, among the newly developed composite devices, the composite devices that can be controlled by the controller are configured to previously hold UI layout information for configuring the UI screen. On the other hand, in the present embodiment, when the UI layout information of the composite device does not exist in the controller, the fact that the controller holds the UI layout information among the individual devices constituting the composite device is notified to that effect. To be notified. Accordingly, the corresponding device sends the UI layout information to the controller.

  With this configuration, when individual devices that can configure the composite device configure the composite device, only the UI layout information of the composite device is transmitted to the controller. This may be a case where a composite device that creates new convenience can be configured by a combination of new devices that the controller knows about each device, but the controller does not know. Accordingly, there is an effect that the composite device can be operated in the controller.

-Third embodiment-
Next, a third embodiment of the present invention will be described. In the second embodiment described above, it is assumed that individual UI components described in the UI layout information are always held in the controller. However, there is a case where a thing that is not held in the controller is designated as a UI part for a composite device that has developed a new function.

  In such a case, the UI component held in the controller has information describing its characteristics. In the controller, when the UI corresponding to the composite device is constructed, if the UI component specified in the UI layout information does not exist, the information describing the above-described characteristics is matched or partly matched. Means for using UI parts are provided. This is present in the controller instead of the UI component that does not exist. Thereby, even if the controller is a new composite device that the controller does not know and does not have a UI component corresponding to the composite device, the UI screen can be configured using the next-best UI component.

  Another object of the present invention is to supply a storage medium storing software program codes for realizing the functions of the above-described embodiments to a system or apparatus, and a computer such as the system reads and executes the program codes from the storage medium. Is also achieved.

  In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the program code itself and the storage medium storing the program code constitute the present invention.

  As a storage medium for supplying the program code, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

  In addition, the case where the functions of the above-described embodiment are realized by performing part or all of the actual processing by an OS or the like running on the computer based on the instruction of the program code read by the computer. It is.

  Further, after the program code read from the storage medium is written in a memory provided in a function expansion unit connected to the computer, the CPU or the like performs actual processing based on the instruction of the program code, and the above-described processing is performed. The case where the functions of the embodiment are realized is also included.

1 is an overall block diagram of a remote control system according to a first embodiment of the present invention. 1 is an overall block diagram of a remote control system according to a first embodiment of the present invention. 1 is an overall block diagram of a remote control system according to a first embodiment of the present invention. It is a figure which shows the connection structure of the apparatus in the 1st Embodiment of this invention. It is a figure for demonstrating the structure of UI screen in the 1st Embodiment of this invention. It is a flowchart which shows the process of the proxy apparatus in the separate apparatus side in the 1st Embodiment of this invention. It is a flowchart which shows the process at the time of the composite apparatus discovery in the separate controller side in the 1st Embodiment of this invention. It is a figure for demonstrating the other operation | movement in the 1st Embodiment of this invention. It is a figure for demonstrating the other operation | movement in the 1st Embodiment of this invention. It is a whole block diagram of the remote control system in a prior art example. It is a figure which shows the connection structure of the apparatus in a prior art example. It is a figure for demonstrating the structure of UI screen in a prior art example. It is a figure for demonstrating the control method of the composite apparatus in a prior art example.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Camera apparatus 102 Pan head apparatus 103 Controller 104 Camera device module 105 Pan head device module 106 Shooting service 107 Playback service 108 Compositing service 109 Pan head control service 112 Compositing service control point 114 Device list 115 Pan head camera device module 116 Shooting service 117 Playback service 118 Head control service 119, 120 Network connection means 121 Connection means 123 Control point 124 Selection device 125 UI layout information 126 UI component group 127 UI construction module 128 UI presentation means

Claims (7)

A control device that controls a plurality of devices via a network,
A component group of operation screens respectively corresponding to the plurality of devices, and an operation screen when the plurality of devices cooperate with each other to function as a composite device having each function of the plurality of devices Holding means for holding layout information ;
Said plurality of devices functions as the composite device, a detecting means for detecting, based on a notification from the composite device,
When the detection unit detects that the plurality of devices function as the composite device, the layout information is acquired from the holding unit, and the operation screens of the plurality of devices are acquired based on the layout information . Screen layout means for configuring an operation screen for the composite device by laying out a group of parts;
When the plurality of devices do not function as the composite device, the plurality of devices are controlled in response to operations on operation screens corresponding to the plurality of devices, and the plurality of devices function as the composite device. A control device that controls the composite device in response to an operation on the operation screen for the composite device.   The control device according to claim 1, further comprising an acquisition unit configured to acquire the layout information from any of the plurality of devices functioning as the composite device. In the case where the layout information does not exist in the control device, it further has notification means for notifying any of the plurality of devices functioning as the composite device,
The control device according to claim 2, wherein the acquisition unit acquires the layout information transmitted from any of the plurality of devices in response to a notification from the notification unit.   4. The control according to claim 1, wherein the layout information includes arrangement information of a component group of the operation screen corresponding to a pan direction and a tilt direction of an operation unit of the operation screen. 5. apparatus. A control method for a control device that controls a plurality of devices via a network and holds a group of operation screen components corresponding to the plurality of devices in a holding unit,
A detection step of detecting, based on a notification from the composite device, that the multiple devices function as a composite device having the functions of the multiple devices in cooperation with each other;
When it is detected by the detection step that the plurality of devices function as the composite device , the plurality of devices function as the composite device together with a component group of an operation screen corresponding to each of the plurality of devices. By acquiring the layout information from the holding means for holding the layout information for configuring the operation screen in the case of, and laying out the component groups of the operation screens of the plurality of devices based on the layout information, A screen configuration step for configuring an operation screen for the composite device,
When the plurality of devices do not function as the composite device, the plurality of devices are controlled in response to operations on operation screens corresponding to the plurality of devices, and the plurality of devices function as the composite device. A control method for a control device, comprising: controlling the composite device according to an operation on an operation screen for the composite device.   The program for making a computer perform the control method of the control apparatus of Claim 5.   A computer-readable recording medium on which the program according to claim 6 is recorded.

Images