JP2004348753A - Control device and method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To achieve an environment capable of making use of multimedia devices transparent from other controllers via a LAN which disuses a special software such as application software, a device driver or the like, when controlling the multimedia devices. <P>SOLUTION: Control devices for controlling controlled devices connected with a network comprises a means for displaying icons displayed on the controlled devices on a display means after the controlled devices recognize that they are connected with the network, a means for forming a control panel for controlling the controlled devices based on control information which is read out from the controlled devices, and a means for giving notice of operation toward the control panel to the controlled devices. The control panel is displayed on the display means in response to operation of the icons. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to control of a multimedia device that handles various types of information such as characters, sounds, still images, and moving images.

  In recent years, digitalization has been rapidly progressing in AV devices such as audio, video, TV, etc., which have been mainly based on analog technology. In addition, along with the spread of digitization of text / still image information, text / sound / still image / moving image information has been generally handled in computers as so-called multimedia.

  However, when multimedia devices (audio input / output devices such as digital cameras, CD-ROM players, scanners, sound boards, and video boards, video input / output devices, etc.) are currently used by computers, application software dedicated to driving them is used. Or I had to install software called device drivers on my computer.

  Therefore, in this method, new application software or device driver must be prepared for each computer or each OS (Operating System) for a new multimedia device, so that the software development load is large, efficient and high-speed. There is a problem that the control of is impossible.

  In addition, in this method, generally, the multimedia device cannot be used transparently from another computer connected to the LAN, so that each computer can access each peripheral device via the LAN. The concept of the multimedia system could not be realized.

  In order to solve the above-described problem, the control device according to the present invention is a control device that controls a controlled device connected to a network, and after recognizing that the controlled device is connected to the network, Means for displaying an icon indicated by the controlled device on display means; means for generating a control panel for controlling the controlled device based on control information read from the controlled device; and Means for notifying the controlled device of an operation on the control device, and displaying the control panel on the display means in response to the operation on the icon.

  Further, the control method of the present invention is a control method for controlling a controlled device connected to a network, and after recognizing that the controlled device is connected to the network, Displaying an icon to be displayed on the display means, generating a control panel for controlling the controlled device based on the control information read from the controlled device, and controlling the operation of the control panel by the controlled device. The method includes a step of notifying a control device and a step of displaying the control panel on the display means in response to an operation on the icon.

  According to the present invention, it is not necessary to install a device driver, application software, or the like for controlling a controlled device connected to a network in the control device, and operability is improved.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  First, the present invention employs a system control method in which multimedia devices are individually regarded as objects, and a controller integrally manages those objects.

  Each object has a function of sending its own function and control means to the controller in order to be managed by the controller. As a result, it is not necessary to prepare a control program on the controller side in advance as before, and control can be realized by simply connecting to the controller.

  Further, the controller has means for displaying and operating the control means sent from the connected object to a person who actually instructs the control, whereby the controller intensively controls the multimedia device. It is possible to realize flexibility and expandability that can be managed and new multimedia devices can be handled without making new preparations.

  The concept of object-oriented used in the present invention itself is described, for example, in "Ishizuka: Object-Oriented Programming, ASCII Publishing, 1988". "Sakai: An Introduction to Object Orientation, Ohmsha, 1990. "," B. J. Cox: Object Oriented Programming, Toppan, 1988. , Etc., the basic technical description is omitted in the following description of the embodiments of the present invention.

This object orientation has attracted attention from the viewpoint of improving the efficiency of programming development environments in recent years. However, it can also be widely used for OSs and multimedia databases.
(1) Encapsulation (2) Inheritance (3) Messaging There are three points, and based on these concepts, the present invention has been developed and expanded so that it can be applied to the control of multimedia equipment.

  FIG. 1 shows a logical connection between a multimedia controller and a multimedia device that adopts the object-oriented concept of the present invention. A communication path is established so that each of the two multimedia devices can directly communicate various kinds of information on a one-to-one basis centering on one multimedia controller, and messages are mutually communicated via the communication path. The control is performed according to the situation. Multimedia devices specifically target all devices that handle multimedia data, such as AV devices such as CD players, digital VTRs, digital cameras, and digital TVs, and OA devices such as digital faxes, digital copiers, and printers. I have.

  Although the controller is assumed to be a dedicated device here, the controller can also be realized by mounting a dedicated OS and application software on a general-purpose computer such as a personal computer or a word processor WS.

  Next, FIGS. 2A to 2C show physical connection forms for establishing a bidirectional communication path between the multimedia controller and the multimedia device.

  FIG. 1A shows a daisy-chain connection system used in a SCSI bus (ANSI X3.131-1986), and FIG. 2B shows an Ethernet (registered trademark) (IEEE 802.3) 10BaseT system. FIG. 2C shows a series connection method employed in the Ethernet (registered trademark) 10Base2 / 5.

  In the connection form, there are mixed methods (a) to (c) such as GPIB (IEEE 488) and mixed methods (b) and (c) in Ethernet (registered trademark). As for the communication system, various combinations and selections other than those shown in FIG.

  In the present invention, there is no particular reference to the method of establishing this bidirectional communication path or which one to select. However, the physical limitations (transfer speed, number of connections, connection length, connector shape, etc.) due to the difference in the communication method do not matter because the protocol hierarchy is different for the mutual communication of messages. It is necessary to have at least one kind of physical (mechanical / electrical) common interface in order to perform the operation reliably.

  In order to realize high-speed data communication such as a moving image, a method using optical communication such as FDDI (Fiber Distributed Data Interface) or B-ISDN, which is faster than Ethernet (registered trademark), is considered. For the sake of explanation, the description will proceed assuming that the inexpensive and widely used Ethernet (registered trademark) 10Base2 (/ T) has a common communication connector.

  Next, FIG. 3 shows an internal block diagram of hardware of a general multimedia device.

  Each of the plurality of multimedia devices is connected to the controller via four LANs. Since the LAN is now Ethernet (registered trademark), an interface unit 20 for processing the communication protocol (TCP / IP) is provided. This can be realized by using a dedicated LSI or the like. Here, the sent message itself is taken out, or conversely, a message is sent to the controller. As an example of a message, in Objective-C, the general form is expressed as:

[Target object Method name: Argument] Although the expression is different in other languages, it is basically the same, and the following specifications are made.
(1) Specifying the target object (2) Specifying the method (processing to be executed) (3) Specifying the argument (parameter) if there is one The handling of this message will be described with reference to the software flow in FIG.

  Inside the multimedia device, 11 CPUs for performing all software processing and hardware control via 12 internal buses, 12 ROMs for storing programs, initial values and unique information, temporary data and 13 RAMs which are used as a work area for storing internal parameters such as device states and executing programs, 14 data I / Os for accessing 15 multimedia data stored in an internal medium or an external medium, There are 16 mechanical drive units that control mechanical parts such as 17 motors, and 18 electrical drive units that control electrical parts of display systems such as 19 switches and LEDs. The fifteen multimedia data is a part in which digital data such as images, voices, characters, etc. are stored. The multimedia data is an optical disk such as a CD-ROM / MD, a magnetic tape medium such as a DCC / DAT, or a semiconductor memory card. There can be various forms.

  Next, FIG. 4 shows an internal block diagram of the multimedia controller in terms of hardware. In the figure, a multimedia device is connected via a LAN 4. Now that the LAN is Ethernet (registered trademark), there is an interface unit 31 that processes the communication protocol (TCP / IP). This can be realized by using a dedicated LSI or the like. The message sent here is taken out, or conversely, the message is sent to the multimedia device.

  Inside the multimedia controller, 21 CPUs for performing all software processing and hardware control, 22 ROMs for storing programs, initial values, and unique information, and 30 temporary data and There are 23 RAMs that store internal parameters such as device status and are used as work areas when executing programs. The twenty-five multimedia filing apparatuses perform storage, retrieval, reproduction, editing, and the like of multimedia data irrespective of an internal medium or an external medium. The access control is carried out by 24 data I / Os, 29 electric switches for controlling electric parts of the display system such as switch SW and LED, and 27 displays for constituting a man-machine interface. There are 26 display controllers for controlling the display and a pointing device such as a mouse (not shown).

  FIG. 6 shows a system hierarchy diagram in terms of software of a multimedia device. The internal block diagram shown in FIG. 3 corresponds to the hardware 57. The OS 58 performs basic control for controlling these hardware. The OS itself is not particularly limited, but desirably has a multitasking function for executing a plurality of programs in parallel with real time. On the OS, a class library 59 unique to each multimedia device is provided in order to realize the object conversion of the multimedia device.

  Although not shown, the controller has its own control panel and control-related library to be controlled by the controller, and by transmitting this when connected to the controller, the control unique to the multimedia device is realized from the controller side. . Further, there is a C function 60 for performing a timer and an arithmetic operation.

  At the highest level, there are 61 application software programs that control the multimedia device itself, communicate with the multimedia controller, and handle user interfaces. With this application, the multimedia device main body can perform various controls and executions by exchanging messages from the controller as one object, and the internal parameters can be read and changed as instance variables.

  FIG. 5 shows a software hierarchy of the multimedia controller. The internal block diagram shown in FIG. 4 corresponds to 50 hardware. The OS 51 performs basic control for controlling these hardware. Again, the OS itself is not particularly limited, but it is desirable to have real-time properties and multitasking functions.

  On this OS, 52 Windows (Graphical Users Interface) for performing general GUI (Graphical Users Interface) such as display of control screens of a plurality of connected multimedia devices, display and control of overall system connection status, and switching of data input / output. (Registered trademark) Server. The common class library 53 stores basic and common parts groups (object groups) related to user interfaces and controls, such as buttons, slide volumes, and text display areas, which are prepared in advance on the controller side.

  Conversely, 55 unique class libraries store component groups (object groups) related to panel displays and controls unique to the connected multimedia device. As described above, the unique library is transmitted from the multimedia device every time the device is connected to the system and increases. These specific procedures will be described later. Further, there is a C function 54 for performing a timer and an arithmetic operation. At the highest level, there are 56 pieces of application software for controlling the connected multimedia devices as a whole, communicating with the multimedia devices, and handling user interfaces.

  The specific control flow and message exchange between the controller and the multimedia device will now be described.

  FIG. 7 is a diagram showing a state before the multimedia device is connected to the multimedia controller. In FIG. 7, reference numeral 4 denotes a LAN for communicating digital data, and reference numeral 1 denotes a multimedia controller for controlling the operation of the entire system. Reference numeral 2 denotes a generalized structure of a multimedia device connected to the LAN 4. Reference numeral 205 denotes a system director object, which is a software object (hereinafter abbreviated as an object) that resides in the multimedia controller 1 and manages the entire system.

  Reference numeral 1064 denotes a multimedia device object which is an object that functions as a multimedia device that has been turned into an object for another object on the LAN 4. The multimedia device object 1064 is further composed of three objects 1065, 1066, 1067.

  Reference numeral 1065 denotes a multimedia device controller object which controls hardware to realize most functions of the multimedia device 2, and 1066 denotes a multimedia device data input which receives input of digital data from another device via the LAN 4. An object 1067 is a multimedia device data output object for outputting digital data to another device via the LAN 4.

  Reference numeral 1061 denotes a multimedia device proxy object description file that describes the specifications of the multimedia device proxy object generated in the multimedia controller 1 when the multimedia device 2 is connected to the multimedia controller 1 via the LAN 4. The multimedia device proxy object description file 1061 includes a multimedia device control panel object description portion 1062 that describes the specifications of the operation panel of the multimedia device 2 and a data input / output proxy object that performs proxy of data input / output to / from the multimedia device 2. It is composed of a data input / output proxy object description unit 1063 that describes specifications. In particular, the multimedia device control panel object description unit implements a GUI description language function that describes a control panel for performing operations on the multimedia device 2 with a GUI.

  FIG. 8 is a diagram illustrating a state when the multimedia device 2 is connected to the LAN 4. In FIG. 8, reference numeral 1068 denotes an object generated in the multimedia controller 1 and a multimedia device proxy object 1068 which functions as a substitute for the multimedia device 2 in the multimedia controller 1. The multimedia device proxy object 1068 is a multimedia device control panel object 1069 that functions as a control panel of the multimedia device 2, and a multimedia device data input proxy object 1070 that functions as a substitute for the multimedia device data input object 1066 when data is input. Similarly, a multimedia device data output proxy object 1071 that functions as a substitute for the multimedia device data output object 1067 is configured.

  FIG. 9 is a diagram showing a configuration of a general class library. In FIG. 9, reference numeral 1079 denotes a first class, which is one of classes that define properties and functions common to objects having similar properties and function as templates for generating objects. A library in which p classes from the first class 1079 to the p-th class 1085 are put together as a library is called a class library 1086, and all objects belong to a specific class. Reference numeral 1080 denotes a class definition unit that defines the data type and name of an internal variable of an object belonging to the class, and the data type and name of an internal function (generally called a class method) representing data processing means. A class method table in which pointers to each code of the class method are tabulated to enable the function, and a code section 1082 stores function codes of k class methods from the first function code 1083 to the k-th function code 1084. It is.

  FIG. 10 is a diagram showing the structure of a general object. In FIG. 10, reference numeral 234 denotes an object, which comprises a pointer storage unit 244 for a class method table, a message communication unit 245, a processing search unit 246, a method unit 239, and an internal data unit 235. The method unit 239 is configured by m data processing units including a first data processing unit 240, a second data processing unit 241, and an m-th data processing unit 242. Reference numeral 235 denotes an internal data portion, which is composed of n pieces of internal data up to n-th internal data 238 including the first internal data 236 and the second internal data 237.

  Since the individual internal data constituting the internal data part 235 are unique to each object, they are held inside the object, but the data processing means of the method part can be shared between the objects if the class is the same, so the first data Data processing means from the processing means 240 to the m-th data processing means 242 are managed for each class by the class method table 243, and are shared by a plurality of objects belonging to the same class. The class method table 243 is referenced from each object by a pointer stored in the pointer storing section 244 for the class method table.

  The message communication unit 245 receives a message from another object and sends it to the processing search unit 246. The processing search means 246 analyzes the message, searches the method part 239 (actually from the class method table 243) for a data processing means corresponding to the message, and executes the data processing means. The data processing means performs a predetermined process on the data attached to the message, the internal data existing in the internal data section 235, and the external data. Some processes send messages to other objects. In this case, the messages are sent to other objects via the message communication means 245.

  FIG. 11 is a diagram showing the structure of the system director object 205. In the figure, reference numeral 1072 denotes a storage unit for a pointer to the class method table, which indicates the system director class method table 1073. A multimedia device proxy object generation unit 1047 generates a multimedia device proxy object 1068 based on the description of the multimedia device proxy object description file 1061. Reference numeral 343 denotes a data input / output management unit that manages data input / output between objects, and 380 denotes an application object generation unit that generates application objects for various purposes. 1074 is a message communication unit, 342 is a process search unit, and 1075 is a method unit. Reference numeral 1076 denotes an internal data unit, object IDs 344, inter-device link information management data when a certain operation is performed using a plurality of multimedia devices, 1078, object registration relating to the connected multimedia devices and generated objects. Information.

  When the multimedia device 2 is connected to the LAN 4 using the multimedia device proxy object generating means 1047, the system director object 205 reads the multimedia device proxy object description file 1061 and describes the multimedia device proxy object description file 1061. The class to which the object to be generated belongs is selected from the information, and the multimedia device proxy object 1068 is generated in the class library 1081 based on the class definition section 1080 of the corresponding class.

  FIG. 12 shows the structure of the control panel description section of the proxy object description file. In FIG. 12, reference numeral 247 denotes a control panel object description section, which is composed of i pieces of object description information from the first object description information 248 to the i-th object description section 249. One piece of object description information includes object recognition information 250, object drawing information 254, and object link information 260.

  The object recognition information 250 includes a class name 251 indicating the class to which the object belongs, an object ID 252 which is an ID unique to the i-th object, and a belonging object ID 253 indicating the ID of the object to which the i-th object belongs.

  The object drawing information 254 is information for drawing an object such as a button constituting the control panel display screen 231, and includes information on j pieces of object drawing information from the first object drawing information 255 to the j-th object drawing information 259. Be composed. One piece of object drawing information includes drawing position / size information 256, shape / color information 257, and an object image 258.

  The object link information 261 is a description for providing link information to an object corresponding to an object constituting a control panel object such as the controller object 207, and includes k pieces of object information from the first object link information 261 to the k-th object link information 264. Consists of object link information. One piece of object link information includes a corresponding object ID 262 and a message 263 sent to the corresponding object.

  FIG. 13 shows the configuration of the data input / output proxy object description section of the proxy object description file. In FIG. 13, 650 is a data input / output proxy object description section, 651 is first input proxy object information, and 655 is m-th input proxy object information. Each input proxy object information is composed of its own object ID 652, a link destination corresponding data input object ID 653 indicating the ID of the data input object of the link destination, and a matching file type list 654 which is a list of file types that can be input. . Reference numeral 659 denotes first output proxy object information, and 663 denotes n-th output proxy object information. Each output proxy object includes its own object ID 660, a corresponding data output object ID indicating the ID of the corresponding data output object, and a matching file type list 662 that is a list of file types that can be output.

  Next, the operation of the present invention will be described using a digital VTR as an example of a specific control system of the multimedia device 2 based on the above-described system control system.

  FIG. 14 is a diagram showing a state before connecting an objectized digital VTR to a multimedia controller. In FIG. 14, reference numeral 203 denotes a digital VTR, and reference numeral 206 denotes a digital VTR object which resides in the digital VTR 203 and functions as a digital VTR converted into an object when viewed from another device on the LAN. The digital VTR object 206 is further composed of three objects. A digital VTR controller object 207 controls hardware of the digital VTR 203.

  Reference numeral 208 denotes a digital VTR data input object that receives an input of digital data from another device via the LAN 4. Reference numeral 209 denotes a digital VTR data output object for outputting digital data to another device via the LAN 4. Reference numeral 210 denotes a digital VTR proxy object description file that describes the specifications of a digital VTR proxy object generated in the multimedia controller 1 when the digital VTR 203 is connected to the multimedia controller 1 via the LAN 4.

  The digital VTR proxy object description file 210 describes the specifications of a digital VTR control panel object description section 211 that describes the specifications of the operation panel of the digital VTR 203 and the specifications of a digital VTR data input / output proxy object that performs proxy of data input / output to / from the digital VTR 203. It is composed of a digital VTR data input / output proxy object description section 212.

  FIG. 15 is a diagram showing the structure of the VTR controller object 207. Referring to FIG. 10, reference numeral 1009 denotes a pointer storage unit for the class method table, which stores a pointer to the class method table 1018. The class method table 1018 includes a large number of data processing units such as a reproduction execution unit 1019 that controls the hardware of the digital VTR 203 to execute a reproduction operation, and a recording execution unit 1020 that executes a recording operation. 1010 is a message communication unit, and 1011 is a processing search unit. Reference numeral 1012 denotes a method part, but the actual data processing means is indicated by a class method table 1018. Reference numeral 1015 denotes an internal data section, which is composed of a number of variables and status information necessary for controlling the digital VTR 203, such as a tape running state 1016 and a tape current position 1017.

  First, an operation when the digital VTR 203 is connected to the LAN 4 will be described. FIG. 16 is a diagram showing an operation flow when the digital VTR 203 is connected to the LAN 4. FIG. 17 is a diagram showing a screen of the multimedia controller 1. In FIG. 17, reference numeral 228 denotes a display of the multimedia controller 1, reference numeral 229 denotes an icon display indicating that the digital VTR 203 is connected, and reference numeral 230 denotes a cursor indicating a position pointed by a pointing device such as a mouse. Although the pointing device is not shown, the pointing device is provided with a button, and an operation of pressing and releasing the button by a user is generally referred to as clicking, and an operation of clicking twice at a predetermined interval is referred to as double-clicking. It should be noted that, as other connected devices, various devices such as a camera (still image input), a tuner, a television, various databases, a CD, and the like can be connected. This can be done with the icon display.

  FIG. 18 is a diagram for explaining a state when an objectized digital VTR 203, which is an example of a multimedia device, is connected to the LAN 4. In FIG. 18, reference numeral 220 denotes an object generated in the multimedia controller 1, and a digital VTR proxy object 220 which functions as a proxy for the digital VTR 203 in the multimedia controller 1. The digital VTR proxy object 220 includes a digital VTR control panel object 221 functioning as a control panel of the digital VTR 203, a digital VTR data input proxy object 222 functioning as a proxy for the data input object 208 when data is input, and a data output object 209. The digital VTR data output proxy object 223 functions as a proxy.

  The operation when an objectized digital VTR 203, which is an example of a multimedia device, is connected to the LAN 4 will be described with reference to FIGS. 16, 17, and 18. When the digital VTR 203 is connected to the LAN (636), the system director object 205 recognizes the connection of the digital VTR 203 (637). Next, the system director object 205 sends the device ID to the digital VTR 203 (638).

  Next, the system director object 205 loads the digital VTR proxy object description file 210 from the digital VTR 203 using the multimedia device proxy object generation means 1047 (639). Next, the system director object 205 generates the digital VTR proxy object 220 in the multimedia controller 1 based on the digital VTR proxy object description file 210 using the multimedia device proxy object generating means 1047 (640). As a result, the connection state shown in FIG. 18 is obtained. Next, the digital VTR proxy object 220 displays the icon display 229 of the digital VTR 203 on the display 228 of the multimedia controller 1 (641). Thereafter, it waits for a user's instruction (642).

  Thereafter, the operator operates the digital VTR on the basis of the operation screen displayed based on the digital VTR control panel object 221 of the multimedia controller, so that the operator operates the digital VTR proxy object 220 in the multimedia controller 1. The digital VTR can be controlled.

  Next, the relationship between the description of the digital VTR proxy object description file 210 and the generated object will be described in more detail.

  FIG. 19 is a diagram showing an example of an icon of the digital VTR 203, and FIG. 20 is a diagram showing an example of a control panel display screen. FIG. 19 shows an icon 229 displayed when the digital VTR 203 connects to the LAN 4. FIG. 20 shows a default display screen drawn by the digital VTR control panel object 221. In FIG. 20, reference numeral 232 denotes a control panel display selection menu displayed on the display, and 265 denotes a time counter display for displaying the elapsed time of the tape. 266, a control mode selection unit 267 for selecting a control mode of the digital VTR 203; a first switch button display for setting a default control mode; and 268, a second switch button for selecting a more detailed control mode. Display, 269 is a rewind button display, 270 is a reverse play button display, 271 is a pause button display, 272 is a play button display, 273 is a fast forward button display, 274 is a stop button display, and 275 is a record button display.

  FIG. 21 is a view for explaining the correspondence between the class to which the object belongs and the components of the digital VTR control panel object 221. The class to which each basic component belongs is defined in the class library 1081 in advance, and is held in the multimedia controller 1. As shown in FIG. 21, each component of the digital VTR control panel object 221 functions as an object constituting the digital VTR control panel object 221.

  In FIG. 21, the frame of the control panel display screen 231 corresponds to the VTR control panel object 284 (ID = 1) of the panel class. The display selection menu 232 of the control panel corresponds to the panel view setting menu object 285 (ID = 2) of the menu class. The time counter display 265 corresponds to the time counter object 286 (ID = 3) of the form class. The rewind button display 269 corresponds to the rewind button object 287 (ID = 4) of the button class. The reverse play button display 270 corresponds to the reverse play button object 288 (ID = 5) of the button class. The pause button display 271 corresponds to the pause button object 289 (ID = 6) of the button class. The play button display 272 corresponds to the play button object 290 (ID = 7) of the button class. The fast forward button display 273 corresponds to the fast forward button object 291 (ID = 8) of the button class. The stop button display 274 corresponds to the stop button object 292 (ID = 9) of the button class, and the recording button display 275 corresponds to the recording button object 293 (ID = 10) of the button class.

  The control mode selection unit 266 corresponds to the control mode switching object 294 (ID = 11) of the button group class. The first switch button 267 corresponds to the default button object 295 (ID = 12) of the radio button class. The second switch button 268 corresponds to the advanced button object 296 (ID = 13) of the radio button class.

  Next, generation of a play button object play button object 290 will be described as an example of the objects constituting the digital VTR control panel object 221 shown in FIG.

  FIG. 22 is an explanatory diagram relating to generation of the play button object 290. 22, 297, 298, 299, 300, 601, 602, 603, 604, 605, 606, 607, 608, 609, 610, and 611 are described in the object control panel object description section 247 of the digital VTR proxy object description file 210. Indicates the element that was created.

  Reference numeral 297 denotes object recognition information, which includes a class name 298, an object ID 299, and a belonging object ID 300. Reference numeral 601 denotes first object drawing information, which includes drawing position / size information 602, shape / color information 603, and an object image 604. Reference numeral 605 denotes second object drawing information, which includes drawing position / size information 606, shape / color information 607, and an object image 608. Reference numeral 609 denotes object link information, which includes a link destination object ID 610 and a transmission message 611.

  Reference numeral 290 denotes a button object playback button object generated from information of the class and the object control panel object description section 247 of the digital VTR proxy object description file 210. Reference numeral 613 denotes a pointer storage unit for the class method table, which stores a pointer pointing to the button class class method table 625. The button class class method table includes a button initializing unit 626 for initializing internal variables of the button object when a button class object is generated, a button drawing unit 627 for drawing the display of the button object, and a user drawing the button object. When a position is indicated by the cursor 230 of a pointing device such as a mouse and a click operation is performed, the button object is clicked in response to the operation by temporarily changing the display of the button, and other objects are displayed. And click response means for sending a message to the user.

  The definition of each data processing means held by these button class method tables is described in the class, and is commonly used not only by the reproduction button object 290 but also by all objects belonging to other button classes. 614 is a message communication means, and 615 is a processing search means. 616 is a method part, and 620 is an internal data part. The internal data section 620 includes an object ID 621, button state data 622, drawing parameters 623, and link data 624. The type of internal data that all the button objects belonging to the button class should have, not only the reproduction button object 290, is described in the class.

  The system director object 205 reads the digital VTR proxy object description file 210 and generates each object. In the example of FIG. 22, the system director object 205 generates a button class object based on the description of the class name 298 of the object recognition information 297. When the system director object 205 generates the play button object 290, the button initialization means 626 initializes the internal data section 620. According to the example of FIG. 22, the object ID is set to ID = 7 according to the description of the object ID 299. From the description of the belonging object ID 300, the system director object 205 knows that the play button object 290 belongs to the digital VTR control panel object 221. The system director object 205 knows the inclusion relationship between the objects based on the belonging object information of each object, and generates an object composed of a plurality of objects as a composite object.

  The button drawing means 627 draws the reproduction button object 290 based on the drawing parameter 623 and the button state data 622. The button drawing means 627 is automatically executed when a button object is generated and when a belonging object is moved.

  The first object drawing information 601 describes the drawing information 625 of the button when it is not pressed. The drawing position / size information 602 describes rectangular frame information indicating the drawing position and size of the digital VTR control panel object 221 when the play button object 290 is drawn. The rectangular frame information is coordinate information that defines the rectangular information in the coordinate system of the digital VTR control panel object 221 such as (X1, Y1) and (X2, Y2) of the drawing information 625 of the button when not pressed. For example, it is represented by upper left and lower right coordinates. Drawing of the play button object when it is not pressed is performed based on the shape / color information 603 or the object image 604. The shape / color information 603 is described in a language for drawing an object, such as how to draw a line and how to paint a color. The object image 604 is represented by bitmap data. In general, the former requires a smaller amount of data, but the latter has a higher degree of freedom.

  The second object drawing information 605 describes the drawing information 626 of the button when pressed in the same manner as the first object drawing information 601. The drawing parameters 623 are determined based on the first object drawing information 601 and the second object drawing information 605. The link data 624 is set based on the object link information 609, "play" is set as the transmission message, and the link destination object ID is set as the link destination object ID. The system director object 205 sets the device ID assigned to the digital VTR to the link destination object ID when the digital VTR 203 is connected to the LAN 4 for the purpose of being uniquely determined by the above.

  Therefore, it is possible to correctly transmit a message even if an ID is used in which objects are duplicated between devices. The button state data holds the state of whether or not the button has been pressed.

  FIG. 23 is a diagram showing a flow chart showing an operation when the user positions the cursor 230 on the icon display 229 of the digital VTR 203 and double-clicks, and a flow chart showing an operation when operating the control panel.

  FIG. 24 is a diagram showing a display screen of the multimedia controller 1 when the user double-clicks the icon display 229 of the digital VTR 203. In FIG. 24, 231 is a default control panel display screen of the digital VTR 203, and 272 is a play button.

  FIG. 29 is a diagram showing the relationship between the structure of a panel class digital VTR control panel object and object description information.

  In FIG. 29, reference numeral 1401 denotes a storage unit for a pointer to a class method table, which indicates a panel class class method table 1402. The panel class class method table includes panel initialization means 1403 for initializing a panel object, panel drawing means 1404 for drawing a panel, and click response means 1405 for indicating an operation when a panel is double-clicked. 1406 is a message communication unit, 1407 is a processing search unit, 1410 is an internal data unit, 1411 is an object ID, 1412 is panel state data, and 1413 is a drawing parameter. The internal data section 1410 is initialized according to the description of the digital VTR proxy object description file 210. The digital VTR control panel object description section 211 of the digital VTR proxy object description file 210 has object recognition information 1414 and an icon image 1426 of the digital VTR 203. And the second object drawing information 1422 indicating the frame 1427 of the control panel of the digital VTR. The object recognition information 1414 includes a class name 1415 (panel class), an object ID 1416 (ID = 1), and a belonging object ID. The first object drawing information 1418 includes drawing position / size information 1419, shape / color information 1420, and an object image 1421. The second object image 1422 is composed of drawing position / size information 1423, shape / color information 1424, and an object image 1425.

  A method for instructing the control panel display operation and the reproduction operation of the digital VTR 203 will be described with reference to FIGS. When the system director object 205 generates the digital VTR proxy object 220 in the operation described with reference to FIG. 16, the digital VTR proxy object 220 displays the icon display 229 based on the icon image 1426. Is designated with the cursor 230 and double-clicked (643), the control panel object 221 of the digital VTR proxy object 220 sends a message instructing drawing to all the objects constituting the control panel object 221. According to the message, all the objects shown in FIG. 21 execute the drawing means, and at this time, the control panel object draws the frame of the control panel of the digital VTR based on the second object drawing information. As a result, a digital VTR control panel display 231 for operating the digital VTR 203 is displayed as shown in FIG. 24 (644), and waits for a user instruction (645). When the user points and clicks the play button 272 of the control panel 231 with the cursor 230 in this state (646), the control panel object 221 sends a message 'PLAY' to the controller object 214 of the digital VTR 203 (647). Thereby, the controller object 214 of the digital VTR 203 activates the reproduction execution means in response to the message (648). The reproduction operation of the digital VTR 203 is started by the activation of the reproduction execution means.

  As described above, according to the present invention, simply by connecting a multimedia device to a multimedia controller via a LAN, a multimedia device proxy object required for operating the multimedia device is automatically generated in the multimedia controller, Further, a control panel required for operating the multimedia device is automatically displayed on a display of the multimedia controller, and when a user operates the control panel, an appropriate message is transmitted to a controller object of the multimedia device. A desired operation can be performed. Since the information required to generate the multimedia device proxy object necessary for operating the multimedia device is obtained from the multimedia device proxy object description file read from the multimedia device, the multimedia controller uses the basic class library. You only need a rally, you do not need to have any information about a particular multimedia device in advance.

  FIG. 25 is a diagram showing the relationship between the structure of the digital VTR data input proxy object and the object description information. In FIG. 25, 222 is a digital VTR data input proxy object, 668 is a pointer storage unit for a class method table, and shows a data input proxy class class method table 679. The data input proxy class class method table 679 includes a data input proxy object initializing unit 680, a link information updating unit 681, and a matching file type responding unit 678.

  669 is a message communication means, 670 is a processing search means, and 671 is a method part. Reference numeral 674 denotes an internal data portion, 675 denotes an object ID, and 676 denotes a corresponding data input object ID which is an ID of a corresponding data input object. Reference numeral 677 denotes a matching file type indicating a file type of data that can be input, and 1006 denotes link information to a data output object.

  The digital VTR data input / output proxy object is generated based on the digital VTR data input / output proxy object description section 212 of the digital VTR proxy object description file 210, and the input proxy 682 is described in the digital VTR data input / output proxy object description section 212. Object information, which is an object ID (ID = 1 in this example) 683, a corresponding data input object ID (ID = 1 in this example) 684, and a matching file type list 685 (in this example, a format called AV1 and AV2) Consists of Based on these descriptions, the input proxy object initialization means 680 initializes the data of the internal data section 674.

  FIG. 26 shows the relationship between the structure of the digital VTR data output proxy object and the object description information. In FIG. 26, 223 is a digital VTR data output proxy object, 690 is a pointer storage unit to a class method table, and shows a data output proxy class class method table 1048. The data output proxy class class method table 1048 includes a data output proxy object initialization unit 694, a link information updating unit 695, and a matching file type response unit 700.

  691 is a message communication unit, 692 is a processing search unit, and 693 is a method unit. Reference numeral 696 denotes an internal data part, 697 denotes an object ID, and 698 denotes a corresponding data output object ID which is an ID of a corresponding data output object. Reference numeral 699 denotes a matching file type indicating a file type of data that can be output, and reference numeral 688 denotes link information to a data output object.

  A digital VTR data output proxy object is generated based on the digital VTR data input / output proxy object description section 212 of the digital VTR proxy object description file 210. Reference numeral 1001 denotes a data output described in the digital VTR data input / output proxy object description section 212. This is proxy object information, and has object ID (ID = 1 in this example) 1002, corresponding data output object ID (ID = 1 in this example) 1003, and matching file type list 1004 (AV1 and AV2 in this example). ). Based on these descriptions, the data output proxy object initialization means 694 initializes the data of the internal data section 696.

  FIG. 27 is a diagram showing the structure of a digital VTR data input object. In FIG. 22, reference numeral 208 denotes a digital VTR data input object, and 1022, a pointer storage unit for a class method table, which indicates a data input class class method table 1031. The data input class class method table 1031 includes a file writing unit 1032, a data receiving unit 1033, and a link information updating unit 686. 1023 is a message communication unit, 1024 is a process search unit, and 1025 is a method unit. 1028 is an internal data part, 1029 is an object ID, and 1030 is link information.

  FIG. 28 is a diagram showing the structure of a digital VTR data output object. In FIG. 28, reference numeral 209 denotes a digital VTR data output object; 1035, a pointer storage unit for a class method table; and a data output class class method table 1044. The data output class class method table 1044 includes a file reading unit 1045, a data transmitting unit 1046, and a link information updating unit 687. Reference numeral 1036 denotes a message communication unit, 1037 denotes a process search unit, and 1038 denotes a method unit. 1041 is an internal data part, 1042 is an object ID, and 1043 is link information.

  When the data input proxy object 222 and the data output proxy object 223 of the digital VTR 203 are generated in the multimedia controller, they function as if they were the digital VTR data input object 208 and the digital VTR data output object 209. For example, when copying files from another multimedia device to a digital VTR, the system director object 205 queries the digital VTR data input proxy object 222 for the types of files that can be input. In response to the inquiry from the system director object 205, the matching file type response means of the digital VTR data input proxy object 222 returns a file type that the digital VTR 203 can accept.

  If the file type of the file to be copied exists therein, a link from the output proxy object of the multimedia device having the file to be copied to the digital VTR data input proxy object 222 is set. The link information updating means 681 of the digital VTR data input proxy object 222 sends a message to the digital VTR data input object 208 to activate the link updating means of the digital VTR data input object 208 to update the link information 688 of the digital VTR data input object 208. I do.

  The data output proxy object of the multimedia device having the file to be copied at the same time sends a message for updating the link information of the data output object, and the data of the multimedia device having the file to be copied by the update of the link information is updated. A link between the output object and the digital VTR data input object 208 is set.

  Thereafter, the data transmission means of the data output object of the multimedia device having the file to be copied is activated, and the data output object of the multimedia device having the file to be copied sends a message to the digital VTR data input object, The file is copied by activating the receiving unit 1033 and the file writing unit 1032. That is, when a copy instruction or the like is given to the data input proxy object and the data output proxy object in the multimedia controller, the data input proxy object and the data output proxy object send messages to the data input object and the data output object of the multimedia device body, respectively. There is no need for the multimedia controller to be directly involved in sending and setting up data links between multimedia devices, such as copying actual data.

It is a figure which shows the logical connection form of a multimedia controller and a multimedia device. It is a figure which shows the physical connection form of a multimedia controller and a multimedia device. It is a figure showing the internal structure of the multimedia equipment made into the object. It is a figure showing the internal structure of the multimedia controller made into the object. It is a system hierarchy diagram of a multimedia controller. It is a system hierarchy diagram of a multimedia device. FIG. 3 is a diagram illustrating a state before a multimedia device is connected to a multimedia controller. FIG. 3 is a diagram illustrating a state when a multimedia device is connected to a LAN. FIG. 2 is a diagram illustrating a configuration of a general class library. It is a figure showing the structure of an object. It is a figure showing the structure of a system director object. It is a figure showing composition of a control panel description part of a proxy object description file. It is a figure showing composition of a data input / output object description part of a proxy object description file. FIG. 3 is a diagram showing a state before connecting an object-formed digital VTR to a multimedia controller. FIG. 3 is a diagram illustrating a structure of a VTR controller object. This is a flowchart of the operation when a digital VTR is connected to a LAN. It is a figure showing a screen of a multimedia controller. FIG. 2 is a diagram showing a state when an object digital VTR is connected to a LAN as a multimedia device. It is a figure showing the icon of a digital VTR. It is a figure showing a control panel display screen. FIG. 3 is a diagram illustrating correspondence between a class to which an object belongs and constituent elements of a digital VTR control panel object. FIG. 9 is an explanatory diagram related to generation of a play button object. This is a flowchart of the operation when the user selects the control by moving the cursor to the icon display of the digital VTR. It is a figure showing a display screen of a multimedia controller when an operator selects control from icon display of a digital VTR. FIG. 4 is a diagram showing the relationship between the structure of a digital VTR data input proxy object and object description information. FIG. 4 is a diagram showing the relationship between the structure of a digital VTR data output proxy object and object description information. FIG. 3 is a diagram showing a structure of a digital VTR data input object. FIG. 3 is a diagram illustrating a structure of a digital VTR data output object. FIG. 4 is a diagram showing the relationship between the structure of a panel-class digital VTR control panel object and object description information.

Claims (5)

A control device for controlling a controlled device connected to a network,
After recognizing that the controlled device is connected to the network, displaying an icon shown on the controlled device on display means,
Means for generating a control panel for controlling the controlled device based on the control information read from the controlled device,
Means for notifying the controlled device of an operation on the control panel,
A control device for displaying the control panel on the display means in response to an operation on the icon.   The control device according to claim 1, wherein the control panel includes a plurality of operation buttons corresponding to functions executable by the controlled device. A control method for controlling a controlled device connected to a network,
After recognizing that the controlled device is connected to the network, displaying an icon shown on the controlled device on display means,
Generating a control panel for controlling the controlled device based on the control information read from the controlled device;
Notifying the controlled device of an operation on the control panel,
Displaying the control panel on the display means in response to an operation on the icon.   The control method according to claim 3, wherein the control panel has a plurality of operation buttons corresponding to functions executable by the controlled device.   A storage medium storing a program for realizing the control method according to claim 3 or 4 by a control device.

Images