JP2000222335A - Device control system, its method and record medium for recording program for constructing the same system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To attain similar control by using an application program regardless of the kind of a device object or the kind of a communication path. SOLUTION: Device abstracting parts 28a and 28b transfer each kind of control information or data with devices 34a and 34b, and operate device abstracting (hardware abstracting) for constituting elements positioned at the higher rank. Interface parts 22a and 22b transfer each kind of control information or data with an application part 20 and the device abstracting parts 28a and 28b, and provide the same interfaces to the application part 20. Communication path abstracting parts 24a and 24b transfer each kind of control information or data through communication paths 26a and 26b beyond a process boundary or network boundary by abstracting the communication paths.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a technique for controlling a device.

[0002]

2. Description of the Related Art Conventionally, for example, a scanner and a printer are connected to a single computer. When image data is fetched by a scanner and the fetched image data is printed by a printer, first, an application program supporting the scanner is used. Was started, the application program was used to control the scanner to capture image data, and temporarily stored in the memory of the computer. At this time, a user interface for operating the scanner is displayed on the screen of the monitor, and the user instructs the computer on the user's desired capture setting and the like via the user interface for the scanner. The scanner has to take in the image data along. Thereafter, another application program that supports the printer is started, the image data stored in the memory is read out using the application program, and the printer is controlled to print the image data by the printer. At this time, a user interface for operating the printer is displayed on the screen of the monitor, and similarly, the user instructs the computer about the print settings desired by the user via the printer user interface. In this case, the printer prints image data according to the request.

[0003]

As described above, conventionally, when data is transmitted between devices such as a scanner and a printer, a plurality of application programs that support each device are activated to transmit the data. Transmission had to be performed.

Conventionally, when a certain device is connected to one computer and another device is connected to another computer, among a plurality of computers connected via a network. Another one
When an application program is started on one computer and data is transmitted between these devices using the application program, it is difficult to transmit the data due to the intervening network. .

Further, conventionally, between a predetermined device and a device, it has been possible to send out data from one device and receive and process the data with the other device. Since sending data from one device to another does not guarantee that the other device will be able to receive and process the data, it is important to ensure that valid data is transmitted between those devices. In some cases, it was not possible.

Conventionally, when data is transmitted between devices, user interfaces for those devices are displayed separately, so that the user gives separate instructions on different user interfaces. And it is very inoperable for the user.

Accordingly, an object of the present invention is to solve the above-mentioned problems of the prior art, and to use an application program without depending on the type of a device such as a scanner or a printer or the type of a communication path such as a local connection or a network connection. To provide a device control system capable of performing similar control.

Another object of the present invention is to enable effective data transmission between arbitrary devices and to provide a user with operability optimized for any combination of devices. It is to provide a device control system that can perform the above.

[0009]

In order to achieve at least a part of the above object, a device control system of the present invention is a device control system for controlling one or more devices. And one or more device abstraction units respectively corresponding to the devices and exchanging data or information with the corresponding devices, and corresponding device abstraction units respectively corresponding to the device abstraction units. Connected via a communication path, the corresponding device abstraction unit, an application unit configured by a predetermined application program,
At least one interface unit that mediates exchange of data or information between the device and one or more communication path abstraction units provided between the corresponding device abstraction unit and the interface unit, respectively. The device abstraction unit absorbs a control difference caused by a device type for the corresponding device, and provides the application unit with the same control environment independent of the device type via the interface unit. The communication path abstraction unit absorbs a control difference caused by a type of the communication path for the communication path connecting the device abstraction unit and the interface unit, and provides the application unit with the communication path abstraction unit. On the other hand, the gist is to provide the same control environment independent of the type of the communication path via the interface unit.

[0010] The device control method of the present invention is a device control method for controlling one or more devices. (A) Each of the devices corresponds to the device, and data or information is exchanged with the corresponding device. Of the corresponding device, absorbs control differences caused by the device type of the corresponding device, and provides the same control environment independent of the device type to an application unit constructed by a predetermined application program. Generating one or more device abstraction units to be provided; (b) corresponding to each of the device abstraction units, connected to the corresponding device abstraction unit via a communication path, and corresponding to the device abstraction unit One or more interfaces that mediate the exchange of data or information between Generating a scan unit, for the communication path connecting between the (c) corresponding to said interface unit, the corresponding interface unit with the device abstraction units corresponding to the interface unit,
Generating one or more communication path abstraction sections for absorbing the control difference caused by the communication path type and providing the application section with the same control environment independent of the communication path type; And (d) controlling the device by the application unit via the interface unit, the communication path abstraction unit, and the device abstraction unit.

As described above, in the device control system and the device control method, the device abstraction unit exchanges data or information with the corresponding device, and controls the corresponding device based on the type of the device. To provide the same control environment independent of the type of device for an application unit constructed by a predetermined application program. The interface unit is connected to the corresponding device abstraction unit via a communication path, and mediates exchange of data or information between the corresponding device abstraction unit and the application unit. Furthermore, the communication path abstraction unit absorbs a control difference caused by the type of the communication path for the communication path connecting the device abstraction unit and the interface unit, and communicates with the application unit. Provide the same control environment independent of the type of road.

In this specification, the device includes:
Not only a physical device but also a part of the function of a physical device, a device having a function equivalent to a physical device by software, and a device that can be treated equivalently to a physical device are included. Examples of the physical device include a scanner, a printer, a digital camera, a facsimile, a copier, and various other computer peripheral devices. Some of the functions of the physical device include, for example, those in which only the FAX function of the multi-function color copier is disclosed to the outside. In addition, examples of a device having the same function as a physical device by software and a device that can be treated as a physical device include a processing server and an application server in addition to e-mail and image processing. . The application server is, for example, WE
When there is an application program for automatically searching and extracting image files included in the cache directory of the B browser, and the application program itself acts as a still image input device such as a digital camera In this case, the device has no physical entity.

The communication path includes, for example, a communication path connecting different computers across a network boundary, and a communication path connecting different processes across a process boundary within the same computer.

Therefore, according to the present invention, from an application program, one or more devices can be controlled in a similar control environment without being aware of the type of the device, via the device abstraction unit. Becomes possible. Also, through the communication path abstraction unit,
Regardless of the position of the device, control can be performed in a similar control environment without being aware of the type of communication path interposed therebetween.

In the device control system of the present invention,
When there are a plurality of the devices and a plurality of the device abstraction units corresponding to the devices, the device abstraction unit responds to an instruction from the application unit via a corresponding interface unit. The connection with the device abstraction unit may be canceled, and a connection may be established with another predetermined device abstraction unit via a communication path to exchange data or information.

As described above, by exchanging data or information between device abstraction units independently of the application unit and the interface unit,
Higher-speed data and information transmission becomes possible.

In the device control system of the present invention, when data or information is exchanged between device abstraction units, the communication path connecting between the two device abstraction units may be a communication path. It is preferable to provide a specific communication path abstraction section for absorbing the control difference caused by the type of the communication path and providing the same control environment independent of the type of the communication path to the two device abstraction sections. .

In this manner, data and information can be exchanged between the device abstraction units without being aware of the type of intervening communication path.

In the device control system of the present invention,
Display means for displaying a symbol corresponding to the device on a screen, and operation means for operating the displayed symbol, wherein the application unit or the interface unit displays the symbol by the operation means. It is preferable to control a device corresponding to the symbol according to the operation content.

Here, the symbol includes an icon representing the existence of a device, a figure or a symbol representing an abstraction of the device, characters representing the name of the device, and the like.
Any device can be used as long as it can be displayed on the display means and the correspondence with the device can be visually recognized by the user.

With this configuration, the user can intuitively give a device operation instruction while looking at the screen of the display means using the operation means, which is very easy for the user to use.

In the device control system of the present invention,
When there are a plurality of the devices, and when there are a plurality of the device abstraction units and the plurality of the interface units corresponding to the devices, each of the interface units provides the same interface to the application unit. Preferably, each device abstraction unit provides the same interface to the interface unit.

As described above, by providing the same interface to the higher-order components,
Can absorb the differences between the underlying devices,
The same control environment can be provided for components located at a higher level.

In the device control system of the present invention,
The interface unit, when instructed by the application unit to perform data transmission between a device corresponding to the interface unit and another device, exchanges information with the interface unit corresponding to the other device. Interact, and based on that information,
It is preferable to determine whether data transmission is possible between the corresponding device and the other device.

By making such a determination, control of subsequent devices is performed only when data transmission is possible, so that useless control need not be performed.

A recording medium according to the present invention is a computer-readable recording medium recording a computer program for constructing a device control system for controlling one or more devices, and corresponds to each of the devices. It exchanges data or information with a device, absorbs control differences caused by the device type of the corresponding device, and provides a device type to an application unit constructed by a predetermined application program. A function of generating one or more device abstraction units that provide the same control environment independent of the device abstraction unit, and correspond to the device abstraction unit, respectively, and are connected to the corresponding device abstraction unit via a communication path; Between the device abstraction unit and the application unit Or a function of generating one or more interface units for mediating the exchange of information, and a function corresponding to each of the interface units, and connecting between the corresponding interface unit and the device abstraction unit corresponding to the interface unit. About the communication channel,
A function of absorbing one or more control differences due to the type of communication path and generating one or more communication path abstraction parts that provide the same control environment independent of the type of communication path to the application unit. And a computer program for causing the computer to realize the above.

When the computer program recorded on such a recording medium is executed by a computer,
Since each component constituting the device control system is generated, the same effects as those of the device control system described above can be obtained.

The present invention provides a device control system,
The present invention can be realized in various modes such as a device control method, a computer program for constructing the system, a recording medium on which the computer program is recorded, a data signal including the computer program and embodied in a carrier wave.

[0029]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of the present invention will be described below based on examples. FIG. 1 is a block diagram showing a configuration of a device control system as one embodiment of the present invention.

In FIG. 1, devices 34a and 34b
Is a device to be controlled, such as a scanner or a printer. Further, the application unit 20 is constructed by a predetermined application program, and can control various devices 34a and 34b located at lower ends through lower-level components such as interface units 22a and 22b described later. .

In FIG. 1, the device control system according to the present embodiment includes interface units 22a and 22b, communication channel abstraction units 24a and 24b, and a device abstraction unit 28.
a, 28b. Each of these components is generated by a computer program corresponding to each of the devices 34a and 34b.

The device abstraction units 28a and 28b exchange various control information and the like, exchange data with the corresponding devices 34a and 34b, respectively, and also interface units 22a and 22b, the application unit 20, and the like. Abstraction of devices (hardware abstraction) is performed on the components located at the upper level of.

The device abstraction units 28a and 28b are respectively composed of device control units 30a and 30b and device drivers 32a and 32b. Of these, the device drivers 32a and 32b
With respect to 4a and 34b, the differences between individual devices are absorbed, and each device is abstracted with respect to the components located at higher levels. However, control differences based on the device class (device type) still remain.

That is, for example, when a device is a printer manufactured by Company A or a printer manufactured by Company B, if both printers belong to the same device class called a printer class, the device driver described above makes use of the device driver described above. There is no difference between this printer and the printer manufactured by Company B, and the higher-level components such as the device control units 30a and 30b are recognized as the same device of the printer class.

Specifically, for example, a general Windows (M
The printer driver for icrosoft) is designed to show the function of GDI (drawing function) of Windows to the outside of the driver, and it is a common requirement to print specific characters at a certain position. Is input, the request is converted into a command sequence unique to the corresponding printer, and then output to the corresponding printer to control the printer. Therefore, such printers
If the driver is used as the device driver of the present embodiment, a portion depending on each printer can be almost completely abstracted.

On the other hand, the device control units 30a and 30b
For the corresponding devices 34a and 34b, the difference in device class is also absorbed, and the interface units 22a and
Each device is completely abstracted with respect to a higher-order component such as 22b.

That is, the aforementioned device driver 32
Although differences between devices belonging to the same device class are absorbed by a and 32b, for example, differences between devices belonging to the printer class and devices belonging to the scanner class still remain. However, the device control unit 30
The differences between the device classes are absorbed by a and 30b, so that the elements in the higher-level configuration have no difference due to the type of the device, and are recognized as the same device.

Each of such device control units includes:
The complete abstraction of the device is performed by providing the same interface to all the higher-level components such as the interface units 22a and 22b.

For example, as a very simple example, it is conceivable that the following functions are provided by a common interface (general-purpose interface).

Data output (data stream, data type) Data input (data stream, data type) Device status acquisition (status ID, status value) Device status setting (status ID, status value) Device attribute acquisition (attribute ID, attribute value)-Device attribute setting (attribute ID, attribute value) However, parentheses are examples of parameters.

As described above, in each device control unit, the interface is unified with respect to the components located at a higher level. As a result, there is naturally a meaningless control item (function) depending on the device class. However, a higher-level component can grasp appropriate control for each device by checking the properties of each device in advance.

Although the device drivers are prepared for the individual devices 34a and 34b as described above, the device control units do not necessarily need to be prepared for the individual devices. What is necessary is just to be prepared so as to correspond to a specific device class.

The interface sections 22a and 22b exchange various control information and data between the application section 20 and the corresponding device abstraction sections 28a and 28b, respectively, and perform application and communication between higher-level applications. The same interface is provided for the unit 20. Also, the interface unit 2
Various control information and the like can be exchanged between 2a and 22b. Furthermore, the interface units 22a and 22b are provided with the corresponding devices 34a and 34.
It also has a function of displaying an icon representing b abstractly on a screen of a display means (not shown).

Incidentally, in the device control system of the present embodiment, as shown in FIG. 1, between the interface unit 22a and the device abstraction unit 28a, between the interface unit 22b and the device abstraction unit 28b, and Between the abstraction units 28a and 28b, there are boundaries indicated by alternate long and short dash lines, respectively. In general, a process boundary exists in the same computer, and a network boundary exists between different computers. This boundary indicated by a dashed line represents either a process boundary or a network boundary.

FIGS. 2 and 3 are block diagrams each showing a typical example of the connection form of the device control system of FIG.

In the example of FIG. 2A, the two devices 34a and 34b shown in FIG. 1 are directly connected to one computer 40. Therefore, in this example, device 3
4a and 34b, that is, the application unit 20 and the interface units 22a and 22 shown in FIG.
b, the communication path abstraction units 24a and 24b, and the device abstraction units 28a and 28b all exist in the same computer 40, so that all the boundaries shown by the dashed lines in FIG. 1 represent process boundaries.

In the example of FIG. 2B, two computers 42 and 44 are connected via a network 46, and two devices 34a and 34b are connected to the two computers 42 and 44, respectively. Have been. In the case of this example, among the main components other than the devices 34a and 34b, for example, the application unit 20, the interface units 22a and 22b, and the device abstraction unit 28
a exists in one computer 42, and the device abstraction unit 28b exists in the other computer 44.
Therefore, although the application unit 20, the interface units 22a and 22b, and the device abstraction unit 28a exist in the same computer 42, the device abstraction unit 28
Since b exists in a different computer 44, the boundary indicated by a dashed line between the interface unit 22a and the device abstraction unit 28a represents a process boundary, but the dashed line between the interface unit 22b and the device abstraction unit 28b. And the device abstraction units 28a and 28b
Each of the boundaries indicated by the dashed lines between and represents the network boundary.

The network includes the Internet, an intranet, a local area network (LAN), and a wide area network (WAN).
For example, various networks can be applied.

Further, in the example of FIG. 2C, three computers 48, 50 and 52 are connected via a network 54, and two of the computers 50, 50 and 52 are connected.
52 are connected to two devices 34a and 34b, respectively. In the case of this example, of the main components other than the devices 34a and 34b, the application unit 20,
And the interface units 22a and 22b exist in the first computer 48, and the device abstraction unit 28a exists in the second computer 50, and the device abstraction unit 2
8b resides in the third computer 52. Therefore, the device abstraction units 28a and 28b exist on different computers, and both of them are the application unit 20 and the interface units 22a and 22b.
1 exists on a computer different from the computer on which the network exists, all the boundaries shown by dashed lines in FIG. 1 represent network boundaries.

In FIG. 2, the computer includes:
In addition to various computers such as personal computers, mobile computers, information processing terminals, and workstations, peripheral devices such as copiers and printers having substantially computer functions, and set tops also having computer functions・ Box (Set
Top Box; for example, a form of information terminal represented by a Web TV receiving terminal), a game machine, and the like.
Although the device is illustrated in FIG. 2 as being connected to the outside of the computer, the device and the computer may be integrally configured as shown in FIG. 3, depending on the form of the device. .

In the example shown in FIG. 3A, the machine 41 includes a device section 34b 'and a computer section 40', and the device and the computer are integrated. Similarly, in the example of FIG. 3B, the machine 45 includes the device 34b ′ and the computer unit 44 ′, and in the example of FIG. 3C, the machine 53 includes the device unit 34b ′ and the computer unit. Each of the units has a unit 52 ′, and each of the units 52 ′ is integrated with a device and a computer.

As described above, between the interface unit 22a and the device abstraction unit 28a, between the interface unit 22b and the device abstraction unit 28b, and between the device abstraction units 28a and 28b, There are process boundaries or network boundaries indicated by dashed lines, respectively. Among them, in particular, between the interface unit 22a and the device abstraction unit 28a and between the interface unit 22b and the device abstraction unit 28b, There are communication paths 26a and 26b for connecting the interface unit 22a and the device abstraction unit 28a, and the interface unit 22b and the device abstraction unit 28b, respectively, beyond these boundaries. These communication paths 26a and 26b are provided depending on whether the boundary to be crossed is a process boundary or a network boundary.
The types are different, such as communication interface and network communication means.

On the other hand, the communication path abstraction units 24a and 24b
Communication paths 26a and 26a are provided between the interface unit 22a and the device abstraction unit 28a and between the interface unit 22b and the device abstraction unit 28b, respectively.
6b are formed on both sides thereof with a space therebetween. The communication path abstraction units 24a and 24b are used to exchange various control information between the interface units 22a and 22b and the device abstraction units 28a and 28b across process boundaries or network boundaries via the communication paths 26a and 26b, respectively. When exchanging data, the interface units 22a and 22b and the device abstraction unit 28
For a and 28b, an abstraction of a communication path interposed therebetween is performed. That is, the communication channel abstraction units 24a and 24b absorb the difference in the type of the intervening communication channel, and
2a, 22b and the device abstraction units 28a, 28b can exchange control information and data without being aware of whether the boundary is a process boundary or a network boundary.

The communication path abstraction units 24a and 24b
The mechanism of will be described in detail later.

As described above, the interface unit 22
a and 22b, the communication path abstraction units 24a and 24b, and the device abstraction units 28a and 28b are generated by computer programs. Specifically, for each computer in which each component exists, CPU reads and executes a desired computer program stored in the internal memory, thereby functioning as a component existing in the computer.

The computer program stored in the internal memory is, for example, a CD-ROM as described later.
It is provided in a form recorded on a computer-readable recording medium such as a ROM. That is, the computer program recorded on the recording medium is read by a reading device such as a CD-ROM device, and transferred to and stored in an external storage device such as a hard disk device. Then, the data is transferred to the internal memory as needed at the time of activation or the like. Alternatively, the read computer program may be directly transferred to the internal memory without going through the external storage device.

As described above, in this embodiment, the CD-ROM is used as a "recording medium" for recording a computer program in a computer-readable manner. However, a flexible disk, a magneto-optical disk, an IC Card, ROM cartridge, punch card,
Various computer-readable media such as printed matter on which codes such as barcodes are printed, internal storage devices (memory such as RAM and ROM) and external storage devices of the computer can be used.

In addition to providing the computer program in a form recorded on such a recording medium, the computer program accesses a program server (not shown) for supplying the computer program via a network, and You may make it take in in each computer.

A part of the computer program may be constituted by an operating system program.

Now, the processing operation of the device control system shown in FIG. 1 will be briefly described. For example, a user of the computer in which the application unit 20 and the interface units 22a and 22b are present instructs the application unit 20 to perform setting of the device 34a via operation means (not shown) such as a keyboard and a mouse. When input, the application unit 20 transmits the instruction to the interface unit 22a, and further,
The interface unit 22a transmits the instruction to the device abstraction unit 28a via the communication path 26a. The device abstraction unit 28a sets the device 34a according to the instruction.

For example, when a user inputs an instruction to the application unit 20 to transmit data from the device 34a to the device 34b, the application unit 20 transmits the data to the interface units 22a and 22b.
2b. The interface unit 22a,
22b communicates with each other in accordance with the instruction to determine whether valid data can be transmitted between the devices 34a and 34b, that is, when data is transmitted from the device 34a, It is determined whether the data can be received and processed.

Then, valid data can be transmitted, that is, even if data is transmitted from the device 34a,
If the device 34b determines that the data can be received and processed, the interface unit 2
2a transmits a data transmission instruction to the device abstraction unit 28a via the communication path 26a. Thus, the device abstraction unit 28a takes in data from the device 34a and sends the data to the interface unit 22a via the communication path 26a. Interface section 22a
Sends the data to the application unit 20. The application unit 20, for example, performs predetermined processing on the data, calls the interface unit 22b, and sends the data to the interface unit 22b. The interface unit 22b calls the device abstraction unit 28b via the communication path 26b, sends data to the device abstraction unit 28b, and sends the data to the device abstraction unit 28b.
Outputs the transmitted data to the device 34b. Upon receiving the data, the device 34b performs a predetermined process on the data.

In FIG. 1, black arrows indicate exchange of various control information and the like, and white arrows indicate the flow of transmitted data.

On the other hand, there is the following method for transmitting data. 4 and 5 are block diagrams for explaining another data transmission method in the device control system of FIG. That is, when the user inputs an instruction to the application unit 20 to transmit data from the device 34a to the device 34b, the application unit 20 transmits the instruction to the interface units 22a and 22b in FIG. The interface units 22a and 22b exchange data according to the instruction to determine whether valid data can be transmitted between the devices 34a and 34b, that is, when data is sent from the device 34a. , Device 34
At b, it is determined whether or not the data can be received and processed.

Then, valid data can be transmitted, that is, even if data is sent from the device 34a,
If the device 34b determines that the data can be received and processed, the interface unit 2
2a and 22b transmit data transmission instructions to the device abstraction units 28a and 28b via the communication paths 26a and 26b. Thereby, as shown in FIG. 5, the connection between the interface unit 22a and the device abstraction unit 28a and the connection between the interface unit 22b and the device abstraction unit 28b are released, and instead, the device abstraction unit is replaced. 28
A new connection is established between the device control unit 30a of device a and the device control unit 30b of device abstraction unit 28b via the communication path 38. Then, the communication path abstraction unit 36 is also newly generated, and when the device abstraction units 28a and 28b exchange various control information and data via the communication path 38 across process boundaries or network boundaries. Next, the communication path is abstracted to the device abstraction units 28a and 28b. That is, the channel abstraction unit 36 absorbs the difference in the type of the intervening channel 38,
It causes the device abstraction units 28a and 28b to exchange control information and data without being conscious of whether the boundary is a process boundary or a network boundary.

Thus, the device abstraction units 28a and 28a
b, the device abstraction unit 28
a fetches data from the device 34a and calls the device abstraction unit 28b via the communication path 38,
The acquired data is sent to the device abstraction unit 28b. The device abstraction unit 28b outputs the transmitted data to the device 34b. The device 34b performs a predetermined process on the input data.

Thereafter, when the data transmission is completed, the connection between the device abstraction units 28a and 28b is released,
Again, the interface unit 22a and the device abstraction unit 2
8a and between the interface unit 22b and the device abstraction unit 28b.

In the case of data transmission as described above, since the data transmission path is bypassed by the communication path 38, for example, the applied computer system is shown in FIG.
In the case shown in FIG. 3C or FIG. 3C, the network boundary between the device abstraction units 28a and 28b is optimized and the application unit 2
0, and the computer 48 having the interface units 22a and 22b does not intervene in data transmission at all, so that higher-speed data transmission is possible.

By the way, from the device 34a to the device 3
4b is instructed to transmit data, the interface units 22a and 22b communicate with each other to determine whether valid data can be transmitted between the devices 34a and 34b, ie , Device 34
When the data is sent from a, it is determined whether or not the device 34b can receive and process the data.

At this time, the interface units 22a, 22
b, the target device (that is, the device 34a,
The above determination is made with reference to the attribute information of 34b).
The attribute information to be referred to includes the type of the device, the device type on the sender side / device type on the receiver side, Push type / Pull type (whether the subject of data transmission is Source side or Destination side), data format that can be handled, device State (operability?), Performance (processing speed, etc.), location (section, floor, etc.), processing cost (communication cost, printing cost), presence / absence of special data transmission method support, and the like.

The attribute information is used in addition to the above-described determination to obtain an evaluation value indicating the degree of effectiveness of the target device combination, as described later.

The attribute information may be stored in the computer where the application unit 20 and the interface units 22a and 22b are present, but is stored in the computer where the device control unit and the device driver are present. Is also good. In this case, the interface units 22a, 22b are connected to the corresponding device control units 30a, 3
0b, establishes a connection with the device controllers 30a and 30b as necessary, and refers to the stored attribute information to transmit valid data. Will be determined. In addition, the attribute information is provided by a computer (for example, a computer) that exists on a network different from the computer on which the application unit 20 and the interface units 22a and 22b exist.
Server). In this case, the interface units 22a and 22b establish a connection with the server, and refer to the stored attribute information to determine whether valid data can be transmitted. Will be.

By the way, when data can be sent from one device and the other device can receive and process the data, even if those devices are connected via a network, the user can send the data. At first glance, those devices may be regarded as if they are composed of one device. Such a device is referred to herein as a composite device. That is, a composite device is a virtual device that has at least some of the functions of the device that sends data and at least some of the functions of the device that receives data among a plurality of target devices. Device. That is, as in the above example, the device 3
When the data is sent from the device 4a and the data is received and processed by the device 34b, the target devices are the device 34a and the device 34b.
A virtual device having at least a part of the function of 4b is a composite device.

Depending on the combination of devices, when data is sent from one device, it may not be possible to receive and process the data with the other device. In such a case, naturally, even if a composite device is virtualized for those devices, the composite device actually cannot operate.

Accordingly, as an example of a method for determining whether data can be received and processed by another device when data is sent from one device to another device, the following method is used. As such, it may be determined whether or not the combination of these arbitrary devices is a combination that can operate as a composite device.

Next, a specific example in the case where the device control system shown in FIG. 1 is realized by using the COM technique will be described.

Here, COM (Compornent Object Mode)
l) is an infrastructure that works with objects promoted and promoted by Microsoft,
It defines a method of constructing components that can be dynamically exchanged, and is a specification that defines standards for component architecture.

In COM, each service provided by software is implemented as a COM object. Each COM object has 1
Implements more than one interface. In addition, each C
Each OM object is identified by a class ID. In this specific example, among the components shown in FIG. 1, the interface units 22a and 22b and the device control units 30a and 30b are each configured as a COM object.

The interface implemented by the COM object is usually composed of several methods having some relation. Each interface is
Each is identified by an interface ID. A method is a function call for executing a specific function, and in order to call a method included in a specific interface, a pointer to the interface is required. An interface pointer can be obtained by designating an interface ID for identifying the interface, a class ID for identifying a COM object implementing the interface, and the like, and calling a service of the COM library.

FIG. 6 shows the device control system of FIG.
FIG. 14 is a block diagram illustrating a specific example in the case of realization using the technique of M.

In FIG. 6, the application unit 20
Is functioned by the application program as described above, and internally has an event handler (Ev
entHandler) N1.

The interface units 22a and 22b
Is composed of COM objects as described above, and each of the interfaces includes a plurality of interfaces I1 to I1.
0 is implemented. In the figure, each interface is represented by a circle. Of these interfaces, I
1 and I6 are ICyberPl (ICyberPl
ug), I2 and I7 are eye context menus (IContextMenu), I3 and I8 are eye drop sources (IDropSource), respectively.
I4 and I9 are eye drop targets (ID
ropTarget), and I5 and I10 are eye cyber events (ICyberEvent), respectively. this house,
The eye context menus I2 and I7, the eye drop sources I3 and I8, and the eye drop targets I4 and I9 are general interfaces, respectively.
Cyber events I5 and I10 are interfaces specific to this specific example.

As described above, the interface units 22a and 22b provide the same interface (general-purpose interface) to the application unit 20 located at a higher level.
The plugs I1 and I6 correspond to the interface.

The interface units 22a and 22b
Implements an interface such as an eye data object (IDataObject) in addition to the interface described above.

On the other hand, the device control units 30a and 30b also
As described above, it is constituted by the COM object, and each implements a plurality of interfaces I11 to I14. Of these interfaces, I1
1 and I3 are the i-cyber protocols (ICyb
erProtocol), and I12 and I14 are
It is a cyber event (ICyberEvent). Each of these interfaces I11 to I14 is an interface unique to this specific example. Also, the device control unit 3
0a and 30b are status modules as modules, respectively.
Monitors M1 and M2 are included.

As described above, the device control unit 3
The devices 0a and 30b provide a complete abstraction of the device by providing the same interface (general-purpose interface) to all the higher-level components such as the interface units 22a and 22b.
The above-mentioned i-cyber protocols I11 and I13
Is the interface.

In FIG. 6, the device drivers 32a and 32b and the devices 34a and 34b are the same as those in FIG.

In FIG. 6, a proxy (Proxy) P1,
P2 and stubs (Stubs) S1 and S2 constitute the communication channel abstraction unit 24a shown in FIG.
3, P4 and stubs S3, S4 are communication path abstraction units 24b.
Is composed. Such proxies and stubs are
It is generated by the OM / DCOM (Distributed COM) mechanism. COM / DCOM is a mechanism supported as standard on Windows platforms and the like.

Then, the communication path abstraction units 24a and 24b
A mechanism for performing the above-described abstraction of the communication path by using the functions of the proxy and the stub that configures the above will be described.

In COM, when a method included in an interface is called (hereinafter referred to as an interface call), the interface calling side is called a client, and the called side is called a server. The server is different from a) a case in which the client operates in the same process (same address space) on the same computer as the client, b) a case in which the server operates in a different process (address space) on the same computer as the client, and c) different from the client. It may run in a process (address space) on a computer.

Therefore, the interface units 22a, 22
b and the device control units 30a and 30b,
Assuming that the above-described relationship between the client and the server is brought in, if the boundary (boundary indicated by a dashed line) between the interface units 22a and 22b and the device control units 30a and 30b is a process boundary, b) If it is a network boundary, it corresponds to the case c).

In the cases b) and c), since the server has a different address space (process) from the client, it is impossible to call the function like a simple function call when making an interface call. Therefore, in this specific example, when the client calls the interface realized by the server, the client creates a proxy that implements the same interface as the server in the same process (address space) as the client, and passes through the proxy. To call. The proxy converts the client's interface call to a remote procedure call (RP
C; Remote Procedure Call)
Procedure Call (LRPC; Lightweight RPC)
And calls a stub created in the same process (address space) as the server. The stub is remote
Restore the procedure call or the interprocess remote procedure call to the original interface call and call the original interface in the server. Subsequent return of the call is an operation that reverses the above operation.

Here, the remote procedure call is a mechanism for calling a function across a network boundary, and the function call is converted into an exchange of data on the network. Thus, this remote procedure call is used in case c). The inter-process remote procedure call is a mechanism for calling a function across process boundaries on the same computer, and the function call is realized by inter-process communication. Therefore, this inter-process remote procedure call is used in case b).

As described above, by converting an interface call into a remote procedure call or an inter-process remote procedure call and exchanging between the proxy and the stub, the difference in the type of communication path is absorbed. The interface can be called without being conscious of whether the boundary is a process boundary or a network boundary, and an abstraction of a communication path can be realized.

The operation of this embodiment will now be described with reference to FIGS. In the following description, the device 34a is a scanner, and the device 34b
Is described as an example.

In the display area of the application functioning as the application section 20, a scanner as the device 34a and a printer as the device 34b are mounted in advance as control targets. As a result, the icon of the scanner and the icon of the printer are displayed on the screen of the display means (not shown) such as the CRT by the interface units 22a and 22b as shown in FIG. Users of existing computers such as 20
Various operations can be performed.

When the user operates an icon displayed on the screen using an operating means (not shown) such as a keyboard or a mouse, the operation is performed to set a scanner (for example, a scanner). (For example, by clicking the right button of the mouse on the icon of (1)), the application 20 calls up the eye context menu I2 from the interface unit 22a corresponding to the device 34a that is a scanner. The eye context menu I2 displays a context menu (pop-up menu) for the scanner in the vicinity of the scanner icon or, when the user instructs execution of an item in the menu, performs device control according to the instruction. The communication with the unit 30a is performed to set the device 34a as a scanner.

When the operation of the icon by the user is drag and drop (Drag & Drop) of the icon, the following operation is performed.

That is, when the user operates the mouse, FIG.
As shown in (b), when the scanner icon displayed on the screen is dragged with the mouse cursor and superimposed on the printer icon, the interface unit 2 is displayed.
2b, the eye drop source I3 mounted on the interface unit 22a is replaced by the eye drop target I3 mounted on the interface unit 22b.
9 passed. Specifically, Eye Drop Source I
One of the methods of the eye drop target I9 is called using the pointer 3 as a parameter.

Next, in the interface unit 22b, the eye drop target I9 extracts the pointer of the eye cyber plug I1 mounted on the interface unit 22a from the passed eye drop source I3, and An inquiry is made to the eye cyber plug I6 mounted on the unit 22b as to whether data transmission with the eye cyber plug I1 is established.

At this time, each interface unit 22
a, 22b, the corresponding device control units 30a, 30
b and establishes a connection with the device control units 30a and 30b as necessary, and then determines whether data transmission is established.

Next, the interface units 22a and 22b
If it is determined that data transmission is established, set the mouse cursor being dragged displayed on the screen to a shape that indicates that drag and drop is possible, and if it is determined that it is not established In, the mouse cursor being dragged is set to a shape indicating that drag and drop is prohibited.

When it is determined that the data transmission is established, the user operates the mouse to drop the scanner icon over the printer icon, and the interface unit 22b causes the eye drop target I9 But I Cyber Plug I6
Interface 2 in the method for starting data transmission
The eye cyber plug I1 mounted on 2a is passed, and the actual processing is left to the eye cyber plug I6.

The actual processing of data transmission is performed as follows. That is, data transmission is performed by the interface unit 22a and the application unit 2 as shown in FIG.
0, when performed via the interface unit 22b, as shown in FIGS. 8 to 12, and when performed directly between the device control units 30a and 30b as shown in FIG. This is performed as shown in FIGS.

FIG. 8 to FIG. 12 are explanatory diagrams showing the procedure for performing data transmission in the device control system of FIG. 6 in time series. In these drawings, a point that is a point at that time is indicated by a bold line, and a part that is less relevant at that point is indicated by a broken line.

When the data transmission process starts, first,
As shown in FIG. 8, data obtained from the device 34a (scanner) is input to the device driver 32a,
The data is stored in a buffer in the device driver 32a.
Next, as shown in FIG. 9, the data input is detected by the status monitor M1 of the device control unit 30a, and as an event, the application is transmitted via the proxy P1, the stub S1, and the eye cyber event I5 of the interface unit 22a. Event handler N of part 20
1 is notified. The application unit 20 can ignore the notified event, but can also input data immediately in response to the event.

When the application section 20 performs data input, as shown in FIG. 10, first, the application section 20 prepares a data storage area therein and calls the interface section 22a to acquire data (FIG. 10). Bold arrow). Thereby, the execution of the processing shifts to the interface unit 22a. Next, the proxy unit P2 and the stub S2 are generated while the interface unit 22a calls the device control unit 30a to acquire data (the thick arrow in FIG. 10). Then, a temporary area corresponding to the data storage area prepared by the application unit 20 is prepared inside the stub S2 for the device control unit 30a, and is passed as a parameter. Thereby, the execution of the processing shifts to the device control unit 30a. Next, the device control unit 30a calls the device driver 32a to acquire data. Thereby, the execution of the processing shifts to the device driver 32a.

Next, the device driver 32a copies the data stored in the buffer to the data storage area prepared by the stub S2. Then, upon the return of the function call, the processing is executed from the device driver 32a through the device control unit 30a to the interface unit 22a.
Move to a. Thereby, the interface unit 22a
Copies the data in the data storage area prepared by the stub S2 to the original data storage area prepared by the application unit 20. After that, the execution of the processing shifts from the interface unit 22a to the application unit 20 by the return of the function call.

Subsequently, the application section 20 reads data from the data storage area in the application section 20 and performs processing as necessary. Then, as shown in FIG. 11, the application unit 20 calls the interface unit 22b to send out data (FIG. 1).
1 thick arrow). Thereby, the execution of the process shifts to the interface unit 22b. Next, in order for the interface unit 22b to send out data, the device control unit 30b
(The thick arrow in FIG. 11), and the proxy P
4, a stub S4 is generated. Then, a temporary area corresponding to the data storage area prepared by the application unit 20 is prepared inside the stub S4 for the device control unit 30b, and the data output from the application unit 20 is copied to the area. Above, passed as a parameter. Thereby, the execution of the processing shifts to the device control unit 30b. Next, the device control unit 30b calls the device driver 32b to send out data. As a result, the processing is executed by the device driver 32.
Move to b.

Subsequently, the device driver 32b copies the data stored in the data storage area prepared by the stub S2 to the buffer of the device driver 32b. When the function call returns, the processing is executed from the device driver 32b to the device control unit 30.
b, the process proceeds to the application section 20 via the interface section 22b.

As shown in FIG. 12, the device driver 32b outputs the data stored in the buffer to the device 34b (printer).

In the case of the synchronous output, the device 34b
Until the output of the data to the device 34b is completed, the execution of the process does not shift to the upper layer. However, in the case of the asynchronous output, the execution of the process is performed without waiting for the completion of the data output to the device 34b. Move to.

On the other hand, when data transmission is performed directly between device control units 30a and 30b as shown in FIG. 5, the following is performed. FIG. 13 is a block diagram showing a specific example when the data transmission method shown in FIG. 5 is realized by using the COM technique.

As described above, the interface unit 22
In (b), the eye drop target I9 is used in the method of starting data transmission of the eye cyber plug I6 by using the eye drop target I9 mounted on the interface unit 22a.
After handing over the cyber plug I1 and leaving the actual processing to the eye cyber plug I6, the method for starting data transmission of the eye cyber plug I6 is performed by the device control units 30a and 30b according to the following procedure. To achieve direct data transmission between

That is, the eye of the interface section 22b
The cyber plug I6 instructs the device control unit 30b to start direct data transmission between the device control units, and the device control unit 30b on the other side.
The information required to generate a (at least the class ID of the device control unit 30a) is passed.

Thus, the device control unit 30b generates its own clone and also generates a clone of the device control unit 30a on the other side based on the passed information. Then, the newly generated device control unit 3
0b establishes a connection with the newly generated device control unit 30a to secure an optimal communication path. At this time, proxies P5 and P6 and stubs S5 and S6 are also generated as the communication path abstraction unit 36 shown in FIG.

After that, the device control unit 30b of the other party responds according to the specified communication setting.
Start data transmission with a. Thereafter, when the preset termination condition is satisfied, the data transmission is terminated, and the device control unit 30b releases the connection with the device control unit 30a.

FIG. 14 to FIG. 17 are explanatory diagrams showing the procedures for performing direct data transmission between the device control units 30a and 30b in FIG. 13 in order of time. In these drawings, a point that is a point at that time is indicated by a bold line, and a part that is less relevant at that point is indicated by a broken line.

When direct data transmission is performed between the device control units 30a and 30b, since the application unit 20 and the interface units 22a and 22b do not intervene, the device control units 30a and 30b directly call a method and send an event. Although transmission and data transmission are performed, the operation contents of the device control units 30a and 30b, the device driver 32a, and the devices 34a and 34b are the same as those in the case where the application unit 20 and the like are interposed, and thus the description is omitted. I do.

As described above, according to the present embodiment,
The application unit 20 includes an interface unit 22
a, 22b, the communication path abstraction units 24a, 24b, and the device abstraction units 28a, 28b, respectively, without being conscious of the types of the devices 34a, 34b and the types of the communication paths 26a, 26b interposed in the middle. , By controlling each device 34a, 34b,
34b, and each device 34a, 34b
Or data transmission between them.

Next, a description will be given of a specific example in which a virtual copier, which is one of the above-described composite devices, is realized by the device control system shown in FIG.

For example, the application unit 2 shown in FIG.
0 is a program for realizing a virtual copy machine (hereinafter, this program will be referred to as “Cyber Copy”), the application program “Cyber Copy” is used by a computer (FIG. When started on the (not shown), the sender (source [So
The scanner registered as the device on the urce] side and the printer registered as the device on the destination (Destination [Destination]) side are automatically selected. On the screen of the display means (not shown), a user interface like a copy machine is displayed as shown in FIG. Therefore, after the user operates the keyboard or mouse while looking at the display screen to specify the number of copies, the start button J1
Is clicked, a connection is established via the communication path, and image data is transmitted from the scanner, which is the sender device, to the printer, which is the receiver device, as described above. Is performed.

In this specification, a device capable of transmitting at least data and the like is referred to as a sender device, and a device capable of receiving at least data and the like is referred to as a receiver device. Therefore, for example, even a device that performs intermediate processing such as intermediate processing can be regarded as a sender device if at least data can be transmitted, and at least receives data and the like. If it is possible, it can be considered as a receiving device, so even such a device can be either a sending device or a receiving device.

The application program "Cyber Copy" is provided with options, such as device change, image enlargement / reduction, and image correction (in this case, color correction). That is, for example,
When the user enlarges an image on the screen shown in FIG.
When an instruction such as with reduction or image correction is given,
An image processing server registered in advance by default is incorporated in the connection relationship described above, and image data is transmitted via the image processing server, and the image processing server enlarges or reduces an image to be copied. Desired processing such as processing and color correction processing is added.

FIG. 19 shows the flow of image data at this time. In FIG. 19, the scanner B is used as the sender device.
However, it is assumed that the printer D is selected as the receiver device and the image processing server D is selected as the processing server. The image data is input from the scanner B to the image processing server D via the device abstraction unit 60a, the communication path abstraction unit 62, and the device abstraction unit 60c, where the desired processing is performed, and then the device abstraction is performed. Part 60
c, to the printer D via the communication path abstraction unit 64 and the device abstraction unit 60b. Here, for the sake of simplicity of explanation, the sender device, the receiver device, and the processing server are separated. However, as described above, the processing server is also a device. Is a receiver device for the scanner, and is a sender device for the printer.

Further, the communication status between the devices at this time is displayed on the screen of the display means as a window as shown in FIG. 18 and presented to the user.

On the other hand, devices such as a sender device, a receiver device, and a processing server can be arbitrarily selected by the user. That is, if the user
When the device selection button J2 shown in FIG.
A device selection tree as shown by 0 is displayed on the screen of the display means. The user can freely select a desired device from them.

As described above, the device control system of the present embodiment can easily realize a virtual copy machine which is one of the composite devices.

Now, the present embodiment will be described more specifically. FIG. 21 is a block diagram showing a device control system when connected in the connection form of FIG. 2C. The components shown in FIG. 21 correspond to those in FIG.
Also, the same components as those shown in FIG. 2 (c) are described with different reference numerals.

As shown in FIG. 21, the computer 100
Is connected to a computer 200 connected to a printer 240 as a receiver device and a computer 300 connected to a scanner 340 as a sender device via a network (not shown). . In addition, the computer 100 is directly connected to a monitor 170 including a CRT and a liquid crystal display, which can display various images such as a user interface.

Further, the computer 100 includes an application unit 110 and interface units 120 and 140.
And user interface (UI) data storage unit 1
50, an icon data storage unit 160, and a proxy (Pr
oxy) 180, 190. On the other hand, the computers 200 and 300 each have a stub (Stu
b) 210, 310 and device control units 220, 320
And device drivers 230 and 330.

Among these, the application unit 110
Is constructed by a predetermined application program. The applications here include shells that display the Windows user interface,
Part of S is also included in this. The interface unit 120, the proxy 180, the stub 210, the device control unit 220, and the device driver 230 respectively
It is generated corresponding to the printer 240 that is the receiver device. On the other hand, the interface unit 140, the proxy 190, the stub 310, the device control unit 320, and the device driver 330 are respectively generated corresponding to the scanner 340 as the sender device.

The interface unit 120 includes a determination unit 122, a device information storage unit 124, a user interface (UI) reference table 128, a data transmission execution unit 129, an icon reference table 130, and a data output unit 132. , Associating unit 134 and determining unit 136
And Also, the interface unit 140
Has at least a device information storage unit 144 and a data transmission execution unit 148. Each of these components is generated by a computer program. The device information storage unit 124 and the device information storage unit 144 store information 125 and 145 of the corresponding device class, information 126 and 146 of the composite operable device class, and information 12 of the composite device category.
7 and 147 are stored in advance, and the result accumulation information 1
31, 149 are stored. Note that such information will be described later in detail.

FIG. 22 shows the computer 100 shown in FIG.
FIG. 2 is a block diagram illustrating an outline of a hardware configuration of FIG.

As shown in FIG. 22, as a hardware configuration, a computer 100 has, inside or outside, a CPU 70 for performing various processes and controls according to a computer program, and stores and executes the computer program. A memory 72 for temporarily storing data and the like obtained therein, an I / O unit 74 for exchanging data and the like with various peripheral devices, and a memory for storing various data. A hard disk device 76, a communication device 78 for communicating with other devices via a network, including a modem, a terminal adapter, a network card, and the like, a CD-ROM drive device 80, and inputs of instructions from a user, etc. And a monitor 170 described above.

As described above, the components in the application section 110 and the interface sections 120 and 140 are each generated by a computer program. Specifically, as described above, in the computer 100, CPU 70 has a memory 72
By reading and executing a desired computer program stored in the computer, the computer functions as those components.

In this embodiment, as described above, the memory 7
2 is provided in a form recorded on a CD-ROM 82 which is a recording medium, and is read into the CD-ROM drive device 80 and taken into the computer 100.
The fetched computer program is transferred to the hard disk device 76, and thereafter, the memory
2 Alternatively, the read computer program may be directly transferred to the memory 72 without passing through the hard disk device 76.

Furthermore, in the present embodiment, each of the components in the interface units 120 and 140 is realized by software, but these may be realized by hardware.

The UI data storage unit 150 and the icon data storage unit 160 are provided in the hard disk device 76, respectively.

Now, the operation of the device control system shown in FIG. 21 will be described. Now computer 100
User captures an image by, for example, a scanner 340 connected to the computer 300, and transfers the captured image to the printer 24 connected to the computer 200.
Consider the case where printing is to be performed with 0.

The monitor 1 connected to the computer 100
As shown in FIG. 23, a scanner icon 4 that visually represents a scanner 340 that is a sender device (device on the source [Source] side) is displayed on the screen 400 of 70.
10 and the receiving device (destination [De
and a printer icon 420 that visually represents the printer 240, which is a device on the [stination] side. Among them, the scanner icon 410 is displayed by the interface unit 140 corresponding to the scanner 340, and the printer icon 420 is displayed by the interface unit 120 corresponding to the printer 240.

Therefore, the user of the computer 100
First, the user operates the mouse 84 connected to the computer 100 to display the mouse cursor 4 displayed on the screen 400.
When the user selects and drags (Drags) the scanner icon 410 on the sender side with the application unit 11,
0 calls the interface unit 140 corresponding to the scanner 340 based on the operation content. Subsequently, when the user operates the mouse 84 and superimposes the dragged scanner icon 410 ′ on the receiver-side printer icon 420, the application unit 110 executes the printer 2 according to the operation content.
A call is made to the interface unit 120 corresponding to 40. As a result, the interface unit 120 corresponding to the printer 240, which is the device on the receiving side, mainly performs the data transmission start processing shown in FIG.

In the present embodiment, the interface unit corresponding to the device on the receiver side executes the processing mainly as described above. However, the present invention is not limited to this. Alternatively, the interface unit corresponding to the device on the sender side may perform the processing mainly.

FIG. 24 is a flowchart showing the flow of the data transmission start process executed by the interface unit 120 in FIG.

Since the operation of the mouse 84 by the user is transmitted to the interface unit 120 via the application unit 110, when the processing shown in FIG. Based on the content transmitted, the unit 134 outputs the printer 24 corresponding to the interface unit 120.
0 is associated with the other device (step S102). The associating unit 134 recognizes that the printer 240, which is the corresponding device, is the target of the association by calling the interface unit 120 from the application unit 110. On the other hand, the associating unit 134 recognizes from the operation content of the mouse 84 transmitted from the application unit 110 that the partner device to be associated is the scanner 340. Accordingly, the associating unit 134 determines that the corresponding printer 2
The scanner 340 is associated with 40 as a partner device, and the result is transmitted to the determination unit 122.

[0146] Next, based on the result transmitted, the judging section 122 divides the information of the device class (that is, the type of device) of each of the printer 240 as the corresponding device and the scanner 340 as the other device into the device information. It is acquired from the storage unit 124 and the device information storage unit 144 of the interface unit 140 corresponding to the scanner 340 (step S104).

As described above, the device information storage unit 12
4 and the device information storage unit 144 store information 125 and 145 of the corresponding device class, respectively. The information 125 and 145 of the corresponding device class are
This is information describing the device class of a device corresponding to each of the interface units 120 and 140 (that is, a corresponding device). Specifically, the information 125 describes “printer” as a device class of the printer 240, and the information 145 describes “scanner” as a device class of the scanner 340.

Accordingly, the determination unit 122 accesses the device information storage unit 124 to acquire the information 125 of the corresponding device class (device class of the printer 240) stored therein,
The device information storage unit 144 of the “0” is accessed to acquire the information 145 of the corresponding device class (device class of the scanner 340) stored therein.

[0149] Next, the judging unit 122 obtains the acquired information 12
From 5,145, the device class of the printer 240 as the corresponding device is “printer”, and the device class of the scanner 340 as the counterpart device is “scanner”.
Is recognized, the multi-operation enabled device class information 12 stored in the device information storage unit 124
6 (step S106), the combination of these device classes (ie, "printer" and "scanner")
Is determined to be a combination operable as a composite device (step S108).

As described above, the composite device is a virtual device having both at least a part of the functions of the target sender device and at least a part of the functions of the target receiver device. Device. That is, in this case, the target devices are the scanner 340 and the printer 240,
A virtual device that has at least a part of the functions of the scanner 340 and at least a part of the functions of the printer 240 is a composite device.

When such a composite device is imagined,
As described above, depending on the combination of devices, the composite device may not actually operate. Therefore,
The determination unit 122 determines in steps S106 and S108 described above.
By the above process, it is determined whether or not the virtual composite device is operable.

As described above, between arbitrary devices, depending on the combination of devices, when data is sent from one device, it may not be possible to receive and process the data with the other device. . In such a case, naturally, even if a composite device is virtualized for those devices, the composite device actually cannot operate. Therefore, in the case of this example, when data is sent from one device, one of the methods for determining whether the data can be received and processed by the other device is to use those arbitrary devices. It is determined by the determination unit 122 whether or not the combination is a combination operable as a composite device.
The determination is made by the processing of 106 and S108.

Therefore, instead of judging whether or not the combination of the arbitrary devices is a combination operable as a composite device, the data from the one device is determined by another judgment method. Is sent, the other device may determine whether the data can be received and processed.

As described above, the device information storage unit 124 and the device information storage unit 144 store the information 126 and 146 of the multifunction device class, respectively. The information 126 and 146 of the composite operable device class is stored in the interface units 120 and 14.
Devices corresponding to 0 (ie, corresponding devices)
This is information that lists other device classes in which the composite device virtualized by the combination is operable when combined with the above device class. Specifically, the information 126 includes “scanner”, “digital camera”, and “digital camera” as other device classes in which the composite device can operate when combined with the device class “printer”.
"Facsimile" and "E-mail" are described.
On the other hand, the information 146 describes “Printer”, “Facsimile”, and “E-mail” as other device classes that can operate the composite device when combined with the device class “Scanner”.

The other device classes combined with the device class of a certain receiver device are all device classes of the sender device.
All other device classes combined with the device class of a certain sender device are device classes of the receiver device. Therefore, in the above case, “scanner”, “digital camera”,
“Facsimile” and “E-mail” are all device classes of the sender device, and “Printer”, “Facsimile”, and “E-mail” combined with “Scanner” which is the device class of the sender device. "
Are all device classes of the receiving device.
Here, the facsimile and the e-mail function both as the sender device and the receiver device, so the device classes “facsimile” and “e-mail”
Belongs to both device classes of the sender device and the receiver device.

Therefore, the determination unit 122 stores in the device information storage unit 124 a case where the device class “scanner” of the scanner 340 as the partner device is combined with the device class “printer” of the printer 240 as the corresponding device. Referring to the composite operable device class information 126 described above, as described above, for the device class “printer”, the device classes “scanner”, “digital camera”, “facsimile”, and “e-mail” Since the combination is described as a combination operable as a device, the combination of the device classes “printer” and “scanner” is determined to be a combination operable as a composite device. When the determination unit 122 determines whether or not the combination is operable as a composite device, the determination unit 122 transmits the determination result to the determination unit 136. Note that, at this time, the determination unit 122
Along with the determination result, the scanner 3 which is the partner device
The information of the name of 40 and the device class is also transmitted.

Next, when the determination unit 122 determines that the combination is operable as a composite device, the determination unit 136 refers to the composite device category information 127 stored in the device information storage unit 124 to determine The type of the previously imagined composite device is determined (step S110), and the determination result by the determination unit 122 and the determination result by the determination unit 136 are stored in the device information storage units 124 and 144 as result storage information 131 and 149.

As described above, the device information storage unit 12
4 and the device information storage unit 144 store information 127 and 147 of the composite device category, respectively. Information 127, 147 of this composite device category
Is information indicating the type (composite device category) of the corresponding composite device for each combination of device classes that can be operated as a composite device. Specifically, the following is described in the information 127 and the information 147.

“Printer” + “Scanner” = “copier” “Scanner” + “Facsimile” = “Facsimile (transmitting side)” “Printer” + “Facsimile” = “Facsimile (receiving side)”

For example, in a combination of the device classes “printer” and “scanner”, a copy machine can be considered as a device having both a printer function and a scanner function. Is described. Further, in the combination of “scanner” and “facsimile”, a transmission-side facsimile can be considered as a device having both the function of the scanner and the function of the transmission part of the facsimile. Facsimile (transmission side) "is described. Furthermore, in the combination of “printer” and “facsimile”, a receiving-side facsimile can be considered as a device having both the function of the printer and the function of the receiving part of the facsimile. Facsimile (receiving side) "is described.

The other composite device categories include
The following can be considered.

“Digital camera” + “E-mail” = ”
Direct mail transmission ”The combination of“ digital camera ”and“ email ”
Direct mail transmission as a virtual device that has both the function of a digital camera and the function of the e-mail transmission part, which can directly send an image taken by a digital camera to a preset destination by e-mail Therefore, “direct mail transmission” is given as the type of the composite device corresponding to the combination.

Thus, the determination unit 136 determines the device class “printer” of the printer 240 as a corresponding device,
As for the combination of the device class “scanner” of the scanner 340 that is the partner device and the combination 127 of the composite device category stored in the device information storage unit 124, as described above, the device class “printer” and “ For the combination with “scanner”, “copier” is described as the type of composite device, so this “copier” is determined as the type of composite device corresponding to the combination of “printer” and “scanner”. I do.

As described above, the type of the composite device determined by the determination unit 136 is determined by the result storage information 131, together with the result determined by the determination unit 122, as described above.
149. Specifically, for example, in the case of the result accumulation information 131, the scanner 3 that is the partner device
The name of the composite device, the determination result indicating that the device can be operated as a composite device when combined, and the type of the composite device (that is, “copier”) are stored. On the other hand, in the case of the result accumulation information 149 which is the other party,
The name of the printer 240, which is the partner device when viewed from the scanner 340, the determination result that the combined device can operate as a combined device when combined, and the type of the combined device (that is, "copier") are stored. become.

After that, returning to FIG.
00 operates the mouse 84 to operate the scanner icon 410 ′ superimposed on the printer icon 420.
Is dropped at that position, the processing in step S112 shown in FIG. 24 is continued.

That is, the decision unit 136 instructs the data transmission execution unit 129 and the data transmission execution unit 148 in the interface unit 140 to start data transmission (step S112). Then, these data transmission execution units 12
9 and 148 start the data transmission execution process (step S114). Specifically, the data transmission execution unit 14
8 notifies the start of data transmission from the proxy 190 to the stub 310 in another computer 300 over the network, and the stub 310 notifies the device driver 330 via the device control unit 320. This allows
The device driver 330 takes in data from the scanner 340 and sends the data to the data transmission execution unit 148 of the interface unit 140 via the device control unit 320, the stub 310, and the proxy 190. The data transmission execution unit 148 sends the data to the data transmission execution unit 129 of the interface unit 120 via the application unit 110. The data transmission execution unit 129 sends the data from the proxy 180 over the network to the stub 210 in another computer 200, and
10 sends the data to the device driver 230 via the device control unit 220, and the device driver 230 outputs the data to the printer 240. Thus, the scanner 34
The data is transmitted from 0 to the printer 240.

At this time, the proxies 180 and 190
As described above, the stubs 210 and 310 are positioned higher when various control information and data are exchanged between the computers 100 and 200 or between the computers 100 and 300 via a network. Application unit 110 and interface unit 12
For 0 and 140, the communication path connecting the computers is abstracted. That is, the proxy 180, 190
The stubs 210 and 310 absorb differences in the types of intervening communication paths, and, for example, determine whether the intervening communication path is a communication path connecting different computers across a network boundary or within the same computer. Control information and data can be exchanged without making the application unit 110 or the interface units 120 and 140 conscious of whether the communication path connects different processes across process boundaries.

The device controllers 220 and 320 also
As described above, the difference between the device classes (device types) of the corresponding devices (that is, the printer 240 for the device control unit 220 and the scanner 340 for the device control unit 320) is absorbed, and the upper-level application unit 110 And interface section 12
For 0 and 140, device abstraction (hardware abstraction) is performed.

Therefore, the proxy 18 is transmitted from the application unit 110 and the interface units 120 and 140.
0, 190 and the stubs 210, 310, the device can be set and controlled in a similar control environment, regardless of the position of the device, regardless of the type of communication path interposed therebetween. And operations can be performed. Further, through the device control units 220 and 320, device setting, control, and operation can be performed in a similar control environment without being aware of a difference in device class (device type).

[0170] As described above, the user of the computer 100 operates the mouse 84 to change the printer icon 4
Dropping the scanner icon 410 ′ overlaid on 20 will cause transmission of data from the scanner 340 to the printer 240.

On the other hand, step S10 in FIG.
In step 8, when the determination unit 122 determines that the combination is not a combination operable as a composite device, the following processing is performed. That is, when such a determination result is obtained, the determination unit 136 instructs the data output unit 132 to display a mark that cannot be associated (step S116). Accordingly, the data output unit 132 displays a predetermined mark indicating that association is impossible on the screen of the monitor 170 at a position where the icon corresponding to the sender device and the icon corresponding to the receiver device overlap each other. The user is instructed that the combination of the target device on the sender side and the device on the receiver side cannot operate as a composite device, and that the association is not finally established.

As described above, according to this embodiment, the user of the computer 100 captures an image by the scanner 340 connected to the computer 300 and prints the captured image by the printer 240 connected to the computer 200. As the scanner icon 4
When the user drags and superimposes on the printer icon 420, the scanner 340 and the printer
It is determined whether the combination with 0 is a combination operable as a composite device. Therefore, if it is determined that the combination is operable as a result of the determination,
Even if image data is sent out from the scanner 340, it is guaranteed that the printer 240 can receive and process the image data. Therefore, after that, the scanner icon 410 ′ which has been overlapped is changed to the printer icon 42.
0 and the scanner 340 to the printer 240
Even if transmission of image data to the device is started, effective data transmission can be performed between these devices without any problem.

In the above example, when the scanner icon 410 ′ superimposed on the printer icon 420 is dropped, the scanner 340 immediately sends the printer 2
Although data transmission to 40 has started, in the following example, the user interface is displayed on the screen of the monitor 170 at the moment of dropping, instead of immediately starting data transmission.

FIG. 25 is a flowchart showing the flow of a user interface display process executed by the interface unit 120 in FIG.

In FIG. 25, step S122
Steps S136 and S136 are the same as those in FIG.
4 are the same as the processing of steps S102 to S110 and the processing of step S116, and thus description thereof is omitted.

Next, the processing after step S132 will be described. In step S130, when the determination unit 136 determines the type of the composite device (that is, determines “copy machine” as the type of the composite device), the determination unit 136 refers to the UI reference table 128 next. A user interface corresponding to the determined type of composite device is determined (step S132). In the UI reference table 128, for example, for each type of operable composite device, for example, an identification number of a corresponding user interface is described. Therefore, the decision unit 13
6 obtains, from the UI reference table 128, the identification number of the user interface corresponding to the determined type of the composite device, and outputs it to the data output unit 132.
Tell

After that, returning to FIG.
00 operates the mouse 84 to operate the scanner icon 410 ′ superimposed on the printer icon 420.
Is dropped at that position, the processing in step S134 shown in FIG. 25 is continued.

That is, the data output unit 132 outputs U based on the transmitted user interface identification number.
From the I data storage unit 150, the data of the corresponding user interface, that is, the data for displaying the user interface on the screen of the monitor 170 is downloaded. The UI data storage unit 150 stores, for each type of operable composite device,
The corresponding user interface data is stored. Here, the user interface corresponding to the type of the composite device is a user interface for operating the composite device, and is suitable for setting, controlling, and operating the composite device in a narrow sense. User interface.

Therefore, in this example, since the type of the composite device determined by the determination unit 136 is “copy machine”, the data output unit 132 outputs the data of the user interface stored in the UI data storage unit 150. Of the user interface for operating the copier from among the above, and download the data.

Subsequently, the data output unit 132 outputs the downloaded user interface data to the monitor 170 connected to the computer 100, and operates the copier as the composite device on the screen of the monitor 170. Is displayed (step S134).

As described above, the user of the computer 100 operates the mouse 84 to change the printer icon 4
At the moment when the scanner icon 410 ′ superimposed on the printer 20 is dropped, the screen of the monitor 170 is a composite device as shown in FIG. 26 as a user interface for operating both the scanner 340 and the printer 240. A user interface for operating the copy machine is displayed.

In the case of the above example, the type of the composite device is “copier” due to the combination of the device classes “printer” and “scanner”.
26, a user interface for operating the copier as shown in FIG. 26 is displayed. For example, if the device class is a combination of "printer" and "facsimile", the type of composite device Is "facsimile (reception side)", so that a user interface for operating the reception side facsimile as shown in FIG. 27 is displayed on the screen of the monitor 170.

As described above, according to this embodiment, the user of the computer 100 captures an image by the scanner 340 connected to the computer 300, and prints the captured image by the printer 240 connected to the computer 200. In such a case, a user interface for operating a copier having both printer and scanner functions is displayed as a user interface for operating both the scanner 340 and the printer 240. There is no need to use different user interfaces for the 340 and the printer 240, and it is possible to give instructions such as settings at once with an integrated user interface, and to provide the user with optimized operability. thing It can be. In addition, the user can regard the scanner 340 and the printer 240 as a copier as one composite device and operate them in a unified manner, so that the operability can be further optimized.

In the above description, the scanner icon 41 superimposed on the printer icon 420 has been described.
At the moment when you drop 0 ', on the screen of the monitor 170,
Although described as displaying the user interface, as described below, prior to displaying the user interface for operating the composite device,
An icon corresponding to the composite device may be displayed. In this case, in order to allow the user to select whether or not to display an icon, a menu is displayed in which it is detected whether a specific key is pressed at the time of drag and drop, or an icon can be selected. And so on.

FIG. 28 is a flowchart showing the flow of processing when a part of the user interface display processing shown in FIG. 25 is changed.

In this modification, the determining unit 136 determines the user interface corresponding to the type of the composite device determined in step S130 by referring to the UI reference table 128 (step S132).
The determining unit 136 refers to the icon reference table 130 and determines an icon corresponding to the type of the composite device determined in step S130 (step S140). In the icon reference table 130, for example, for each type of operable composite device, for example, the identification number of the corresponding icon is described. Thereby, the determining unit 136 obtains the identification number of the corresponding icon from the icon reference table 130 based on the determined type of the composite device, and transmits it to the data output unit 132.

Then, the user of the computer 100
By operating the mouse 84 and dropping the scanner icon 410 ′ superimposed on the printer icon 420 at that position, the processing from step S 142 shown in FIG. 28 is continued.

That is, the data output unit 132 determines, based on the identification number of the icon transmitted from the determination unit 136,
Data for displaying the corresponding icon on the screen of the monitor 170 is downloaded from the icon data storage unit 160. The icon data storage unit 160 stores, for each type of operable composite device,
Icon data that visually represents the composite device is stored.

Therefore, as described above, assuming that the type of the composite device determined by the determination unit 136 is “copier”, the data output unit 132 sends the icon data storage unit 1
The icon data corresponding to the copy machine is selected and downloaded from the icon data stored in 60.

Subsequently, the data output unit 132 outputs the data of the downloaded icon to the monitor 170 connected to the computer 100, and displays an icon corresponding to the copy machine which is the composite device on the screen of the monitor 170. Is displayed (step S142).

Thus, the user of the computer 100
At the moment when the mouse 84 is operated to drop the scanner icon 410 ′ superimposed on the printer icon 420, the copy machine as a composite device is visually displayed on the screen of the monitor 170 as shown in FIG. The displayed copy machine icon 440 will be displayed. This may be displayed at the position where it is dragged and dropped, or may be displayed at another location such as a composite device folder. Note that the original scanner icon 410 and printer icon 420 may temporarily disappear from the screen of the monitor 170 as shown in FIG. 29, or may continue to be displayed on the screen as it is.

Next, for the displayed copier icon 440, the determination unit 136 determines the information indicating what kind of device the composite device indicated by the icon is actually composed of (ie, the composite device). The information indicating that the copier is composed of the scanner 340 as the sender device and the printer 240 as the receiver device) is stored in the device information storage units 124 and 144.
29, the user of the computer 100 operates the mouse 84 to place the mouse cursor 430 on the copy machine icon 440, and press the button of the mouse 84, as shown in FIG. It is monitored whether or not the button has been clicked (step S144).
Then, when the determination unit 136 detects that the click has been performed, the process of step S134 described above is executed. The processing in step S134 has already been described with reference to FIG. 25, and a description thereof will not be repeated.

Thus, the user of the computer 100
With the mouse cursor 430 superimposed on the copy machine icon 440, the moment the button of the mouse 84 is clicked, the processing of step S144 causes the copy screen as shown in FIG. The user interface for operating the machine is displayed.

As described above, by displaying the icon corresponding to the copier, which is a multifunction device, as the icon corresponding to the combination of the scanner 340 and the printer 240 to be associated, the user of the computer 100 can use the scanner 340. And the printer 240 can be visually recognized as one new device (ie, a copier), which facilitates subsequent handling.
Further, when an icon corresponding to the multifunction device copier is displayed, a user interface for operating the multifunction device copier is displayed in accordance with a predetermined instruction from the user. Can immediately input an instruction such as a setting of the copier via the user interface.

Next, when a user interface for operating a multifunction device (for example, a copying machine) is displayed on the screen of the monitor 170, the user of the computer 100 can use the user interface via the user interface. When an instruction such as a setting for the composite device is input to the computer 100,
The instruction is sent to the printer 2 connected to the computer 200.
40 and a scanner 340 connected to the computer 300
Is explained.

The user of the computer 100 operates a keyboard (not shown), a mouse 84 and the like to operate the monitor 1.
When the user inputs a setting instruction for the multifunction device via the user interface displayed on the screen 70, the application unit 110 issues an instruction for setting related to the printer 240 to the interface unit 1.
The instruction is transmitted to the interface unit 140, and the instruction for setting related to the scanner 340 is transmitted to the interface unit 140. Each interface unit 12
0, 140 respectively transmit the instruction to the proxy 180,
190 to another computer 20 across the network
0, 300 to stubs 210, 310 and stub 2
10 and 310 communicate to the device drivers 230 and 330 via the device control units 220 and 320. As a result, the device driver 230 sets the printer 240 according to the instruction, and the device driver 330
Sets the scanner 340.

By the way, as described above, in the data transmission start processing shown in FIG.
In the user interface display process shown in FIG. 25, in step S130, the determination result by the determination unit 122 and the determination result by the determination unit 136 are stored in the device information storage unit 124 as the result storage information 131. That is, in the case of the above-described example, the printer 2 as the corresponding device is used.
The scanner 340 is associated with 40 as a partner device, and the above-described processing is performed. If another device is associated with the corresponding printer 240,
The above processing is performed each time, and the determination result and the determination result are accumulated as the result accumulation information 131. Therefore, the result accumulation information 131 indicates that all devices previously associated with the corresponding printer 240 can operate as a composite device when combined with the device name. The result of the determination as to whether the device is operable and the type of the composite device when the device is operable are stored.

Therefore, the following processing can be performed by using the accumulated information 131. That is, for a device that has been associated with the printer 240 as a corresponding device at least once in the past, since information related to the device is stored in the result accumulation information 131, FIG.
In the data transmission start process shown in FIG. 4 or the user interface display process shown in FIG.
When the name of the partner device with which the association has been made is transmitted from the association unit 134, the result accumulation information 13
1 is accessed to search whether information on the partner device is stored, and if so, the information is read. Then, looking at the information, in the combination with the partner device,
If it is determined that the device can be operated as a multifunction device, the process proceeds to step S112 in the data transmission start process and to step S1 in the user interface display process.
Up to 32, the processing is skipped, and the subsequent processing is performed based on the above information. If it is determined that the operation is not possible, the process is skipped to step S116 in the data transmission start process and to step S136 in the user interface display process, and the process is performed.

By doing so, the processing such as reference, judgment and determination (the processing of steps S104 to S110 or steps S124 to S130) is omitted, so that the processing time can be shortened.

When the result accumulation information 131 includes association frequency information indicating the frequency of association with the printer 240 for the partner device, a series of processing of data transmission start processing and user interface display processing is performed. Is completed, the determination unit 122 accesses the result accumulation information 131 again and updates the association frequency information of the partner device (that is, increases the association frequency by one).

Further, if the result accumulation information 131 is used, the following processing can be performed. FIG. 30 is an explanatory diagram showing a pop-up menu displayed near a printer icon on the screen of the monitor 170 using the result accumulation information 131 in FIG. As shown in FIG.
A printer icon 420 is displayed on the screen 400 of the monitor 170.
Is displayed, the user operates the mouse 84 and the mouse cursor 43 displayed on the screen 400 is displayed.
0, the printer icon 420 is selected, and the right button of the mouse 84 is clicked there.
2 displays a pop-up menu 470 near the printer icon 420 with reference to the result accumulation information 131. In the pop-up menu 470, the names of devices that have been associated with the corresponding printer 240 in the past and have been determined to be a combination operable as a composite device are displayed in a row. In addition, the display order is based on the association frequency information stored in the result accumulation information 131, in the order of the higher frequency of association with the printer 240.

Thereafter, the user designates a device to be associated with the corresponding printer 240 from the displayed devices by using the mouse cursor 4.
When the selection is made at 30, the associating unit 134 associates the printer 240, which is the corresponding device, with the selected partner device.

The pop-up menu 470 as described above
Is displayed, the user can grasp at a glance what kind of devices are determined to be operable as a composite device with the printer 24 as the corresponding device in the past, and among those devices, Then, in the past, what kind of device was often associated with can be known. In addition, since the device with a high association frequency is ranked higher, the user can immediately select a device that is frequently used together with the printer 240.

FIG. 31 shows the result accumulation information 13 shown in FIG.
FIG. 4 is an explanatory diagram showing a combination of a sender device and a receiver device displayed on the screen of a monitor 170 using No. 1; When the user uses the mouse 84 or the like to
When the display of a combination of the sender device and the receiver device is instructed to 0, the computer 100 refers to the result accumulation information owned by itself and the result accumulation information possessed by another interface unit, and the A search is made for a combination determined to be operable as a composite device with respect to the device associated with the device, and the result is displayed by opening a combination display window 480 on the screen 400 of the monitor 170 as shown in FIG. .

In the combination display window 480, the name of the sender device and the name of the receiver device are respectively displayed for the combinations of the devices that have been previously associated by the computer 100 and determined to be operable as a composite device. It is displayed together with the latest date and time when the association was made.

Accordingly, the user can grasp at a glance what devices have been previously associated with each other and determined to be operable as a composite device by the computer 100.

FIG. 32 shows the result accumulation information 13 shown in FIG.
FIG. 4 is an explanatory diagram showing a pop-up menu displayed near a copy machine icon on a screen of a monitor 170 by using FIG. As shown in FIG.
When a copy machine icon 440 that visually indicates a copy machine that is a composite device is displayed on the copy machine 0, the user operates the mouse 84, and the mouse cursor 430 displayed on the screen 400 displays the copy machine. When the icon 440 is selected and the right button of the mouse 84 is clicked there, the data output unit 132 refers to the result accumulation information 131 and displays a pop-up menu 490 near the copy machine icon 440. In the pop-up menu 490, the names of the devices constituting the composite device (that is, the copier) indicated by the copier icon 440 are displayed. Specifically, as the devices constituting the composite device, the name of the scanner 340 (for example, the scanner C) for the sender device, and the name of the printer 240 (for example, the printer A) for the receiver device, respectively. Is displayed.

[0208] Therefore, when the icon indicating the composite device is displayed, the user causes the pop-up menu 490 to be displayed even if the user forgets what kind of device the composite device was composed of. By doing so, you can easily know.

In the above example, as shown in FIG. 23, the operation of the mouse 84 causes the scanner icon 41 corresponding to the scanner 340 as the sender device to operate.
Drag “0” to the printer 2 that is the recipient device
The data transmission start processing shown in FIG. 24 and the user interface display processing shown in FIG. 25 have been executed by superimposing the data on the printer icon 420 corresponding to 40. However, not only when the icon corresponding to the sender device is dragged and superimposed on the icon corresponding to the receiver device as described above, but also in the following cases, the data transmission start processing and the user Interface display processing may be performed.

For example, a digital camera is now considered instead of the scanner 340 as the sender device, and a digital camera icon corresponding to the digital camera as the sender device and a receiver device are displayed on the screen 400 of the monitor 170. It is assumed that a certain printer icon 420 is displayed. Then, when the user operates the mouse 84 to place the mouse cursor 430 on the digital camera icon and double-clicks the button of the mouse 84, a window 460 opens as shown in FIG.
Image icons corresponding to the respective image files captured by the digital camera are listed and displayed. Therefore, the user determines an image file to be printed by the printer 240 from a plurality of image files taken into the digital camera, selects an image icon 450 corresponding to the image file, and drags (Drag)
Then, when it is overlaid on the printer icon 420, the data transmission start processing shown in FIG. 24 or the user interface display processing shown in FIG. 25 is executed.

At this time, in step S102 of FIG. 24 and step S122 of FIG.
The associating unit 134 in 0 analyzes the operation content of the mouse 84 transmitted from the application unit 110, and recognizes that the sender device that is capturing the target image file is a digital camera. It recognizes that the other device to be associated with the printer 240, which is the corresponding device of the interface unit 120, is a digital camera. Therefore, the association unit 134
The association between the printer 240 and the digital camera is performed.

Therefore, by dragging the icon corresponding to the information input to the sender device and superimposing it on the icon corresponding to the receiver device, the data transmission start processing or the user interface Display processing may be executed.

In the above description, the icon corresponding to the sender device (or the icon corresponding to the information input to the sender device) is dragged, but the icon corresponding to the receiver device is dragged. The data transmission start processing or the user interface display processing is performed by dragging and superimposing on the icon corresponding to the sender device (or the icon corresponding to the information input to the sender device). You may do it.

In addition to the method of dragging the icon, the icon corresponding to the sender's device (or the icon corresponding to the information input to the sender's device) and the icon corresponding to the receiver's device are operated by, for example, mouse operation. After selecting the corresponding icons together,
A menu may be displayed, and the above-described processing may be executed by selecting an execution instruction of the data transmission start processing or the user interface display processing, which is put in advance in the menu.

In FIG. 21, the computer 1
The user gives various instructions to the application unit 110 of the PC 100 by operating the mouse 84 connected to the computer 100. However, the present invention is not limited to this. For example, a PDA (Personal D
digital assistants) and the application unit 110 of the computer 100 via a network using information terminal equipment such as a mobile phone and a mobile computer.
May be given various instructions.

FIG. 34 is a block diagram showing a configuration in which an instruction is given to the application unit 110 of the computer 100 using the information terminal device 500. 34, the same components as those shown in FIG. 21 are denoted by the same reference numerals.

[0217] As shown in FIG.
Is connected to information terminals 500 in addition to the computers 200 and 300 via a network (not shown). Then, the computer 100 includes the application unit 110, the interface units 120, 1
In addition to the 40 and the proxies 180 and 190, an information disclosure unit 195 is further provided. Also, the information terminal device 500
Are a remote application unit 510 and an operation unit 52
0, and a display unit 530.

Of these, the information disclosure unit 195 of the computer 100 is constructed by, for example, Web server software, and the remote application unit 510 of the information terminal device 500 is constructed by, for example, Web browser software.

[0219] Therefore, the information disclosure unit 195 publishes the information held by the application unit 110 on the network via the Web. On the other hand, the remote application unit 510 allows the user of the information terminal device 500 to operate the operation unit 520.
To operate, for example, the URL (Un
iform Resource Locator) "http://123.45.67.89
When “/ resource” is input, the computer 100 accesses the computer 100 based on the URL, acquires the information disclosed by the information disclosure unit 195, and displays the information on the display unit 530.
Note that the computer 100 which is a Web server and the Web server
As is well known, information is exchanged with the information terminal device 500, which is a client, by using HTTP, which is a Web standard protocol.

FIG. 35 shows the information terminal device 500 shown in FIG.
FIG. 7 is an explanatory diagram showing an example of the appearance of the image and a screen displayed on a display unit 530. As shown in FIG. 35, the information terminal device 500
The information disclosed by the information disclosure unit 195 of the computer 100 is displayed on a display unit 530 in the form of a so-called homepage.

Therefore, the user of the information terminal device 500
By operating the operation unit 520, for example, the first display area 532 is displayed.
"Source Device (Source Devic
e) ”and“ Destination Device ”
When any one of the items in “e)” is selected and the search button 534 is pressed, the selected device candidate is displayed in the second display area 536.

Further, the user of the information terminal device 500 operates the operation unit 520 to select, for example, “scanner 1” as a desired device from the displayed candidates for each of the sender device and the receiver device. (Scanne
r 1) ”and“ Printer 1 ”are selected, as shown in FIG. 35, the second display area 536 is displayed.
The result of the selection is displayed. Further, when the user presses the execution button 536, the remote application unit 510
Instructs the application unit 110 via the network and the information disclosure unit 195 to start transmitting data from the scanner 1 to the printer 1. The application unit 110 further transmits this instruction to the interface unit 12.
0, whereby the interface unit 120
For example, the data transmission start processing shown in FIG. 24 is started.

As described above, it is possible to give an instruction from the information terminal device to the application unit via the network, so that it is possible to control various devices on the network from the information terminal device with scarce resources. Become.

In FIG. 21, the printer 240
Related to devices such as the scanner and the scanner 340, that is, information 125 and 145 of the corresponding device class, information 126 and 146 of the multifunction device class that can be operated, information 127 and 147 of the multifunction device category, and result accumulation information 131 and 149 etc. are the interface unit 120,
Although the information about the devices such as the printer 240 and the scanner 340 is stored in the device information storage units 124 and 144 in the device 140, the information is also stored in the device control units 220 and 320 corresponding to each device.
It is necessary to store the result accumulation information 131 and 149).
Information about the device such as the
Instead of being incorporated in the device control units 0 and 140, the device control units 220 and 320 may be accessed and acquired via a network when necessary. Further, information about the devices such as the printer 240 and the scanner 340 is stored in another computer (for example, a server) existing on the network other than the computers 100 to 300, and when necessary, the computer is connected via the network. May be accessed and acquired.

In FIG. 21, user interface data and icon data are stored in a UI data storage unit 150 and an icon data storage unit 160 which are separate from the interface unit 120.
At the time of display on the screen of No. 0, it was downloaded from these. However, the present invention is not limited to this. For example, user interface data or icon data may be incorporated into the interface unit 120 configured as a COM object from the beginning. Further, data of the user interface and data of the icons are transferred to the computer 200 or 3.
00 or the computer 10
It may be stored in another computer (for example, a server) existing on a network other than 0 to 300.

The device control system shown in FIG. 21 has the connection form shown in FIG.
Devices such as the scanner 40 and the scanner 340 are different from the computer 100 in which the application unit 110 and the interface units 120 and 140 exist.
0, connected to the computer 300,
In the connection form shown in FIG. 2B, devices such as the printer 240 and the scanner 340 are connected to the application unit 11.
Alternatively, it may be connected to the computer 100 where 0 or the like exists. In this case, the respective components of the stub, the device control unit, and the device driver are also generated in the computer 100 where the application unit 110 and the like exist. In FIG. 21, the printer 240
Devices such as the scanner 20 and the scanner 340 are connected to the computer 20.
Although it is depicted as being connected to the outside of 0 or 300, the device and the computer may be integrally configured as shown in FIG.

The present invention is not limited to the examples and embodiments described above, but can be implemented in various modes without departing from the scope of the invention.

In the above-described embodiment, as shown in FIG. 21, the attribute information of the target device, such as the corresponding device class information 125 and 145 and the multifunction device class information 126 and 146, is used as the attribute information of the device. With reference to the information on the type, it has been determined whether or not the target device is a combination that can operate as a composite device (step S108 in FIG. 24 or step S128 in FIG. 25). However, as described above, as attribute information to be referred to, in addition to the type of device, a sender-side device system / a receiver-side device system, a Push type / Pull type (whether the subject of data transmission is the Source side or Destination Side), data formats that can be handled, device status (operable?), Performance (processing speed, etc.), location (section, floor, etc.), processing cost (communication cost, printing cost), special data Various kinds of information such as whether or not the transmission method is supported can be used.

After determining whether or not the target device is a combination operable as a composite device,
For a target device determined to be a combination operable as a composite device, the extent to which the combination of devices is effective is comprehensively evaluated based on the above attribute information, and the degree of effectiveness is determined. An evaluation value may be obtained. For example, a weighted score is given to each of the attribute information in advance, and an evaluation value is obtained by calculating a total score of a combination of target devices.

When such an evaluation value is obtained, the evaluation value itself may be displayed near the icon of the target device displayed on the screen 400 of the monitor 170.

When a plurality of combinations of target devices are made by selecting a plurality of partner devices with respect to a certain corresponding device, an evaluation value is obtained for each combination, and an evaluation value is obtained for each combination. The partner devices may be listed and displayed in descending order of the evaluation value.

FIG. 36 is a flowchart showing the flow of another user interface display process executed by the interface unit 120 in FIG.

As shown in FIG. 36, when the determination unit 122 determines that the target device is a combination that can operate as a composite device (step S148), the determination unit 136 determines the type of the composite device. After that (step S150), the device information storage units 124 and 1
With reference to the attribute information stored in 44, an evaluation value representing the degree of effectiveness of the combination is calculated for the target device combination (step S152). And
The data output unit 132, based on the calculated evaluation value,
The display as described above is performed on the screen of the monitor 170 (step S154).

In the above embodiment, the number of devices to be controlled is two or three. However, the present invention is not limited to this, and four or more devices may be controlled.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of a device control system as one embodiment of the present invention.

FIG. 2 is a block diagram showing a representative example of a connection mode for the device control system of FIG.

FIG. 3 is a block diagram showing a typical example of a connection mode for the device control system of FIG. 1;

FIG. 4 is a block diagram for explaining another data transmission method in the device control system of FIG. 1;

FIG. 5 is a block diagram for explaining another data transmission method in the device control system of FIG. 1;

FIG. 6 is a block diagram showing a specific example in a case where the device control system of FIG. 1 is realized using the technology of COM.

FIG. 7 is an explanatory diagram showing a state in which icons of a scanner and a printer displayed on a screen are being operated.

FIG. 8 is an explanatory diagram showing a procedure for performing data transmission in the device control system of FIG. 6;

FIG. 9 is an explanatory diagram showing a procedure for performing data transmission in the device control system of FIG. 6;

FIG. 10 is an explanatory diagram showing a procedure for performing data transmission in the device control system of FIG. 6;

FIG. 11 is an explanatory diagram showing a procedure for performing data transmission in the device control system of FIG. 6;

FIG. 12 is an explanatory diagram showing a procedure for performing data transmission in the device control system of FIG. 6;

FIG. 13 is a block diagram showing a specific example when the data transmission method shown in FIG. 5 is realized by using the COM technique.

FIG. 14 is an explanatory diagram showing a procedure when direct data transmission is performed between the device control units 30a and 30b in FIG. 13;

FIG. 15 is an explanatory diagram showing a procedure when direct data transmission is performed between the device control units 30a and 30b in FIG. 13;

FIG. 16 is an explanatory diagram showing a procedure for performing direct data transmission between the device control units 30a and 30b in FIG. 13;

FIG. 17 is an explanatory diagram showing a procedure when direct data transmission is performed between the device control units 30a and 30b in FIG. 13;

18 is an explanatory diagram showing an example of a user interface displayed on a screen when a virtual copier is realized by the device control system shown in FIG. 1;

FIG. 19 is an explanatory diagram showing a data flow when a virtual copier is realized by the device control system shown in FIG. 1;

FIG. 20 is an explanatory diagram illustrating an example of a device selection tree displayed on a screen.

FIG. 21 is a block diagram showing a device control system when connected in the connection form of FIG. 2 (c).

FIG. 22 is a block diagram showing an outline of a hardware configuration of a computer 100 shown in FIG. 21.

23 is an explanatory diagram showing a scanner icon and a printer icon displayed on the screen of the monitor 170 in FIG. 21.

24 is a flowchart showing a flow of a data transmission start process executed by the interface unit 120 in FIG. 21.

FIG. 25 is a flowchart showing a flow of a user interface display process executed by the interface unit 120 in FIG. 21.

26 is an explanatory diagram showing a user interface for operating a copier, which is a multifunction device, displayed on the screen of the monitor 170 in FIG. 1. FIG.

FIG. 27 is an explanatory diagram showing a user interface displayed on the screen of the monitor 170 in FIG. 1 for operating a receiving-side facsimile which is a composite device.

FIG. 28 is a flowchart showing a processing flow when a part of the user interface display processing shown in FIG. 25 is changed.

FIG. 29 is an explanatory diagram showing a copy machine icon displayed on the screen of the monitor 170 in FIG. 21.

FIG. 30 is an explanatory diagram showing a pop-up menu displayed near a printer icon on the screen of the monitor 170 using the result accumulation information 131 in FIG. 21;

31 is an explanatory diagram showing a combination of a sender device and a receiver device displayed on the screen of a monitor 170 using the result accumulation information 131 in FIG. 21.

32 is an explanatory diagram showing a pop-up menu displayed near a copy machine icon on the screen of the monitor 170 using the result accumulation information 131 in FIG. 21.

FIG. 33 is an explanatory diagram showing image icons and printer icons displayed on the screen of the monitor 170 in FIG. 21.

FIG. 34 is a block diagram showing a configuration in a case where an instruction is given to an application unit 110 of the computer 100 using the information terminal device 500.

35 is an explanatory diagram illustrating an example of an appearance of the information terminal device 500 illustrated in FIG. 34 and a screen displayed on the display unit 530.

FIG. 36 is a flowchart showing the flow of another user interface display process executed by the interface unit 120 in FIG. 21.

[Explanation of symbols]

 Reference numeral 20: application unit 22a, 22b: interface unit 24a, 24b: communication path abstraction unit 26a, 26b: communication path 28a, 28b: device abstraction unit 30a, 30b: device control unit 32a, 32b: device driver 34a, 34b ... Device 36 ... Communication path abstraction unit 38 ... Communication path 40 ... Computer 42,44 ... Computer 46 ... Network 48,50,52 ... Computer 54 ... Network 60a, 60b, 60c ... Device abstraction unit 62,64 ... Communication path Abstraction unit I1, I6 ... Eye cyber plug I2, I7 ... Eye context menu I3, I8 ... Eye drop source I4, I9 ... Eye drop target I5, I10 ... Eye cyber event I11 I13 ... I Cyber Protocols I12, I14 Eye Cyber Event M1, M2 Status Monitor N1 Event Handler P1 to P5 Proxy S1 to S5 Stub 70 CPU 72 Memory 74 I / O Unit 76 Hard Disk Device 78 Communication device 80 CD-ROM drive device 82 CD-ROM 84 Mouse 100 Computer 110 Application unit 120 Interface unit 122 Judgment unit 124 Device information storage unit 125 Information on compatible device classes 126 Multifunction operation possible Device class information 127 ... Multiple device category information 128 ... UI reference table 130 ... icon reference table 132 ... data output unit 134 ... association unit 136 ... determination unit 140 ... interface unit 144 ... device information record Storage unit 145 ... corresponding device class information 146 ... multifunction device class information 147 ... multifunction device category information 150 ... UI data storage unit 160 ... icon data storage unit 170 ... monitor 180,190 ... proxy 200 ... computer 210 ... Stub 220 Device control unit 230 Device driver 240 Printer 300 Computer 310 Stub 320 Device control unit 330 Device driver 340 Scanner 400 Screen 410 Scanner icon 420 Printer icon 430 Mouse cursor 440 Copy machine Icon 450 ... image icon 460 ... window

Claims (8)

[Claims] 1. A device control system for controlling one or more devices, each device corresponding to the device and exchanging data or information with the corresponding device. And a unit corresponding to the device abstraction unit, connected to the corresponding device abstraction unit via a communication path, and corresponding to the device abstraction unit and an application unit configured by a predetermined application program. At least one interface unit that mediates exchange of data or information between the devices, and at least one communication path abstraction unit provided between the corresponding device abstraction unit and the interface unit. The device abstraction unit controls a corresponding control device based on a device type. To absorb,
The same control environment that does not depend on the type of device is provided to the application unit via the interface unit, and the communication path abstraction unit provides a communication path connecting the device abstraction unit and the interface unit. Absorbing the control difference caused by the type of the communication path, and providing the same control environment independent of the type of the communication path to the application unit through the interface unit. Control system. 2. The device control system according to claim 1, wherein when there are a plurality of the devices and a plurality of the device abstraction units corresponding to the devices, the device abstraction unit includes a corresponding interface. According to instructions from the application unit via the unit,
A device control system for releasing a connection with the corresponding interface unit, establishing a connection with another predetermined device abstraction unit via a communication path, and exchanging data or information. . 3. The device control system according to claim 2, wherein the communication path connecting between the two device abstraction units absorbs a control difference caused by a type of the communication path. A device control system, characterized in that a specific communication path abstraction unit that provides the same control environment independent of the type of communication path is provided for one of the device abstraction units. 4. The device control system according to claim 1, further comprising: display means for displaying a symbol corresponding to the device on a screen; and operation means for operating the displayed symbol. The application unit or the interface unit includes:
A device control system, wherein a device corresponding to the symbol is controlled in accordance with an operation performed on the symbol by the operation means. 5. The device control system according to claim 1, wherein when there are a plurality of the devices and a plurality of the device abstraction units and the plurality of interface units corresponding to the devices, respectively, A device control system, wherein the same interface is provided to the application unit, and each device abstraction unit provides the same interface to the interface unit. 6. The device control system according to claim 1, wherein the interface unit receives an instruction from the application unit to perform data transmission between a device corresponding to the interface unit and another device. Exchange information with the interface unit corresponding to the other device, based on the information,
A device control system for determining whether data transmission is possible between the corresponding device and the other device. 7. A device control method for controlling one or more devices, comprising: (a) exchanging data or information with each of the devices, and exchanging data or information with the corresponding devices; One or more device abstractions that absorb control differences caused by the device type of the device and provide the same control environment independent of the device type to an application unit constructed by a predetermined application program And (b) respectively corresponding to the device abstraction unit, connected to the corresponding device abstraction unit via a communication path, and connected between the corresponding device abstraction unit and the application unit. Generating one or more interface units that mediate the exchange of data or information at (c) The communication paths respectively corresponding to the interface sections and connecting between the corresponding interface section and the device abstraction section corresponding to the interface section, by absorbing a control difference caused by a type of the communication path. Generating one or more communication path abstraction sections that provide the same control environment independent of the type of communication path to the application section; and (d) the interface section and the communication section by the application section. Controlling the device via a road abstraction unit and a device abstraction unit. 8. A computer-readable recording medium storing a computer program for constructing a device control system for controlling one or more devices, the computer-readable recording medium corresponding to each of the devices, and It exchanges data or information and absorbs control differences caused by the type of device for the corresponding device, so that an application unit constructed by a predetermined application program has the same device type independent of the device type. Providing a control environment 1
A function of generating one or more device abstraction units, respectively corresponding to the device abstraction unit, connected to the corresponding device abstraction unit via a communication path, and corresponding to the device abstraction unit and the application unit. A function of generating one or more interface units that mediate the exchange of data or information between the device and the device abstraction unit corresponding to the interface unit and the corresponding interface unit and the device abstraction unit corresponding to the interface unit For the communication path connecting, absorb the difference in control due to the type of communication path,
A function of generating one or more communication path abstraction sections for providing the same control environment independent of the type of communication path to the application section; and recording a computer program for causing the computer to implement Medium.