JP2002007011A - User interface unit, operation setting method, equipment control system and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a user interface unit capable of reducing a user burden necessary to device operation even when various devices exist. SOLUTION: This user interface unit 1 is provided with a virtual operating means 11 for making a user perform virtual device operation on a device to be used from now and obtaining the history information of the virtual device operation, a device retrieving means 12 for deducing a retrieval condition from the history information of the virtual device operation obtained by the means 11 and retrieving a device fitting the deduced retrieval condition as an actually used device, and an information transmitting means 13 for sending the history information of the virtual device operation obtained by the means 11 to the actually used device retrieved by the means 12.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a user interface unit, an operation setting method, a device control system, and a recording medium used for controlling devices such as a copying machine and a printer.

[0002]

2. Description of the Related Art In today's modern day where people are surrounded by various devices, it is necessary to remember user interfaces designed separately for each device, which is a heavy burden on users. Therefore, it is ideal if the user can carry one user interface unit that is general-purpose for the device and specialized for the user and can control a plurality of devices by using the user interface unit. As such a general-purpose user interface unit,
2. Description of the Related Art Conventionally, there is an example in which a mobile telephone terminal having a communication function and excellent in portability is used.

[0003] For example, Japanese Patent Application Laid-Open No. 5-130181 discloses A
There is disclosed a technique for providing a cordless telephone device with an infrared remote control function of a V device, an air conditioner, or the like. That is, infrared communication is performed between the cordless telephone device and the device because of high affinity with the device at home.

Japanese Patent Laid-Open No. Hei 10-93665 discloses a system for controlling a plurality of devices using a mobile telephone terminal. In this system, a function list is transmitted from a device to a mobile telephone terminal, and a user can select the function list on the mobile telephone terminal and instruct an operation.

[0005]

However, in the cordless telephone device disclosed in Japanese Patent Application Laid-Open No. 5-130181, a plurality of devices are operated with a limited number of buttons on the telephone. However, there is a problem that the user load is still large, such as the need to remember a plurality of.

In the system disclosed in Japanese Patent Application Laid-Open No. Hei 10-93665, a user can selectively operate by transmitting a list of controllable functions from the device side to the mobile telephone terminal. The memory load for operation can be reduced, and the number of compatible devices can be expanded. But,
When there are many functions of the device, it is not easy to select a desired function from the functions using only a display device and buttons similar to those of an ordinary mobile telephone terminal. Further, when considering control of various devices, there is a problem that it is difficult to convey a function unique to each device to the user in a simple display, and it is also difficult for the user to memorize all the operations.

[0007] Separating the user interface unit and the device in this manner facilitates the selective use of a plurality of devices having similar functions, but has the necessary functions without excess or shortage. Choosing the right equipment is not easy. It is conceivable to perform some kind of automatic search, but the setting of the search conditions and the actual operation have many overlapping parts and are troublesome twice.

The present invention provides a user interface unit, an operation setting method, an apparatus control system, and a recording medium capable of significantly reducing the burden on a user required for operating an apparatus even when a variety of apparatuses exist. It is intended to be.

[0009]

In order to achieve the above object, according to the first aspect of the present invention, a virtual device operation history relating to a device to be used is made to be performed by a user. Virtual operation means for obtaining information of
A search condition is determined from the history information of the virtual device operation obtained by the virtual operation device, and a device search device that searches for a device that meets the determined search condition as a device to be actually used; And information sending means for sending the history information of the virtual device operation obtained to the actually used device searched by the device searching means.

According to a second aspect of the present invention, in the user interface unit according to the first aspect, the virtual operation means has a device model storage unit for storing a model of a virtual device. The apparatus is characterized in that the user is caused to perform a virtual device operation based on a virtual device model stored in the unit.

According to a third aspect of the present invention, in the user interface unit of the first aspect, the virtual operation means allows the user to perform a virtual device operation by voice dialogue. Features.

According to a fourth aspect of the present invention, in the user interface unit according to the first aspect, the device searching means is configured to output a plurality of device candidates when a plurality of device candidates are extracted as a result of a search based on the determined search condition. This is characterized in that the user is allowed to select one device from among the device candidates.

According to a fifth aspect of the present invention, in the user interface unit according to the first or fourth aspect, the device search means is configured to use virtual device operation history information obtained by virtual operation means. It is characterized in that the required specifications of the user are determined as search conditions.

According to a sixth aspect of the present invention, in the user interface unit according to the first or fourth aspect, the device search means is configured to use virtual device operation history information obtained by the virtual operation device. It is characterized in that data to be processed by the device and required specifications of the object are determined as search conditions.

According to a seventh aspect of the present invention, in the user interface unit according to any one of the first to sixth aspects, the user interface unit is a mobile telephone terminal.

The invention according to claim 8 provides a virtual operation step of causing a user to perform a virtual device operation on a device to be used from now on to obtain information on a history of virtual device operations, and a virtual operation step. A search condition is determined from the history information of the virtual device operation obtained in the operation process, and a device search process in which a device that meets the determined search condition is searched for as a device to be actually used, and a virtual operation process is performed. An information transmission step of transmitting virtual device operation history information to a device actually used, which is searched in the device search process.

According to a ninth aspect of the present invention, there is provided a device control unit having a function of controlling a device, and a user interface unit capable of transmitting and receiving information to and from the device control unit. Virtual operation means for allowing a user to perform virtual device operation on a device to be used from now on to obtain information on the history of virtual device operation, and virtual device operation history obtained by the virtual operation means Device search means for calculating a search condition from the information, and searching for a device that meets the determined search condition as a device to be actually used, and history information of virtual device operation obtained by the virtual operation device by the device search means Information sending means for sending to the actually used device searched.

According to a tenth aspect of the present invention, there is provided a virtual operation process in which a user performs a virtual device operation on a device to be used from now on to obtain information on a history of the virtual device operation, and a virtual operation process. A search condition is determined from the virtual device operation history information obtained in the operation process, and a device search process for searching for a device that meets the determined search condition as a device to be actually used, and a virtual operation process. It is characterized by a computer-readable recording medium storing a program for causing a computer to execute information transmission processing for transmitting virtual device operation history information to an actually used device searched by the device search process.

[0019]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a diagram showing a configuration example of a device control system according to the present invention. Referring to FIG. 1, the device control system includes devices M1 to Mn and devices M1 to M
n, and includes a device control unit U1 to Un that controls each of the devices M1 to Mn, and a user interface unit 1 that can transmit and receive information between the device control units U1 to Un. ing.

Here, the user interface unit 1
Is configured as, for example, a mobile telephone terminal.

The user interface unit 1 and the device control units U1 to Un can communicate with each other by radio waves or infrared rays or by wires. That is,
Communication between the user interface unit 1 and each of the device control units U1 to Un can be performed via the center C, or can be performed directly between them without passing through the center C. For example, as described later, communication via the center C is used for communication at the time of device search, and direct communication is performed when an operation command is transmitted to operate an actual device.

Each of the device control units U1 to Un
Each of the devices M1 to Mn may be incorporated in the corresponding device, or may be a separate housing from the devices M1 to Mn.

In the present invention, the user interface unit 1 comprises a virtual operation means 11 for allowing a user to perform a virtual device operation on a device to be used from now on to obtain virtual device operation history information. A device search unit 12 for calculating a search condition from history information of virtual device operation obtained by the virtual operation unit 11 and searching for a device that meets the calculated search condition as a device to be actually used; An information transmission unit for transmitting the history information of the virtual device operation obtained by the unit to the actually used device searched by the device search unit;

Here, the virtual operation means 11 has a device model storage unit 23 for storing a model of a virtual device.
The user is caused to perform a virtual device operation based on the virtual device model stored in the device model storage unit 23.

The virtual operation means 11 allows the user to perform a virtual device operation by voice conversation.

The device search means 12 can also determine the user's required specifications from the virtual device operation history information obtained by the virtual operation means 11 as search conditions, or the virtual operation means 11 It is also possible to determine, as search conditions, data to be processed by the device and required specifications of the target object from the virtual device operation history information obtained in step (1).

The device searching means 12 allows the user to select one device from the plurality of device candidates when a plurality of device candidates are extracted as a result of the search based on the determined search condition. ing.

Further, as described above, in the example of FIG. 1, the device searching means 12 searches each of the device control units U1 to Un in order to search for a device which satisfies the search condition from among the plurality of devices M1 to Mn. And a communication via the center C between the communication device and the communication device. Further, in the example of FIG.
Transmits the history information of the virtual device operation obtained by the virtual operation unit 11 to the actually used device searched by the device search unit 12, by using the device control units U 1 to U
n is directly communicated with the n.

In the configuration of FIG. 1, in the user interface unit 1, the steps performed until the actually used device is operated include a virtual operation phase, a device search phase, and information transmission (device operation). Consists of phases. That is, in the present invention, as an operation setting method for a device to be actually used, a virtual operation for allowing a user to perform a virtual device operation on a device to be used from now on to obtain information on a history of the virtual device operation A process and a device search process in which search conditions are determined from history information of virtual device operations obtained in the virtual operation process, and a device that meets the determined search conditions is searched for as a device to be actually used; and a virtual operation. An information transmission step of transmitting the virtual device operation history information obtained in the process to the actually used device searched in the device search process.

FIG. 2 is a diagram showing a specific example of the device control system of FIG. Referring to FIG. 2, each device control unit (for example, U1) includes a device control unit 31 that controls each corresponding device (for example, M1) and a device (for example, M1).
A device unique information storage unit 32 in which the unique information (1) (for example, device functional specifications) is stored.

Here, a device control unit (for example, U1)
The device control unit 31 transmits device-specific information (for example, M1) stored in the device-specific information storage unit 32 to the user interface unit 1 (more specifically, the operation reservation unit 22 described later), Based on the device control command and parameters received from the unit 1 (more specifically, the operation reservation unit 22 described later), the device (for example, M
A control signal is sent to 1).

The user interface unit 1
Has an input / output device 21, an operation reservation unit 22, a device model storage unit 23, a history storage unit 24, a search condition specifying unit 25, and a device search unit 26.

Here, the input / output device 21 has a function of making a voice conversation with the user.
It has a voice synthesizer 28 and a dialogue controller 29.

In the configuration example of FIG. 2, the virtual operation means 11 of FIG. 1 includes an input / output device 21 (a voice recognition unit 27, a voice synthesis unit 28, a dialogue control unit 29) and an operation reservation unit 22.
And the device model storage unit 23.

1 includes an input / output device 21 (speech recognition unit 27, speech synthesis unit 28, dialog control unit 29), a history storage unit 24, and a search condition identification unit 2.
5 and the device search unit 26.

1 is realized by the input / output device 21 (speech recognition unit 27, speech synthesis unit 28, dialog control unit 29), history storage unit 24, and operation reservation unit 22. You.

Here, in the virtual operation phase, the dialog control unit 29 generates output information from the operation reservation unit 22 to the user as an utterance sentence and sends it to the speech synthesis unit 28 (that is, the speech synthesis unit 28). , The information to be conveyed to the user is sent to the speech synthesizer 28 as an utterance sentence).
In addition, the dialog control unit 29 sends information required by the operation reservation unit 22 from the user to the speech recognition unit 27 as a recognition candidate keyword as a process common to all phases, and operates the recognition result from the speech recognition unit 27. The information is sent as necessary information of the reservation unit 22 (that is, the recognition candidate keywords are reserved and sent to the speech recognition unit 27 from the conversation up to now).

The speech recognition unit 27 includes a dialog control unit 29
A keyword uttered by the user is recognized from among the recognition candidates set in the above. Note that the voice recognition unit 2
7 can use an existing voice recognition technology.

The speech synthesizer 28 includes a dialogue controller 29
A speech waveform is generated from the system utterance sentence generated in (1). It should be noted that an existing rule speech synthesis technique can be used as a speech synthesis technique in the speech synthesis unit 28.

In the virtual operation phase, the operation reservation unit 22 implements a virtual device operation that does not operate an actual device, and stores a virtual operation history in the history storage unit 24. At this time, the operation status of the virtual device is fed back to the user based on general device information stored in the device model storage unit 23. Further, in the information transmission (device operation) phase, the operation reservation unit 22 obtains device-specific information obtained from the device control unit 31 of the device control unit of the device actually used from the operation history stored in the history storage unit 24. Is transmitted to the device control unit 31 of the device control unit of the device actually used.

Further, in the device search phase, the search condition specifying unit 25 uses the virtual operation history stored in the history storage unit 24 to determine the user's required specifications (for example, the number of print copies) and the processing target of the device. And the required specifications of the object (for example, A4 size and color) are extracted as search conditions.

In the device search phase, the device search unit 26 sends the unique information (functional specifications) of the devices M1 to Mn stored in the device unique information storage units 32 from the individual device control units U1 to Un. Are received, and the optimum device is determined by comparing these, and presented to the user through the dialog control unit 29.

In the above configuration example, the user interface unit 1 has the input / output device 21, the operation reservation unit 22, the equipment model storage unit 23, and the history storage unit 24.
And the search condition specifying unit 25 and the device searching unit 26, but the user interface unit 1 is provided with only the input / output device 21 (the voice recognition unit 27, the voice synthesis unit 28, and the dialog control unit 29). In the center C, the operation reservation unit 22,
The system can be configured by centralized management by providing the device model storage unit 23, the history storage unit 24, the search condition specifying unit 25, and the device search unit 26.

The present invention is particularly useful when a device is selectively used from a plurality of devices M1 to Mn having slightly different functions. As a specific example of such a device,
Examples include a copier in a convenience store, a karaoke machine in a karaoke box, and printers scattered in a large office.

Next, the operation of the device control system of the present invention,
As an example of the operation, the data in the computer at your seat is
A case where the selection and output of one printer from a plurality of printers in the office where the user is going out is realized by an interactive operation using the user interface unit 1 (for example, a mobile phone) will be described with reference to the flowchart of FIG. I do.

Referring to FIG. 3, first, the user virtually operates the device by voice dialog through the input / output device 21 (voice recognition unit 27, voice synthesis unit 28, dialog control unit 29) (step S1). . At this time, virtual devices are not assumed as operation target devices, and virtual operations are performed using general device models prepared in advance (device models stored in the device model storage unit 23). Do. FIG. 4A shows an example of the dialogue and an example of the process at this time. In FIG. 4A, S is a system utterance, and U is a user utterance.

Thus, when a virtual operation is performed,
The operation history as shown in FIG. 4A is stored in the history storage unit 24. Thereafter, the search condition specifying unit 25 specifies search conditions (required specifications) as shown in FIG. 4B from the operation history as shown in FIG. 4A stored in the history storage unit 24 ( Step S2). FIG. 4C shows the specified search conditions. That is, in the specification of the search condition in step S2, first, the target model is specified. FIG.
In the examples of (a) and (c), “printer” is specified from the keyword “printout”. Next, a required specification for the user's device is specified. In the examples of FIGS. 4 (a) and 4 (c), it is specified as a function specification that a certain level of image quality can be secured (good image quality or higher) from the keyword "meeting material". If it is 45 minutes, it is specified as a functional specification that high-speed printing is possible from the keywords “until 3:00” and “30 copies”. Also, by accessing the specified file, the required specification of the data is specified. If the file is a color original, specify that it is a color printer as a data requirement specification. If the file consists of multiple pages, the necessity of the sorter function is determined based on the keywords "meeting materials" and "30 copies". Further, the number of bins (for example, 18 or more) is also specified as a required function specification. As you can see from this example,
By introducing voice dialogue into the operation, it is possible to easily specify a plurality of functions simply by indicating the target "meeting material" without specifying the functions required by the user in detail.

As shown in FIG. 4C, when the search condition, that is, the required specification is specified, the device search unit 26 performs a device search as shown in FIG. 4D (step S).
3). In this device search, the device search unit 26 transmits search conditions (required specifications) to the target device group. As a result, each target device returns a function that is not satisfied among the search conditions (required specifications), an installation location, and the like.

FIGS. 4E and 4F show examples of replies from two target devices. In the examples of FIGS. 4E and 4F, items enclosed by frames are shown. Unsatisfied function.
That is, in the reply example from the target device in FIG.
This is a function that does not satisfy “speed = medium speed”.
In the example of the reply from the target device, "image quality = acceptable" and "color / monochrome = monochrome" are functions that are not satisfied.

The device search unit 26 sets a reply result as shown in FIGS. 4 (e) and 4 (f), that is, a result determined to be optimum by evaluating the conditions as a first search result. As an example of the search method, an item that has a small number of unsatisfied items can be selected as a first search result (first candidate). According to this selection method, in the example of FIGS.
The target device of (e), that is, the printer named AAA of the third floor production department is selected. As a search method, a method using the importance of an item or a method in which the distance from the current position of the user, the number of waiting jobs, and the like can be used.

When the search result is obtained by the device search unit 26 in this manner, the dialog control unit 29 notifies the user of the search result by voice, for example, by the voice synthesis unit 28 (step S4). That is, for example, an item that is not satisfied by the searched device is presented to the user. Then, the user is asked whether the search result (candidate) is satisfactory (step S5). If the user replies that the search result (candidate) is not satisfactory, the process returns to step S2.
Return to and search for the next candidate. Then, step S5
When the user is satisfied with the search result (candidate), the device of this search result (candidate) is operated (step S
6).

FIG. 4G shows steps S4 and S5 in FIG.
Is shown. In the device search in step S3, as described above, as the search result (candidate) from the device search unit 26, the first candidate in FIG. 4E (the number of unsatisfied functions is the smallest (in FIG. 4E) 1) candidate),
That is, the model name AAA and the second candidate in FIG. 4F (the number of unsatisfied functions is the next smallest (2 in FIG. 4F)
(Candidate), that is, when the model name BBB is given, the processing of steps S4 and S5 is performed as shown in FIG. 4 (g), for example.

That is, first, an inquiry is made as to the model name AAA which is the first search result (candidate) in FIG. In the example of FIG. 4E, the item that is not satisfied by the model name AAA is the speed, and the completion time (3
4), the predicted operation completion time (3:15) is presented to the user in FIG. Since this is rejected by the user, the next candidate is searched.
The next search result, ie, model name BB, which is the second search condition
Since both items that are not satisfied with B are allowed by the user, the device is fixed to the model name BBB, and the operation reservation unit 22
An operation command is created from the operation history and transmitted to the device BBB to cause the device to perform an operation.

FIG. 5 is a diagram showing an example of a hardware configuration of the user interface unit of FIG. Referring to FIG. 5, this user interface unit is realized by, for example, a mobile communication terminal, a personal computer, or the like, and controls a CPU 41 that controls the whole, a ROM 42 that stores a control program of the CPU 41, and a work area of the CPU 41. It has a RAM 43 to be used, an audio input unit (for example, a microphone) 44 for inputting audio, and an audio output unit (for example, speaker) 45 for outputting audio.

Here, the CPU 41 has the functions of the virtual operation unit 11, the device search unit 12, and the information transmission unit 13 of FIG.

Note that such virtual operation means 11, device search means 12, information transmission means 13 in CPU 41
For example, the functions such as can be provided in the form of a software package (specifically, an information recording medium such as a CD-ROM). For this reason, in the example of FIG. , A medium driving device 51 for driving this is provided.

In other words, the user interface unit of the present invention allows a mobile communication terminal or a computer system having a voice input / output device or the like to read a program recorded on an information recording medium such as a CD-ROM, and perform mobile communication. The present invention can also be implemented in an apparatus configuration in which a terminal or a microprocessor of a computer system executes an operation setting process. In this case, a program for executing the operation setting process of the present invention (that is, a program used in the hardware system) is provided in a state recorded on a medium. Information recording media on which programs and the like are recorded are not limited to CD-ROMs.
An AM, a flexible disk, a memory card, or the like may be used. The program recorded on the medium is installed in a storage device incorporated in the hardware system, so that the program can be executed to realize the operation setting function.

The program for realizing the operation setting function of the present invention is not only provided in the form of a medium, but also
It may be provided by communication (for example, by a server).

[0059]

As described above, according to the first to tenth aspects of the present invention, the user is caused to perform a virtual device operation on a device to be used from now on, thereby enabling the virtual device operation to be performed. A search condition is determined from virtual operation means for obtaining history information and virtual device operation history information obtained by the virtual operation means, and a device that meets the determined search condition is searched for as a device to be actually used. Device searching means, and information sending means for sending the history information of the virtual device operation obtained by the virtual operating means to the actually used device searched by the device searching means. And can be operated by a common method irrespective of the method of use. Therefore, even when a variety of devices exist, the burden on the user required for operating the devices can be significantly reduced. Further, by grasping the user's request before specifying the device, it is possible to select an optimum device from a plurality of devices and achieve the object. That is, it is possible to provide an operation method common to the devices and to select an optimum device.

[0060] In particular, according to the third aspect of the present invention, in the user interface unit according to the first aspect, the virtual operation means allows the user to perform a virtual device operation by voice dialogue. Since the user can specify the purpose instead of the function by the voice dialogue, the user's request can be specified more easily. That is, it is possible to more easily specify the purpose of use and the supplementary conditions, which are important information for selecting a device.

According to a fifth aspect of the present invention, in the user interface unit according to the first or fourth aspect, the device search means includes a virtual device operation history obtained by the virtual operation means. Since the required specifications of the user are determined from the information as search conditions, it is possible to estimate functions necessary for the user without excess or deficiency.
That is, it is possible to select a device that matches what the user wants to do.

According to a sixth aspect of the present invention, in the user interface unit according to the first or fourth aspect, the device search means includes a virtual device operation history obtained by the virtual operation means. Since the required specifications of the data and the object to be processed by the device are determined as search conditions from the information, the functions required for the data and the object to be processed by the device can be estimated without excess or deficiency. . That is, it is possible to select a device that matches the data and the attribute of the target object.

[Brief description of the drawings]

FIG. 1 is a diagram showing a configuration example of a device control system according to the present invention.

FIG. 2 is a diagram showing a specific example of the device control system of FIG.

FIG. 3 is a flowchart illustrating a processing operation of the device control system of FIG. 1;

FIG. 4 is a diagram illustrating a processing example in the device control system of FIG. 1;

FIG. 5 is a diagram illustrating an example of a hardware configuration of a user interface unit in FIG. 1;

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 User interface unit 11 Virtual operation means 12 Device search means 13 Information sending means 21 I / O device 22 Operation reservation part 23 Device model storage part 24 History storage part 25 Search condition specification part 26 Device search part 27 Voice recognition part 28 Voice synthesis Unit 29 dialogue control unit 31 device control unit 32 device-specific information storage unit M1 to Mn device U1 to Un device control unit 41 CPU 42 ROM 43 RAM 44 microphone 45 speaker 50 information storage medium 51 medium drive device

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04M 1/725 H04M 1/725 5K048 H04Q 9/00 321 H04Q 9/00 321B 331 331A // B41J 29/00 B41J 29/00 TF term (reference) 2C061 AP04 BB10 CQ01 2H027 EJ15 GA19 GA48 5B021 AA01 BB01 EE02 5E501 AA06 AA13 AC33 BA05 CB15 EA21 FA32 5K027 AA11 BB01 CC08 HH19 HH20 EB02 DC02A08 FC01 GC03 HA01 HA02 HA05 HA07 HA13 HA21

Claims (10)

[Claims] 1. A virtual operation means for allowing a user to perform a virtual device operation relating to a device to be used from now on to obtain information on a virtual device operation history, and a virtual operation device obtained by the virtual operation means. Device search means for determining search conditions from history information of various device operations, and searching for devices that match the search conditions as devices to be actually used, and history information of virtual device operations obtained by virtual operation means And an information sending means for sending the information to the actually used device searched by the device searching means. 2. The user interface unit according to claim 1, wherein said virtual operation means has a device model storage unit for storing a model of a virtual device, and the virtual operation means stored in the device model storage unit. A user interface unit for allowing a user to perform a virtual device operation based on a model of a simple device. 3. The user interface unit according to claim 1, wherein said virtual operation means causes a user to perform a virtual device operation by voice dialogue. 4. The user interface unit according to claim 1, wherein, when a plurality of device candidates are extracted as a result of the search based on the determined search condition, one of the plurality of device candidates is extracted from the plurality of device candidates. A user interface unit for allowing a user to select one device. 5. The user interface unit according to claim 1, wherein the device search means includes:
A user interface unit wherein a user's required specification is determined as search conditions from virtual device operation history information obtained by virtual operation means. 6. The user interface unit according to claim 1, wherein the device searching means includes:
A user interface unit for determining, as a search condition, data to be processed by a device or required specifications of an object from history information of virtual device operation obtained by a virtual operation means, as a search condition. 7. The user interface unit according to claim 1, wherein the user interface unit is a mobile telephone terminal. 8. A virtual operation process in which a user performs a virtual device operation on a device to be used from now on to obtain information of a virtual device operation history, and a virtual operation process obtained in the virtual operation process. Device search process to determine search conditions from the history information of various device operations, and search for devices that match the search conditions as devices that are actually used, and virtual device operation history information obtained in the virtual operation process And sending an information to the device actually used retrieved by the device retrieval process. 9. A device control unit having a function of controlling a device, and a user interface unit capable of transmitting and receiving information to and from the device control unit, wherein the user interface unit is a virtual device related to a device to be used. Operating means for allowing a user to perform a virtual device operation to obtain virtual device operation history information, and a search condition based on virtual device operation history information obtained by the virtual operation means Device search means for searching for a device that meets the search condition as the device to be actually used, and a device actually used by the device search means for searching the virtual device operation history information obtained by the virtual operation device And an information sending means for sending the information to a device control system. 10. A virtual operation process for allowing a user to perform a virtual device operation on a device to be used from now on to obtain information on a virtual device operation history, and a virtual operation process obtained by the virtual operation process. Device search processing to find search conditions from the history information of various device operations, and to search for devices that match the search conditions as devices to be actually used, and history information of virtual device operations obtained by virtual operation processing And a computer-readable recording medium storing a program for causing a computer to execute an information sending process of sending the information to an actually used device searched by the device search process.