JPH10240657A - Remote operation device and its system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a device which can reading handle plural units and remotely operates various kinds of unit by validating an operation procedure corresponding to the unit of an operation object based on reception information and transmitting operation instruction to the unit of the operation object based on the operation procedure. SOLUTION: A reception means receiving information on the unit of the operation object, a means for invalidating the operation procedure corresponding to the object of the operation object and a transmission means for transmitting the operation to the unit of the operation object are provided. In the system, an optimum planning part 210 makes an optimum plan on the execution of a JOB. A JOB execution judgment part 206 judges whether the JOB is to be executed and whether the JOB is executed in a self-device or in the other unit when it is to be executed. When it is executed in the other unit, an indication part 205 to the other unit indicates the execution of the JOB to the other unit. When it is executed in the self-device, a JOB execution part 209 executes it.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a remote control device for operating various devices from outside the device and a system therefor.

[0002]

2. Description of the Related Art A remote controller (remote control) for operating a device from a place away from the device, mainly for home appliances such as a video recorder and an air conditioner.
Is used.

[0003] Also, a remote control for both television and video,
Compatible remote controllers that can handle multiple types of TVs are also appearing.

[0004]

SUMMARY OF THE INVENTION In the above-mentioned conventional remote controller which can handle a plurality of models, it is necessary for the operator himself to change the setting of the remote controller in order to operate a specific model.

[0005] For this reason, when the number of models that can be supported increases, the setting operation becomes complicated, such as the operator confirming the target model and referring to a manual or the like, and the possibility of erroneous setting increases. Further, when the operation target is frequently switched, it is necessary to repeat the setting operation, and there is a problem that the usability is deteriorated.

[0006] In addition, the operation target of such a remote controller is limited to devices within a range where a control signal from the remote controller can reach.

An object of the present invention is to solve such a conventional problem and to provide a remote control device and a system thereof that can easily operate various devices.

[0008]

According to the present invention, there is provided, according to the present invention, a receiving means for receiving information on a device to be operated by a remote operation device, and a receiving means for receiving information on the equipment to be operated. An activation unit that activates an operation procedure corresponding to the operation target device; and a transmission unit that transmits an operation command to the device based on the activated operation procedure.

According to another aspect, the remote control system includes a recognizing means for recognizing a device to be operated by the remote control device, and a transmitting means for transmitting information on the recognized device to the remote control device. The remote control device transmits an operation command to the device based on an operation procedure based on the transmitted information.

According to another aspect, an input means for inputting an instruction to a remote control device, a processing means for performing processing based on a processing instruction input from the input means, and another device. Communication means for communicating, and communication control means for controlling an operation instruction for another device input from the input means to be transmitted to the target device of the operation instruction by the communication means.

[0011]

BEST MODE FOR CARRYING OUT THE INVENTION

[Embodiment 1] FIG. 1 is a system configuration diagram of the present embodiment, and shows a plurality of devices connected to a network. 101 is a personal computer (PC), 1
02 represents a scanner, 103 represents a color printer, and 104 represents a monochrome printer.

In this embodiment, in a system in which a plurality of devices are connected (in FIG. 1, connected to a network), when a certain device is instructed to execute a job, the content of the job is determined based on the content of the job. Analyze the purpose and understand what JOB you should execute. As a result of the understanding, information necessary for the job to be executed is acquired and executed. When executing a JOB, if there is a method or another device that is more effective than the specified contents, it instructs another device to perform processing or notifies the user of the proposed method. I do.

Further, depending on the contents of the job, the instruction itself may be rejected. Here, the types of JOB include a user's input operation, an execution instruction from another device, a result of analyzing these JOBs, and a new JOB generated by itself when idling. For example, when a document is read from a scanner and printed by another printer, the following job occurs.

Analysis of the contents of instructions to the scanner for a document set by the user in the scanner. The scanner reads and generates a document generated by analyzing the instructions (and that the document is set) received from the user.
Analysis processing and instruction processing to the printer to print the scanned document Print instruction to the printer generated by the scanner in accordance with the instruction processing Print processing generated by analyzing the print instruction received from the scanner by the printer The details of the method for generating and managing a JOB will be described in the eleventh embodiment and thereafter.

Hereinafter, a procedure for executing these processes by a plurality of devices will be specifically described with reference to the drawings.

FIG. 2 is a functional configuration diagram for performing the processing of this embodiment. The job receiving unit 201 receives a job from a user or another device. JOB received is J
It is registered in the OB table 202. The JOB analysis unit 203
The job registered in the OB table 202 is extracted and analyzed. The other device information acquisition unit 204 acquires the attributes and the current state of the other connected devices. Situation judgment unit 20
7 judges the status from the current status of other devices.

The optimal planning unit 210 makes an optimal plan for the execution of JOB. JOB execution determination unit 206
Then, it is determined whether or not to execute the job, and if so, whether to execute the job on its own device or on another device. When executing on another device, the instruction unit 205
Instructs another device to execute JOB. When the job is executed by the own device, the job is executed by the job execution unit 209. The execution notifying unit 211 notifies the user of the execution result, the fact that another device has been instructed to execute, and the like.

FIG. 3 is a hardware configuration diagram of each device for realizing the processing of this embodiment.

The I / O 301 performs input / output with the outside of the apparatus. The CPU 302 executes programs and controls each unit of the apparatus. The ROM 303 stores programs to be executed by the CPU 302, fixed data, and the like corresponding to each flowchart described below.

The RAM 304 temporarily stores various variables and intermediate data generated during the execution of the processing, such as the job table 202 and the attributes and the current state of the other devices obtained by the other device information obtaining unit 204. . Further, a program may be loaded into the RAM 304 from the outside of the apparatus and stored.

FIG. 4 is a flowchart showing the flow of the processing of this embodiment.

First, in step S109, the contents of the job table are initialized. In step S110, it is checked whether there is an input job from the user, an input job from a device that can be detected by the system, an analysis result of these jobs, and a new job generated by itself during idling. To determine whether a job has been input. If entered, in step S111, the entered job is added to the job table. In step S112, it is checked whether there is a job in the job table.
Then, take out the job. In step S114, the given instruction is analyzed, and the purpose of the job is analyzed from the information.
In step S115, a job to be further performed is identified from the analyzed instruction. In step S116, the job identified in step S115 is registered.

In step S117, it is checked whether there is an unexecuted job. If there is, the process proceeds to step S118. Step S118
Then, it is determined whether or not the job can be executed. If it is determined that the job cannot be executed, the process returns to step S115 to identify a new job to be executed. In the step S119, a job is executed, and the process returns to the step S117.

For example, reading a document from a scanner,
When the user gives an instruction to print on another printer, it is analyzed that the user's purpose is to obtain a printed document. In this case, a document reading / analyzing process generated by the scanner analyzing information received from the user and an instruction process to the printer for printing the read document are identified as JOB. The detailed explanation of these flows will be described in the first embodiment based on a specific example.
Description will be made from 1 onward.

FIG. 5 is a diagram showing a flow of processing for selecting an optimum printer from a plurality of printers and executing printing.

In FIG. 5, as a command from a host computer, a command from a remote controller, or the like, or by analyzing a natural language command issued by a user by voice, a bar code or a text read from a cover page, or the like. , JOB information is transmitted and input.

The device that has received the transmitted JOB information analyzes the JOB, automatically selects a printer capable of executing processing suitable for the JOB, and outputs the selected printer. Select and notify the optimal media according to the destination.

For this purpose, in response to a user's request, the user refers to the configuration of the printer, selects an appropriate printer, and executes printing. At this time, processing is also distributed to a plurality of printers according to the situation. If there is a notification instruction, the most suitable medium for the notification is selected, and the name of the printer that executed the printing, the end of the printing, and the like are notified.

The user's request includes paper size, print quality, color, time limit (for example, printing by 5:00). The configuration of the printer includes the type and number of printers, the performance, the current state (whether the printer is operating normally, whether there is a queue waiting for printing, whether there is a shortage of paper and toner), and the like. As the media for the notification, the user's terminal notifies the user by voice, transmits the message by telephone, sends a message to a pager, or transmits the content of the notification as a document by e-mail or FAX.

In the following, the situation in which each device processes the process of FIG. 5 according to the flowchart of FIG. 4 will be described.

First, in step S110, for example, when an instruction to output a certain document urgently to 5:00 is given to the host computer, a job is added to the job table in step S111. In step S113, the job is taken out, and in step S114, the given instruction is analyzed, and the purpose of the job is analyzed from the information.

In step S115, the following job is identified from the analyzed instruction. Information (paper size, print quality, color document, etc.) for selecting a printer suitable for output from documents to be output, and information such as time limit are acquired. Select a printer that is appropriate for the information from the connected printer. Check the selected printer for output obstructions. Output to the selected printer automatically. Notifies that the selected printer has been output.

In step S116, the job identified in step S115 is registered. In step S117, J
The following is repeated until it is determined that all the OBs are gone.

In step S118, it is determined whether or not the job can be executed. If it is determined that the job cannot be executed, the job to be newly executed is identified. In step S119, the identified jobs are sequentially executed.

[Embodiment 2] FIG. 6 is a diagram for explaining a case where a remote controller (remote controller) is used as a method for instructing various devices.

The remote controller 605 has a display unit, and displays a control panel and information corresponding to the device only by approaching the device, such as the printer 601, 602, FAX 603, or PC 604, and gives an instruction to the device. ,
You can control. Further, a remote device can be controlled from a device near the remote control 605 via a network.

The remote controller 605 can monitor and display the status of each device.
It is also possible to get the status of remote devices on the network via 5 nearby devices.

[Embodiment 3] FIG. 7 is a diagram showing an example in which a document is read from a scanner and transmitted to a specific printer.

After the document is read from the scanner 701,
The user specifies the destination (using voice, etc.). Alternatively, the transmission destination is specified on the cover page, and the transmission destination is automatically determined. In this way, after the monochrome printer A 702 is determined as the transmission destination, the status of the transmission destination is acquired. As a result, if the transmission destination is in a state where printing is not possible, a substitute printer (for example, the monochrome printer B703 ) And print. If the printer specified as the transmission destination cannot print (due to conditions such as color and paper size), it transmits only that page to another printer (for example, color printer C704 for color). In the case of a document having a large number of pages, printing is performed by dividing the document into several printers. If the transfer destination is specified as the destination, it is automatically sent to the transfer destination.

[Embodiment 4] FIG. 8 is a diagram showing an example of a case where a document is read from a scanner and transmitted to a specific printer which cannot be managed by the scanner (because of a different network domain).

After the document is read from the scanner 701 in Austin, the user specifies the destination (using voice or the like). Alternatively, the destination is described as a character string or a barcode on the cover page, and the destination is automatically determined by reading, recognizing and interpreting the destination. In this way, the monochrome printer A702 in Tokyo is determined as the destination, and the monochrome printer A7 is actually
If the monochrome printer A702 cannot print on its own after the document has been sent to the
703) and print. When the monochrome printer A 702 (including color pages,
If the received document cannot be printed (due to conditions such as different paper sizes), the entire received document or only the unprintable pages are transmitted to another printer (for example, color printer C704 for color). For documents with a large number of pages, a monochrome printer A702
Prints on its own and divides it into other printers for printing. When the transfer destination is designated for the monochrome printer A 702 itself, the transfer is automatically performed to the transfer destination.

The difference between the third embodiment and the fourth embodiment is that in the third embodiment, the scanner 701 determines the transmission destination, whereas in the fourth embodiment, the printer 702 that has received the document from the scanner 701 determines In determining the transfer destination.

[Fifth Embodiment] FIG. 9 is a diagram showing an example of a case where a document is read from a scanner and is transmitted to a specific printer which cannot be managed by the scanner (due to a different network domain or the like).

After the document is read from the scanner 701 in Austin, the user specifies the destination (using a voice or a keyboard). Alternatively, the destination is described as a character string or barcode on the cover page,
By reading, recognizing and interpreting it, the transmission destination is automatically determined. In this way, after the monochrome printer A 702 in Tokyo is determined as the transmission destination, the document is actually sent to the monochrome printer A 702 and then transferred to the personal computer 705 capable of more advanced processing.

As a result, the personal computer 705 determines that the document is an urgent document (for example, from the character “urgent” in the cover letter), and determines where the recipient of the document is now from the schedule data and the like. If so, transfer it to that location (eg, Atsugi). At this time, if the transfer destination is not a printer but a facsimile D706 and the media is different, the media is converted and transmitted.

[Embodiment 6] FIG. 10 is a diagram showing an example of a case where a document is read from a scanner and is transmitted to a specific printer which cannot be managed by the scanner (due to a different network domain or the like).

After the document is read from the scanner 701 in Austin, the user specifies the destination (using voice or the like). Alternatively, the destination is described as a character string or a barcode on the cover page, and the destination is automatically determined by reading, recognizing and interpreting the destination. After the monochrome printer A702 in Tokyo is determined as the transmission destination in this way, after the document is actually sent to the printer A702, a personal computer capable of more advanced processing
Transferred to 705. As a result, the personal computer 705 can recognize the recipient of the document, create a notice, and notify the recipient of the document by telephone 707.

[Embodiment 7] FIG. 11 is a diagram showing an example of a case where the status of the printer is notified.

The PC 1102 obtains the status of the printer 1103 via the network and, when detecting a change in status such as occurrence of an error or an event, determines a notification destination such as a user or an administrator according to the content, and determines the destination. The notification is performed using the media corresponding to the notified notification destination. For example, it notifies the terminal 1101 of the user or the administrator by e-mail, makes a telephone call to the telephone 1104, or sends a message to the pager 1105.

Thus, for example, in the example of FIG. 10, the reception of the document may be notified by e-mail or pager instead of telephone 707.

[Embodiment 8] In this embodiment, when a device instructed by JOB executes the job by itself, the job is not executed as it is, but depending on the type and conditions of the job, the contents of the job are not executed before execution. The user is notified / confirmed or cancels a job that is determined to be unnecessary for the user.

FIG. 127 shows information designating whether or not to give advance notice in accordance with the type and condition of the job.

FIG. 12 is a flowchart showing the processing procedure of this embodiment.

First, in step S120, the designated job
Before executing the process, whether to notify the user of the process or the content to be executed, refer to the designation information of the advance notification corresponding to the type and condition of the job in FIG. Judge by analyzing the contents described on the page. When the notification is made in advance, the process proceeds from step S121 to step S122, and the processing to be executed and the contents are notified. Further, in step S123, if necessary, the execution permission is obtained from the user.
Execute OB.

On the other hand, if not notified in advance,
In S125, it is determined whether the job is necessary for the user. If necessary, the job is executed in step S127. If not, the job is discarded in step S128.

Next, an example will be described in which, when the content of the job is information filing, the system analyzes the content before executing the information filing and transmits the content to the user.

FIG. 13 is a diagram showing a case where the information to be filed is transmitted to the user in advance in the filing process. 1301 is a file storage device, 1302 is a scanner, and 1303 is a user terminal.

The processing of the scanner 1302 in FIG. 13 will be described with reference to the flowchart in FIG.

In step S120, since this is a job for filing information, referring to the designated information in FIG. 127,
Before filing, it is determined that the information to be filed is notified, and the information is scanned. In step S121, the process for notifying the information to be filed is performed in step S122.
Pass to. In step S122, the scanned information is notified to the user terminal 1303 via the network. Step S124
Then, a filing job is performed.

Next, an example will be described in which, when there is received information, the first sheet is received and analyzed, and when it is determined that the information is completely unrelated to the user, no further information is received.

FIG. 14 shows a case in which it is determined whether a large amount of received data is necessary or unnecessary from the first page, and information subsequent to the next page is discarded. 1401 is the receiving side, 14
02 is a transmitting PC.

The processing of the PC 1401 in FIG.
This will be described according to the flowchart of FIG.

In step S 120, as a result of referring to the designation information of the advance notice corresponding to the type and condition of the job in FIG. 127,
Since only information is received, it is determined that advance notification is not performed.
In step S121, the process is passed to step S125. In step S125, the first page of the received information is analyzed, and there is "notification to general affairs person". Therefore, the information is irrelevant to the user, and it is determined that the reception of this information is unnecessary. In step S126, the process is passed to step S128. In step S128, the received first image is discarded, and the process ends without receiving the information of the second and subsequent images.

[Embodiment 9] FIG. 15 is a flowchart showing the processing procedure of this embodiment. In this embodiment,
The device instructed to execute the process determines whether the process should be executed by the device itself or another device, and executes the process by itself or instructs another device according to the determination result.

First, in step S150, it is determined whether or not a job has been input.
Add the input JOB to the B table. Step S1
In step 52, check if there is a job in the job table.
In step S153, the job is taken out. In step S154, the given instruction is analyzed, and the purpose of the job is analyzed from the information. In step S155, the status of the device itself is determined. In step S156, the status of another device according to the purpose of the job is determined.

Based on the status of the device itself and other devices,
If it is optimal to execute the job by itself, the process proceeds from step S157 to step S158, where it is decided to execute the job by yourself, and in step S159, the job is executed by itself. On the other hand, if the execution is not optimal by itself and there is another optimal device for the purpose of the job, steps S160 to S1 are executed.
Proceeding to 61, it is determined that the job is to be performed by a device other than the user, and in step S162, execution of the job is instructed to another device according to the purpose. In step S163, the user is notified that the job has been executed on a device other than his own.

If there is no other device corresponding to the purpose of the job, the flow advances from step S160 to step S164 to plan an optimal method that does not impair the purpose of the job. Propose to user.

FIG. 16 is a diagram showing a flow of information in the present embodiment.

When the user of the PC 101 gives a job for outputting the information input by the scanner 102 to the printer 104, for example, when the printer 104 has a printing operation defect,
The printer 104 determines that the given job cannot be executed, communicates with another device, and finds a printer 103 that can execute the given job.

As a result, it is determined that the job is not performed by the user but is performed by the printer 103, and the job is instructed to the printer 103. In order to further inform the user of the actions performed,
Notify PC101. FIG. 16 shows this flow by arrows.

The procedure performed by each device in the process of FIG. 16 will be described below with reference to the flowchart of FIG.

First, the processing of the scanner 102 will be described.
In step S150, the information is scanned, and a job for transmitting the information to the printer 104 is received. In step S151, JOB
This job is added to the table, and in step S153, the job is
Take out. In step S154, it is understood that the job is a job for scanning and transmitting data. In step S155, it is determined that the user is operating normally and there is no problem in scanning and transmitting the designated information.

In step S156, it is understood that the job cannot be sent to another device. In step S157,
Since it is optimal to execute it by itself, the process is passed to step S158. In step S158, it is determined that the information is to be scanned by itself, and in step S159, the information is scanned and the information is transmitted to the printer 104 via one path via the network.

On the other hand, in the printer 104, step S150
Then, a job for outputting the received information is received. Steps
In S151, this job is added to the job table. In step S153, the job is taken out. In step S154, it is understood that the information of the user of the PC 101 is output on a sheet from the received information. In step S155, it is determined that the user has run out of toner and cannot output to paper. In step S116, communication is performed to determine whether there is any other printer that can output information received via the network, and it is determined that there is a printer 103 that can output information (route 2).

In step S157, the process is passed to step S160 because the process cannot be executed by itself. In step S160, since a job of outputting information can be executed by the printer 103, it is determined in step S161 to transmit the received information to the printer 103. In step S162, the printer
Instruct 103 to output the information to be transmitted (path 3). In step S163, the PC of the user who instructed the job
101 is notified by e-mail that the specified output has been performed by the printer 103 (path 4).

FIG. 128 is a diagram showing the flow of information when there is no device corresponding to the job purpose.

When the user of the PC 101 gives a job for outputting the information input by the scanner 102 to the printer 104, and the printer 104 is out of toner and cannot print, the printer 104 communicates with another device. And finds a printer 103 corresponding to the purpose of the given JOB, and determines its status. Here, since the printer 103 is out of paper and cannot print, and there is no other printer according to the purpose of the job, it is necessary to restore the printer 104 or 103 to a printable state and print as an optimal plan. Is notified to the PC 101 in order to propose to the user. FIG. 128 shows this flow by arrows.

Next, the procedure performed by each device in the process of FIG. 128 will be described with reference to the flowchart of FIG.

The scanner 102 reads a document and the printer 104
This is the same until it is transmitted to. In step S150, the printer 104 receives a job for outputting the received information.
In step S151, this job is added to the job table. In step S153, the job is taken out. Step S154
It is understood that the information of the user of the PC 101 is output on a sheet from the received information. In step S155, it is determined that the user has run out of toner and cannot output to paper. In step S116, communication is performed to determine whether there is any other printer that can output information received via the network. However, it is determined that the printer 103 is also out of paper and cannot be printed, and that there is no other suitable device. .

In step S157, the process is passed to step S160 because the process cannot be executed by itself. In step S160, since there is no device capable of executing the job for outputting information, the process proceeds to step s164. In step s164, an optimal method for realizing printing, which is the purpose of the job of outputting information, is planned. As a result, returning the status of the printable device to normal is planned as the optimal method. Next step s165
Based on the planned result, the window as shown in FIG. 129 is proposed to the user to restore the out-of-toner printer 104 or the out-of-paper printer 103 to a printable state.

Thereafter, the user's answer or the change in the status of the printer itself is recognized as an input JOB, and the same processing is performed, thereby achieving the user's purpose.

The details of the planning described above will be described in Embodiment 11 and thereafter based on specific examples.

[Embodiment 10] In the processing of the ninth embodiment, in steps S158 and S159, it is determined that a job is to be executed by the user. Is analyzed in detail as in the procedure of FIG. 17 to be described later, and depending on the environment or situation in which JOB is executed, if it is determined that JOB execution is not suitable, a problem is notified or the job is rejected. There is.

For example, when an instruction to print a confidential document is issued and the user is not confirmed as an authorized user, the instruction is rejected.

FIG. 17 is a flowchart showing a detailed procedure for executing a job.

In step S170, it is analyzed whether there is any problem in the execution of the designated job. If there is no problem in executing the job in step S171, the job is executed in step S175. If there is a problem, in step S172, it is determined whether to notify the user of the generated problem or to refuse the execution of JOB. When notifying, a problem is notified in step S174.
On the other hand, in the case of rejection, the job is rejected in step S176, and the rejection is notified.

Hereinafter, a case where the user of the PC 101 instructs to output confidential information read by the scanner 102 to the printer 104 will be described with reference to FIGS. FIG.
FIG. 7 is a diagram illustrating an example of confidential information to be read.

First, in the scanner 102, step S150
Then, the information is scanned and a job for transmitting the information to the printer 104 is received. In step S151, this job is added to the job table. In step S153, the job is taken out. In step S154, scan the data and transmit
Understand that it is OB. In step S155, it is determined that the user is operating normally and there is no problem in scanning and transmitting the designated information.

In step S155, it is understood that a job cannot be sent to another device. In step S157, the process is passed to step S158 because it is optimal to execute the process by itself. In step S158, it is decided to scan the information by itself.

In step S170, as a result of scanning the information, it is analyzed that the confidential document cannot be output. In step S171, there is a problem in executing the job. Step S172
It is determined that JOB (scanning and outputting information) is rejected. In step S173, the job is rejected, so the process is passed to step S176. In step S176, JO
Notify B of refusal.

Similarly, when the same system is used by a plurality of users, the current user can be recognized from the login name and the like, and an instruction to output the contents of the file of another user can be rejected. . Also, when a document is received from outside, not from the user, if the destination user is different from the current user, output of the received document or notification of the fact of reception may be refused, or the destination user may be notified by the system. The process can be suspended until the is used.

[Embodiment 11] The flow of processing will be described with reference to FIG. First, in step S109, the job table is initialized. In step S110, input from the user,
Check if there is any input from devices that the system can detect. In step S111, an input analysis job for analyzing the contents input in the above step is added to the job table. In step S112, it is checked whether an executable job exists, and if so, an executable job is acquired in step S113. Step S114
Now, understand the purpose of the background to execute the job.

In step S115, possible processing is planned based on the input contents, the state of devices and the like that can be detected by the system, the knowledge currently known by the system, and the like. Add JOB. In steps S117-S119, the process is executed according to the contents planned in step S115. JO
Repeat until B disappears, and when it disappears, step S110
Return to

The case where the user attempts to print <file A> will be described. FIG. 22 is a diagram showing the contents of <file A>, and it is assumed that the picture portion of the car is drawn in color. FIG. 23 is a diagram showing the configuration of the system according to the present embodiment. A user issues a print instruction from the PC 2301, and a monochrome printer 2303 is set as a printer to be used normally, and a color printer 2302 is also connected. ing.

In step S109, the job table is initialized. JO performed when there is no input in step S111
B is added to the JOB table (FIG. 19). Also, in FIG.
When the file name <file A> is specified in the window and printing is selected, it is determined in step S110 that there is an input, and the process proceeds to step S111. In step S111, as shown in FIG.
The input analysis job is added to the job table (FIG. 21).
In step S112, there is a job that can be executed.
Proceed to step S113. In step S113, executable
JOB: Get the analysis of the input "Print <file A>". In step S114, the purpose of the input "print <file A>" is <file A>
Understand that printing.

In step S115, planning to propose printing to the color printer to the user is planned based on the following conditions and situations. <File A> includes a color portion (the car portion in FIG. 22). A usable color printer 2302 exists (FIG. 23).

In step S119, the user is asked "Do you want to print with a color printer?" (FIG. 24). At the same time, a job corresponding to the case where there is no response from the user is added to the job table (FIG. 25). Then, the process returns to step S110.

If there is no input for 10 minutes in step S110, there is a job that can be executed in step S112, and the process proceeds to step S113. In step S113, the executable job:
Acquire the response when there is no response from the user.

At step S114, it is understood that the purpose of the response when there is no response from the user is to know whether or not the proposal is accepted. In step S115, it is determined that an inquiry is made to the user using a telephone from the following conditions and situations. -Know the phone number where the user is currently located (Fig. 2
6 schedule data). It must be printed urgently (file A is used for negotiations from 13:00 in the schedule data of FIG. 26).

In step S119, the user is asked "Do you want to print with a color printer?" (FIG. 27). At the same time, a job corresponding to the case where there is no response from the user is added to the job table (FIG. 28). It returns to step S110.

In step S110, if the user says "Yes, please" as shown in FIG. 27, it is determined that there is an input, and the flow advances to step S111. In step S111, the input analysis job
Is added to the JOB table (FIG. 21). Step S112
Then, since there is an executable job, the process proceeds to step S113. In step S113, the analysis of the executable JOB: input “Yes, thank you” is acquired. In step S114, it is understood that the purpose of the input "yes, thank you" is to indicate that the proposal has been accepted.

In step S115, <file A> is sent to the color printer 2302 to determine to print. Step S1
In step 18, <file A> is sent to the color printer 2302 for printing. At the same time, a job is added to the job table to confirm whether the printing has been completed normally (FIG. 29). It returns to step S110.

No input in step S110, step S112
When the printer status changes from “printing” to “printed document exists” as shown in FIG.
Since B exists, the process proceeds to step S113. Step S113
Then, the process corresponding to the executable JOB: printer status is acquired. In step S114, from the printer status table in FIG. 31, the status “printed document exists” means that the printed document is left in the tray of the printer, and the purpose is to pass the printed document to the user. I understand.

In step S115, since the user may come to pick up immediately, it is decided to wait. Step S1
At 16, a job is added to the job table to confirm whether or not the printed document has been retrieved (FIG. 32). It returns to step S110. In step S110, there is no input for 10 minutes. If it is determined in step S112 that the printed document remains, the job proceeds to step S113 because there is an executable job. In step S113, an executable job: a response when there is a printed document is acquired. In step S114, FIG.
From 1, it is understood that the purpose is that the printed document is passed to the user because the status “printed document present” means that the printed document is left in the tray of the printer. In step S115, since the document has been left for 10 minutes, the user determines that the user has forgotten and determines to notify that "the printed document is in the color printer". In step S119, a notification "printed document is present in BJC600" is notified (FIG. 33). At the same time, a job corresponding to a case where there is no response from the user in the job table and a job corresponding to a case where a printed document is fetched are added (FIG. 3).
4). It returns to step S110.

In step S110, there is no input. Step S1
When the printer status changes from “printed document present” to “normal” as shown in FIG.
Exist, the process proceeds to step S113. Step S113
Executable JOB: J corresponding to the presence of a printed document
Obtain OB review. In step S114, it is understood that the purpose of reviewing the job corresponding to the presence of the printed document is to delete the unnecessary job. Step S115
Then, it is decided to delete the job waiting for the user's response. In step S119, the job waiting for the user's response is deleted. Here, no new job is added. In the initial state, the process returns to step S110.

FIGS. 36 and 37 are diagrams showing plan and action rules. The user can use the print window shown in Fig. 20
In this case, when the button [print] is pressed, the user's purpose is determined to be "printed document present" with reference to the plan & action in the table of FIG. Furthermore, since “printed document present” is also a precondition for the purpose “printed document acquisition”, it is determined that the ultimate user purpose is “printed document acquisition”.

When the user asks a question in FIG. 24 or FIG.
In addition, in the case of performing an operation of expressing consent or disagreement by voice, mouse operation, or the like in response to the inquiry by telephone in FIG. 27, it is determined that the purpose of the user is an expression of consent or disagreement with the inquiry.

In FIG. 37, the ultimate purpose of the system is to achieve the purpose of the user. As a prerequisite, the system must be stable. In addition, the system understands the purpose of the user, and plans and executes the achievement of the purpose.

In order to stabilize the system, the power is turned off when it is not necessary to execute the system in order to reduce the cost and avoid the instability of the system, in addition to normalizing the system at the time of abnormality.

FIG. 38 shows a part of FIG. 37 for easy understanding.

In order to understand the purpose of the user, if there is an input, the input is understood. In addition, “handover of a printed document to the user” exists as a system purpose in correspondence with the user's purpose of “printed document acquisition” in FIG. 36.

In order to deliver a printed document to a user, it is premised that a printed document exists, and an attempt is made to achieve the purpose by teaching the user where the document is located. Of course, in order for the user to actually obtain the document, the user must fetch the document or deliver the document to the user in some way, but this system does not define it in detail, It is determined that the loss of the printed document is equivalent to the acquisition by the user.

On the other hand, in order to have a printed document, it is premised that the printing source document is present, the printing conditions are clarified, and the corresponding printing environment exists normally. Select the corresponding printing environment and execute printing. In order to have a print source document, a print source document may be created. In order to clarify the printing conditions, it is sufficient to inquire the user of a part whose conditions are unclear. In order for the printing environment to be normal, if the printing environment is abnormal, the printing environment may be normalized. Also, in order to acquire the user's intention, it is necessary to perform replanning again if there is no response from the user for a certain period of time.

The properties of each device are stored in a memory inside each device or a memory in a server managing each device. FIG. 39 shows an example of properties of each device. The status of each device is held in each device, and is transmitted to other devices by each device actively transmitting or passively returning according to a request from another server or the like.

In the present system, the properties are unique to each device and do not change. Therefore, the properties are acquired when the system is started or when the connection on the network is changed. On the other hand, status is acquired as needed during the planning process,
Alternatively, the information is acquired at certain time intervals and updated and stored as information in an internal memory.

[Embodiment 12] As in Embodiment 11,
This is an example of processing when printing a <file A> when the color printer is Busy.

First, when there is an input: “Print <file A>”,
This is added to the JOB table and the purpose is understood to be printing. Here, as the condition / situation, the document includes a color portion, and the available color printer is Busy.
And So, wait until you are no longer Busy,
Make a plan to ask the user whether to print in black and white. Ask the user, "A color printer is Busy. Wait or do you want to print on a monochrome printer?" If the user selects "Wait", B
Wait until it is no longer usy.

[Embodiment 13] Input: "<file A> is <f
ile A '>. ", It is understood that the purpose is to update the JOB table.
There is a print job of <file A> in the B table. Therefore,
Change the print target to <file A '> or ask the user a question. Make a plan. Then, `` <file before modification>
Do you want to print <file A '> instead of A>? ”.

[Embodiment 14] In this embodiment, in a system in which a plurality of devices are connected (in this case, connected to a network), when a job is instructed to each device, each device is connected to the job. Analyze the purpose of JO and determine the JO on the designated device based on your situation and the status of the pointing device.
This is an embodiment for transferring a JOB to another device and executing it when it is determined that it is better not to perform the B execution.

FIGS. 41A and 41B show two examples in which a plurality of devices are connected to a network. FIG. 41A shows an environment in which each of the scanner 411 and the printers 412 and 413 can determine the status of each device. Network. (B) is a network in an environment where the scanner 411 cannot determine the status of the printers 412 and 413.

FIG. 42 is a diagram showing a functional configuration for performing the processing of this embodiment.

The job receiving section 421 receives a job from a user or another device. The received JOB is JOB
Registered in table 422. The job analysis unit 423
The job registered in the table 422 is taken out and analyzed. The other device status determination unit 424 determines an attribute, a current state, and the like of another connected device. Own device status judgment unit
427 determines the attributes of the device itself, the current state, and the like.

The optimal planning unit 425 makes an optimal plan for the execution of JOB. JOB execution determination unit 426
Then, it is determined whether or not to execute a job, and if so, whether to execute the job on its own device or on another device. When the job is executed by the own device, the job is executed by the job execution unit 428. When the job is executed by another device, the job is transferred to another device by the job transfer unit 429 to another device. The execution notifying unit 211 notifies the user of the execution result, that the job has been transferred to another device, and the like.

FIG. 43 is a main flowchart showing the flow of processing for realizing this embodiment.

First, in step S430, an input job from a user, an input job from a device or the like that can be detected by the system, a result of analyzing these jobs, and a new job generated by itself during idling are generated. It is checked whether or not there is a job, and it is determined whether or not a job has been input. If input, in step S431, the input job is added to the job table. In step S432, it is checked whether there is a job in the job table.
Then, take out the job. In step S434, the given instruction is analyzed, and the purpose of the job is analyzed from the information.
In step S435, it is determined whether there is a job to another device. If there is, the other device is controlled in step S436. If not, the device is controlled in step S437.

FIG. 44 shows a step S4 in the main processing.
37 is a flowchart illustrating a process flow when controlling another device when performing a process on another device in 36.

In step S440, the status of the device specified in the job is determined, and based on this determination, step S441 is performed.
Then, it is determined whether there is a problem in executing the job on the specified device. If there is no problem, in step S442, the job is transmitted to the designated device. If there is a problem with the execution on the specified device, in step S443, it is checked whether there is a device other than the specified device suitable for the job, and if so, the situation is determined. As a result, if there is a device other than the designated device that can execute the job, the job is transferred to the device in step S445, and the process proceeds to step S4.
At 46, the user is notified that the job has been transferred. On the other hand, if there is no device other than the designated device that is suitable for the JOB, or if it is not currently available, in step S447, an optimal plan that does not impair the purpose of the JOB is made, and in step S448, Propose the plan to the user.

FIG. 45 shows a step S4 in the main processing.
37 is a flowchart showing the flow of a process when the process is performed by the user's own device in 37.

In step S450, the status of the own device is determined.
Based on this determination, in step S451, the device
To determine if there is a problem. If there is no problem, the job is executed in step S452. If there is a problem in the execution by the own device, in step S453, it is checked whether there is any device other than the own device suitable for the job, and if so, the situation is determined. As a result, if there is a device that can execute the job other than the own device, the job is transferred to the device in step S445, and the user is notified that the job has been transferred in step S446. On the other hand, if there is no device other than the own device that is suitable for the JOB, or if it is not currently available, at step S447, an optimal plan that does not impair the purpose of the JOB is created, and at step S448, the plan is determined. To the user.

FIG. 46 shows that, in (A) of FIG. 41, the information read from the scanner 411 is instructed to be output to the printer 412 via the path A. FIG. 11 is a diagram when an output is performed to the printer 413 through the path B because a failure is found in FIG.

FIG. 47 shows that, in (B) of FIG. 41, the information read from the scanner 411 is instructed to be output to the printer 412 via the path A, and the scanner 411 tries to check the status of the printer 412. The printer 412 transfers the received information (JOB) to the printer 413 via the route B because the printer 412 itself has failed due to its own failure. FIG.

The process of performing the processing shown in FIGS. 46 and 47 will be described below.
This will be described with reference to the flowcharts in FIGS.

When an output job occurs from the scanner 411 to the printer 412 in FIG. 46, the processing of the scanner 411 is as follows.

First, in step S430, information is scanned and a job for transmitting information to the printer 412 is received. In step S431, a job is added to the job table. In step S433, the job is taken out. In step S434, the data is scanned, and it is understood that the job is a job to be transmitted to the designated printer. Step S435
Then, it is determined that there is a job to be performed by another device that outputs the scanned information by the printer 412. With this determination, the process is passed to the other device control process of FIG. 44 in step S436.

In step S440, the designated printer 412
Get the current state of. As a result, information indicating that a failure has occurred is received from the printer 412, and it is determined in step S441 that output is impossible. In this case, there may be a case where it is not possible to perform an output such as running out of paper or running out of toner even if a malfunction is not occurring. Steps
At S443, the printer 412, which is the designated device,
Since it is impossible to execute B, a similar device that can execute JOB is communicated from the network and searched. In step S444, the printer 413 that can execute the job is found.
Determine the execution of.

At step S445, the scanned information is transmitted to the printer 413. In step S446, since something other than the instruction was performed, J
Notifies that the OB has been changed. As described above, the processing of the instructed job has been completed, so that the processing waits until the next job is input.

Next, the scanner 411 shown in FIG.
Processing when an output job occurs to 12 will be described.

At step S430, the scanner 411 scans the information and receives a JOB for transmitting the information to the printer 412. In step S431, the job is added to the job table, and in step S433, the job is extracted. Step S4
At 34, the data is scanned and it is understood that this job is a job to be transmitted to the designated printer. In step S435, it is determined that there is a job to be performed on another device that outputs the scanned information by the printer 412. By this determination, in step S436, FIG.
To another device control process.

At step S440, the designated printer 412
Communicates with the user, and tries to know the situation. However, since it is confirmed that the printer 412 is at a remote place, it is determined that the information is to be transmitted regardless of the state of the printer 412. In step S441, it is determined that there is no problem since the printer 412 is far away. In step S442, the scanned information is transmitted to the printer 412, which is the designated device, and the job is passed. As described above, the processing of the instructed job has been completed, so that the processing waits until the next job is input.

On the other hand, in the printer 412, step S430
Then, a job for outputting the received information is received. Steps
In S431, a job is added to the job table. Steps
At S433, the job is taken out. In step S434, it is understood that the received information is a JOB that outputs the information. In step S435, it is determined that there is no job for another device. In step S437, the process is passed to the own device control process of FIG.

In step S450, the user checks his / her current state. In step S451, it is determined that the user is currently out of order and cannot execute JOB. In this case, there may be a case where it is not possible to perform an output such as running out of paper or running out of toner even if a malfunction is not occurring. In step S453, another device similar to the user who can execute the job is communicated from the network and searched.

In step S454, since a printer 413 capable of executing a job is found, execution of the job by the printer 413 is determined. In step S455, the information transmitted to the printer 412 is retransmitted to the printer 413. In step S456, since a process other than the instruction has been performed, the designated partner is notified that the job has been changed. Here, the instructed party is notified, but the destination may be notified to the recipient because the output destination is away from the instructed party. Since the processing of the specified job has been completed, the process waits until the next job is input. Since the printer 413 can execute the job for outputting the received information without any problem, the printer 413 executes the job.

In the above embodiment, each device automatically sets J
Although the OB has been transferred, if there is a problem with each device, it is also possible for the user to set the order so that the JOB is transferred. For example, in the present embodiment, the user inputs that the scanned document is to be printed by the designated printer as a job.
The second and third printers, which perform printing when the designated printer is unavailable, may be set simultaneously during JOB. As a result, step s443 or step s4
In 53, the set second and third printers are selected as devices suitable for JOB, and the status is determined. Conversely, a second printer or a third printer that substitutes for printing when the printer itself cannot be used may be set on the printer receiving the job. At this time, even if the second and third printers are not set in the job itself as described above, the printer that has received the job can transfer the job according to the specification set in itself. it can.

[0144] Even in cases other than failure or inoperability, specifications that are not suitable for performing a job, for example, when a job to a monochrome printer is printing color information, or when waiting for a job many times, Even if the processing cannot be performed in a timely manner, it may be a determination condition for not performing a job.

[Embodiment 15] In this embodiment, when executing the job for outputting the emergency information received by the printer to the user, in the process of judging the status of the own apparatus in step S450 in FIG. 45, the execution of the job is executed. This represents a process in which schedule information of a target user is also taken into account as a material for determining a problem.

Here, the processing in the environment shown in FIG. 48 in which the user to whom emergency information is to be transmitted is out and the printer 413 connected to the network at the destination is described.

In this case, in the procedure shown in FIG. 43, it is understood that the purpose of the job is to urgently notify the user of the received information in step S434. Step S435
Since the job to another device is not at this point, the process is passed to step S437. In step S437, the process is passed to the own device control process of FIG.

In step S450, when determining the status of the own device, the schedule of the user designated as the transmission destination is checked with the device 414, and it is determined that the user is out of the office. In step S451, since the user is out of the office, it is determined that there is a problem with the execution of the emergency notification on the own device. Step S453
To check if there is a printer that can output information on the go. In step S454, since it is confirmed that there is a printer 412 capable of outputting, it is determined that output is to be performed by the printer. In step S455, information is transmitted to the printer 412. In step S456, the source and destination users are notified that the job has been transferred.

In step S443, when there is no device capable of performing the same output as the transfer destination of the job, and when it is determined that there is another device used by the user, for example, a PC, a facsimile, a telephone, etc. In step S444, the processing may be executed by the device. However, since the information cannot be transmitted as it is, in step S445, the output information to the printer is converted and transmitted as an e-mail document or a FAX document, or converted into voice information and output.

At this time, in step S446, depending on the medium used for output, it is not necessary to notify that the job has been transferred using another medium again, and it is possible to transmit the job simultaneously on the same medium. For example, when transmitting output information using a telephone, it may be smarter to convey the fact that the output information was transmitted after or before it was transmitted.

In step S443, the PC or F
The AX, telephone, etc. are not determined as the devices suitable for the job to be executed by the printer, and in step S447, the use of those devices is determined as an optimal plan that does not impair the job's purpose. Then, the plan may be proposed.

[Embodiment 16] FIG. 49 shows a processing procedure of this embodiment. FIG. 49 shows steps S498-500 as a process when there is no job in the flowchart of FIG.
Is added.

In step S498, the current operation status of another device is checked, and in step S499, a job executable by
Is determined to be stored in another device without being executed, and if so, in step S500, the job is taken out and added to the job table of its own device, and
Delete from the OB table. In this manner, in the present embodiment, JOB is found and processed by itself.

FIG. 50 shows a situation in which this processing is performed. In this situation, there is no job in the printer 412, and
Since there are 10 OBs, the printer 415
FIG. 13 is a diagram showing a concept of taking out 13 jobs and processing them by the own device.

The processing flow of the printer 415 is as follows. In step S492, since there is no job, the process is passed to step S498. In step S498, the current status of the other devices, the printers 412 and 413, is checked. Steps
In S499, it is determined that the printer 413 has a job executable by itself. In step S500, the job is taken out of the printer 413 and added to its own job table. Further, the extracted job is deleted from the printer 413. In step S490, there is no job input. In step S492, since there is a job added by himself / herself, the process is passed to step S493 to execute the job.

After that, the operation for executing in the own apparatus described in the fourteenth and fifteenth embodiments is performed, and the processing is ended.

[Embodiment 17] FIG. 51 is a diagram showing the flow of a print job and the flow of other information in a system using the apparatus of this embodiment. In addition,
The thick arrows in the figure indicate the flow of the print job, and the dotted arrows indicate the flow of other information.

However, the print job described in the present embodiment includes a document to be printed and parameters referred to at the time of printing, such as the number of prints, print quality, and print size. Other information includes the status of each printer, such as printing, normal, no paper, and the like, and the print job schedule of the print job scheduling unit.

In FIG. 51, the client machine 510
Then, a print job is created by the print job creation unit 512 and stored once in the print job storage unit 513, and then printed by the print job transmission unit 514.
Is transmitted to the server machine 511 that manages the printer.

In the server machine 511, the transmitted print job is received by the print job receiving unit 516, and is passed to the print job automatic setting unit 517 when the parameters of the print job are not set. It is passed to the print job automatic change unit 518.

The print job automatic setting unit 517 sets unset print parameters in consideration of the urgency, economy, quality, and the like obtained from the print job. On the other hand, the print job automatic changing unit 518 realizes the same processing by changing already set parameters. The print job set or changed in this way is transmitted to the print job scheduling unit 52.
The print job is registered in the print job schedule of the print job 0, and is sequentially read out from the print job to the print job transmitting unit 519 or directly passed to the print job transmitting unit 519 and printed.

Here, the print job automatic setting unit 517 and the print job automatic change unit 518 store the status of usable printers, such as printing, normal, and no paper, acquired through the printer status recognition unit 515. It is used for setting or changing a print job. Similarly, the print job print schedule of the print job scheduling unit 520 is also used.

Further, as shown in FIG. 51, it is assumed that the print job flows through different routes. For example, if the machine that created the print job is the same as the machine that manages the printer, it may not pass through the print job transmission unit 514.

FIG. 52 shows a print job automatic setting unit 517.
5 is a flowchart showing the flow of the processing of FIG. The print job automatic setting unit 517 automatically sets parameters so that printing can be performed as quickly and economically as possible within a range satisfying the specified quality.

In FIG. 52, first, in step S520, as a preparation for the simulation, factors for determining the printing time and the toner usage are initialized. Subsequently, in step S521, the quality determining variable is initialized with the highest quality value (for example, 5).
In S522, the printing time is simulated. Step S523
It is determined whether the simulated printing time satisfies a specified value. If satisfied, in step S524, the amount of toner used is simulated. In step S525, it is determined whether the simulated toner usage satisfies a specified value. If so, the job is changed to the current value of the quality determining variable in step S526.

If the specified value is not satisfied in step S523 or 525, the quality determining variable is set to 1 in step S527.
Reduce. In step S528, it is determined whether or not the specified quality is satisfied. If so, the process returns to step S522. If it is not satisfied, an automatic setting impossible error occurs and the process ends.

FIG. 53 is a diagram showing the printing time per character and the toner consumption according to the designated quality difference between the printer A521 and the printer B522. These values may be fixed values unique to each printer, or may be dynamically changing values obtained by measuring the time required for printing performed in the past and the amount of toner used, and averaging the measured values. .

FIG. 54 is a diagram showing the contents of a print job printed in this embodiment and parameters specified by the user. In the system using this embodiment, FIG.
The contents of the print job represented by (2) and the setting parameters are collectively called a print job. In the present embodiment, in order to simulate the printing time and the toner usage,
In the description, the print amount of the print job is 500 characters in terms of the number of characters. In addition, the user has specified that only urgency is within one minute, and has not specified economics and quality with default values.

In the example of FIG. 54, a print job automatic setting unit
When 517 is activated, first, in preparation for the simulation in step S520, factors that determine the printing time and the toner usage are initialized. For example, as defined in the table of FIG. 53, the minimum quality (=
In the case of 1), the printing time per character is 10 on average
The steps are 0 m steps S and 200 m steps S, and the average amount of toner used per character is 100 mg and 200 mg.

Subsequently, in step S521, the quality determining variable is initialized with the highest quality value (for example, 5), and in step S522,
Simulate printing time. For example, the printer A521 and the printer B522 can print, and the print job scheduled by the print job scheduling is
If there is not one, printing can be started immediately, and no waiting time is required. Therefore, if the print job to be printed contains 500 characters, the printer A
It takes 250 seconds for printer B and 500 seconds for printer B. Then, in Step S523, it is not possible to satisfy the urgency within one minute specified by the specified parameter in FIG. 54, so in Step S527, the quality determining variable is reduced by one. Here, since the quality is not designated by the designated parameter in FIG. 54, the process is returned to the simulation of the printing time in step S522 again. As a result of repeating these processes, the printing time becomes 50 seconds with the printer A521 only when the quality becomes the minimum quality of 1 and the urgency is satisfied. Therefore, the quality is set to the value of the quality determination variable (= 1). Terminates normally.

Here, if the quality is set to 2 or more, since the parameters set by the user cannot be satisfied, the process ends with an automatic setting impossible error.

[Embodiment 18] FIG. 55 shows a print JO.
6 is a flowchart illustrating a flow of a process of a B automatic change unit 518. The print job automatic change unit 518 automatically changes parameters so that printing can be performed with as high a quality as possible within a range that satisfies the specified urgency and economy. Then, if all the specifications cannot be satisfied, the highest priority specification is satisfied, and the other specifications are changed as close to the specifications as possible.

FIG. 56 is a diagram showing the contents of a print job printed in this embodiment and parameters designated by the user. In the system using this embodiment, FIG.
The contents of the print job represented by the symbol and the setting parameters are collectively called a print job. In this embodiment,
In order to simulate the printing time and the toner usage, the print amount of the print job is described as 500 characters in terms of the number of characters. In addition, the user has set all parameters, and specifies that quality is the highest priority among them.

In FIG. 55, when the print job automatic changing unit 518 is activated, first, in step S550, factors for determining the printing time and the toner usage are initialized in preparation for the simulation. For example, as defined in the table of FIG. 53, the printing time per character in the case of the minimum quality (= 1) of the printer A and the printer B is 100 m steps S and 200 m steps S on average, respectively. Are 100 mg and 200 mg on average.

Subsequently, in step S551, the quality determining variable is initialized with the highest quality value (for example, 5), and in step S552, the printing time is simulated. For example, the printer A 521 and the printer B 522 can print, and the print job scheduled by the print job scheduling unit 520 is performed.
If there is no B, printing can be started immediately, and no waiting time is required. Therefore, if 500 characters are included in the print job to be printed, it takes 250 seconds for the printer A521 and 500 seconds for the printer B522, and the simulation is performed.

Then, in Step S553, the urgency specified by the specified parameter in FIG. 56 cannot be satisfied within one minute, so the quality determining variable is reduced by one in Step S556. In step S557, since the specification of the quality of the specified parameter in FIG. 56 is satisfied, the process returns to the simulation of the printing time in step S552. As a result of repeating these processes, even if the quality specified by the user (= 3) is reached,
The printing time is 150 seconds with the printer A521, which cannot satisfy the urgency. Therefore, if the quality determining variable is reduced by 1 in step S556, the quality specified by the user cannot be satisfied in step S557. Therefore, the process proceeds to step S558, where it is checked whether the quality is the designated parameter with the highest priority. If priority is given, in step S560, the print job is changed with the specified quality, and the process ends normally.

Here, if urgency is the highest priority, the printing time becomes 50 seconds with the printer A only when the quality becomes the lowest quality of 1 and the urgency is satisfied. = 1) and ends normally.

[Embodiment 19] FIG. 57 is a diagram showing the flow of print jobs and the flow of other information in a system using the apparatus of this embodiment. In addition,
The thick arrows in the figure indicate the flow of the print job, and the dotted arrows indicate the flow of other information.

However, the print job described in the present embodiment includes a document to be printed and parameters referred to at the time of printing, such as the number of prints, print quality, and print size. Other information includes the status of each printer, such as printing, normal, and no paper, and the print job schedule of print job scheduling.

In FIG. 57, client machine 510
Then, a print job is created by the print job creation unit 512 and stored once in the print job storage unit 513, and then printed by the print job transmission unit 514.
Is transmitted to the server machine 511 that manages the printer.

In the server machine 511, the received print job is received by the print job receiving unit 516, and is passed to the print job interpreting unit 571. Print job
The interpretation unit 571 interprets instructions from the user included in the received print job and converts them into information such as parameters that can be processed by the system. If the parameters of the print job have not been set, they are passed to the print job automatic setting unit 517, and if they have already been set, they are passed to the print job automatic change unit 518.

The print job automatic setting unit 517 sets unset print parameters in consideration of urgency, economy, quality, and the like obtained from the print job. On the other hand, in the print job automatic change unit 518, the same processing is realized by changing a parameter that has already been set. The print job set or changed in this way is registered in the print job schedule held by the print job scheduling unit 520.
From there, it is sequentially read out to the print job transmitting unit 519 or directly passed to the print job transmitting unit and printed.

Here, the print job automatic setting unit and the print job automatic changing unit 518 include a printer status recognizing unit 5.
The status of the available printer, such as printing, normal, out of paper, etc., acquired via the printer 15 is passed over and used for setting or changing the print job. Similarly, the print job print schedule of the print job scheduling unit 520 is also used.

Further, as shown in FIG. 57, it is assumed that the print job flows through different routes. For example, if the machine that created the print job is the same as the machine that manages the printer, it may not pass through the print job transmission unit 514.

In this embodiment, as shown in FIG. 58, the print job parameters are set ambiguously using a natural language. FIG. 130 is a diagram showing, in correspondence with an input character string in a natural language, the meaning of the character string in parameter setting and the required items required to complete the meaning. The print job interpreting unit 571 converts the instruction in the natural language passed as the print job setting parameter into a meaning corresponding to the input character string in the natural language shown in FIG. 130 and a request item necessary to complete the meaning. With reference, the interpretation is as follows.

From the character string “print” in the input natural language, the action intended by the user, which is meant by this character string, is “print”. Further, the required item, [object], is the content of the print job input at the same time, and [quality] and [quantity] are specified in the uninterpreted part of the input natural language. It should be expected. Therefore, when interpreting the character string "1 sheet for business partners and 5 sheets for members", 1 sheet of [sheets] is printed with high quality [quality], and 5 sheets of [sheets] are printed with free [quality]. It is understood that it is specified as follows.

The print job automatic setting section 51 thereafter
7 and the processing of the print job automatic change unit 518 are the same as those of the seventeenth and eighteenth embodiments.

[Embodiment 20] In this embodiment, FIG.
As shown in, the print job parameter settings are
This is performed based on the distribution destination and the number of copies described in the document itself, which is the content of the print job. Print job interpreter
At 571, the contents of the print job are interpreted and the operation is performed as follows. The action is print. "For business partners"
Is interpreted as high quality, and the number of sheets is one. The “ABC project” is “for members”, and the quality is interpreted as free, and the number of sheets is set to five (information that the user is a member of the ABC project has been obtained in advance).

Thereafter, the print job automatic setting unit 51
7 and the processing after the print job automatic change unit 518 are the same as those in the seventeenth and eighteenth embodiments.

[Embodiment 21] FIG. 60 is a diagram showing the flow of print jobs and the flow of other information in a system using the apparatus of this embodiment. In addition,
The thick arrows in the figure indicate the flow of the print job, and the dotted arrows indicate the flow of other information.

However, the print job described in the present embodiment includes a document to be printed and parameters referred to at the time of printing, such as the number of prints, print quality, and print size. Other information includes the status of each printer, such as printing, normal, out of paper, etc., and the print job scheduling unit 52.
There is a print job schedule that 0 has.

In FIG. 60, the client machine 510
Then, a print job is created by the print job creation unit 512 and stored once in the print job storage unit 513, and then printed by the print job transmission unit 514.
Is transmitted to the server machine 511 that manages the printer.

In the server machine 511, the received print job is received by the print job receiving unit 516 and passed to the print job interpreting unit 571. Print job
The interpretation unit 571 interprets instructions from the user included in the received print job and converts them into information such as parameters that can be processed by the system. If the parameters of the print job have not been set, they are passed to the print job automatic setting unit 517, and if they have already been set, they are passed to the print job automatic change unit 518. Further, the print job simulation unit 601 simulates printing with the settings specified in the print job, and obtains the printing time and toner usage.

The print job automatic setting unit 517 sets unset print parameters in consideration of urgency, economy, quality, and the like obtained from the print job. On the other hand, in the print job automatic change unit 518, the same processing is realized by changing a parameter that has already been set. The print job set or changed in this way is registered in the print job schedule held by the print job scheduling unit 520.
From there, the print job is sequentially read out to the print job transmitting unit 519 or directly passed to the print job transmitting unit 519 and printed.

Here, the print job automatic setting unit 517 and the print job automatic change unit 518 transfer the status of a usable printer, such as printing, normal, or no paper, acquired via the printer status recognition unit 515. , Print J
Used for setting or changing OB. Similarly, the print job print schedule of the print job scheduling unit 520 is also used.

Further, as shown in FIG. 60, it is assumed that the print JOB flows through different routes. For example, if the machine that created the print job and the machine that manages the printer are the same, the print job may not pass through the print job transmission unit 514.

FIG. 61 is a flowchart of the process performed by the print job simulation unit 601. In the print job simulation unit 601, first, step S611
Then, as preparation for the simulation, the factors that determine the printing time and the toner usage are initialized. In step S612, the printing time at the setting specified by the print job is simulated. At step S613, the toner usage at the setting specified by the print job is simulated to obtain the printing time and the toner usage.

The specific method is the same as that described in Embodiments 17 and 18.

[Embodiment 22] In this embodiment, a printer is provided with a plurality of output trays, and the output tray is selected according to the user.

FIG. 62 is a flowchart of the processing procedure of the printer system of this embodiment. When the print system receives the print job, the printer system sends a plurality of print jobs.
After receiving the same time,
The process of FIG. 62 is started.

FIG. 63 is an external view of the printer of the printer system of this embodiment. As shown in the figure, each of the printers 631 and 632 has a plurality of output trays.
In 1, each output tray has a screen that shows who the document on that tray is, and the printer 632
Then, a common screen displays which document is in which output tray. Also, if users are set in advance for each output tray, the output tray will be dedicated to the user, and if not set, the users of each output tray will change as necessary. Become.

This system realizes functions such as notifying the arrival of a document, notifying the end of printing, and notifying that a printed document has been forgotten (with a sensor).

The flow of the above processing will be described. In FIG. 62, in step S621, destination information is acquired from information included in the print job. The destination information is obtained by interpreting the specification entered in the contents of the print job as described in the twenty-ninth embodiment, or from information initially set separately from the contents of the print job such as Email. Is obtained. At this time, when a printer is used as an output device of a normal personal computer as in the use example of the conventional technology, the destination is usually not specified.
FAX or Ema, as in the system using this embodiment
When used in place of il, the destination is usually specified. In step S622, it is checked whether the destination is specified. Steps
In S623, the recipient is notified that the document has arrived. In step S624, sender information is obtained from the information included in the print job. The sender information is obtained by interpreting the specification entered in the contents of the print job as described in the twenty-ninth embodiment, or from information set separately from the contents of the print job from the beginning, such as Email. Is obtained. At this time, when a printer is used as an output device of a normal personal computer as in the past, the sender is usually within the management range of the present system, but as in the system using the present embodiment, On the other hand, when used in the alternative, the sender is usually out of the management range.

In step S625, it is checked whether the sender is within the management range. If the destination is specified in step S626, the output tray is selected in accordance with the destination. If the destination is not specified and only the source is specified, the output tray is selected according to the source. In step S627, as shown in (a) of FIG. 63, information on the destination or the sender is displayed on the corresponding output tray. Or, as shown in FIG.
Display destination or sender information and output tray location. At this time, if the user is set in advance for each output tray, the output tray will be dedicated to the user,
If not set, the user of each output tray will change as needed.

In step S628, printing is executed. In step S629, it is checked whether printing is completed and the sender is within the management range. In step S630, the sender is notified that printing has been completed. In step S631, it is checked whether a document remains for a certain period of time and the sender is within the management range. In step S632, the sender is notified that the printed document remains for a long time.

[Twenty-third Embodiment] In this embodiment, information relating to time is handled. FIG. 65 is a diagram illustrating a functional configuration of the system according to the present embodiment. The processing unit 650 includes the understanding unit 65
2. It has a planning unit 653, an execution unit 654, a response unit 655, and a knowledge base 656, and is connected to the database 651.

FIG. 64 is a flowchart of the overall processing of this embodiment, and is a flowchart of the processing procedure in the functional configuration of FIG.

In step S640, it is checked whether there is an external input. If there is, the understanding unit 652 refers to the knowledge base 656, and in step S641, analyzes the input sentence in units of words or sentences. Further, in step S643, the purpose of the input content is analyzed and understood. In step S644, it is determined whether information necessary for understanding the purpose is not insufficient. If there is insufficient information, an inquiry is made to the user in step S645,
Step S by learning the answer from the user into the knowledge base 656
Return to 643. If there is no shortage, the process proceeds to step S646. If there is no input in step S640, in step S642,
The task to be performed is found, and the process proceeds to step S646.

[0209] In step S646, planning for achieving the object is performed by the planning unit 653. In step S647, it is determined whether or not information necessary for planning is sufficient.
To make an inquiry to the user, learn the answer from the user in the knowledge base 656, and return to step S646. If there is no shortage, the execution unit 654 executes the plan in step S649. At this time, the execution unit 654 accesses the database 651 and communicates with another application as necessary. Then, in step S650, the response unit 655 determines whether or not to execute the response. If so, the content is determined. Further, step S651
Then, a response corresponding to the determined content is created and responded to the user.

[0210] The understanding unit 652 includes information input from the outside,
For example, keyboard input, voice input, e-mail, fax, news information, etc. are recognized if necessary, and the content is analyzed. Understand the contents of sentences with text.

FIG. 67 is a diagram showing an example of extracting schedule information from an electronic mail. The above processing specifically analyzes the contents of the document received by Email, as shown in FIG. 67, and “February 22” “13:30” “15: 0”
The temporal concept of “0” was found and analyzed, and the sentence related to this concept, “From 13:30 on February 22, 1
We are planning to hold a patent system briefing session in Conference Room B until 5:00. , It becomes possible to associate time-related actions with schedules.

The analyzed time concept is compared with the current time. If the time is in the future, the action is registered in the schedule, and if the description is in the past, the action is discarded without registering in the schedule. Or as a record of past events, such as a personal database, registered as a type of information other than the schedule.

[0213] The understanding unit 652 includes information input from the outside, such as keyboard input, voice input, Email, FAX,
When analyzing information such as news information and finding words that the system does not know yet (words, concepts, etc.) or plans that have not been executed in the words in the text, the words and plans need to be urgent. If there is no such information, learning is performed by sequentially finding information related to the words and the plan, and the information is stored in the knowledge base 656 as knowledge.

Specifically, for example, when the unknown word “XYZ” appears, it is remembered that there is something called “XYZ”, and then “XYZ is very delicious”, “X
By analyzing sentences such as "YZ is hard," XY
Z is a hard and delicious food. To learn.

As for the plan, when the first plan is instructed, if the user understands from the situation at that time, for example, that the plan is for the absence, learning is performed as an example of how to make a plan for the absence of the user. Things.

[0216] Further, when information about the user is obtained from news or the like, for example, regarding the action or plan performed by the system, when the user receives a report for the system reporting to the user each time. To
By giving an instruction to the system in a natural language such as "do not report this information from now on", the system can learn not to report the information.

As described above, in this system, the understanding unit
At 652, the contents of the information input from the outside are analyzed, the purpose is analyzed, and at the planning unit 653, a plan of the action that the system must perform to achieve the purpose is made. Then, the execution unit 654 executes the processing. The response unit 655 notifies the user of the executed process.

For example, when an e-mail as shown in FIG. 67 is received, if it is understood from the information of the sender that the e-mail is from an unregistered person in the personal database, information on the person is extracted from the e-mail. And database 651
Register in your personal database. Furthermore, even when there is information about an unregistered person in the personal database, the information may be registered in the personal database.

By understanding that the mail is a guide for the briefing session, the user accesses the schedule of the user in the database 651, and performs time matching with the existing schedule data. If there is no problem such as collision of the new schedule data with the existing schedule data, this data is additionally registered in the schedule.
As shown at 9, when a problem is found, a reply to the sender and a report to the user are created.

As described above, in the present system, by understanding the contents from the received information, a response to be performed by the system is created according to the situation and executed.

In the above description, the system creates a reply to the person who sent the Email without confirming the user, and returns the reply. Please contact me as soon as possible. ", And from the analysis of this sentence, it is the action taken because it was judged that the urgency of the response was high. If it is determined that the urgency of the response is low at a scheduled date and time, or at a meeting such as voluntary participation, the user is asked to confirm the urgency before responding. To decide what action to take.

Further, in the same way as the user's instruction in the natural language, it is possible to access the schedule, the personal database, etc. and respond to the natural language input from the user.

For example, "Who is the telephone number for that person?"
You can access your personal database by asking questions in natural language, and you can access the schedule by asking questions in natural language, "Where is the 16th meeting?" And reply to the user. It is.

FIG. 66 is a diagram showing the type of input / output between the system which performs the overall processing of this embodiment and the outside.

The input includes natural language information input from a keyboard, e-mail, a document or image input as an image from a scanner, a voice input from a microphone, an image input from a camera, and the like. Can handle. By performing a character recognition process on a document read by a scanner and performing a voice recognition process on a voice, natural language input information can be obtained.

In the input, when there is no input (Idle), FIG.
As shown in step S642 of step 4, when there is no external input, the system itself searches for a job to be executed and uses it as an input. For example, when the user is in an idle state where there is no given work, the user accesses news and goes to get information related to the user himself, and uses it as input information.

Outputs include registration of a schedule or the like in a database, filing in a file storage device, or deletion of data. Further, there are a notification to the user and a reply to the transmission source. The important thing in the output is that it is possible to judge that processing cannot be performed within the scope of the system's understanding, and it is possible to perform other actions when processing cannot be performed, such as responding that processing cannot be performed. It is.

The input / output partner includes a user, an external device, another processing unit in the system, or another application.

[0229] In addition, it analyzes the incoming document, extracts information about people and information about time, stores it in a personal information database or schedule data, and analogizes expected actions. Information is also extracted and used for planning.

In the example of FIG. 67, as a result of analyzing the incoming e-mail document, as a description about a person, To: toshima@abc.canon.co.jp, rohra@abc.canon.co.jp, kazuyo @ abc. canon.co.jp From: ichiro@abc.canon.co.jp I am Suzuki of the System Intellectual Property Promotion Division. Suzuki (ichiro@abc.canon.co.jp) 044-549-6312 (ext. 620-5151) Canon Inc. has an intellectual property headquarters system intellectual property promotion section, of which the e-mail address is “kazuyo @ a
Assuming that the person “bc.canon.co.jp” has been registered in the personal database and the other persons have not been registered, FIG.
, Information of PERSON1,2,3 is extracted and registered in the database 651.

[0231] On the other hand, as a description of information related to time,
There will be a briefing on the patent system in the B conference room from 13:30 to 15:00 on February 22. ”The information on EVENT1 will be extracted from there.

Further, there is a description used for estimating the expected action, "Please contact us immediately if you find it inconvenient." This is used in the processing described in FIG. 70 and thereafter.

FIG. 68 is a flowchart showing the processing flow for executing the processing of FIGS. 67 and 69 by extracting necessary parts based on the flowchart of FIG. 64 and more specifically showing the execution processing step S649. is there.

The following is a specific description in accordance with the flow of FIGS. 67 and 69.

In step S680, when an email is input,
In step S681, the input Email document is analyzed for each word or sentence. In step S683, it is understood from the signature and the header that "there is information about a person" and "there is an event called a briefing session". In addition, understand that "reply is necessary in the event of inconvenience."

In step S684, a plan for extracting information of a person and registering it in the database and a plan for registering the briefing event in the schedule are created. In step S685,
An execution plan exists. Since there is no problem in step S686, the process is passed to step S688. In step S688, information on the person is extracted and registered in the database, and the flow returns to step S685.

In the case of FIG. 67, there is an execution plan for registering the briefing event in the schedule in step S685. In step S686, this event can be registered in the schedule without any problem, so the process is passed to step S688.
In step S688, a schedule is registered. When the process returns to step S685, there is no execution plan, and there is no notification statement in step S689, so the process ends.

In the case of FIG. 69, there is an execution plan for registering the briefing event in the schedule in step S685. In step S686, a schedule conflict is found. Since there is a problem in executing the plan, step S687
Then, reply to your inconvenience and re-plan to report to the user. In step S685, there is a plan for writing and sending a reply. In step S686, there is no problem in executing the plan. In step S688, a document to the effect that it is inconvenient is created, and the reply document is transmitted to the transmission source. In step S685, a document creation plan for user notification exists. There is no problem in execution in step S686, step
In S688, due to content of email and schedule conflict,
Create a document that notifies the user that he / she has replied to ask for reconsideration. In step S685, there is no execution plan,
In step S689, since there is a notification message, the user is appropriately notified, and the process ends.

In the example of FIG. 69, the schedule information EVENT1 from which the data has been extracted is compared with the previously scheduled schedule EVENT2, and it can be seen that the schedules overlap. Further, according to the information extracted in the example of FIG. 69, it can be understood that if it is inconvenient, it is necessary to report. Therefore, in the system using the present embodiment, a letter is transmitted using a knowledge of the letter creation to notify that the attendees cannot attend the meeting because the schedules overlap, and a reply is automatically transmitted.

Further, the system user using the present embodiment is notified that the system using the present embodiment has automatically responded.

[Embodiment 24] FIG. 70 is a diagram showing an example of a case where a user inquires of the system of this embodiment by voice.

When the user asks by voice, "Where are you going to hold a meeting tomorrow?", The system can reply to the meeting location by referring to the user's schedule information.

Further, if the user does not know how to get to the place where the conference is held, "Where is Shimomaruko?"
And refer to the database for that,
Furthermore, after planning how to explain to the user, it will be easy to understand, create an explanation story, and execute the explanation with graphical images and sounds.

FIG. 71 is a flowchart showing the processing flow of FIG. 70 based on the basic flowchart of FIG. Here, an external input is a question.

The process for the first question will be described. In step S710, when an external voice input (where is the meeting tomorrow going?) Is performed, the input sentence is analyzed in step S711. In step S712, it is a question for the meeting tomorrow, and it is understood that the purpose of the user is to know the location. In step S713, the following planning is performed to answer the question. Take out tomorrow's schedule. Get the location registered in the schedule. Create a document to notify the acquired location.

In step S714, the process is passed to step S716 since there is no lack of information in this case. However, if there are a plurality of conferences in the schedule, it is not known which conference is available. And rebuild the plan. Step S7
In step 16, the plan set up in step S713 is executed, and a document for reply to the user is created. In step S717, since there is a document to be notified to the user, it is determined to reply. At this time, it is understood that the input is a voice, and it is simultaneously determined that a reply and a voice are performed. In step S718, the user is notified of the document converted into the audio data.

Here, although the processing is once ended, a question is continuously input from the user. Processing for the second question will be described.

In step S710, when an external voice input (where is it in Shimomaruko?) Is performed, step S711 is performed.
Parses the input sentence. In step S712, it is understood that the question is a continuation question of the first question, and it is understood that the question is a question asking the specific place of the answered name.

At step S713, the following planning is performed to answer the question. The plan is that it is difficult to explain with a document, the plan is to explain images in sequence, the plan is to acquire the required images from the image database and the location database, and the plan is to create a document that matches the images.

In step S714, there is no shortage of information. In step S716, the plan created in step S713 is sequentially executed, and a document of a reply to the user according to the image is created. In step S717, since there is a document to be notified to the user, it is determined to reply. At this time, the user understands that the input was a voice, and at the same time, decides to give a description by voice while displaying the image on the monitor. In step S718, the user is notified. Thus, the flow of the series of processes in FIG. 70 ends.

[Embodiment 25] In the example of FIG. 72, when the schedules overlap, the priorities of the two schedules are evaluated, and what is to be done is planned, and then a proposal is made to the user.

That is, in the case of this example, if one schedule is more important than the other, it is proposed to cancel the less important schedule.

On the other hand, if the user has the knowledge that it is possible to send a substitute for the schedule proposed to be canceled, by answering the system in such a manner, the system further takes action in accordance with the system. It can be carried out. At this time, you can also learn about a plan to send a proxy.

FIG. 72 is a combination of another example of how to make a plan in step S646 in FIG. 64 when a schedule conflict is found in step S686 described in the flowchart in FIG. 68.

In FIG. 68, the processing for transmitting an inconvenient reply to the other party unconditionally has been described.
As a processing method of the 46 replanning, a process using a plurality of reprinings will be described.

FIG. 73 is a flowchart of a process for estimating a priority from the contents of a document and proposing it to a user as reprining at the time of a schedule collision. This processing will be described below.

The priority of the schedule described above is analyzed from information set in advance by the user for each schedule, attendees to events included in the schedule, purpose of the schedule, and received document contents. It is determined comprehensively from the results. Here, the priority determined from the attendees may be set in advance for a person whose user is to be an attendee.

The priority determined from the purpose of the schedule may be set in advance by the user, or may be set in common with the purpose or field in which the user has learned from past operations. You may make it determine by considering. That is, when the user is engaged in computer-related work, the schedule of the computer-related event has priority over the property-related event. Of course, if the user is considering purchasing a house and that information is stored as information about the user, the real estate-related event schedule may be given priority.

On the other hand, the priority determined from the analysis result of the contents of the document is, for example, a case where the schedule of the document "Please attend" must coincide with the schedule of the document "Please attend if possible". It can be determined that the former is determined to have a higher priority.

In FIG. 73, in step S730, existing schedule information is obtained. In step S731, the priority of the new schedule information is evaluated. Step S732
Then, the priorities of both information are compared. In step S733,
Notification document for inquiring the user based on the comparison result (for example, indicating two conflicting schedules, and asking whether to cancel the lower priority one, etc.)
Make a plan to create. In step S734, the created notification message is transmitted to the user. In step S735, a response from the user to the inquiry about the plan is obtained. Here, in order to execute the user's reply, the same processing as the reply replanning of FIG. 68 is performed to perform the planning again with the user's reply as an input (FIG. 74).

FIG. 74 is a flowchart of the above-described replanning process.

In step S740, the reply finally obtained in FIG. 73 is input. In step S741, the input document is analyzed. In step S742, it is understood that the schedule is changed and the instruction plan is the first instruction plan.

In step S743, the following plan is made. (a) Change the schedule. (b) Create a document to notify the agent. (c) Learn a new plan. (d) Create a document to notify the user. (e) Notify that there is a reminding schedule.

In step S744, the plan established in step S743 is executed. (a) Change the schedule. (b) Create and notify a document to notify the agent. (c)
Learn a plan to ask for an agent. (d) Create a document to notify the user, and (e) Add to the created document that there is a reminding schedule.

At step S745, a notice sentence to the user is transmitted to the user. This is the end of the description of the processing for executing the processing in FIG. 72.

[Twenty-sixth Embodiment] FIG. 75 is a diagram showing an overall image including the input / output of the system according to the present embodiment. FIG. 76 is a flowchart showing the flow of the processing of the entire system of FIG. 75.

Email, voice, keyboard input, WWW,
Information input from various input devices such as a telephone, a fax, a scanner, and a camera is all analyzed by the input management unit 751 (step S760), and the core unit 752 understands the contents and plans appropriate processing (step S760). S761), output Mana
The output media and output path are prepared by the gement unit 753 (step S762), and then output from various output devices such as Email, voice, WWW, telephone, FAX, printer, and copier.

FIGS. 77 to 79 show steps S760 (input management) which are each step of the overall flowchart of FIG.
37 is a flowchart specifically illustrating step S761 (processing of the core section 752), step S762 (processing of the output management section 753), and step S762 (processing of the output management section 753).

Referring to FIG. 77, an input management unit 751
Waits for a new input in step S770. The information input in step S771 is obtained. In step S772, analysis of the acquired input information is performed after recognition if necessary. At this time, the input management unit 751 can receive information from various media, and performs recognition and analysis by a method corresponding to each medium.

In FIG. 78, the core unit 752 performs a receiving process of the input information analyzed in FIG.

At step S780, the purpose of the input information is analyzed and understood from the analysis result. In step S781, it is checked how the purpose of the input information relates to the user (system, user). In step S782, planning is performed on what to execute based on the relationship with the user according to the purpose. In step S783, the plan created in step S782 is executed.

In FIG. 79, the output management unit 753
Determines whether it is necessary to respond from the result executed in FIG. 78, and if necessary, creates and outputs a response.

In step S790, the result of the execution in FIG. 78 is analyzed. In step S791, it is determined whether there is a response to the execution result. If nothing is found, the process ends. If there is a response, it is determined in step S792 how to respond to an external response. In step S793, a medium to which a response is made is determined. In step S794, a response corresponding to the determined medium is created. The response created in step S795 is issued according to the medium. In step S796, the response is actually physically output. The above is the processing representing the overall image of FIG.

For example, E informing the user of the holding of the conference
When the mail arrives, first, the input Management unit 751
, The input information is analyzed in the procedure shown in FIG. From this result, the core unit 752 plans and processes how the user and the system should respond in the procedure shown in FIG. 78. The result is passed to the output Management unit 753,
When the processing is performed according to the procedure shown in FIG. 79 and the response is planned to be performed, the response is actually performed.

Here, depending on the contents of the conference notified by Email and the status of the user's schedule before that, it is planned in step s782 that it is necessary to actively notify the user, so that a response is required. Becomes Therefore, it is determined that there is a response in step s791. In step s792, the content of the response is determined. For example, when the schedules are in conflict, the content of the response itself, such as prompting the user to select one of the schedules or in the case of a conference where it is not known whether or not to participate, is determined here. Subsequently, in step s793, a medium that can most effectively convey the content of the response determined above is determined. For example, if the user is away from home, a medium that can notify the user on the go, such as telephone or fax, is selected. On the other hand, if the user is using a personal computer or the like, various materials can be downloaded. A medium such as a personal computer that can be displayed effectively is selected. Subsequently, in steps s794 and s795, a response is created and issued by a method such that a document or image is created in accordance with the content or the medium determined above, and depending on the medium, it is converted into natural language sound. Is done.

FIG. 80 is a flow chart for explaining in more detail how the data is extracted from the input information, in more detail the overall flow of FIG.

In the system using this embodiment, when a document is input, first, in step S801, the type of the document is estimated by referring to the type identification symbol such as the layout of the document or a bar code. As a result, if the document can be guessed as a letter, a report, a patent gazette, etc., the process proceeds to step S803. If the document cannot be guessed, the process proceeds to step S810, and complete OCR is performed to determine the document type.

In step S803, in order to confirm whether or not the guessed document type is correct, the OCR interprets the characteristic block for confirming the document type by OCR (see FIG. 82). As a result, in step S804, the address of the letter, the patent number of the patent publication, and the like are known, and the document type is confirmed. If the confirmed document type matches the inferred document type, the process proceeds to step S806, and if not, the process proceeds to step S810. For example, if the form is a form in which a character string indicating the form type is printed on the upper part of the paper,
By performing OCR on the upper part of the sheet, the document type can be easily determined.

In step S806, a specific block is read and interpreted by the OCR using the above-described knowledge base of the document type, and it is checked in step S807 whether information related to the information obtained as a result has existed in the past. If there is, the process proceeds to step S808, and if not, the process proceeds to step S810. As a result, the address, the patent number, and the like are known, and it is understood whether the reply is a reply to a letter sent in the past.

In step S808, the purpose is determined from the contents of the important text based on the above-described situation, and the processing to be executed in step S809 is determined.

In step S811, for the purpose understood above, the analysis range is expanded to another range not subjected to OCR, and analysis is performed, and the process is actually executed in step S812 and subsequent steps. As a result, if necessary, processing such as filing is performed.

According to the above-described processing, while estimating the contents,
Since R can be performed, it is possible to obtain an accurate OCR result more efficiently than in the conventional case where complete OCR is performed suddenly, and processing performed based on the OCR result can be performed correctly.

FIG. 81 is a diagram showing an example of a letter / fax to be subjected to data extraction processing.

In this example, in step S801, the type of the document is estimated from the layout of the document. As a result, Do
cType1 = Letter / fax.

On the other hand, in step S803, a specific block is read and interpreted by OCR. (See FIG. 82) As a result, From, To, Dear Sir, etc. are obtained, and step S804 is performed.
Is confirmed as DocType2 = letter / fax.

The OCR described in step S803 in FIG.
The specific block reading by the above will be specifically described. FIG.
FIG. 2 is a diagram for explaining this processing.

In the system using this embodiment, scanning is performed as follows. High-speed reading by low-resolution prescan. The read information form is compared with the form information stored in DB823, and if they match, the information entered other than the form or the area specified for each form
Only the information (for example, the portion within the frame on the card in FIG. 82) is read at a high resolution. Only the area read in above is analyzed as an object of OCR, and the processing is continued.

Further, in this example, it is assumed that there are a plurality of cards of the same form. Therefore, the documents to be read at regular time intervals have a high possibility of the same form. Processing is performed as if the form is the same, and re-analysis is performed as if the form is different only after contradiction occurs.

As a result, the processing speed can be greatly improved, the analysis range can be limited, and the analysis domain can be specified by specifying the form, and the analysis accuracy can be greatly improved.

The determination of the purpose from the contents and the like described in step S808 in FIG. 80 will be specifically described.

In the system using this embodiment, the process is determined by referring to the date data according to the procedure shown in FIG. When the sender is a user, the following processing is executed. If the date is today, it is determined that the fax is to be transmitted. If the date is before yesterday, the user is inquired as to whether the same document has been sent before, the same content has been seen before, etc., and filing, retransmission, and user error are determined. If the date is after tomorrow, keep it until the date specified in the date or ask if the user is wrong.

More specifically, taking the document of FIG. 81 as an example, Da
When te1 is the date of the document and Date2 is today's date, Date1 = November 25, 1996 & Date2 = November 25, 1996-Send document Date1 = November 25, 1996 & Date2 = July 1997 2nd-File Date1 = November 25, 1995 & Date2 = November 26, 1996 Contents Date = December 18, 22nd, 1996-Wrong

FIG. 83 is an example of a flowchart of a process for analyzing a purpose from an input document. When a document is input, it is determined in step s830 whether the sender is a user. Otherwise, the input document is determined to be a received document. In step s831, filing or data corresponding to the received document is performed. The purpose such as extraction is identified, and the process ends.

On the other hand, if the sender is a user, to further analyze what the input document is,
Proceed to step s832 and subsequent steps. In step s833, the date of the document is compared with today's date.
At s835, it is checked whether the document has been sent before, and if not, the purpose is determined to be "send document". In the case of a previously transmitted document, in step s843, the purpose of filing, retransmission, or the like is identified correspondingly.

On the other hand, if the date of the document is considerably earlier, the flow advances to step s836 to check whether or not the document has been transmitted.
Proceed to s843. If not, step s8
Proceeding to 37, the information in the document is checked for any other dates. If a date is found, the process proceeds to step s843. If there is no date, the document may be transmitted for the purpose, but it is determined that the date may be wrong.

If the date of the document is considerably earlier than the current date, it is checked in step s840 whether there is any other date from the information in the document, and the date is found in step s841. If so, the purpose is determined to be "sending the document". If there is no date, step
Proceed to s839.

[Embodiment 27] FIG. 84 is a diagram showing an example of the configuration of a system using this embodiment. In this example, the system operates like a current fax.

However, according to the system of this embodiment,
The user can determine the destination of the document based on the barcode or the information on the cover sheet attached to the read document without specifying the destination, and can transmit the document to an appropriate destination.

As a result, the printer, FAX, Emai
1, Information is appropriately sent to WWW.

[Embodiment 28] FIG. 85 is a diagram showing an example of the configuration of a system using this embodiment. In this example, the system implements the functionality of a desk sorter that processes any document on the desk.

That is, classification, filing, scheduling, other data extraction, and automatic execution of processing are performed in accordance with the content of the read document.

[Embodiment 29] FIG. 86 shows the system explained in FIG. 85 in more detail. FIG.
87, the processing procedure will be specifically described according to the flowchart in FIG.

FIG. 87 is a flowchart showing the processing procedure of this embodiment. FIG. 88 and FIG. 89 show the knowledge used during this processing, and FIG. 88 shows the knowledge of the general knowledge base. FIG.
It represents the knowledge of the knowledge base of the field specified on the cover page. In this embodiment, FIGS. 88 and 89
By comparing the character string included in the input document with the character string defined in the character string column in the figure by referring to the information defined in, the concept of the matched item and its meaning are explained. Role to further specify, Condition to specify the following information, or
Acquire the specified processing action and analyze it.

Referring to FIG. 87, in step S870, the cover page is scanned and the OCR process is executed. Steps
In S871, information such as the sender, receiver's name, telephone number, and fax number is extracted with reference to the knowledge base of FIG. In step S872, the extracted information is registered in the database. For example, in the example of FIG. 86, the cover page of the received document includes a character string “To: Macrohard Corp.”. Then, when comparing with the item defined in the character string column of FIG. 88, a matching item “To” is found and its Role
"Macrohard Corp." is extracted as the information of the recipient because is the receiving company name or name.

In step S873, an action or a job such as a notification method or means, filing work or place is extracted from the knowledge base of the field specified on the cover page in FIG. For example, in the example of FIG. 86, the cover page of the received document includes the character string “File: MH / Contract”. Then, when comparing with the item defined in the character string column of FIG. 89, a matching item "File" is found, and the filing is taken out as the instructed action, and the information on the filing location is included in the document. From "MH
/ Contract ”is extracted.

Here, Date1 = November 25, 1996 & Date
Assuming that 2 = November 25, 1996, it is determined that the purpose is to send the document as described with reference to FIG.

In step S874, it is checked whether an action for the purpose of the present process exists. In step S875,
Since the purpose is to send the document to the other party, the action of sending is executed. In step S876, it is determined whether filing is necessary based on the information on the cover page. In step S877, since it is necessary in the example of FIG. 86, the file is filed in the designated location "MH / Contract".

At step S878, similar to step S876,
From the information on the cover page, determine whether it is necessary to notify the sender. Since the sender has been instructed to notify the sender by voice, in step S879, the sender is notified by voice that the document has been transmitted to the other party. In step S880, it is determined whether there is another action. In step S881, since a keyword is specified, an index is created using the keyword ABC.

[Embodiment 30] FIG. 90 is a diagram showing an example of executing a process by referring to a history performed in the past based on an instruction in a natural language inputted by voice. FIG.
The processing will be described according to the flowchart of FIG.

FIG. 91 is a flowchart showing the flow of the processing of this embodiment. “Fax
When receiving the instruction "Contract again to John. Notify him by Phone.", The system analyzes the purpose of the received instruction in natural language, and converts the document "Contract" to John.
Re-send it by fax and let us know by phone. I understand that. Therefore, the flow of FIG. 91 is executed to specifically execute the processing by specifying the document Contract and the transmission destination John.

[0311] In step s910, since retransmission has been performed before, history information is obtained from the database. As a result, the documents Contract and John are specified from the history information. In step S911, the address of John is acquired from the personal database. In the database, there are two Johns, John Smith and John Bush, so it should not be possible to identify the destination normally, but by referring to the history information in step s910, John Smi, who previously sent the document Contract,
th, and the transmission destination is specified. Step S912
To get the "Contract" document from the filing database. In step S913, the document is transmitted to John, the transmission destination. In step S914, the notification instruction “Notify him
"Phone", so it is determined that notification is necessary.
In step S915, similarly to FIG. 89, the F of the transmission destination is notified from the rules of the knowledge base so as to notify the recipient by telephone.
AX901 is instructed. In step S916, since no other action has been instructed, the process ends.

Further, the FAX 901 that has received the document notifies John that the document has been received from Mr. Doors by telephone in accordance with the above-described notification instruction. If the FAX 901 cannot notify by telephone, the transmission may be performed at the transmission source.

[Embodiment 31] FIG. 95 shows that the user determines that the user should do something from the analyzed contents of the input document.
It is a flowchart of an example in which necessary processing is automatically executed after actually inquiring the user. FIG. 92 is a diagram illustrating an example of an input document. FIG. 93 is a diagram showing the contents of a conversation between the system and the user. FIG. 94 is an output document created by the system based on the conversation shown in FIG.

Based on the flowchart of FIG. 95, FIG.
The processing up to creation of the output document of FIG. 94 from the input document of FIG. 94 will be described.

In step S950, the input document shown in FIG. 92 is analyzed to understand the following purpose. (a) 11 by John Smith
Arriving in Yokohama at 3:00 on March 28. (b) John Smith is not good at Japanese. (c) I want you to pick me up at the station.

In step S951, it is determined from the understood contents whether the user should do something. Here, since it is determined that it is necessary to pick up at the station, step S9
Move on to 52. In step S952, it is determined whether or not the user (system) can execute it on behalf of the user. Here, the system cannot go to pick itself up, so the process moves to step S953. In step S953, it is determined whether it is necessary to make an inquiry to the user, and the process proceeds to step S954. In this example, since it is determined from the destination of the input document that the request is directed to Aruna Rohra, the process proceeds to step S954.

[0317] In step S954, an operation for inquiring the user (Mr. Aruna Rohra) is performed, and an inquiry is made. In this example, from the result understood in step s951,
We have to pick up John from the user, but we ask the user what to do. In step S955, what to do next is determined from the result of the inquiry, and it is determined whether or not it is necessary to take action. In this example, since the user is instructing to ask Mr. Tanaka to go to pick up, the user takes action according to the instruction. Therefore, here it is necessary to ask Mr. Tanaka if he can ask for it, so he decides that it is necessary to take action. In step S956, a document is prepared and contacted for asking Mr. Tanaka for a substitute. Here, a document for electronic mail is created and transmitted. In this example, from the information that John will arrive on the 28th, the instructions that he wants you to pick up on behalf of the user, and the original document that was the basis of this request is attached,
The document is created automatically.

The above has described the flow of the processing for performing the matter that the user must actually take action (here, picking up at the station) from the input document.

[Embodiment 32] FIG. 96 shows an embodiment in which the system is operated by a remote controller.

According to the system of the present embodiment, the device and the remote controller can directly or indirectly communicate with each other to specify each other.
As a result, automatic device identification, acquisition of device capabilities from devices, device-specific UI (user interface), voice operation, and basic operations are common to all devices, user-specific UI, and freedom according to the situation. A function such as a high-level UI is realized.

That is, the operation target device is automatically recognized only by pointing the remote controller at the operation target device, information of each device is obtained from the device itself via IrDA or wireless LAN, and from the obtained information of each device. While realizing a device-specific UI and enabling voice operation, the basic operation can be operated with the same remote control to realize a common basic operation, and by referring to the user identification information, the user can be operated. Each time, necessary information is acquired from a database or an address book, and not only a user-specific UI is realized, but also an optimum UI is realized according to the situation.

In FIG. 96, by pointing the remote control 960 at the FAX 963, model identification information is obtained from the FAX 963, the UI corresponding to this model is activated, and the displayed “Fax
After inputting the character string "Fax to John" with the touch pen after "to" and instructing the fax 963, the computer 9
Then, John's FAX number is read from the address book 965 in 64, and a document set in the FAX 963 or a specified document on a file in the personal computer 964 is transmitted to that number. The details will be described later.

[Embodiment 33] FIG. 97 is a diagram showing an example of a status monitor.

According to the system of this embodiment, information other than the machine on which the user is directly operating can be referred to.

As a result, functions such as remote & handy management, automatic device identification, common input / output for checking status, functions of a mobile phone, voice operation, and support for all devices capable of infrared input / output are realized. You.

That is, necessary information can be obtained even in a place remote from the target device, and the operation target device is automatically recognized just by pointing the remote controller at the operation target device.
The basic operation can be operated with the same remote control to realize common basic operation, and the remote control has the function of a mobile phone to improve operability, enable voice operation, and enable general protocols. By using it, it becomes possible to support all devices that can input and output infrared rays.

In FIG. 97, the status monitor 970 is directed to a printer 961, a copier 962, or a facsimile
By inputting and instructing a character string “Status” with a touch pen, status information is read from the device to which the status monitor 970 is directed to the status monitor 970,
The user of the status monitor 970 can check the status of each device. Also, for example, a personal computer 96
4 is located in a place where the command from the status monitor 970 cannot be received.
, The status information can be read from the personal computer 964 to the status monitor 970 via the network and the printer 961.

[Embodiment 34] FIG. 98 shows a remote controller 960.
FIG. 11 is a diagram showing an example in which a target model is recognized, a corresponding UI is read from inside the remote controller 960 and displayed. On the remote controller in a state where the remote control is not directed to the target model, as shown in the center of the figure, a screen in a default state in which a message "Please direct to the machine to be operated" is displayed.

Now, the flow of communication between the remote controller and the target model will be described. In the following description, and are not essential. For example, if the target model always emits a signal directed to the remote controller at a constant interval, the same effect can be realized. Alternatively, the fact that the remote controller 960 is pointed at the target model by the target model or another device may be detected from the positional relationship between the remote controller 960 and the target model. Also, the remote controller 960 may identify the target model by looking at the device shape of the target model, or may identify the target model by reading a bar code attached to the target model. That is,
FIG. 98 shows only essential parts. The user points the remote control 960 at the target model. To determine when to send the target model identification signal request signal from the remote control 960 to the target model, the user
Touch the 960 touch panel. Alternatively, it is set in advance to always send the target model identification signal request signal at a constant interval. The remote controller 960 sends a target model identification signal request signal to the target model. The target model identification signal is transmitted according to the request of the target model identification signal request signal from the remote controller 960, or if it is set in advance to always transmit the target model identification signal at a constant interval. Upon receiving the target model identification signal, the remote controller 960 determines the UI according to the target model indicated by the signal, and
Displays the corresponding UI stored internally. Here, the identification signal is set for each model. However, if the identification signal is set for each device, a different UI can be used for each device even with the same model.

FIG. 99 shows that the remote controller recognizes the target model,
19 is a flowchart illustrating an example of processing on the remote controller side in an example in which a corresponding UI is read from inside the remote controller 960 and displayed. The processing flow on the remote control side will be described.

[0331] In step S991, the flow waits until there is an instruction operation by the user. In step S992, a target model identification signal request signal for transmitting a target model identification signal from the target model is transmitted by a method such as infrared rays. Step S993
And waits until a target model identification signal is transmitted from the target model. In step S994, the UI corresponding to the received target model identification signal is acquired from an internal memory or the like that can be referred to by the remote controller 960 and displayed.

FIG. 100 is a flowchart showing an example of processing on the target model side in an example in which the remote control 960 recognizes the target model and reads out and displays the corresponding UI from inside the remote control 960. The processing flow on the target model side will be described.

At step S1001, the process stands by until there is a request signal from remote controller 960. In step S1002, a target model identification signal is transmitted by a method such as infrared communication.

[Embodiment 35] FIG. 101 is a diagram showing an example in which a remote controller receives and displays a UI from a target model. A screen in a default state is displayed on the remote control 960 in a state where it is not directed to the target model, as shown in the center of FIG.

Now, the flow of communication between the remote controller and the target model will be described. It is not essential from the following description. For example, if the target model always emits a signal directed to the remote controller at a constant interval, the same effect can be realized. Alternatively, the fact that the remote controller 960 is pointed at the target model by the target model or another device may be detected from the positional relationship between the remote controller 960 and the target model. Also, the remote controller 960 may identify the target model by looking at the device shape of the target model, or may identify the target model by reading a bar code attached to the target model. That is,
In FIG. 101, only essential parts are described. The user points the remote control 960 at the target model. The user touches a touch panel or the like of the remote control 960 to determine the timing of sending a UI request signal from the remote control 960 to the target model. Alternatively, it is set in advance to always send the UI request signal at a constant interval. The remote controller 960 sends a UI request signal to the target model. According to the request of the UI request signal from remote control 960, U
Send I. Alternatively, if the UI is set so as to always send the UI at a constant interval, the UI is sent according to the setting. The remote control 960 that has received the UI displays the UI.

FIG. 102 is a flowchart showing an example of processing on the remote controller side in an example in which the remote controller 960 receives and displays a UI from a target model. The processing flow on the remote control side will be described.

[0337] In step S1021, the flow waits until there is a user's instruction operation. In step S1022, the UI
Is transmitted by a method such as infrared communication. In step S1023, U
Wait until I is transmitted. In step S1024, the received UI is displayed.

FIG. 103 shows that the remote controller operates the UI from the target model.
9 is a flowchart illustrating an example of processing on the target model side in an example of receiving and displaying a message. The processing flow on the target model side will be described.

In step S1031, the process stands by until a request signal from remote controller 960 is received. In step S1032, the UI is
Calls are transmitted by a method such as infrared communication.

[Embodiment 36] FIG. 104 shows that the UI of each device is in the wireless LAN server 1041,
Is requested to the copy machine 962 as a target model, the wireless LAN server 104 is requested by the copy machine 962.
FIG. 9 is a diagram showing an example in which a UI is transmitted from 1 to a remote controller 960 and displayed.

Remote control not directed to target model
At 960, a default screen is displayed as shown in the center of FIG.

Now, the flow of communication between the remote controller and the target model will be described. The user points the remote controller 960 to a target model (here, the copy machine 962). The user touches a touch panel or the like of the remote control 960 to determine the timing of sending a UI request signal from the remote control 960 to the target model. Alternatively, it is set in advance to always send the UI request signal at a constant interval. A UI request signal is sent to the target model together with remote control identification information (remote control A) for identifying the remote control 960 itself. The target model that has received the remote control identification information and the UI request signal from the remote control is the remote control identification information (remote control A) and the target model identification information that identifies the target model itself (copier).
To the server 1041 that manages the target model, and requests transmission of the UI. The server 1041 is a remote control 96 indicated by the remote control identification information.
At 0, the UI of the model indicated by the target model identification information is transmitted via a wireless LAN or the like. Remote control 960 that received the UI sent to you
Displays a UI.

FIG. 105 shows that the remote controller operates the UI from the target model.
7 is a flowchart of processing on the remote controller side in an example in which a UI is received and displayed via a wireless LAN or the like without directly receiving the UI.

The flow of processing on the remote control side will be described. In step S1051, the process waits until there is a user's instruction operation.
In step S1052, a UI request signal for transmitting a UI and remote control identification information for identifying the remote control itself are transmitted to the target model by a method such as infrared communication. In step S1053, the process waits until a UI is transmitted from somewhere. In step S1054, the received UI is displayed.

FIG. 106 is a diagram showing a case where the remote control is switched from the target model to the UI.
9 is a flowchart illustrating an example of processing on the target model side in an example in which a UI is received and displayed via a wireless LAN or the like without directly receiving the UI. The processing flow on the target model side will be described.

In step S1061, the process stands by until a request signal from remote controller 960 is received. In step S1062, the remote controller identification information received from the remote controller and its own target model identification information are transmitted to the server 1041, and transmission of the UI is requested.

[0347] Fig. 107 shows that the remote controller operates the UI from the target model.
9 is a flowchart illustrating an example of processing on the server side in an example in which a UI is received and displayed via a wireless LAN or the like without directly receiving the UI. The processing flow on the server side will be described.

In step S1071, the process waits until there is a UI transmission request signal from the target model.

In step S1072, the UI of the model indicated by the target model identification information is transmitted to the remote control 960 indicated by the remote control identification information received from the target model.

[Embodiment 37] In FIG. 108, the UI of each device is in the wireless LAN server 1041, and the remote controller 960a
Or aim 960b at the target model FAX963
When I request I, the wireless LAN is requested by FAX963.
21 is a diagram showing an example in which a different UI is transmitted from the server 1041 to the remote controller 960a or 960b for each user and displayed.

[0351] Remote control not directed to target model
On 960a or 960b, a default screen is displayed as shown in the center of FIG. This screen is common to remote controllers 960a and 960b.

Here, the user and the remote control 960a or
The flow of communication between 960b and the target model will be described. The user points the remote control 960a or 960b at the target model. To determine when to send a UI request signal from the remote control 960a or 960b to the target model, the user
Touch the 960a or 960b touch panel. Alternatively, it is set in advance to always send the UI request signal at a constant interval. Remote control identification information (remote control A, remote control B) for identifying remote control 960a or 960b itself, and user identification information for identifying the user himself (advanced, beginner)
Are sent together with the UI request signal to the target model. The target model that has received the remote control identification information, the user identification information, and the UI request signal from the remote control 960a or 960b transmits the target model identification information that identifies the target model itself together with the received remote control identification information and the user identification information to the target model. Send it to the server 1041 that manages the model. The server 1041 is a remote control 96 indicated by the remote control identification information.
At 0a or 960b, a UI indicated by the user identification information and the target model identification information is transmitted via a wireless LAN or the like. In the example of FIG. 108, the UI for the broadcast communication function that is difficult for a beginner to use is not sent to a beginner, but is sent only to an advanced user. Remote control 960a that receives the transmitted UI to itself
Alternatively, 960b displays a UI.

In the above example, the level information of the user is transmitted from the remote controller as the user identification information. However, the information such as the user name which individually identifies the user is transmitted from the remote controller. Alternatively, the target device or server may determine the level of the user from the received identification information.

In the above example, only the UI has been described, but if the user identification information that differs for each user is referred to, the contents of the emergency mail arriving at the user, the schedule that the user wants to be notified immediately, and the like are displayed on the UI. And can be sent to the remote control.

[0355] Fig. 109 shows that the remote controller operates the UI from the target model.
7 is a flowchart showing an example of processing on the remote controller side in an example in which a UI different for each user is received and displayed via a wireless LAN or the like without directly receiving the UI. The processing flow on the remote control side will be described.

[0356] In step S1091, the flow waits until a user's instruction operation is performed. In step S1092, the UI
, The remote control identification information for identifying the remote controller itself, and the user identification information for identifying the user himself, by a method such as infrared communication. In step S1093, the process waits until a UI is transmitted from somewhere. In step S1094, the received UI is
indicate.

FIG. 110 shows a case where the remote
9 is a flowchart illustrating an example of processing on the target model side in an example in which a different UI is received and displayed for each user via a wireless LAN or the like without directly receiving the UI. The processing flow on the target model side will be described.

In step S1101, the process stands by until a request signal is received from the remote controller. In step S1102, the server transmits its own target model identification information to the server 1041 together with the remote control identification information received from the remote controller and the user identification information, and requests transmission of the UI.

FIG. 111 is a diagram showing a case where the remote control
9 is a flowchart illustrating an example of processing on the server side in an example of receiving and displaying a different UI for each user via a wireless LAN or the like without directly receiving the user interface. FIG. 112
Is an example of a table showing the UI determined from the target model and the user identification information. The processing flow on the server side will be described.

In step S1111, the process waits until there is a UI transmission request signal from the target model. In step S1112, a UI corresponding to the target model identification information and the user identification information is transmitted to the remote controller indicated by the remote control identification information received from the target model with reference to the definition as shown in FIG.

[Embodiment 38] FIGS. 113 and 114 are diagrams showing an example of realizing a function not possessed by the operation target model in front of the eyes. The flow of communication between the user, the remote controller, and the target model in this example will be described. The user points the remote control 960 at the target model and specifies a function to be performed. The operation target model that has received the request from the remote controller 960 transmits the request to the server 1041. The server 1041 transmits a UI of a model corresponding to the requested function. Remote control 960 displays the received UI. The user operates according to the instruction of the UI. In the case of this example, the user sets a document to be sent to the copy machine 962 in front of the user, and instructs and executes the destination using the remote controller 960. The operation target device performs what it can do by itself,
Ask other devices for things that you cannot do. In this example, the copy machine 962 reads the document,
Since transmission is not possible, the contents of the operation instruction such as the transmission destination are sent to the FAX 963 together with the document data. The FAX 963 transmits the sent document data by facsimile to the designated destination according to the instruction.

In the above example, in order to determine a device for which the copier 962 requests a function that cannot be performed by itself, each device may have knowledge of the functions of other devices, May be determined as a result of inquiring of each of the devices whether the function is executable. Alternatively, a server that has knowledge of the model corresponding to the function
You may make an inquiry to 1041.

[Embodiment 39] FIG. 115 shows a case where the remote controller cannot communicate directly with the operation target model due to an obstacle in the middle of the operation target model in front of the user and the remote controller. It is a figure showing an example which tries indirect communication by a course.

Here, the flow of communication between the user, the remote controller, and the target model will be described. It is not essential from the following description. For example, if the target model always emits a signal directed to the remote controller at a constant interval, the same effect can be realized. That is,
FIG. 115 shows only essential parts. The user points the remote control 960 at the target model. The user touches a touch panel or the like of the remote control 960 to determine the timing of sending a UI request signal from the remote control 960 to the target model. Alternatively, it is set in advance to always send the UI request signal at a constant interval. The remote controller 960 sends a UI request signal to the target model. The target device responds to the request of the UI request signal from the remote controller 960 or, if it is set in advance to always transmit the UI at a constant interval, according to the setting.
Send. The remote control 960 that has received the UI displays the UI. Here, in the remote control 960, if a UI is not transmitted for a predetermined time after the transmission of the UI request signal, or when the UI is set to be transmitted at a predetermined interval, the UI is transmitted via another route. Sends a UI request signal. In this example, when communication using an infrared signal cannot be realized, communication using a wireless LAN is attempted. The acquired UI is displayed via the wireless LAN.

FIG. 116 shows the case where the remote controller cannot communicate directly with the operation target model due to an obstacle in the middle of the operation target model in front of the user and the remote controller. 9 is a flowchart illustrating an example of processing on the remote controller side in an example of attempting communication. The processing flow on the remote control side will be described.

[0366] In step S1161, the flow waits until a user's instruction operation is performed. In step S1162, the UI
, And a remote control identification information for identifying the remote controller itself by a method such as infrared rays. In step S1163, it is checked whether a UI has been received. In step S1164, it is checked whether a predetermined time has elapsed after the request was transmitted. In step S1165, a UI request signal for having the target model transmit a UI,
The remote controller identification information for identifying the remote controller itself is transmitted by a method such as a wireless LAN, which is different from the transmission path in step S1162. In step S1166, the received UI
Is displayed.

In this case, the UI request signal transmitted directly to the operation target model itself is sent to the wireless LAN server 1041, and the wireless LAN server 101 receiving the UI request signal receives the UI request signal.
In 41, since the operation target model is unknown,
A menu for selecting (Function) is displayed. Then, a UI corresponding to the selected model is displayed. The UI may be such that the wireless LAN server 1041 receives a model selection signal from the remote control 960 and transmits a UI corresponding to the model to the remote control 960, or a plurality of menus that can be selected from the menu together with the menu. May be transmitted.

[Embodiment 40] FIG. 117 is a diagram showing an example in which the operation / action performed by the user and the time are stored as a history together with important information relating to the operation / action.

Here, the flow of saving the operation / action performed by the user and the time together with important information related thereto as a history will be described. The user sets the document in the FAX 963, and instructs the user (sender) to transmit the document to Mr. a of Company A. The FAX 963 transmits the document in accordance with the instruction, and transmits the fact that the document was transmitted to Mr. a together with the transmitted document and the transmission time to the server 1041 according to Tom's instruction. The server 1041 stores the received document as a file [File ABC] with an appropriate name, and stores the received fact as history information.

FIG. 118 is a flowchart showing an example of processing on the remote controller side in an example in which the operation / action performed by the user and the time are stored together with important information related thereto as a history. The processing flow on the remote control side will be described.

In step S1181, the flow waits until a user's instruction operation is performed. In step S1182, a request signal for an instruction operation performed by the user, remote control identification information for identifying the remote controller itself, and user identification information for identifying the user himself are transmitted by a method such as infrared communication. In step S1183, the process waits until a UI is transmitted from somewhere. In step S1184, the received UI is displayed.

FIG. 119 is a flow chart showing an example of processing on the target model side in an example in which the operation / action performed by the user and the time are stored together with important information related thereto as a history. The processing flow on the target model side will be described.

In step S1191, the process stands by until a request signal from remote controller 960 is received. In step S1192, remote control 9
The processing corresponding to the request signal from 60 is executed. Fig. 117
In the case of the example, the document set by the user is read and transmitted to Mr. a of Company A. In step S1193, the remote control 960 transmits to the server 1041 the remote control identification information received from the remote control 960, the user identification information, the target model identification information of the user himself, and important information relating to the performed action. In the example of FIG. 117, according to Tom's instruction, the fact that the document was sent to Mr. a, together with the sending time, sends the sent document itself, which is important information related to this fact, to the server 1041.

FIG. 120 is a flowchart showing an example of the processing on the server side in an example in which the operation / action performed by the user and the time are stored together with important information related thereto as a history. FIG. 121 is a diagram illustrating an example of history information updated as a result of this processing.
The processing flow on the server side will be described.

In step S1201, the process waits until there is a request signal from the target model. In step S1202, important information relating to the received fact is stored. In the case of the example in FIG. 117, the document that Tom instructed to transmit is stored as File ABC.

In step S1203, the history information is updated based on the received fact. In the example of FIG. 117, the fact that Tom sent the document to Company A at 10:00 on July 5, 1996 is recorded together with the file name saved in step S1201. FIG. 121 shows an example of updated history information.
On July 7, 1996, Tom copied File ABC from Company A to the fact that Mary copied 10 copies of FileXYZ.
The fact that you sent to was added. In step S1204, the remote control indicated by the remote control identification information received from the target model has a U
Send I.

[Embodiment 41] FIGS. 122 and 123
FIG. 8 is a diagram illustrating an example in which an operation / action performed by a user and time are stored together with important information related thereto as a history, and then an operation is performed based on the history.

[0378] Here, the flow of the operation performed based on the history after saving the operation / action performed by the user and the time together with important information related thereto as a history will be described. The remote control 960 instructs the copy machine 962 to show Tom's history. The copy machine 962 notifies the server 1041 that manages the history to show Tom's history based on the instruction. The server 1041 refers to the history information and transmits only the history related to Tom as a UI to the copy machine 962, and the copy machine 962 transmits the UI to the remote control 960. Tom selects a specific fact from the history displayed on the remote control 960, and instructs an action. In this case, since the material sent to Company A previously was needed again, select the fact that "File ABC was sent to Company A" from the history, and set "Copy" as the action. By instructing, the user tries to retrieve the material from the copy machine 962 in front of him. Copy machine 962 is used to copy “File ABC” from the user.
Is transmitted to the server 1041. The server 1041 sends the corresponding document “File ABC” to the copy machine 962. The copy machine 962 prints the document received from the server 1041.

In the above description, the user selects the fact that “File ABC was sent to Mr. a of Company A” from the history in order to take out necessary materials from the copy machine 962 in front of him. However, the name of the document to be output "F
If you know "ile ABC", you can display a list of files instead of the history, and select a file name from the list or enter the file name directly.

In the above description, the document to be taken out is assumed to be FAX
Although the document is transmitted in 963 and stored in the server 1041, a document stored in a PC on a network may be used.

FIG. 124 is a diagram showing a configuration example of the remote controller 960 used in the above embodiment.

[0382] Reference numeral 1241 denotes a display portion, which performs display using liquid crystal. Further, the display portion 1241 has a resistive film,
Information can be entered using the 1242. This input may be to select a button on the screen with the pen 1242. Further, a character recognition function is provided, and characters written with the pen 1242 can be input.

The input information can be transmitted from the communication unit 1243 to another device. In addition, a storage unit 1245 is provided inside the apparatus together with a CPU 1244 for control, and stores input information, information received from the communication unit 1243, operation history, and the like. As the storage unit 1245, an SRAM card, a SIMM, an HDD, or the like can be used. It is battery-operated and drip-proof.

FIG. 125 is a diagram showing another configuration example of the remote controller 960 used in the above embodiment.

[0385] Reference numeral 1251 denotes a display unit, which performs display by liquid crystal or CRT. Further, a touch panel can be added to the display portion 1251 as an option. Thus, information can be input using a finger, a pen, or the like. Reference numeral 1252 denotes an input unit for inputting information by operating a button. The input information can be transmitted from the communication unit 1253 to another device. In addition, a storage unit 1255 is provided inside the device together with a CPU 1254 for control, and stores input information, information received from the communication unit 1253, operation history, and the like. As the storage unit 1255, an SRAM card, SIMM, HDD, or the like can be used.

The remote controller shown in FIG. 125 can be used as a button remote controller even when the storage unit 1255 is removed. Even if the communication unit 1253 is removed, it can be used as an electronic notepad (PC). Even if the input unit 1252 is removed, the touch panel can be used as shown in FIG. 124 using the touch panel.

FIG. 126 is a diagram showing another configuration example of the remote controller 960 used in the above embodiment.

[0388] Reference numeral 1261 denotes a display unit, which performs display by liquid crystal. Reference numeral 1262 denotes an input unit for inputting information by operating a button. The input information can be transmitted from the infrared communication unit 1263 to another device. Further, a storage unit 1265 is provided inside the device together with a CPU 1264 for control, and input information and information received from the infrared communication unit 1263,
The operation history and the like are stored. As the storage unit 1255, the SR
An AM card, SIMM, HDD, or the like can be used. Further, a PCMCIA slot 1266 is provided, and for example, a PCMCIA card can be inserted and connection by a PCMCIA bus becomes possible, and two communication paths can be used. Also,
Infrared communication unit 1263 only transmits by light emission, reception is PCMCIA
A bus may be used. Of course, it is not necessary to use the connection by the PCMCIA bus.

The present invention can be applied to a system including a plurality of devices (for example, a computer main body, an interface device, a display, etc.) as long as the functions of the above embodiments can be realized. May be applied to such a device. Further, for the purpose of operating various devices so as to realize the functions of the above-described embodiments, a software program for realizing the functions of the above-described embodiments is stored in an apparatus or a computer in the system connected to the various devices. The present invention also includes a code that is supplied and executed by operating the various devices by a computer (or CPU or MPU) of the system or apparatus according to the supplied program. Also in this case,
The program code itself read from the storage medium will realize the functions of the above-described embodiment, and the program code itself, means for supplying the program code to a computer, for example, a storage medium storing such a program code, This constitutes the present invention.

As a storage medium for supplying such a program code, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-RO
M, CD-R, magnetic tape, nonvolatile memory card,
A ROM or the like can be used.

When the computer executes the readout program code, not only the functions of the above-described embodiment are realized, but also the OS (Operating System) running on the computer based on the instruction of the program code. ) Or when the functions of the above-described embodiments are realized in cooperation with other application software or the like, it goes without saying that such program codes are included in the scope of the present invention.

Further, after the program code read from the storage medium is written into a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, based on the instruction of the program code, It goes without saying that a CPU or the like provided in the function expansion board or the function expansion unit performs a part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

When the present invention is applied to the storage medium,
The storage medium may store the program code corresponding to the flowchart described above.

[0394]

As described above, according to the present invention,
Even if an operator does not perform complicated setting operations, there is an effect that a remote control device capable of remotely controlling each device can be provided, which can easily cope with a plurality of devices. In addition, there is an effect that a distant device that cannot be directly instructed to be operated can be operated via a nearby device.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating a system configuration according to an embodiment.

FIG. 2 is a diagram showing a functional configuration of the embodiment.

FIG. 3 is a diagram illustrating a hardware configuration of each device according to the embodiment.

FIG. 4 is a flowchart illustrating a flow of a process according to the embodiment;

FIG. 5 is a diagram showing a flow of processing for selecting an optimum printer from a plurality of printers and executing printing.

FIG. 6 is a diagram illustrating a case where a remote control is used.

FIG. 7 is a diagram illustrating an example of a case where a document is read from a scanner and transmitted to a specific printer.

FIG. 8 is a diagram illustrating an example of a case where a document is read from a scanner and transmitted to a specific printer that cannot be managed by the scanner.

FIG. 9 is a diagram illustrating an example of a case where a document is read from a scanner and transmitted to a specific printer that cannot be managed by the scanner.

FIG. 10 is a diagram illustrating an example in which a document is read from a scanner and transmitted to a specific printer that cannot be managed by the scanner.

FIG. 11 is a diagram illustrating an example of a case where a status of a printer is notified.

FIG. 12 is a flowchart illustrating a processing procedure according to an eighth embodiment.

FIG. 13 is a diagram showing a case where information to be filed is notified to a user in advance in the filing process.

FIG. 14 is a diagram illustrating a case where the necessity of received data is determined and unnecessary information is discarded.

FIG. 15 is a flowchart illustrating a processing procedure according to the ninth embodiment.

FIG. 16 is a diagram showing a flow of information according to the ninth embodiment.

FIG. 17 is a flowchart showing a detailed procedure of executing a job.

FIG. 18 is a diagram illustrating an example of confidential information to be read.

FIG. 19 is a diagram illustrating an example of a JOB table.

FIG. 20 is a diagram illustrating an example of a print window.

FIG. 21 is a diagram illustrating an example of a JOB table.

FIG. 22 shows the contents of <file A>.

FIG. 23 is a diagram illustrating a system configuration example.

FIG. 24 is a diagram illustrating an example of a question window.

FIG. 25 is a diagram illustrating an example of a JOB table.

FIG. 26 is a diagram showing an example of schedule data.

FIG. 27 is a diagram illustrating an example of an inquiry to a user.

FIG. 28 is a diagram illustrating an example of a JOB table.

FIG. 29 is a diagram illustrating an example of a JOB table.

FIG. 30 is a diagram illustrating an example of a change in the status of the printer.

FIG. 31 is a diagram illustrating a printer status table.

FIG. 32 is a diagram illustrating an example of a JOB table.

FIG. 33 is a diagram illustrating an example of a question window.

FIG. 34 is a diagram illustrating an example of a JOB table.

FIG. 35 is a diagram illustrating an example of a change in the status of the printer.

FIG. 36 is a diagram showing plan and action rules.

FIG. 37 is a diagram showing plan and action rules.

FIG. 38 is a diagram showing an action for a purpose and preconditions.

FIG. 39 is a diagram illustrating an example of properties of each device.

FIG. 40 is a diagram illustrating an example of the status of each device.

FIG. 41 is a diagram illustrating a state in which a plurality of devices are connected to a network.

FIG. 42 is a diagram illustrating a functional configuration for performing processing according to a fourteenth embodiment;

FIG. 43 is a main flowchart showing the flow of a process according to the fourteenth embodiment.

FIG. 44 is a flowchart showing the flow of processing when controlling another device.

FIG. 45 is a flowchart showing the flow of processing when processing is performed by the user's own device.

FIG. 46 is a diagram illustrating an example in which output is performed by a printer different from the designated printer.

FIG. 47: The designated printer sends a job to another printer
FIG. 6 is a diagram showing an example of transferring the.

FIG. 48 is a diagram illustrating an example in which a user's printer transfers a job to a printer at a user's destination.

FIG. 49 is a flowchart showing the flow of processing in the sixteenth embodiment.

FIG. 50 is a conceptual diagram of the processing of the sixteenth embodiment.

FIG. 51 is a diagram showing a job flow in the seventeenth embodiment.

FIG. 52 is a flowchart showing a flow of processing of a print job automatic setting unit.

FIG. 53 is a diagram illustrating a printing time per character and a toner usage amount of a plurality of printers.

FIG. 54 is a diagram showing the contents of a print job and parameters designated by the user.

FIG. 55 is a flowchart showing a flow of processing of a print job automatic changing unit.

FIG. 56 is a diagram showing the contents of a print job and parameters designated by the user.

FIG. 57 is a diagram showing a job flow in the nineteenth embodiment.

FIG. 58 is a diagram illustrating an example in which parameters of a print job are set using a natural language.

FIG. 59 is a diagram for describing an example in which print job parameters are set in the document itself.

FIG. 60 is a diagram showing a job flow according to the twenty-first embodiment.

FIG. 61 is a flowchart of a process performed by a print job simulation unit.

FIG. 62 is a flowchart of a processing procedure of the printer system of the twenty-second embodiment.

FIG. 63 is an external view of a printer of a printer system according to a twenty-second embodiment.

FIG. 64 is a flowchart showing the processing procedure of Embodiment 23.

FIG. 65 is a diagram showing a functional configuration of a system according to Embodiment 23.

FIG. 66 is a diagram illustrating types of input / output between a system that performs overall processing according to the twenty-third embodiment and the outside.

FIG. 67 is a diagram showing an example of extracting a schedule from an email.

FIG. 68 is a flowchart showing a specific processing procedure according to Embodiment 23;

FIG. 69 is a diagram showing an example in which schedules collide.

FIG. 70 is a diagram showing an example of a case where a user makes a question to the system by voice.

FIG. 71 is a flowchart showing a processing procedure of the twenty-fourth embodiment.

FIG. 72 is a diagram illustrating an example of adjusting a conflicting schedule.

FIG. 73 is a flowchart showing a procedure for replanning a conflicting schedule.

FIG. 74 is a flowchart showing the procedure for reply replanning.

FIG. 75 is a diagram illustrating an overall image including inputs and outputs of the system according to the twenty-sixth embodiment;

FIG. 76 is a flowchart showing the flow of processing of the entire system of the twenty-sixth embodiment.

FIG. 77 is a flowchart showing the flow of processing of the input management unit.

FIG. 78 is a flowchart showing a flow of processing of a Core unit.

FIG. 79 is a flowchart showing the flow of the process of the output management unit.

FIG. 80 is a flowchart showing the procedure of a data extraction process.

FIG. 81 is a diagram illustrating an example of a document to be subjected to data extraction processing.

FIG. 82 is a view for explaining a specific block reading process;

FIG. 83 is a flowchart showing a procedure for determining processing with reference to date data.

FIG. 84 is a diagram showing the flow of information in Embodiment 27.

FIG. 85 is a diagram showing the flow of information in Embodiment 28.

FIG. 86 is a diagram showing the information flow in the twenty-eighth embodiment.

FIG. 87 is a flowchart showing a processing procedure in the twenty-eighth embodiment.

FIG. 88 is a diagram showing knowledge in a general knowledge base.

FIG. 89 is a diagram showing the knowledge of the knowledge base of the field specified on the cover page.

FIG. 90 is a diagram illustrating an example of executing a process by referring to a history performed in the past by voice.

FIG. 91 is a flowchart showing the flow of processing in Embodiment 30.

FIG. 92 is a diagram illustrating an example of an input document.

FIG. 93 is a diagram showing the contents of a conversation between the system and a user.

FIG. 94 is an output document created by the system as judged from conversation.

FIG. 95 is a flowchart of an example in which necessary processing is automatically executed after inquiring the user.

FIG. 96 is a diagram showing an embodiment in which the system is operated by a remote controller.

FIG. 97 is a diagram illustrating an example of a status monitor.

FIG. 98: Remote control recognizes target model and corresponding UI
It is a figure showing the example which displays.

FIG. 99: The remote control recognizes the target model and the corresponding UI
7 is a flowchart of a process on the remote controller side in an example of displaying.

FIG. 100: Remote control recognizes target model, and corresponding U
It is a flowchart of the process of the target model side in the example which displays I.

FIG. 101: The remote control receives the UI from the target model,
It is a figure showing the example of a display.

FIG. 102: The remote control receives the UI from the target model,
It is a flowchart of the process of the remote control side in the example displayed.

FIG. 103: The remote control receives the UI from the target model,
It is a flowchart of the process of the target model side in the example displayed.

FIG. 104 is a diagram illustrating an example in which the remote controller does not directly receive the UI from the target model, but receives and displays the UI via a wireless LAN or the like.

FIG. 105 is a flowchart of processing on the remote controller side in an example in which the remote controller receives and displays a UI via a wireless LAN or the like.

FIG. 106 is a flowchart illustrating an example of processing on the target model side in an example in which the remote controller receives and displays a UI via a wireless LAN or the like.

FIG. 107 is a flowchart illustrating an example of server-side processing in an example in which a remote controller receives and displays a UI via a wireless LAN or the like.

FIG. 108 is a diagram illustrating an example in which a remote controller receives and displays a different UI for each user via a wireless LAN or the like.

FIG. 109 is a flowchart of processing on the remote controller side in an example in which the remote controller receives and displays a different UI for each user via a wireless LAN or the like.

FIG. 110 is a flowchart of processing on the target model side in an example in which the remote controller receives and displays a different UI for each user via a wireless LAN or the like.

FIG. 111 is a flowchart of processing on the server side in an example in which the remote controller receives and displays a different UI for each user via a wireless LAN or the like.

FIG. 112 is a diagram illustrating a table indicating UIs determined from target models and user identification information.

FIG. 113 is a diagram illustrating an example of realizing a function that the operation target model in front does not have.

FIG. 114 is a diagram illustrating an example of realizing a function that the operation target model in front does not have.

FIG. 115 is a diagram illustrating an example of a case where direct communication with the operation target model in front of the user is not possible;

FIG. 116 is a flowchart of processing on the remote controller side in the thirty-ninth embodiment.

FIG. 117 is a diagram illustrating an example in which an operation / action performed by a user and time are stored as history together with important information relating to the operation / action.

FIG. 118 is a flowchart of remote controller-side processing according to the fortieth embodiment.

FIG. 119 is a flowchart of processing on the target model side in the fortieth embodiment.

FIG. 120 is a flowchart of processing on the server side according to the fortieth embodiment.

FIG. 121 is a diagram illustrating an example of updated history information.

FIG. 122 is a diagram illustrating an example in which an operation is performed based on a history.

FIG. 123 is a diagram illustrating an example in which an operation is performed based on a history.

FIG. 124 is a diagram illustrating a configuration example of a remote controller.

FIG. 125 is a diagram illustrating a configuration example of a remote controller.

FIG. 126 is a diagram illustrating a configuration example of a remote controller.

FIG. 127 is a diagram illustrating information specifying whether to perform advance notification.

FIG. 128 is a diagram showing the flow of information when there is no device corresponding to the job purpose.

FIG. 129 is a diagram illustrating a display example of a window that proposes an optimal method to a user.

FIG. 130 is a diagram showing the meaning of a character string in parameter setting and required items required to complete the meaning.

Continued on the front page (72) Inventor Kenichi Fujii 3-30-2 Shimomaruko, Ota-ku, Tokyo Canon Inc. (72) Inventor Satomi Takahashi 3-30-2 Shimomaruko, Ota-ku, Tokyo Canon Inc. (72) Inventor Shuichi Sanbe 3-30-2 Shimomaruko, Ota-ku, Tokyo Inside Canon Inc. (72) Inventor Masayuki Takayama 3-30-2 Shimomaruko 3-chome, Ota-ku, Tokyo Inside Canon Inc. (72) Invention Person Aruna Laura 3-30-2 Shimomaruko, Ota-ku, Tokyo Inside Canon Inc.

Claims (38)

[Claims] A receiving unit for receiving information on the operation target device; an activation unit for validating an operation procedure corresponding to the operation target device based on the information received by the reception unit; Transmitting means for transmitting an operation command to the device based on the operation procedure. 2. The remote operation device according to claim 1, wherein the remote operation device transmits a transmission request of information on the device to the operation target device by the transmission unit. 3. The information received by the receiving means is an operation procedure of an operation target device.
The remote control device according to item 1. 4. An apparatus according to claim 1, further comprising a storage unit configured to store an operation procedure in association with the operation target device, wherein information received by the reception unit is identification information of the operation target device, and the validation unit receives the received operation procedure. The remote operation device according to claim 1, wherein the operation procedure stored in correspondence with the identification information of the operation target device is validated. 5. An apparatus according to claim 1, further comprising a storage unit configured to store an operation procedure in association with a type of the operation target device, wherein the information received by the reception unit is a type of the operation target device, and the activation unit receives the information. 2. The method according to claim 1, wherein the operation procedure stored corresponding to the type of the operation target device is validated.
The remote control device according to item 1. 6. The remote operation device according to claim 1, wherein information on the operation target device is received from the operation target device. 7. The remote operation device according to claim 1, wherein information on the operation target device is received from a device other than the operation target device. 8. The receiving means reads and receives shape information of a specific portion of the operation target device, and the activating means determines a device corresponding to the shape information, and operates the determined device. The remote control device according to claim 1, wherein the procedure is validated. 9. The remote control device according to claim 8, wherein the shape information is a shape of the entire operation target device. 10. The remote control device according to claim 8, wherein the shape information is a barcode attached to the operation target device. 11. The remote control device according to claim 1, wherein the receiving unit and the transmitting unit perform two-way communication with the operation target device. 12. The apparatus according to claim 1, wherein said receiving means and said transmitting means can use a plurality of communication paths.
2. The remote control device according to 1. 13. The remote control device according to claim 11, further comprising a selection unit that selects a specific communication path from the plurality of communication paths. 14. The remote control device according to claim 11, further comprising a selection unit that selects a second communication path while selecting a first communication path of the plurality of communication paths. 15. The remote control device according to claim 11, wherein the plurality of communication paths can be used simultaneously. 16. The remote control device according to claim 1, further comprising storage means for storing a history of operations performed based on the operation procedure. 17. The remote operation according to claim 1, wherein the operation command is transmitted to a device other than the operation target device, and the operation command is transmitted to the operation target device via the device. apparatus. 18. The method according to claim 18, wherein the operation command is transmitted to a first operation target device, and the operation instruction is transmitted to a second operation target device via the first operation target device. Item 2. The remote control device according to Item 1. 19. The remote control device according to claim 1, wherein the status of the operation target device is received by the receiving unit, and the operation procedure is changed based on the status. 20. A remote control device comprising: recognition means for recognizing an operation target device of a remote operation device; and transmission means for transmitting information on the recognized device to the remote operation device, wherein the remote operation device transmits Based on the operating procedure based on
A remote control system for transmitting an operation command to the device. 21. The remote operation system according to claim 20, wherein the information on the device is an operation procedure of the device. 22. The apparatus according to claim 20, wherein the information on the device is identification information of the device, and the remote control device uses an operation procedure corresponding to the device stored in the device. Remote control system. 23. The apparatus according to claim 20, wherein the information on the device is a type of the device, and the remote control device uses an operation procedure stored in the device and corresponding to the type of the device. Remote control system. 24. The recognizing means recognizes a position of the remote operation device, and recognizes an operation target device based on the position and positions of a plurality of devices that can be operated by the remote operation device. 21. The remote control system according to claim 20, wherein: 25. The remote control system according to claim 20, wherein said recognition means is provided in each device that can be operated by said remote control device. 26. The remote control system according to claim 20, wherein said recognizing means recognizes an operator of said remote control device, and determines an operation procedure based on said operator. 27. The apparatus according to claim 2, wherein the recognition means recognizes a level of an operator of the remote control device and determines a function to be included in an operation procedure based on the level.
0. The remote control system according to 0. 28. The remote control system according to claim 20, wherein each of the devices that can be operated by the remote control device has a storage unit that stores an operation history of the device. 29. The remote control system according to claim 28, wherein said device operates by referring to an operation history stored in said storage means. 30. The remote control system according to claim 20, further comprising storage means for storing an operation history for each device that can be operated by said remote control device. 31. The remote operation system according to claim 30, wherein the device operates by referring to an operation history of the device stored in the storage unit. 32. An input unit for inputting an instruction, a processing unit for performing processing based on a processing instruction input from the input unit, a communication unit for communicating with another device, and A remote control device comprising: a communication control unit that controls an input of an operation instruction for another device to be transmitted to a target device of the operation instruction by the communication unit. 33. Validation means for validating an operation procedure corresponding to a target device of the operation instruction, and the input means for inputting an operation instruction to the target device based on the activated operation procedure. 33. The remote control device according to claim 32, further comprising: input control means for controlling the operation of the remote controller. 34. The apparatus according to claim 33, further comprising storage means for storing an operation procedure of another device, wherein said validation means validates the operation procedure stored in said storage means. Remote control device. 35. The remote control device according to claim 33, wherein an operation procedure of another device is received by the communication unit, and the validation unit validates the received operation procedure. 36. The remote control device according to claim 35, wherein the communication unit receives an operation procedure of the target device of the operation instruction from the target device. 37. The remote operation apparatus according to claim 32, wherein the communication unit receives a processing result of the target device based on the operation instruction, and the received processing result is processed by the processing unit. . 38. The remote control device according to claim 32, wherein a processing result by said processing means is transmitted by said communication means as a processing target of a target device based on said operation instruction.