JP2014239275A - Information processing system and information processing apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing system which can be used by an intuitive operation by a user.SOLUTION: An information processing apparatus 100 detects the presence of an information terminal device at a site (a document tray 171, a sheet ejection tray 172, or the like) where executable functions are expressed physically. When the presence of an information terminal 400 or a physical icon 500 is detected, status information is acquired from the information terminal 400 or the physical icon 500. Simultaneously, a function to be executed in association with the information terminal 400 or the physical icon 500 is determined by the combination of the acquired status information and a function expressed by the site.

Description

  The present invention relates to an information processing system and an information processing apparatus that provide an intuitive operation environment to a user.

  When a user uses an information processing system, for example, for copying a document or transmitting a FAX document, the user understands the functions that can be executed in the information processing system and performs different operations (operation procedures) for each function. There is a problem that you need to remember.

  For such a problem, the data processing device disclosed in Patent Document 1 is configured such that a plurality of communication units are provided in the data processing device, and a user can assign various functions to the communication unit. . In this data processing device, when a user places an information terminal in one of the communication units, the communication unit receives the content in the information terminal and executes a function to which the information processing device is assigned to the received content. .

JP 2011-014971 A

  The operation of the user will be examined by taking as an example the case where the data processing device disclosed in Patent Document 1 is applied to a printing device. When the user places the information terminal in one communication unit, the content stored in the information terminal is printed. Further, when the user places the information terminal in another communication unit, the content stored in the information terminal is faxed. This means that the user recognizes in advance that printing will be executed if an information terminal is placed in a certain communication unit, and FAX transmission will be executed if an information terminal is placed in another communication unit. That is, the user understands the function executed by the data processing apparatus for each communication unit and remembers the operation for each function. Therefore, the problem remains that the user cannot use the data processing apparatus with an intuitive operation.

  The user can further store content stored in a device other than the information terminal in the information terminal via the data processing device, and exchange content stored between each of the plurality of information terminals. You may need a collaborative function.

  The main object of the present invention is to provide an information processing system and an information processing apparatus that can be used by a user's intuitive operation.

  The information processing system of the present invention is an information processing system including an information terminal device and an information processing device, and the information terminal device notifies the information processing device of status information indicating a state of information processing in the device itself. A notification means, wherein the information processing device detects a presence of the information terminal device in a part where an executable function is physically expressed; and the presence of the information terminal device is detected. Function determining means for acquiring the status information from the information terminal device and determining a function to be executed in cooperation with the information terminal device by a combination of the acquired status information and the function represented by the part It is characterized by having.

In the information processing system of the present invention, the presence of the information terminal device is detected at a part where the functions executable by the information processing device are physically represented.
When the presence of the information terminal device is detected, status information is acquired from the information terminal device, and a function to be executed in cooperation with the information terminal device is obtained by a combination of the acquired status information and the function represented by the part. decide.
Thereby, the user can reduce the burden of having to learn complicated operations for executing each function after understanding the functions executed by the information processing system. That is, the information processing system can be operated by an intuitive operation based on user recognition. Moreover, the content memorize | stored in apparatuses other than an information terminal can be transmitted to an information terminal by a user's intuitive operation, or a content can be exchanged between several information terminals.

(A), (b) is a figure for demonstrating the concept of the information processing system in this embodiment. The block diagram which showed the hardware structural example of information processing apparatus. The figure which shows the software structural example of an information processing apparatus control program. The block diagram which showed the hardware structural example of the information terminal. The block diagram which showed the hardware structural example of the physical icon. (A), (b), (c) is a figure for demonstrating operation | movement of an information processing apparatus when an information terminal is mounted in the original document tray of an information processing apparatus. (A), (b) is a figure for demonstrating operation | movement of an information processing apparatus when a document is set in the document tray of an information processing apparatus, and a physical icon is mounted in the discharge tray of an information processing apparatus. . (A), (b), and (c) of the information processing apparatus when the information terminal is placed on the document tray of the information processing apparatus and another information terminal is placed on the discharge tray of the information processing apparatus. The figure for demonstrating operation | movement. The flowchart which showed the example of the basic process sequence of the whole information processing system. The flowchart which showed the example of the process sequence in case a marker is used for specification of the mounting part of an information terminal. The flowchart which showed the example of the process sequence in case a short distance communication antenna is used for the specification of the mounting site | part of an information terminal. The flowchart which showed the example of the process sequence in case a short-range communication antenna is used for specification of the mounting site | part of a physical icon. The flowchart which showed the process sequence of the function mode change process concretely. The example of a screen showing the determined function. (A) is an example when the function mode is “print”. (B) is an example when the function mode is BOX storage. (C) is an example when the function mode is document copy. 6 is a flowchart showing an example of a processing procedure of execution processing when the function mode is printing of document information recorded in an information terminal. The flowchart which showed the example of the process sequence of the execution process in case a function mode is BOX storage of the document information recorded on the information terminal. The flowchart which showed the example of the process sequence of the execution process in case a function mode is a copy of the document information file between information terminals. The flowchart which showed the process sequence of timeout control concretely. The flowchart which showed the basic process sequence of the whole information processing system about the operation | movement for not applying the determined function mode. The flowchart which showed the process sequence of the function execution process outside a function mode concretely.

  Hereinafter, exemplary embodiments will be described with reference to the drawings.

[First Embodiment]
FIG. 1 is a conceptual diagram illustrating an example of the information processing system according to the present embodiment. An information processing system 10 illustrated in FIG. 1A includes an information processing apparatus 100, an information terminal 400, and a physical icon 500. The information processing apparatus 100 is a multi-function printer (MFP) having various functions such as a printer function, a scanner function, a copy (copying) function, and a FAX transmission / reception function. The information terminal 400 is an information terminal device such as a tablet PC or a smartphone. The physical icon 500 is a kind of information terminal device, and is physically shaped so that a user can recognize a certain function provided in the information processing apparatus 100, for example. Details of the physical icon 500 will be described later.

  The information processing apparatus 100 includes a scanner document tray 171 on which an information input part from which a document is read, for example, a document to be read is set. The information processing apparatus 100 also has an information output part, for example, a paper discharge tray 172 of a printer, on which paper copied after printing is discharged. In this manner, the document tray 171 and the paper discharge tray 172 can be said to be parts where functions that can be executed by the information processing apparatus 100 are physically expressed. The information processing apparatus 100 also includes a part not related to input / output of information, for example, a top plate 173 of the casing of the information processing apparatus 100. Each of these parts is provided with a short-range communication antenna 154. The short-range communication antenna 154 is used exclusively for mutual communication with each device included in the information processing system 10.

  FIG. 1B illustrates an example in which a marker 160 (for example, a two-dimensional barcode) is formed instead of the short-range communication antenna 154 provided in the information processing apparatus 100. Details of the marker 160 will be described later. Note that the marker 160 can be formed together with the short-range communication antenna 154.

  An information terminal 400 shown in FIG. 1A includes a camera 454 and a short-range communication antenna 453 which will be described later. In this description, the camera 454 is used exclusively for imaging the marker 160. Further, the short-range communication antenna 453 is used exclusively for communication between devices included in the information processing system 10.

A physical icon 500 shown in FIG. 1A is physically shaped so that the user can recognize the contents of the processing executed by the information processing apparatus 100. For example, the MFP has a function (document storage function) called “BOX” for storing document information in a recording device provided in the MFP. As shown in FIG. 1 (a), the physical icon 500 representing the function has a box with "BOX" drawn on the surface of the box.
Hereinafter, when either the information terminal 400 or the physical icon 500 is indicated, it is indicated as “information terminal device”. Further, the information processing system 10 may be configured to include only one of the information terminal 400 or the physical icon 500 or may include a plurality of information terminals 400 and physical icons 500 depending on the purpose of use of the user. can do.

FIG. 2 is a block diagram illustrating a hardware configuration example of the information processing apparatus 100.
The information processing apparatus 100 includes a CPU 101, a graphic controller 102, a memory controller 103, a main memory 104, an I / O controller 105, an engine controller 106, and a flash memory 107. The information processing apparatus 100 includes an HDD (hard disk drive) 108, an internal bus 109, and a scanner controller 110. The information processing apparatus 100 includes a display / touch panel 151, a telephone line port 152, a LAN port 153, a short-range communication antenna 154, a printer engine 155, a scanner 156, a microphone 157, and a speaker 158.

The CPU 101 comprehensively controls each component of the information processing apparatus 100. The graphic controller 102 controls display on the display / touch panel 151 in accordance with an instruction from the CPU 101. The memory controller 103 controls memory access to the main memory 104 according to instructions from the CPU 101. The main memory 104 is a volatile memory and can be accessed at high speed. Therefore, information stored in the flash memory 107 and the HDD 108, information used temporarily, and the like are stored.
The I / O controller 105 mediates mutual transmission of information from the display / touch panel 151, the telephone line port 152, the LAN port 153, the short-range communication antenna 154, the microphone 157, the speaker 158, and the like. The I / O controller 105 also mediates mutual transmission of information from each component connected via the flash memory 107, the HDD 108, and the internal bus 109.

  The engine controller 106 controls the printer engine 155 according to instructions from the CPU 101. The scanner controller 110 controls the scanner 156 according to an instruction from the CPU 101. The flash memory 107 stores information temporarily or permanently. The flash memory 107 stores a boot loader program described later. The HDD 108 stores an information processing apparatus control program for the CPU 101 to control the information processing apparatus 100 in an integrated manner. The internal bus 109 transmits an electrical signal so that information can be transmitted among the memory controller 103, the I / O controller 105, the engine controller 106, and the scanner controller 110.

  The display and touch panel 151 is a combination of a display for displaying various types of information to the user and a touch panel that receives instructions from the user. The information processing apparatus 100 displays information for prompting the user's operation input on the display and touch panel 151 according to the situation. Upon receiving this, the user touches the display / touch panel 151 to input necessary instructions.

  The information processing apparatus 100 also includes means for receiving an instruction from the user in addition to the touch operation. Specifically, the information processing apparatus 100 prompts an instruction from the user by outputting sound from the speaker 158 according to the situation. The microphone 157 detects the voice when the user responds to the voice output from the speaker 158 as a voice signal. The voice signal detected by the microphone 157 is accepted as a user instruction by the CPU 101 performing voice recognition processing and instruction extraction processing.

  The telephone line port 152 mediates exchange of information with an external device connected via the telephone line 201. The LAN port 153 mediates transmission / reception of information with an external device connected via the network 202. The short-range communication antenna 154 is provided at a predetermined part of the information processing apparatus 100 and is used exclusively for communication between devices included in the information processing system 10. The printer engine 155 is a device having a printing function, and reproduces image information obtained by the scanner 156 reading a document on paper. The scanner 156 is a device having a function of optically reading a document or a photograph.

  The CPU 101 reads a boot loader program and executes it when the information processing apparatus 100 is powered on. Thereby, necessary initial processing is performed. In the initial processing, for example, an information processing apparatus control program stored in the HDD 108 is read, and the read program is stored in the main memory 104. Various functions of the information processing apparatus 100 are realized by the CPU 101 executing the information processing apparatus control program stored in the main memory 104. Hereinafter, an example of various functions executed by the information processing apparatus 100 will be described.

The CPU 101 instructs the printer engine 155 to reproduce the image information obtained by the scanner 156 reading the document on paper. In this way, the printing function of the information processing apparatus 100 is realized. The CPU 101 instructs the scanner 156 to optically read a document or a photograph. In this way, the imaging function of the information processing apparatus 100 is realized.
In addition, for example, imaging information from a camera that is an external device is received, the CPU 101 performs necessary processing on the received imaging information, and the printer engine 155 prints the processed imaging information on paper. In this way, the copy function of the information processing apparatus 100 is realized. Also, the processed imaging information is transferred to an external device via the LAN port 153 or the network 202. In this way, the SEND (transmission) function of the information processing apparatus 100 is realized. Further, the received imaging information is recorded in the HDD 108. In this way, the BOX storage function of the information processing apparatus 100 is realized.

In addition, document information recorded in an external device is received via the network 202 or the LAN port 153, and the CPU 101 performs document interpretation processing and image processing on the received document information. The processed document information is printed on paper by the printer engine 155 in accordance with an instruction from the CPU 101. In this way, a PDL (page description language) printing function is realized. Further, the processed document information is recorded in the HDD 108. In this way, the BOX storage function of the PDL document is realized. Further, the document information recorded in the external device is received via the telephone line 201, and the CPU 101 performs document interpretation processing and image processing on the received document information. The processed document information is printed on paper by the printer engine 155 in accordance with an instruction from the CPU 101. In this way, a FAX reception function and a printing function are realized.
As shown in these examples, various functions of the information processing apparatus 100 operate in various combinations such as printing a scanned document, storing a BOX, sending a SEND, and printing a document received from an external device. Can be made.

FIG. 3 is a diagram illustrating a software configuration example of the information processing apparatus control program. The information processing apparatus control program is read and executed by the CPU 101 as necessary.
The job controller 305 manages processing states (execution states) of various functions of the information processing apparatus 100. Specifically, when an execution request for a specific function is made to the information processing apparatus 100, the management from the start of execution of the function to the end of execution is managed.
The FAX communication processing unit 301 transmits information received via the telephone line 201 (for example, document information, image information, etc., the same applies hereinafter) to the job controller 305 together with a signal indicating a FAX function execution request. The FAX communication processing unit 301 also transmits information generated under the management of the job controller 305 to an external device via the telephone line 201.
The network communication processing unit 302 transmits information received via the network 202 to the job controller 305 together with a signal indicating a PDL function execution request. The network communication processing unit 302 also transmits information generated under the management of the job controller 305 to an external device via the network 202.

  The short-range communication processing unit 303 transmits the information received via the short-range communication antenna 154 to the job controller 305 together with a signal indicating a PDL function execution request. The short-range communication processing unit 303 also transmits information generated under the management of the job controller 305 to the information terminal device via the short-range communication antenna 154.

The UI processing unit 304 displays various contents on the display and touch panel 151 under the instruction of the job controller 305. The UI processing unit 304 also converts the content displayed on the display / touch panel 151 into an audio signal under the instruction of the job controller 305, and reproduces the converted audio signal from the speaker 158. Further, the UI processing unit 304 performs a process of interpreting the instruction content in response to an operation instruction from the user received by the display and touch panel 151. Thereafter, a function to be executed is specified from the interpretation result, and a signal representing the execution request is transmitted to the job controller 305.
The UI processing unit 304 performs speech recognition processing for interpreting the utterance content of the utterance from the user received by the microphone 157. Thereafter, a function to be executed is specified from the voice recognition result, and a signal representing the execution request is transmitted to the job controller 305.

When the FAX job processing unit 306 receives a print execution request and document information from the job controller 305, the FAX job processing unit 306 executes document information analysis processing and image processing and post-processing document information printing processing. When the FAX job processing unit 306 receives an execution request for FAX transmission of a scanned document from the job controller 305, the FAX job processing unit 306 executes document scanning processing and image processing to generate information, and the generated information is stored in the job controller 305. Send to.
When a PDL document print execution request and document information are received from the job controller 305, the PDL job processing unit 307 executes document information analysis processing, image processing, and post-processing document information printing processing. When the PDL job processing unit 307 receives a request to execute BOX storage processing of a PDL document and document information from the job controller 305, the PDL job processing unit 307 executes document information analysis processing and image processing to generate information. The generated information is transmitted to the job controller 305.

When the BOX job processing unit 308 receives a BOX storage execution request and image information of a PDL document from the job controller 305, the BOX job processing unit 308 stores the image information in the HDD 108. When the BOX job processing unit 308 receives an execution request to store a scanned document from the job controller 305, the BOX job processing unit 308 executes document scanning processing and image processing to generate information, and stores the generated information in the HDD 108. To do.
When the SEND job processing unit 309 receives a network transmission execution request for transmitting a scanned document from the job controller 305 to another device, the SEND job processing unit 309 executes document scanning processing and image processing to generate information. The generated information is transmitted to the job controller 305.
When receiving a print execution request for a scanned document from the job controller 305, the COPY job processing unit 310 executes document scan processing and image processing to generate information, and executes print processing for the generated information.

The function mode change processing unit 311 acquires information (information) indicating the status of the information terminal device via the network communication processing unit 302 or the short-range communication processing unit 303.
The information includes, for example, a signal (identification signal) for uniquely identifying the information terminal 400, the physical icon 500, and the like, and whether these are executing some processing or are waiting It is information including. For example, it can be known from the information that the document is displayed on the screen of the information terminal 400. Thereby, the cooperation between the apparatuses of the information processing system 10 can be smoothly performed and a smooth process can be performed.
The function mode change processing unit 311 also determines a function mode to be executed by the information processing apparatus 100 based on the combination of the acquired information and the part information of the part where the information terminal device is placed. The function mode is a function operated (executed) as the information processing system 10, for example, a document printing function, a file copying function, a FAX document transmission function, or the like. The part information is, for example, information obtained by combining (associating) a function realized by the information processing system 10 with an information input part, an information output part, and a part not related to information input / output of the information processing apparatus 100. . The part information is recorded as a table in, for example, the HDD 108 included in the information processing apparatus 100 in advance. This table is referred to when determining the function mode.

FIG. 4 is a block diagram illustrating a hardware configuration example of the information terminal 400.
The information terminal 400 includes a CPU 401, a graphic controller 402, a memory controller 403, a main memory 404, an I / O controller 405, and a flash memory 406. The information terminal 400 further includes a display / touch panel 451, a LAN port 452, a short-range communication antenna 453, and a camera 454.

  The CPU 401 comprehensively controls each component of the information terminal 400. The graphic controller 402 controls display on the display / touch panel 451 in accordance with an instruction from the CPU 401. The memory controller 403 controls memory access to the main memory 404 according to instructions from the CPU 401. The main memory 404 is a volatile memory and can be accessed at high speed. For this reason, information stored in the flash memory 406 and information used temporarily are stored.

The I / O controller 405 mediates mutual transmission of information from the flash memory 406, the LAN port 452, the short-range communication antenna 453, and the display / touch panel 451. The I / O controller 405 also mediates mutual transmission of information from each component connected via the internal bus 109. The flash memory 406 stores a boot loader program and an information terminal control program.
The internal bus 407 transmits an electrical signal so that information can be transmitted between the memory controller 403 and the I / O controller 405. The LAN port 452 mediates exchange of information with an external device connected via the network 202. The short-range communication antenna 453 is exclusively used for communication between devices included in the information processing system 10.

The display and touch panel 451 is a combination of a display for displaying various types of information for the user and a touch panel for receiving instructions from the user. The information terminal 400 displays information for prompting the user's operation input on the display and touch panel 451 according to the situation. Upon receiving this, the user touches the display / touch panel 451 to input necessary instructions.
The camera 454 is exclusively used for imaging the marker 160. When the marker 160 is imaged, the CPU 401 analyzes the content that the marker 160 means. Thereby, the information represented by the marker 160 is extracted.

  The CPU 401 reads a boot loader program and executes it when the information terminal 400 is powered on. Thereby, necessary initial processing is performed. In the initial process, for example, an information terminal control program stored in the flash memory 406 is read, and the program stores the main memory 404. Thereafter, the CPU 401 executes the information terminal control program stored in the main memory 404, whereby various functions of the information terminal 400 are realized. The functions of the information terminal 400 include, for example, a function of displaying a document on the display / touch panel 451 and transmitting recorded document information to another device.

FIG. 5 is a block diagram illustrating a hardware configuration example of the physical icon 500. The physical icon 500 includes an RFID 551 and an LED 552. The RFID 551 is powered by contactless power transmission via a short-range communication antenna at a sufficiently close distance outside the physical icon 500. The RFID 551 exchanges information with a device that has come close to a communicable distance. The LED 552 is a light source and emits light when power is supplied from the RFID 551. The physical icon 500 includes a CPU, a recording device, and a short-range communication antenna (not shown). The CPU comprehensively controls each component included in the physical icon 500 and stores, for example, received document information in the recording device. The short-range communication antenna provided in the physical icon 500 is used exclusively for communication between devices included in the information processing system 10. Note that the RFID 551 can be configured to function as a short-range communication antenna. Here, it is assumed that a short-range communication antenna is used.
Hereinafter, a specific processing flow of the information processing system according to the present embodiment will be described in detail.

Information processing system capable of realizing mutual transmission of content recorded on information terminal 400 and content recorded on other physical media performed through information processing apparatus 100 by a user's intuitive operation 10 will be described. In the description, FIG. 6 to FIG. 18 will be used.
6, 7, and 8 are diagrams schematically illustrating the basic operation of the information processing system 10. FIGS. 9 to 13 and FIGS. 15 to 18 are flowcharts showing an example of a processing flow of the entire system of the information processing system 10, and an example of processing procedures of the information terminal 400 and the physical icon 500. FIG. 14 is a diagram illustrating a display example of the display and touch panel 151 provided in the information processing apparatus 100.

  FIG. 6 is a diagram for explaining the operation of the information processing system 10 when the information terminal 400 is placed on the scanner 156 (document tray 171). The user knows that it is possible to input (read) the document content to the information processing apparatus 100 by using the scanner 156. That is, it can be said that the user is recognized that “information (content) can be input by using a scanner”. Therefore, the user intuitively associates that if the information terminal 400 is placed on the document tray 171, the content recorded on the information terminal 400 can be input to the information processing apparatus 100.

As shown in FIG. 6A, the user operates the information terminal 400 to display content desired to be input to the information processing apparatus 100, for example, the document T, on the display / touch panel 451 of the information terminal 400. Then, as shown in FIG. 6B, the information terminal 400 in a state where the document T is displayed is placed on the document tray 171. At this time, for example, an image (not shown) schematically representing a scanner is displayed as information indicating the placed part on the background of the document T displayed on the information terminal 400. Accordingly, the user can understand that the information processing system 10 correctly recognizes that the information terminal 400 is placed on the document tray 171. The images displayed in the background are different images for each part of the information processing apparatus 100, and these are recorded in advance in the flash memory 406, for example.
The user touches an execution button (not shown) displayed on the display and touch panel 151 after the function mode is determined. Here, since the function mode is determined as the printing function, the printing process of the document T is executed. Specifically, the information processing apparatus 100 receives the document information of the document T from the information terminal 400 via the short-range communication antenna 154 of the information input part. Then, the document T is reproduced on paper from the received document information, and the printed paper P is discharged from the paper discharge tray as shown in FIG.

  FIG. 7 is a diagram for explaining the operation of the information processing system 10 when the original G is set on the original tray 171 and the physical icon 500 of the BOX function is placed on the paper discharge tray 172. The user knows in common sense that if the original is copied, the paper on which the original content is printed is discharged from the paper discharge tray 172. That is, it can be said that the user is recognized that “the output is output to the paper discharge tray”. Therefore, the user intuitively associates that the product can be output to the physical icon 500 if the physical icon 500 is placed on the paper discharge tray 172.

As shown in FIGS. 7A and 7B, the user sets the original G on the original tray 171 and places the physical icon 500 on the discharge tray 172. When the physical icon 500 is placed on the paper discharge tray 172, an LED 552 (not shown) blinks. As a result, the user can understand that the information processing system 10 normally recognizes that the physical icon 500 is placed on the paper discharge tray 172.
The user touches an execution button (not shown) displayed on the display and touch panel 151 after the function mode is determined. Here, since the function mode is determined to be the BOX function, the document G is scanned, and the BOX storing process for storing the information obtained thereby in the physical icon 500 is executed.

  Here, the BOX function of the physical icon 500 can select the storage destination of various data from 0 to 99. However, when it is placed on the paper discharge tray 172, the storage destination has not yet been determined. Therefore, the BOX function cannot be executed in this state. Therefore, the information processing apparatus 100 announces to the user “What number should I enter?” From the speaker 158 and prompts the user to input the BOX storage number. On the other hand, when the user replies with a voice such as “put in No. 3”, for example, the voice signal received by the microphone 157 is subjected to voice recognition processing to determine the storage destination as the third BOX. Thereafter, the information processing apparatus 100 transmits information obtained by scanning the document G to the physical icon 500 via the short-range communication antenna 154 of the information output part. The physical icon 500 stores the received information in the third BOX. The physical icon 500 lights the LED 552 after the storing process is completed. Thereby, the user can recognize that the storing process to the physical icon 500 has been normally completed.

  FIG. 8 illustrates the operation of the information processing system 10 when the information terminal 400 is placed on the document tray 171 and another information terminal 410 is placed on the discharge tray 172 with the document T displayed. FIG. Here, a description will be given by taking a file copy via the information processing apparatus 100 from the information terminal 400 to the information terminal 410 as an example. The information terminal 410 is a device having a function equivalent to that of the information terminal 400.

As shown in FIG. 8A, the user operates the information terminal 400 to display information to be file copied, in this case, the document T in the display and touch panel 451. Then, as shown in FIG. 8B, the information terminal 400 in a state where the document T is displayed is placed on the document tray 171. Further, as shown in FIGS. 8A and 8B, the information terminal 410 serving as a copy destination is placed on the paper discharge tray 172. At this time, for example, an image (not shown) schematically representing a scanner is displayed as information indicating the placed part on the background of the document T displayed on the information terminal 400. Further, on the display / touch panel 461 of the information terminal 410, for example, an image H schematically representing a paper discharge tray is displayed as information indicating the placed part. Accordingly, the user can understand that the information processing system 10 correctly recognizes that the information terminal is placed on each of the document tray 171 and the paper discharge tray 172.
The user touches an execution button (not shown) displayed on the display and touch panel 151 of the information processing apparatus 100 after the function mode is determined. Here, since the function mode is determined to be the file copy function, a file copy process is executed. Specifically, the information processing apparatus 100 receives the document information of the document T from the information terminal 400 via the short-range communication antenna 154 of the information input part. The information processing apparatus 100 transmits the received document information to the information terminal 410 via the short-range communication antenna 154 of the information output part. The information terminal 410 that has received the document information displays the document T on the display / touch panel 461 as shown in FIG. As a result, the user can recognize that the file copy has been successfully completed.

FIG. 9 is a flowchart illustrating an example of a basic processing procedure of the entire information processing system 10. The information processing system 10 processes three processes in parallel as shown in FIG.
The first process is a process starting from S901. The process of S901 is a process for detecting the presence of the information terminal 400 or the physical icon 500 and specifying the part (placement part) of the information processing apparatus 100 on which these are placed. The process of S902 is a process for changing the function mode, that is, a process for determining a function to be executed by the information processing apparatus 100 in cooperation with the information terminal 400 or the physical icon 500.
The second process is the process of S905. The process of S905 is a timeout control process. Details will be described later.
The third process is a process starting from S903. The process of S903 is a process of accepting an operation instruction from the user, for example, an input to the display / touch panel 151. The process of S904 is a function execution process for executing a process according to the function mode.
The information processing system 10 repeats these three processes from the start to the end of activation. Hereinafter, details of each of these processes will be specifically described.

FIGS. 10 and 11 are flowcharts specifically showing the processing procedure for specifying the placement site of the information terminal 400 in the processing of S901. In specifying the placement site in this case, processing is different between the case where the marker 160 is used (FIG. 10) and the case where the short-range communication antenna 154 is used (FIG. 11). FIG. 12 is a flowchart specifically showing the processing procedure for specifying the placement site when the physical icon 500 is placed. Each will be described.
FIG. 10 is a diagram illustrating an example of a processing flow when the marker 160 is used. Each process of S1001 to S1008 shown in FIG. Further, the information processing apparatus 100 executes each process from S1009 to S1011. In addition, it is assumed that each device included in the information processing system 10 has completed necessary initial processing such as power ON (on).

  The information terminal 400 detects that the camera 454 has been activated by the user and an imaging operation has been performed (S1001). The information terminal 400 determines whether or not the imaging result is in a completely dark state for a predetermined time (for example, 3 seconds) or more starting from the imaging timing (S1002). For example, in a state where the information terminal 400 is placed on the information processing apparatus 100, light does not enter the camera 454, and the imaging result becomes dark. That is, if the imaging result is in a completely dark state for 3 seconds or more, it can be determined that the information terminal 400 is already placed on the information processing apparatus 100.

If the information terminal 400 has not been in a completely dark state for a predetermined time or longer (S1002: no), it is considered that the information terminal 400 is not yet placed on the information processing apparatus 100, and the marker 160 is imaged by an imaging operation. It is determined whether or not it has been done (S1007).
When the marker 160 has been imaged (S1007: yes), the information terminal 400 extracts the IP address information and part information of the information processing apparatus 100 from the imaged marker 160 (S1008). The extracted information is recorded in the flash memory 406. If the marker 160 has not been imaged (S1007: no), the process returns to S1001.

The information terminal 400 acquires the IP address information and the part information of the information processing apparatus 100 extracted from the marker 160 most recently (S1003) when the imaging result remains in a completely dark state for 3 seconds or more (S1002: yes). .
Thereafter, a network communication session by wireless LAN is established by executing the processing of S1004 by the information terminal 400 and executing the processing of S1009 by the information processing apparatus 100 (S1004, S1009). As a result, information communication is enabled between the information terminal 400 and the information processing apparatus 100. The information terminal 400 transmits an identification signal to the information processing apparatus 100 when the session is established.
The information terminal 400 transmits the extracted part information to the information processing apparatus 100 (S1005). The information processing apparatus 100 receives the part information transmitted from the information terminal 400 (S1010).
The information terminal 400 displays on the display / touch panel 451 an image that directly represents the part from the part information, for example, an image representing the document tray 171 (S1006). Further, the information processing apparatus 100 records the received part information in association with the information terminal 400, for example, in the HDD 108 (S1011). This association is performed based on the identification information of the information terminal 400.
The information processing system 10 ends the processing of S901 when a series of processing ends.

  FIG. 11 is a diagram illustrating an example of a processing flow when the short-range communication antenna 154 is used to specify the placement site of the information terminal 400. FIG. 12 is an example of a processing flow when the short-range communication antenna 154 is used for specifying the placement site of the physical icon 500. In some cases, both the information terminal 400 and the physical icon 500 are placed. Therefore, whether each information terminal device is the information terminal 400 or the physical icon 500 is determined in each processing flow.

First, identification of the placement site in the case of the information terminal 400 will be described with reference to FIG.
Each process from S1101 to S1102 illustrated in FIG. 11 is executed by the information terminal 400. In addition, each processing from S1103 to S1109 is executed by the information processing apparatus 100.
A short-distance communication session is established by executing the process of S1101 by the information terminal 400 and executing the process of S1103 by the information processing apparatus 100 (S1101, S1103). As a result, information communication is enabled between the information terminal 400 and the information processing apparatus 100. The information terminal 400 transmits an identification signal to the information processing apparatus 100 when the session is established.

  The information processing apparatus 100 specifies the type of the information terminal device (the information terminal 400 or the physical icon 500) from the content of the received identification signal (S1104). Here, the information terminal 400 is specified. The information processing apparatus 100 specifies the placement part of the information terminal 400 by specifying the short-range communication antenna 154 used for communication with the information terminal 400, and derives part information of the specified part (S1105). ). The information processing apparatus 100 determines whether the placed information terminal apparatus is the information terminal 400 or the physical icon 500 (S1106). Here, since the information terminal 400 is placed, the process proceeds to S1107. If a physical icon is placed, the process proceeds to S1209 described later.

  If the information terminal device is the information terminal 400, the information processing device 100 transmits the part information to the information terminal 400 (S1107). The information terminal 400 displays on the display and touch panel 451 an image that briefly represents this part, upon receipt of the part information (S1102). The information processing apparatus 100 stores the part information in association with the information terminal 400, for example, in the HDD 108 (S1108). The information processing system 10 ends the processing of S901 when a series of processing ends.

Next, identification of the placement site in the case of the physical icon 500 will be described with reference to FIG.
Each process of S1201 to S1202 shown in FIG. Further, the information processing apparatus 100 executes each process from S1203 to S1209.
A short-distance communication session is established by executing the processing of S1201 by the physical icon 500 and executing the processing of S1203 by the information processing apparatus 100 (S1201, S1203). As a result, information communication is possible between the physical icon 500 and the information processing apparatus 100. The physical icon 500 transmits an identification signal to the information processing apparatus 100 when a session is established.

  The information processing apparatus 100 identifies the type of the information terminal device (the information terminal 400 or the physical icon 500) from the content of the received identification signal (S1204). Here, the physical icon 500 is specified. The information processing apparatus 100 specifies the part on which the physical icon 500 is placed by specifying the short-range communication antenna 154 used for communication with the physical icon 500, and part information on the specified part Is derived (S1205). The information processing apparatus 100 determines whether the placed information terminal device is the information terminal 400 or the physical icon 500 (S1206). Here, since the physical icon 500 is placed, the process proceeds to S1209. The information processing apparatus 100 notifies the physical icon 500 of an instruction to start blinking the LED 552 (S1209). When the information terminal 400 is placed, the process proceeds to the above-described processing of S1209 (FIG. 11).

The physical icon 500 causes the LED 552 to blink in response to reception of an instruction to start blinking the LED 552 (S1202). The information processing apparatus 100 stores the part information in association with the physical icon 500, for example, in the HDD 108 (S1208). The information processing system 10 ends the processing of S901 when a series of processing ends.
Hereinafter, the description will be given by taking as an example the case where the short-range communication antenna 154 is used for specifying the part.

FIG. 13 is a flowchart specifically showing the processing procedure of the function mode change processing (FIG. 9: S902).
Each process of S1301, S1302, and S1303 shown in FIG. 13 is executed by the information terminal 400 or the physical icon 500 placed in any part. Further, the information processing apparatus 100 executes each process from S1304 to S1314.
The information processing apparatus 100 determines whether the information terminal 400 or the physical icon 500 is placed on the information input site (S1304). When the information processing apparatus 100 determines that the information terminal 400 or the physical icon 500 is placed (S1304: yes), the information processing apparatus 100 derives the part information of the information input part (for example, the document tray 171) on which the information terminal 400 or the physical icon 500 is placed. (S1305). If it is determined that the information terminal 400 or the physical icon 500 is not yet placed (S1304: no), the process proceeds to S1307.
The information terminal 400 or the physical icon 500 placed on the information input part transmits information to the information processing apparatus 100 (S1301). Further, the information processing apparatus 100 receives information transmitted from the information terminal 400 or the physical icon 500 (S1306). The information processing apparatus 100 can determine from the information that, for example, the document T is displayed on the screen of the information terminal 400 (FIG. 6). The transmission of information is started when a communication session is established, for example.

The information processing apparatus 100 determines whether or not the information terminal 400 or the physical icon 500 is placed on the information output part (S1307). When the information processing apparatus 100 determines that the information terminal 400 or the physical icon 500 is placed (S1307: yes), the part information of the information output part (for example, the paper discharge tray 172) on which these are placed is derived. (S1308). If it is determined that the information terminal 400 or the physical icon 500 is not yet placed (S1307: no), the process proceeds to S1310.
The information terminal 400 or the physical icon 500 placed on the information output part transmits information to the information processing apparatus 100 (S1302). Further, the information processing apparatus 100 receives information transmitted from the information terminal 400 or the physical icon 500 (S1309).

The information processing apparatus 100 determines whether or not the information terminal 400 or the physical icon 500 is placed on a part not related to information input / output (S1310).
When the information processing apparatus 100 determines that the information terminal 400 or the physical icon 500 is placed (S1310: yes), the information processing apparatus 100 derives part information of the part (for example, the top board 173) on which the information terminal 400 or the physical icon 500 is placed (S1305). ). If it is determined that the information terminal 400 or the physical icon 500 is not yet placed (S1310: no), the process proceeds to S1313.
The information terminal 400 or the physical icon 500 placed in a part not related to information input / output transmits information to the information processing apparatus 100 (S1301). Further, the information processing apparatus 100 receives information transmitted from the information terminal 400 or the physical icon 500 (S1312).

  The information processing apparatus 100 determines a function (function mode) to be operated as the information processing system 10 based on the combination of the part information and the information (S1313). The information processing apparatus 100 displays an image that directly represents the determined function on the display / touch panel 151 (S1314). The information processing system 10 ends the processing of S902 when a series of processing ends.

Here, a display example of an image that directly represents the determined function will be described with reference to FIG. FIG. 14A shows an example when the determined function is “print”. FIG. 14B shows an example when the determined function is BOX storage. FIG. 14C shows an example in which the determined function is document copy.
For example, if the determined function is printing of a document recorded in the information terminal 400, a screen as shown in FIG. 14A is displayed. On this screen, a text “abcde.pdf is printed on paper” is displayed together with a conceptual diagram showing that the document recorded in the information terminal 400 is printed. Further, as a setting for printing, a color mode (color, monochrome) selection button and a print surface change button (single side, double side) are displayed.

  If the determined function is BOX storage of the document recorded in the information terminal 400, a screen as shown in FIG. 14B is displayed. On this screen, a text “abcde.pdf is stored in the BOX” is displayed together with a conceptual diagram showing that the BOX storage of the document recorded in the information terminal 400 is performed. Further, a BOX number selection button for designating the storage destination is displayed.

  If the determined function is a document copy (FIG. 8) between the information terminal 400 and the information terminal 410, a screen as shown in FIG. 14C is displayed. A text “abcde.pdf is file copied” is displayed on this screen together with a conceptual diagram showing that document copying between information terminals is performed. The user can understand what kind of processing will be performed from now on in the information processing system 10.

  In addition, when the information terminal 400 and the physical icon 500 are placed on a part not related to input / output of information, a user interface (UI) screen including contents that are hints for subsequent operations is displayed. For example, when the information terminal 400 is placed on the top board 173, “No processing that can be executed” is displayed.

  FIG. 15, FIG. 16, and FIG. 17 are flowcharts specifically showing the processing procedure of the function execution processing (FIG. 9: S904) for executing processing according to the function mode. FIG. 15 shows a print processing procedure for document information recorded in the information terminal 400 when the function mode is print processing. FIG. 16 shows a BOX storage processing procedure for document information recorded in the information terminal 400 when the function mode is BOX storage. FIG. 17 shows a file copy processing procedure between information terminals when the function mode is file copy.

A case where the function mode is “print” will be described. Each process of S1401 to S1402 shown in FIG. 15 is executed by the information terminal 400 placed on the information input part. In addition, each processing from S1403 to S1405 is executed by the information processing apparatus 100.
The information processing apparatus 100 transmits (inputs) the document information selected by the user as a print target (for example, displaying the document on the screen) to the information processing apparatus 100 to the information terminal 400 placed on the information input part. (S1403). The information terminal 400 transmits the document information to be printed to the information processing apparatus 100 (S1402) upon reception of a document information transmission instruction (S1401). The information processing apparatus 100 receives the document information transmitted from the information terminal 400 (S1404), and executes a printing process for the received document information (S1405). Thereby, the operation (FIG. 6) when the information terminal 400 is placed on the document tray 171 is realized.
The information processing system 10 ends the processing of S904 when a series of processing ends.

A case where the function mode is “BOX storage” will be described. The processing of S1501 shown in FIG. 16 is executed by the physical icon 500 placed on the information output part. In addition, each processing from S1502 to S1507 is executed by the information processing apparatus 100.
The information processing apparatus 100 determines whether the storage destination BOX number of the physical icon 500 has already been determined (S1502). For example, the information processing apparatus 100 receives a user input from the screen illustrated in FIG. If the storage destination BOX number is determined, the process proceeds to S1503. If the storage destination BOX number has not yet been determined, the information processing apparatus 100 asks the user for the desired storage destination BOX number by voice (S1506). After that, the information processing apparatus 100 determines the storage destination BOX number based on the voice input result in response to reception of a response from the user (S1507).

  The information processing apparatus 100 scans the document placed on the document tray 171 and converts the scan result into image information (S1503). The information processing apparatus 100 executes BOX storage processing of image information (S1504). After the storage process is completed, the information processing apparatus 100 notifies the physical icon 500 of an instruction to turn on the LED 552 (S1505). The physical icon 500 turns on the LED 552 in response to reception of an instruction to turn on the LED 552 (S1501). As a result, the operation (FIG. 7) when the original is placed on the original reading surface of the scanner 156 and the physical icon 500 representing the BOX function is placed on the paper discharge tray is realized.

A case where the function mode is “file copy” will be described. Each process of S1601 to S1602 shown in FIG. 17 is executed by the information terminal 400 placed on the information input part. Each process of S1603 is executed by the information terminal 410 placed on the information output part. Further, each processing from S1604 to S1606 is executed by the information processing apparatus 100.
The information processing apparatus 100 instructs the information terminal 400 placed in the information input part to transmit (input) the document information selected as a file copy target by the user to the information processing apparatus 100 (S1604). The information terminal 400 receives the document information transmission instruction (S1601), and transmits the document information to be copied to the information processing apparatus 100 (S1602).
Upon receiving the document information transmitted from the information terminal 400 (S1605), the information processing apparatus 100 transmits the received document information to the information terminal 410 placed on the information output site (S1606). The information terminal 410 records the received document information in the flash memory included in the information terminal 410 (S1603). Thus, the operation (FIG. 8) when the information terminal 400 displaying the document is placed on the document tray 171 and the other information terminal 410 is placed on the paper discharge tray 172 is realized.

FIG. 18 is a flowchart specifically showing the processing procedure of timeout control (FIG. 9: S905).
If the information terminal 400 or the physical icon 500 is left in any part of the information processing apparatus 100, the operation of the information processing system 10 is fixed in a specific function mode, which is difficult for the user. Very inconvenient. In order to avoid this, timeout control (S905) is executed to release the fixed function mode when a predetermined time has elapsed since the information terminal device was placed in any part of the information processing device 100. To do.

The process of S1901 illustrated in FIG. 18 is executed by one or a plurality of information terminals 400 placed on any part of the information processing apparatus 100. Further, the process of S1902 is executed by one or a plurality of physical icons 500 placed on any part of the information processing apparatus 100. Furthermore, each process of S1903 to S1909 is executed by the information processing apparatus 100.
In the function mode change process (S902), the information processing apparatus 100 determines whether or not a predetermined time (for example, 3 minutes) has elapsed since the timing at which the function mode was determined (S1903). Specifically, the elapsed time is measured by a timer (not shown) starting from the timing at which the function mode is determined. When it is determined that the predetermined time has elapsed (S1903: yes), the information processing apparatus 100 cancels the fixed function mode (S1904). If it is determined that the time has not elapsed (S1903: no), the process ends.

After canceling the fixed function mode, the information processing apparatus 100 transmits a signal indicating that the function mode has been canceled to the information terminal 400 (S1905). As a result, all the information terminals 400 placed on the information processing apparatus 100 are notified that the current function mode has been canceled. The information terminal 400 turns off the display of the display and touch panel 451, for example, upon reception of a signal indicating that the function mode has been canceled (S1901). Thereby, the user can understand that the current function mode is canceled.
The information processing apparatus 100 also notifies the physical icon 500 of an instruction to turn off the LED 552 (S1906). The physical icon 500 turns off the LED 552 when receiving a turn-off instruction from the information processing apparatus 100 (S1902). Thereby, the user can understand that the current function mode is canceled.

The information processing apparatus 100 turns off the function of the short-range communication antenna 154 provided in the part where the information terminal device is not placed (S1907). Thereby, even when another new information terminal device is placed before all the left information terminal devices are removed, execution of the current function mode is suppressed.
The information processing apparatus 100 determines whether or not all the information terminal devices that have been left are removed (S1908). For example, if there is an information terminal 400 in which a short-distance communication session is still established, it can be determined that all have not been removed. If all the information terminal devices have not been removed (S1908: no), the process returns to S1907 and the process is repeated.
When the information processing apparatus 100 determines that all of the information terminal apparatuses that have been left are removed (S1908: yes), the functions of all the short-range communication antennas 154 deployed in the information processing apparatus 100 are turned on again ( ON) (S1909).

  As described above, in the information processing system 10 according to the present embodiment, the information terminal device (the information terminal 400, the physical icon 500) is identified on which part of the information processing device 100 is mounted, and the part information of the part is derived. To do. Furthermore, the information processing system 10 acquires status information of the information terminal device. The information processing system 10 determines a function to be realized in cooperation with the information terminal device according to the combination of these pieces of information. Thereby, a user can understand the function of the information processing system 10, and can reduce the burden for memorizing complicated operations for each function. Furthermore, the user can operate the information processing system with an intuitive operation to transmit content stored in a device other than the information terminal to the information terminal, or to transfer content between a plurality of information terminals. Can do.

[Second Embodiment]
For example, when the MFP is installed in an office, a plurality of users use this MFP. In this case, the MFP is temporarily monopolized by a single user (hereinafter referred to as a first user), and used as intended by the first user. Therefore, while the first user is using the MFP, it is necessary to prevent an unexpected operation caused by the use of a third party as another user (hereinafter referred to as another user). is there. Hereinafter, an exemplary embodiment of an information processing system in which these functions are implemented will be described. In addition, about the same thing as each structure already demonstrated in the 1st Embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted.

For example, consider a case where the first user places the physical icon 500 on the paper discharge tray 172. At this time, even if a FAX document is input from another user, this document must not be stored in the physical icon 500 on which the first user is placed. In addition, when a user prints a FAX document and the paper is output to the paper discharge tray 172 on which the physical icon 500 is placed, a problem such as a paper jam occurs.
Hereinafter, a processing procedure for not applying the determined function mode under a predetermined condition to an execution instruction from another user will be described with reference to FIGS. 19 and 20.

FIG. 19 is a flowchart showing a basic processing procedure of the entire information processing system 10 regarding an operation for not applying the determined function mode. The information processing system 10 processes two processes in parallel as shown in FIG.
The first process starts from S1701 and is executed by the information processing apparatus 100. The information processing apparatus 100 specifies a placement site on which the information terminal 400, the physical icon 500, and the like are placed (S1701). The information processing apparatus 100 determines whether or not the information terminal device is placed on the paper discharge tray 172 (S1702). When the information terminal device is placed on the discharge tray 172 (S1702: yes), the information processing apparatus 100 changes the state of the information processing apparatus 100 to a state where the use of the discharge tray 172 is restricted (S1703). ). When the information terminal device is not placed on the paper discharge tray (S1702: no), the information processing apparatus 100 changes the state of the information processing apparatus 100 to a state where the use of the paper discharge tray 172 is released ( S1705). Thereafter, the information processing apparatus 100 performs a function mode change process (S1704).

The second process starts from S1706 and is executed by the information processing apparatus 100. The information processing apparatus 100 accepts an execution instruction from the user (S1706). The information processing apparatus 100 determines whether or not the received execution instruction is an execution instruction via the display and touch panel 151 (S1707). If it is an execution instruction via the display and touch panel 151 (S1707: yes), since it is an execution instruction from the first user, the information processing apparatus 100 performs a function execution process according to the function mode (S1708). . If it is not an execution instruction via the display and touch panel 151 (S1707: no), the information processing apparatus 100 performs a function execution process outside the function mode shown in FIG. 20 (described later) (S1709). In this way, it is possible to determine whether the instruction is an execution instruction from the first user or an execution instruction from another user.
The information processing system 10 repeats these two processes until the power is turned off.

FIG. 20 is a flowchart specifically showing the procedure of the function execution process outside the function mode (FIG. 19: S1709).
Each process of S1801 to S1804 shown in FIG. 20 is executed by the information processing apparatus 100. Here, a description will be given by taking as an example a case where an execution instruction from another user is a FAX document printing process.
The information processing apparatus 100 receives FAX document information transmitted from another user via the telephone line 201 (S1801). The information processing apparatus 100 determines the state of the information processing apparatus 100, that is, whether the use of the paper discharge tray 172 is restricted or released (S1803). If the condition that the use of the discharge tray 172 is restricted is satisfied, the information processing apparatus 100 temporarily stops the printing process and holds the received FAX document information (S1802), and then performs the process of S1803. Return. In this case, the received FAX document information is stored in, for example, the HDD 108 until the printing process is resumed. If the condition that the use of the paper discharge tray 172 is satisfied is satisfied, the information processing apparatus 100 executes a printing process of FAX document information including a reserved FAX text (S1804).

  As described above, in this embodiment, when the information terminal device is placed on the paper discharge tray 172 by the first user, for example, even if there is an instruction to print a FAX document from another user, the printing is performed. Is put on hold. If the received execution instruction is an execution instruction via the display and touch panel 151, it is determined that the execution instruction is from the first user, and processing according to the determined function is executed.

  The embodiment described above is for explaining the present invention more specifically, and the scope of the present invention is not limited to these examples.

  DESCRIPTION OF SYMBOLS 10 ... Information processing system, 100 ... Information processing apparatus, 151, 451, 461 ... Display and touch panel, 154 ... Short-range communication antenna, 160 ... Marker, 171 ... Document tray, 172 .. discharge tray, 173... Top plate, 400, 410... Information terminal, 500.

Claims (8)

In an information processing system including an information terminal device and an information processing device,
The information terminal device has a notification means for notifying the information processing device of status information indicating a state of information processing in the own device,
The information processing apparatus includes:
Detecting means for detecting the presence of the information terminal device in a part where an executable function is physically represented;
When the presence of the information terminal device is detected, the status information is acquired from the information terminal device and executed in cooperation with the information terminal device by a combination of the acquired status information and the function represented by the part. A function determining means for determining a function to be performed,
Information processing system. The information processing apparatus further includes function execution means for executing the function determined by the function determination means,
In addition to executing the determined function, the function execution means suspends execution of the function when it is determined that the execution of the function is hindered by placing the information terminal device based on a predetermined condition. It is characterized by
The information processing system according to claim 1. The information terminal device further includes a first display means for displaying various information,
The first display means displays information indicating the part when the presence of the information terminal device is detected in the part.
The information processing system according to claim 1 or 2. When the execution of the determined function ends, the first display means displays information indicating the end of the execution,
The information processing system according to claim 3. The function determining means cancels the function determined most recently and indicates that the function has been canceled when a predetermined time has elapsed since the presence of the information terminal device was detected in the part. A signal is transmitted to the information terminal device,
The first display means displays information indicating the release of the function upon reception of a signal indicating that the function is released,
The information processing system according to claim 3 or 4. The information processing apparatus, when it is determined that an additional instruction from a user is necessary to execute the determined function, output means for outputting information prompting the user;
Receiving means for accepting the addition instruction from the user, further comprising:
The information processing system according to any one of claims 1 to 5. The information processing apparatus further includes a second display unit for displaying various information,
The second display means displays information indicating the function determined by the function determining means,
The information processing system according to any one of claims 1 to 6. In an information processing device in an information processing system including an information terminal device and an information processing device,
The information processing device includes a detecting unit that detects the presence of the information terminal device in a part where an executable function is physically expressed;
A combination of the acquired status information and the function represented by the part is acquired when the presence of the information terminal device is detected and status information indicating the information processing state in the own device notified from the information terminal device The function determining means for determining the function to be executed in cooperation with the information terminal device,
Information processing device.