JP7173266B2 - Information processing device, program and control method - Google Patents

Description

The present invention relates to an information processing device, program, and control method.

Patent Literatures 1 and 2 disclose techniques for linking a plurality of devices.

JP 2015-177504 A Japanese Patent Application Laid-Open No. 2015-223006

An object of the present invention is to provide information on executable cooperative functions.

The invention according to claim 1 has a processor, and the processor belongs to at least one same group before performing an identification operation on the first device in the real space necessary for using the cooperation function. When sharing information of a second device in the real space identified by performing an identification operation on the first terminal operated by the user, the own device performs a new identification operation on the first device in the real space is finished, the information processing apparatus notifies information of the cooperative function that can be executed by combining the first device identified by the own device and the second device identified by the first terminal.

In the invention according to claim 2, the processor operates when one or more of the user operating the own device and the other users does not have administrative authority to operate devices necessary for using the cooperative function. 2. The information processing apparatus according to claim 1, wherein execution of said cooperation function is not permitted.

In the invention according to claim 3, when the position of the device instructing the execution of the cooperation function is outside the range of the area where the use of the equipment required for the use of the cooperation function is permitted, the cooperation function is not executed. The information processing apparatus according to claim 1 or claim 2.

In the invention according to claim 4, by photographing the first device with its own device, the first device photographed with its own device is identified, and by photographing the second device with the first terminal, 4. The information processing apparatus according to any one of claims 1 to 3, wherein the second device captured by the first terminal is identified.

The invention according to claim 5 has a processor, and the processor stores information indicating that the first device has been identified by performing an identification operation on the first device with the first terminal operated by the first user. obtaining information indicating that the second device has been identified by performing an identification operation on the second device with a second terminal operated by a second user after identifying the first device; The information processing apparatus proposes a cooperative function executable by a combination of devices shared by the same group when a user and the second user belong to at least one same group.

The invention according to claim 6 has a processor, and the processor stores information indicating that the first device has been identified by performing an identification operation on the first device with the first terminal operated by the first user. After identifying the first device, a second terminal operated by a second user performs an identification operation on the second device to obtain information indicating that the second device has been identified, and the information is identified. Restricting use of the linking function if at least one of the first user or the second user does not have administrative authority when executing the linking function executable by a combination of a plurality of devices. , is an information processing device.

The invention according to claim 7 has a processor, and the processor is configured so that at least one other user belonging to the same group before performing an authentication operation on the own device with respect to the first software necessary for using the cooperative function. When the information of the second software whose use has been authenticated by the first terminal to be operated is shared, when the authentication operation for the first software is newly completed on the own device, the self device The information processing apparatus notifies information of the cooperative function that can be executed by combining the first software whose use is authenticated and the second software whose use is authenticated on the first terminal.

According to the eighth aspect of the invention, the processor operates when one or more of the user operating the own device and the other users does not have administrative authority to operate the software necessary for using the cooperative function. 8. The information processing apparatus according to claim 7, wherein execution of said cooperation function is not permitted.

In the invention according to claim 9, when the position of the device instructing the execution of the linkage function is outside the range of the area where the use of the software necessary for using the linkage function is permitted, the linkage function is not executed. The information processing apparatus according to claim 7 or 8.

The invention according to claim 10 has a processor, and the processor authenticates that the use of the first software is authenticated by performing an authentication operation on the first software on the first terminal operated by the first user. indicating that the use of the second software has been authenticated by acquiring the information indicating the use of the first software and performing an authentication operation on the second software at the second terminal operated by the second user after authenticating the use of the first software. An information processing apparatus that acquires information and proposes a cooperative function executable by a combination of software shared by the same group when the first user and the second user belong to at least one same group.

The invention according to claim 11 has a processor, and the processor authenticates that the use of the first software is authenticated by performing an authentication operation on the first software at the first terminal operated by the first user. indicating that the use of the second software has been authenticated by acquiring the information indicating the use of the first software and performing an authentication operation on the second software at the second terminal operated by the second user after authenticating the use of the first software. At least one of the first user or the second user does not have administrative authority when acquiring information and executing a cooperative function executable by a combination of a plurality of software authorized for use. In this case, the information processing apparatus restricts the use of the cooperation function.

In the invention according to claim 12, before the computer identifies and operates the first device in the real space necessary for using the cooperation function, at least one other user belonging to the same group operates the first device. When sharing the information of the second device in the physical space identified by the identification operation on one terminal, when the identification operation for the first device in the real space is newly completed by the self-device, the self-device and the second device identified by the first terminal are combined with each other to notify information of the cooperative function that can be executed.

In the invention according to claim 13, the computer acquires information indicating that the first device has been identified by performing an identification operation on the first device with the first terminal operated by the first user, and After identifying the device, the second terminal operated by the second user performs an identification operation on the second device to acquire information indicating that the second device has been identified, and the first user and the second user. belong to at least one same group, the program proposes a cooperative function executable by a combination of devices shared by the same group.

In the invention according to claim 14, the computer acquires information indicating that the first device has been identified by performing an identification operation on the first device with the first terminal operated by the first user, and After identifying the device, a second terminal operated by a second user performs an identification operation on the second device to acquire information indicating that the second device has been identified, and a combination of a plurality of identified devices To restrict the use of the linking function if at least one of the first user or the second user does not have administrative authority when executing the linking function that can be executed. program.

In the fifteenth aspect of the invention, the computer is a first terminal operated by at least one other user belonging to the same group before the computer authenticates the first software necessary for using the cooperation function. In the case where the information of the second software whose use is authenticated by the authentication operation is shared, when the authentication operation for the first software is newly completed on the own device, the use of the above-mentioned software whose use is authenticated on the own device is shared. A program for notifying information of the cooperative function that can be executed by combining the first software and the second software whose use is authenticated on the first terminal.

In the invention according to claim 16, the computer acquires information indicating that the use of the first software has been authenticated by authenticating the first software on the first terminal operated by the first user, obtaining information indicating that the use of the second software has been authenticated by performing an authentication operation on the second software at the second terminal operated by the second user after the use of the first software has been authenticated; A program for operating such that, when a first user and said second user belong to at least one same group, a cooperation function executable by a combination of software shared by said same group is proposed.

In the invention according to claim 17, the computer acquires information indicating that the use of the first software has been authenticated by authenticating the first software on the first terminal operated by the first user, After authenticating the use of the first software, the second terminal operated by the second user performs an authentication operation for the second software, thereby acquiring information indicating that the use of the second software has been authenticated, and using the second software. is executed by a combination of a plurality of authenticated software, and if at least one of the first user or the second user does not have administrative authority, the cooperation function It is a program for restricting usage.

The invention according to claim 18 is a first terminal operated by at least one other user belonging to the same group before performing an identification operation on the first device in the real space necessary for using the cooperation function. In a case where the information of the second device in the physical space identified by the identification operation is shared, when the identification operation is newly performed on the first device in the real space by the own device, the identification is performed by the own device. In the control method, information of the cooperative function that can be executed by combining the first device and the second device identified by the first terminal is notified.

In the invention according to claim 19, a first terminal operated by a first user performs an identification operation on a first device, thereby acquiring information indicating that the first device has been identified, and identifying the first device. After that, the second terminal operated by the second user performs an identification operation on the second device to acquire information indicating that the second device has been identified, and the first user and the second user are at least one This control method proposes a cooperative function that can be executed by a combination of devices shared by the same group when the devices belong to the same group.

In the invention according to claim 20, a first terminal operated by a first user performs an identification operation on a first device, thereby acquiring information indicating that the first device has been identified, and identifying the first device. After that, a second terminal operated by a second user performs an identification operation on a second device to acquire information indicating that the second device has been identified, and can be executed by a combination of a plurality of identified devices. In the control method, use of the cooperation function is restricted if at least one of the first user or the second user does not have administrative authority when executing the cooperation function.

In the invention according to claim 21, before performing an authentication operation on the own device for the first software necessary for using the cooperation function, the authentication operation is performed on the first terminal operated by at least one other user belonging to the same group. In the case where the information of the second software whose use has been authenticated is shared by the device, when the authentication operation for the first software is newly completed in the own device, the first software whose use has been authenticated in the own device and the second software whose use is authenticated in the first terminal, and notifying information of the cooperative function executable.

In the invention according to claim 22, a first terminal operated by a first user performs an authentication operation on the first software, thereby obtaining information indicating that use of the first software has been authenticated, After authenticating use of the software, a second terminal operated by a second user authenticates the second software, thereby obtaining information indicating that the use of the second software has been authenticated, and obtaining information indicating that the use of the second software has been authenticated. and the second user belong to at least one same group, the control method proposes a cooperative function executable by a combination of software shared by the same group.

In the twenty-third aspect of the invention, a first terminal operated by a first user performs an authentication operation on the first software, thereby obtaining information indicating that use of the first software has been authenticated, After authenticating the use of the software, the second terminal operated by the second user performs an authentication operation on the second software to acquire information indicating that the use of the second software has been authenticated, and the use is authenticated. In the case of executing a linkage function that can be executed by a combination of a plurality of software, if at least one of the first user or the second user does not have administrative authority, the use of the linkage function is restricted. is a control method.

According to the invention according to claims 1 to 23, information on executable link functions is provided.

1 is a block diagram showing an equipment system according to a first embodiment of the present invention; FIG. 1 is a block diagram showing an image forming apparatus according to a first embodiment; FIG. 2 is a block diagram showing a server according to the first embodiment; FIG. 1 is a block diagram showing a terminal device according to a first embodiment; FIG. 1 is a schematic diagram showing an appearance of an image forming apparatus; FIG. It is a figure which shows an example of a device function management table. FIG. 10 is a diagram showing an example of a linking function management table; FIG. It is a figure which shows the apparatus utilized independently. It is a figure which shows an example of a function display screen. It is a figure which shows an example of a function display screen. FIG. 10 is a diagram showing devices to be linked; It is a figure which shows an example of a function display screen. FIG. 10 is a sequence diagram showing connection processing; It is a figure which shows an example of a device display screen. It is a figure which shows an example of a device selection screen. It is a figure which shows an example of a function display screen. FIG. 10 is a diagram showing an example of a linking function management table; FIG. It is a figure which shows an example of a function display screen. It is a figure which shows an example of a function display screen. It is a figure which shows an example of a device function management table. It is a figure which shows an example of a device display screen. It is a figure which shows an example of a device selection screen. It is a figure which shows an example of a device function management table. FIG. 10 is a diagram showing an example of a linking function management table; FIG. Fig. 2 shows a device; It is a figure which shows an example of a function display screen. It is a figure which shows an example of a function display screen. It is a figure which shows an example of a function display screen. It is a figure which shows an example of a confirmation screen. It is a figure which shows an example of a device and a device display screen. It is a figure which shows an example of a function display screen. It is a figure which shows an example of a confirmation screen.

<First embodiment>
A device system as an information processing system according to an embodiment of the present invention will be described with reference to FIG. FIG. 1 shows an example of a device system according to this embodiment.

The device system according to this embodiment includes a plurality of devices (for example, devices 10 and 12), a server 14 as an example of an external device, and a terminal device 16 as an example of an information processing device. In the example shown in FIG. 1, the devices 10 and 12, the server 14 and the terminal device 16 have a function of communicating with each other via a communication path N such as a network. Of course, the devices 10 and 12, the server 14, and the terminal device 16 may communicate with other devices via different communication paths without using the communication path N. In the example shown in FIG. 1, two devices (devices 10 and 12) are included in the device system, but three or more devices may be included in the device system. Also, a plurality of servers 14 and a plurality of terminal devices 16 may be included in the equipment system.

The devices 10 and 12 are devices having specific functions, such as image forming devices having image forming functions, personal computers (PCs), projectors, display devices such as liquid crystal displays and projectors, telephones, clocks, and surveillance cameras. , etc. The devices 10 and 12 also have the function of transmitting and receiving data to and from other devices. In this embodiment, the equipment 10 is assumed to be an image forming apparatus as an example. The image forming apparatus (equipment 10) is, for example, an apparatus having at least one function among a scanning function, a printing function, a copying function, and a facsimile function.

The server 14 is a device that manages the functions of each device. For example, the server 14 manages functions possessed by each device, cooperation functions using a plurality of functions, and the like. The server 14 also has a function of transmitting and receiving data to and from other devices.

Server 14 may manage the features available by a user on a per-user basis. The functions that can be used by the user are, for example, functions provided free of charge to the user, functions provided to the user for a fee and purchased by the user, and the like. The server 14 may manage usable function information (for example, function purchase history information) indicating functions usable by the user for each user. Of course, since there are functions that can be used free of charge, additional update functions, functions that are specially managed by the administrator, etc., the server 14 does not have to manage the functions based on whether or not they have been purchased. The function purchase process is performed by the server 14, for example. Of course, the purchase process may be performed by another device.

The terminal device 16 is a device such as a personal computer (PC), tablet PC, smart phone, mobile phone, etc., and has a function of transmitting and receiving data to and from other devices. The terminal device 16 functions, for example, as a user interface unit (UI unit) when using the device.

Each device included in the equipment system according to the present embodiment will be described in detail below.

The configuration of the device 10 as an image forming apparatus will be described in detail with reference to FIG. The device 10 may be referred to as an image forming apparatus 10 below. FIG. 2 shows the configuration of the image forming apparatus 10. As shown in FIG.

The communication unit 18 is a communication interface and has a function of transmitting data to other devices and a function of receiving data from other devices. The communication unit 18 may be a communication interface with a wireless communication function or a communication interface with a wired communication function. The communication unit 18, for example, supports one or more types of communication methods, and may communicate with a communication partner according to a communication method suitable for the communication partner (that is, a communication method supported by the communication partner). . Communication methods include, for example, infrared communication, visible light communication, Wi-Fi (registered trademark) communication, close proximity wireless communication (for example, NFC (Near Field Communication), etc.), and the like. Felica (registered trademark), Bluetooth (registered trademark), RFID (Radio Frequency Identifier), and the like are used as close proximity wireless communication. Of course, another type of wireless communication may be used as close proximity wireless communication. For example, the communication unit 18 may switch the communication method or frequency band according to the communication partner, or may switch the communication method or frequency band according to the surrounding environment.

The image forming section 20 has an image forming function. Specifically, the image forming section 20 has at least one function among a scanning function, a printing function, a copying function, and a facsimile function. By executing the scanning function, a document is read and scan data (image data) is generated. By executing the print function, an image is printed on a recording medium such as paper. By executing the copy function, the document is read and printed on the recording medium. By executing the facsimile function, image data is facsimile-transmitted or facsimile-received. Also, a linking function using a plurality of functions may be executed. For example, a scan transfer function that combines a scan function and a transmission function (transfer function) may be executed. By executing this scan transfer function, the document is read, scan data (image data) is generated, and the scan data is transmitted to a transmission destination (for example, an external device such as the terminal device 16). Of course, this cooperation function is only an example, and another cooperation function may be executed.

The storage unit 22 is a storage device such as a hard disk or memory (such as an SSD). The storage unit 22 stores, for example, information indicating an image forming command (e.g., job information), image data to be printed, scan data generated by executing the scan function, and addresses of other devices. Device address information, server address information indicating the address of the server 14, various control data, various programs, and the like are stored. Of course, they may be stored in separate storage devices or in one storage device.

The UI section 24 is a user interface section and includes a display section and an operation section. The display unit is, for example, a display device such as a liquid crystal display. The operation unit is, for example, an input device such as a touch panel or keyboard. Of course, a user interface (including, for example, a touch-type display or a device that electronically displays a keyboard or the like on the display) that serves both as a display unit and an operation unit may be used. Note that the image forming apparatus 10 may not include the UI unit 24, or may include a hardware user interface unit (hardware UI unit) as hardware without including a display unit. The hardware UI unit includes, for example, hardware keys specialized for inputting numbers (for example, a numeric keypad), hardware keys specialized for indicating directions (for example, direction keys), and the like.

The control section 26 controls the operation of each section of the image forming apparatus 10 .

The configuration of the server 14 will be described in detail below with reference to FIG. FIG. 3 shows the configuration of the server 14. As shown in FIG.

The communication unit 28 is a communication interface and has a function of transmitting data to other devices and a function of receiving data from other devices. The communication unit 28 may be a communication interface with a wireless communication function or a communication interface with a wired communication function.

The storage unit 30 is a storage device such as a hard disk or a memory (such as an SSD). The storage unit 30 stores, for example, device function management information 32, cooperation function management information 34, various data, various programs, device address information indicating the address of each device, server address information indicating the address of the server 14, and the like. remembered. Of course, they may be stored in separate storage devices or in one storage device. The device function management information 32 and the cooperation function management information 34 stored in the storage unit 30 are provided to the terminal device 16 periodically or at designated timing, whereby the information stored in the terminal device 16 is May be updated. The device function management information 32 and the cooperation function management information 34 will be described below.

The device function management information 32 is information for managing the functions of each device. For example, device identification information (device identification information) for identifying the device, function information indicating the function of the device, is information indicating the correspondence between The device identification information includes, for example, the device ID, device name, information indicating the type of device, model number of the device, information for managing the device (such as asset management number), and information indicating the location where the device is installed. (equipment location information), appearance image representing the appearance of the equipment, address information of the equipment, and the like. The appearance image may be an image representing the housing of the device, an image representing a state in which the housing is opened and the interior can be seen from the outside, or an image representing the state where the device is covered with a packing sheet or the like. It may be an image representing a state in which the user is present. The appearance image may be an image obtained by photographing the appearance of the device, or may be an image simulating the appearance of the device (such as an icon). The function information is, for example, a function ID, a function name, and the like. For example, when the image forming apparatus 10 has a scan function, a print function, a copy function, and a scan transfer function, the device identification information of the image forming apparatus 10 includes function information indicating the scan function, function information indicating the print function, and copy function. Function information indicating the function and function information indicating the scan transfer function are associated with each other. By referring to the device function management information 32, the functions of each device are specified (identified).

Devices managed by the device function management information 32 are, for example, devices included in the device system (eg, devices 10 and 12). Of course, equipment not included in the equipment system may be managed by the equipment function management information 32 . For example, the server 14 may acquire information (information including device identification information and function information) about new equipment not included in the equipment system and newly register it in the equipment function management information 32 . The information about the device may be acquired by using the Internet or the like, or may be input by an administrator or the like. Further, the server 14 may update the device function management information 32 at arbitrary timing, periodically, or at timing designated by an administrator or the like. As a result, in some cases, function information indicating functions that the device does not have before the update but that the device has after the update is registered in the device function management information 32 . Similarly, when function information indicating a function that the device had before the update but does not have after the update is deleted from the device function management information 32 or registered as unusable information. There is The information for updating may be acquired by using the Internet or the like, or may be input by an administrator or the like.

The linked function management information 34 is information for managing linked functions that are executed by linking a plurality of functions. By linking multiple functions, one or more linked functions are performed. The linking function may be executed, for example, by linking a plurality of functions possessed by one device (for example, the devices 10 and 12), or by linking a plurality of functions possessed by a plurality of devices (for example, the devices 10 and 12). may be performed by allowing Further, the terminal device issuing the operation instruction (the terminal device 16 in this embodiment) may be included in the equipment to be identified, and the function of the terminal device may be used as part of the cooperation function.

The cooperation function may be a function that is executed without using a device as hardware. For example, the link function may be a function executed by linking multiple pieces of software. Of course, the linking function may be a function executed by linking a function of a device as hardware and a function realized by software.

The linking function management information 34 is, for example, information indicating association between a combination of function information indicating each function used for a linking function and linking function information indicating the linking function. The linking function information is, for example, a linking function ID, a linking function name, and the like. When a single function is updated, the linked function management information 34 is also updated along with the update. As a result, linked functions of multiple functions that could not be linked with each other before the update can be used after the update, and conversely, linked functions that were available before the update cannot be used after the update. It may become possible. Linkage function information indicating linkage functions that have become available after the update is registered in the linkage function management information 34, and linkage function information indicating linkage functions that have become unusable after the update is deleted from the linkage function management information 34. , or registered as unusable information.

When a plurality of devices are to be linked, the linking function management information 34 is information for managing linking functions that use multiple functions possessed by the plurality of devices, and is information for identifying each device used for the linking functions. This is information indicating the association between a combination of device identification information and linked function information. As described above, when the device function management information 32 is updated, the cooperation function management information 34 is also updated along with the update. As a result, the functions of multiple devices that could not cooperate with each other before the update can now be used after the update, and vice versa. It may become possible.

The linking function may be a function executed by linking a plurality of mutually different functions, or may be a function performed by linking the same functions. The linking function may be a function that was not available before linking. The functions that cannot be used before linkage may be functions that can be used by using the same functions among the functions of the equipment to be linked, or functions that can be used by combining different functions. may For example, by linking a device (printer) with a print function and a device (scanner) with a scan function, a copy function is realized as a linked function. That is, the copy function is realized by linking the print function and the scan function. In this case, a copy function as a cooperative function is associated with a combination of a print function and a scan function. The cooperation function management information 34 includes, for example, cooperation function information indicating a copy function as a cooperation function, device identification information for identifying a device having a print function, and device identification information for identifying a device having a scan function. are associated with a combination of

The conceptual category of the linked function may include a united function that enables execution of a new function by linking a plurality of functions or a plurality of devices. For example, by combining a plurality of displays, an extended display function as a combined function may be realized. As another example, a recording function as a combined function may be realized by combining a television and a recorder. The recording function may be a function of recording the image being displayed on the television. Also, by combining a plurality of cameras, a shooting area expansion function may be realized as a uniting function. The extended function is, for example, a function of connecting the photographing areas of each camera and photographing. Also, by combining a telephone with a translator or translation software, a translation call function (a function of translating a conversation over a telephone) may be realized as a combined function. In this way, the concept of linked functions includes functions that can be realized by linking devices and functions of the same type, and functions that can be implemented by linking devices and functions of different types. is included.

Note that the storage unit 30 may store usable function management information. The available function management information is information for managing the functions available to each user. (may contain information) and information indicating the correspondence between As described above, the functions available to the user are, for example, functions provided free of charge to the user, functions purchased by the user, etc., and may be a single function or a linked function. good too. The user identification information is, for example, user account information such as user ID and name. By referring to the available function management information, functions available to each user are specified (identified). The usable function management information is updated, for example, each time a function is provided to the user (for example, each time a function is provided to the user free of charge or for a fee).

The control unit 36 controls operations of each unit of the server 14 . Also, the control unit 36 includes a specifying unit 38 .

The identification unit 38 receives device identification information for identifying a device, and identifies function information indicating functions associated with the device identification information in the device function management information 32 stored in the storage unit 30 . Thereby, the functions of the device are specified (identified). For example, device identification information is transmitted from the terminal device 16 to the server 14, and the identifying unit 38 identifies function information indicating a function associated with the device identification information. Information about functions (for example, function information, function description information, etc.) is transmitted from the server 14 to the terminal device 16 and displayed on the terminal device 16 . As a result, the terminal device 16 displays information about the functions of the device specified by the device identification information.

In addition, the identification unit 38 receives device identification information for identifying each device to be linked, and determines the linkage information associated with the combination of device identification information in the linkage function management information 34 stored in the storage unit 30 . Identify the linked function information that indicates the function. This specifies (identifies) the linked function to be executed by linking the functions of the devices to be linked. For example, a plurality of pieces of device identification information are transmitted from the terminal device 16 to the server 14, and the identification unit 38 identifies cooperation function information indicating cooperation functions associated with the plurality of device identification information. Information about the linkage function (for example, linkage function information, description information of the linkage function, etc.) is transmitted from the server 14 to the terminal device 16 and displayed on the terminal device 16, for example. As a result, the terminal device 16 displays information about the cooperation functions executed by the multiple devices specified by the multiple device identification information.

For example, when one device is identified (for example, when one device is photographed), the identification unit 38 receives device identification information for identifying the device, and stores the device identification information in the device function management information 32. You may specify the function information which shows the function matched with. Thereby, when one device is identified (for example, when one device is photographed), the function of the device is specified (identified). When a plurality of devices are identified (for example, when a plurality of devices are photographed), the identification unit 38 receives device identification information for identifying each device included in the plurality of devices, and may specify cooperation function information indicating a cooperation function associated with each combination of device identification information. As a result, when a plurality of devices are identified (for example, when a plurality of devices are photographed), a cooperation function that uses the functions of the plurality of devices is specified (identified).

Further, the specifying unit 38 receives function information indicating each function used for the linking function, and selects the linking function associated with the combination of each function information in the linking function management information 34 stored in the storage unit 30. You may specify the cooperation function information to show. As a result, a linked function to be executed by linking each linked function is specified (identified). For example, a plurality of pieces of function information are transmitted from the terminal device 16 to the server 14, and the identifying unit 38 identifies cooperation function information indicating cooperation functions associated with the plurality of pieces of function information. In the same manner as described above, the terminal device 16 displays information about the cooperative functions executed by the multiple devices specified by the multiple pieces of function information.

It should be noted that when functions available to the user are managed, the identification unit 38 receives user identification information for identifying the user, and adds the user identification information to the usable function management information stored in the storage unit 30. You may specify the function information which shows each function matched with. This specifies (identifies) a function group that can be used by the user. For example, user identification information is transmitted from the terminal device 16 to the server 14, and the identifying unit 38 identifies function information indicating each function associated with the user identification information. Information about each function available to the user (for example, information indicating the name of each function) is transmitted from the server 14 to the terminal device 16 and displayed on the terminal device 16, for example. As a result, information about each function that can be used by the user identified by the user identification information is displayed on the terminal device 16 . For example, the identifying unit 38 receives the device identification information and the user identification information, identifies the function information indicating the function associated with the device identification information in the device function management information 32, and Function information indicating a function associated with the user identification information is specified. As a result, the functions that the device identified by the device identification information has and that can be used by the user identified by the user identification information are identified.

The control unit 36 may execute the function purchase process and manage the purchase history. For example, when a paid function is purchased by a user, the control unit 36 may apply billing processing to the user.

Also, the control unit 36 may execute functions related to image processing such as a character recognition function, a translation function, an image processing function, an image forming function, and the like. Of course, the control unit 36 may execute functions related to processing other than image processing. By executing the character recognition function, characters in the image are recognized and character data representing the characters are generated. By executing the translation function, the characters in the image are translated into characters expressed in a specific language, and character data representing the translated characters is generated. An image is processed by executing the image processing function. For example, the control unit 36 receives scan data generated by executing a scan function from the image forming apparatus 10, and performs image processing such as a character recognition function, a translation function, and an image processing function on the scan data. may perform functions related to The control unit 36 may receive image data from the terminal device 16 and execute each function on the image data. Character data and image data generated by the control unit 36 are transmitted from the server 14 to the terminal device 16, for example. The server 14 may be used as an external device, and the cooperation function may be a function of using functions of a plurality of devices including the server 14 .

The configuration of the terminal device 16 will be described in detail below with reference to FIG. FIG. 4 shows the configuration of the terminal device 16. As shown in FIG.

The communication unit 40 is a communication interface and has a function of transmitting data to other devices and a function of receiving data from other devices. The communication unit 40 may be a communication interface with a wireless communication function or a communication interface with a wired communication function. The communication unit 40, for example, supports one or more types of communication methods, and may communicate with the communication partner according to a communication method suitable for the communication partner (i.e., a communication method supported by the communication partner). . Communication methods include, for example, infrared communication, visible light communication, Wi-Fi communication, and close proximity wireless communication. For example, the communication unit 40 may switch the communication method or frequency band according to the communication partner, or may switch the communication method or frequency band according to the surrounding environment.

A camera 42 as a photographing means generates image data (for example, still image data or moving image data) by photographing an object to be photographed. In addition to using the camera of the terminal device 16, the communication unit 40 receives image data captured by an external camera connected to a communication path such as a network, and the UI unit 46 displays the image data so that the user can Image data may be manipulated.

The storage unit 44 is a storage device such as a hard disk or memory (for example, SSD), and stores various programs, various data, address information of the server 14, address information of each device (for example, address information of the devices 10 and 12), identification information on the identified device, information on the identified device to be linked, information on the function of the identified device, information on the linked function, and the like.

The UI section 46 is a user interface section and includes a display section and an operation section. The display unit is, for example, a display device such as a liquid crystal display. The operation unit is, for example, an input device such as a touch panel, keyboard, mouse. Of course, it may be a user interface (including, for example, a touch-type display or a display that electronically displays a keyboard or the like) that serves both as a display unit and an operation unit.

The control unit 48 controls the operation of each unit of the terminal device 16 . The control unit 48 functions as display control means (control means), for example, and displays various information on the display unit of the UI unit 46 .

The display unit of the UI unit 46 displays, for example, an image captured by the camera 42, an image associated with a device identified as a device to be used (for example, a device to be used alone or a device to be linked), a function , etc. are displayed. The image associated with the device may be an image (still image or moving image) representing the device captured by the camera 42, or an image (for example, an icon) schematically representing the device. The data of the schematically represented image may be stored in the server 14 and provided to the terminal device 16 from the server 14, may be stored in advance in the terminal device 16, or may be stored in another device. may be provided to the terminal device 16 from the other device. An image associated with a function is, for example, an image such as an icon representing that function.

The device function management information 32 described above may be stored in the storage unit 44 of the terminal device 16 . In this case, the device function management information 32 does not have to be stored in the storage unit 30 of the server 14 . Similarly, the linking function management information 34 described above may be stored in the storage unit 44 of the terminal device 16 . In this case, the cooperation function management information 34 does not have to be stored in the storage unit 30 of the server 14 . The control unit 48 of the terminal device 16 has the identification unit 38 described above, and may identify the device based on the device identification information and identify the function of the device, or may identify the function of the device, or may identify the function of cooperation using a plurality of functions. may be specified. In this case, the server 14 may not have the identification unit 38 .

When usable function management information is created, the usable function management information may be stored in the storage unit 44 of the terminal device 16 . In this case, the usable function management information does not have to be stored in the storage unit 30 of the server 14 . The control unit 48 of the terminal device 16 may manage the history of function purchases made by the user. In this case, the control unit 36 of the server 14 may not have the management function. The control unit 48 of the terminal device 16 may identify functions that can be used by the user based on the user identification information.

As still another example, the devices such as the devices 10 and 12 may store the device function management information 32 and the cooperation function management information 34, and the devices such as the devices 10 and 12 may have the specifying unit 38. may That is, the processing (for example, device identification processing, function identification processing, cooperation function identification processing, etc.) by the identification unit 38 of the server 14 may be performed in the server 14 or may be performed in the terminal device 16. Alternatively, it may be performed in a device such as devices 10 and 12 .

In this embodiment, as an example, by applying AR (Augmented Reality) technology (augmented reality technology), device identification information is acquired and the device is identified. For example, by applying AR technology, the device identification information of a device that is used alone is acquired to identify the device, and the device identification information of a device to be linked is acquired to identify the device to be linked. be done. AR technology known as AR technology is used. For example, marker type AR technology using markers such as two-dimensional barcodes, markerless type AR technology using image recognition technology, location information AR technology using location information, and the like are used. Of course, the device identification information may be obtained to identify the device without applying the AR technology. For example, if the device is connected to a network, the device may be identified based on the IP address, or the device may be identified by reading the device ID. Furthermore, for devices and terminal devices equipped with various wireless communication functions such as infrared communication, visible light communication, Wi-Fi, and Bluetooth, by obtaining the device ID of the device that cooperates using these wireless communication functions may be identified and may perform coordination functions.

The device identification information acquisition process will be described in detail below with reference to FIG. As an example, a case of acquiring the device identification information of the image forming apparatus 10 will be described. FIG. 5 schematically shows the appearance of the image forming apparatus 10. As shown in FIG. Here, processing for acquiring device identification information by applying marker-type AR technology will be described. A housing of the image forming apparatus 10 is provided with a marker 50 such as a two-dimensional barcode. The marker 50 is information in which the device identification information of the image forming apparatus 10 is encoded. The user activates the camera 42 of the terminal device 16 and takes an image of the marker 50 provided on the image forming apparatus 10 to be used. Thereby, image data representing the marker 50 is generated. The image data is transmitted from the terminal device 16 to the server 14, for example. In the server 14, the control unit 36 extracts the device identification information by applying decoding processing to the marker image represented by the image data. As a result, the image forming apparatus 10 to be used (the image forming apparatus 10 having the photographed marker 50) is identified. The identification unit 38 of the server 14 identifies function information indicating functions associated with the extracted device identification information in the device function management information 32 . Accordingly, the function of the image forming apparatus 10 to be used is specified (identified).

Note that the device identification information may be extracted by the control unit 48 of the terminal device 16 applying decoding processing to the image data representing the marker 50 . In this case, the extracted device identification information is transmitted from the terminal device 16 to the server 14 . The specifying unit 38 of the server 14 specifies function information indicating a function associated with the device identification information transmitted from the terminal device 16 in the device function management information 32 . When the device function management information 32 is stored in the storage unit 44 of the terminal device 16, the control unit 48 of the terminal device 16 performs functions associated with the extracted device identification information in the device function management information 32. may be specified.

The marker 50 may include coded function information indicating the functions of the image forming apparatus 10 . In this case, by applying the decoding process to the image data representing the marker 50, the device identification information of the image forming apparatus 10 is extracted, and the function information indicating the functions of the image forming apparatus 10 is also extracted. As a result, the image forming apparatus 10 is specified (identified), and the functions of the image forming apparatus 10 are specified (identified). This decoding process may be performed by the server 14 or by the terminal device 16 .

When executing a linkage function that uses functions possessed by a plurality of devices, the device identification information of each device is acquired by photographing the marker of each device to be linked, and the linkage function is thereby specified (identified). .

When acquiring device identification information by applying markerless AR technology, for example, the user captures all or part of the appearance of the device to be used (for example, the image forming apparatus 10) with the camera 42 of the terminal device 16. FIG. Of course, it is useful to obtain information for specifying the device, such as the name of the device to be used (for example, product name), model number, and asset management number, by photographing the exterior of the device. By photographing, exterior image data representing all or part of the exterior of the device to be used is generated. The appearance image data is transmitted from the terminal device 16 to the server 14, for example. In the server 14, the control unit 36 identifies the equipment to be used based on the appearance image data. For example, the storage unit 30 of the server 14 stores, for each device, appearance image association information indicating correspondence between appearance image data representing all or part of the appearance of the equipment and device identification information of the equipment. It is For example, the control unit 36 compares the appearance image data transmitted from the terminal device 16 with each appearance image data included in the appearance image correspondence information, and based on the comparison result, determines the device identification information of the device to be used. identify. For example, the control unit 36 extracts the features of the appearance of the device to be used from the appearance image data transmitted from the terminal device 16, and extracts the features of the appearance of the device to be used in the appearance image data group included in the appearance image association information. Alternatively, external image data representing similar features is specified, and device identification information associated with the external image data is specified. As a result, the device to be used (the device photographed by the camera 42) is identified. As another example, when the name (for example, product name) and model number of a device are photographed and external image data representing the name and model number is generated, based on the name and model number represented in the external image data may be used to identify the device to be used. The specifying unit 38 of the server 14 specifies function information indicating each function associated with the specified device identification information in the device function management information 32 . Accordingly, the functions of the device to be used (for example, the image forming apparatus 10) are specified.

Note that the control unit 48 of the terminal device 16 compares appearance image data representing all or part of the appearance of the device to be used (for example, the image forming apparatus 10) with each appearance image data included in the appearance image association information. Then, based on the comparison result, the device identification information of the device to be used may be specified. The appearance image association information may be stored in the storage unit 44 of the terminal device 16 . In this case, the control unit 48 of the terminal device 16 identifies the device identification information of the device to be used by referring to the appearance image association information stored in the storage unit 44 of the terminal device 16 . As another example, the control unit 48 of the terminal device 16 acquires the appearance image association information from the server 14, and refers to the appearance image association information to specify the device identification information of the device to be used. good too.

When executing a linkage function that utilizes multiple functions possessed by a plurality of devices, the device identification information of each device is acquired by photographing all or part of the appearance of each device to be linked, and as a result, the linkage function is specified (identified).

When the device identification information is obtained by applying the location information AR technology, for example, the location information indicating the location where the device (for example, the image forming apparatus 10) is installed is obtained by using the GPS (Global Positioning System) function. is obtained. For example, each device has a GPS function and acquires device location information indicating the location of the device itself. The terminal device 16 outputs information indicating a device location information acquisition request to the device to be used, and receives the device location information of the device from the device as a response to the acquisition request. The device location information is transmitted from the terminal device 16 to the server 14, for example. In the server 14, the control unit 36 identifies the device to be used based on the device location information. For example, the storage unit 30 of the server 14 stores, for each device, location correspondence information indicating the correspondence between the device location information indicating the location where the device is installed and the device identification information of the device. there is The control unit 36 identifies the device identification information associated with the device location information transmitted from the terminal device 16 in the location association information. As a result, the device to be used is specified (identified). The specifying unit 38 of the server 14 specifies function information indicating each function associated with the specified device identification information in the device function management information 32 . Thereby, the function of the device to be used (for example, the image forming apparatus 10) is specified (identified).

Note that the control unit 48 of the terminal device 16 may specify the device identification information associated with the location information of the device to be used in the location association information. The location correspondence information may be stored in the storage unit 44 of the terminal device 16 . In this case, the control unit 48 of the terminal device 16 identifies the device identification information of the device to be used by referring to the location correspondence information stored in the storage unit 44 of the terminal device 16 . As another example, the control unit 48 of the terminal device 16 may acquire the location association information from the server 14 and refer to the location association information to identify the device identification information of the device to be used. .

When executing a linkage function using a plurality of devices, device location information of each device to be linked is acquired, and device identification information of each device is specified based on each device location information. Thereby, the cooperation function is specified (identified).

Note that a plurality of identification techniques may be used to identify the device. For example, a device may be identified using a plurality of technologies selected from marker-type AR technology, markerless-type AR technology, and location information AR technology. In addition, when a device cannot be identified by a certain identification technology, another identification technology may be used to identify the device. For example, if a device cannot be identified by marker-type AR technology or markerless-type AR technology, the device may be identified by using position information AR technology.

The image forming system according to this embodiment will be described in more detail below.

The device function management information 32 will be described in detail with reference to FIG. FIG. 6 shows an example of a device function management table as the device function management information 32. As shown in FIG. In the device function management table, for example, device IDs, information indicating device names (for example, device types), information indicating functions possessed by the devices (function information), and image IDs are associated with each other. there is The device ID and device name correspond to an example of device identification information. The image ID is an example of image identification information for identifying an image representing the device (for example, an image representing the appearance of the device, an image (eg, icon) schematically representing the device, etc.). Note that the image ID may not be included in the device function management table. For example, a device with a device ID of "B" is a multifunction device (an image forming apparatus having multiple image forming functions) and has functions such as a print function and a scan function. An image ID for identifying an image representing the device is associated with the device. The image data representing the device is stored in, for example, the storage unit 30 of the server 14 or another device.

For example, by applying AR technology, a device ID for identifying a device to be used is acquired. The specifying unit 38 of the server 14 specifies the device name, function, and image ID associated with the device ID by referring to the device function management table. As a result, the equipment to be used is identified. For example, information indicating the device name and image data representing the device are transmitted from the server 14 to the terminal device 16 and displayed on the UI section 46 of the terminal device 16 . An image representing a device is displayed as an image associated with the device. Of course, the image itself captured by the camera 42 may be displayed on the UI section 46 of the terminal device 16 . Further, when the user designates an image associated with a device (for example, an image captured by the camera 42 or an image that schematically represents the device) in the UI unit 46 of the terminal device 16, the function related to the device is specified. Information (for example, function information, function description information, etc.) may be transmitted from the server 14 to the terminal device 16 and displayed on the UI section 46 of the terminal device 16 .

The cooperation function management information 34 will be described in detail below with reference to FIG. FIG. 7 shows an example of a cooperation function management table as the cooperation function management information 34. As shown in FIG. In the linkage function management table, for example, a combination of device IDs, information indicating the linkage target device name (for example, the type of each device), and information indicating the linkage function (linkage function information) are associated with each other. ing. For example, a device with a device ID of "A" is a PC (personal computer), and a device with a device ID of "B" is a multifunction device. By linking the PC (A) and the MFP (B), for example, a "scan transfer function" and a "print function" are realized as linked functions. The "scan transfer function" is a function for transferring image data generated by scanning by the multifunction device (B) to the PC (A). The "print function" is a function of transmitting data (eg, image data and document data) stored in the PC (A) to the multifunction device (B) and printing the data on the multifunction device (B).

Processing when the device is used alone will be described below with reference to FIG. FIG. 8 shows an example of a device used alone. As an example, assume that the image forming apparatus 10 is a device that is used alone. The image forming apparatus 10 is, for example, a multifunction machine. The image forming apparatus 10 is a device existing in the physical space. The terminal device 16 shown in FIG. 8 is a device that exists in the real space, such as a mobile terminal device such as a smart phone or a mobile phone.

For example, a housing of the image forming apparatus 10 is provided with a marker 50 such as a two-dimensional barcode. When marker-type AR technology or marker-less AR technology is used, the user takes an image of the image forming apparatus 10 to be used with the camera 42 of the terminal device 16 (for example, a smartphone). As a result, image data representing the marker 50 or appearance image data representing the appearance of the image forming apparatus 10 is generated. A device display screen 52 is displayed on the display unit of the UI unit 46 of the terminal device 16 , and a device image 54 associated with the image forming apparatus 10 is displayed on the device display screen 52 . The equipment image 54 is, for example, an image generated by photographing with the camera 42 (it may be an image having the size at the time of photographing, or may be an enlarged or reduced image).

Image data generated by photographing by the camera 42 is transmitted from the terminal device 16 to the server 14 . In the server 14 , the control unit 36 applies decoding processing to the image data to extract the device identification information of the image forming apparatus 10 , thereby identifying the image forming apparatus 10 . As another example, appearance image data representing the appearance of the image forming apparatus 10 may be generated, and the appearance image data may be transmitted from the terminal device 16 to the server 14 . In this case, in the server 14, the control unit 36 identifies the device identification information of the image forming apparatus 10 by referring to the external image association information. Thereby, the image forming apparatus 10 is identified.

Further, the specifying unit 38 of the server 14 specifies (identifies) the functions of the image forming apparatus 10 by referring to the device function management information 32 (for example, the device function management table shown in FIG. 6). This point will be described in detail with reference to FIG. Assume that the image forming apparatus 10 is, for example, a "multifunction machine (B)". The identification unit 38 identifies the function associated with the multifunction device (B) in the device function management table shown in FIG. Thereby, the functions of the multifunction device (B) are specified. Information about the identified function is transmitted from the server 14 to the terminal device 16 . Of course, the terminal device 16 may perform the processing for identifying the device or function.

It should be noted that instead of the image generated by photographing by the camera 42, the device display screen 52 displays a prepared image associated with the identified image forming apparatus 10 (not the image itself obtained by photographing, but a schematic image). An image (for example, an icon)) or an image captured by an external camera may be displayed as the device image 54 .

For example, when using image data obtained by photographing a device, the current appearance of the device itself (for example, appearance reflecting scratches, notes, stickers pasted on the device, etc.) is reflected in the image. Therefore, there is an effect that the user can visually recognize the difference from other devices of the same type.

When using a schematic image, the data of the schematic image is transmitted from the server 14 to the terminal device 16, for example. For example, when the image forming apparatus 10 is identified, the specifying unit 38 of the server 14 refers to the device function management table (device function management information 32) shown in FIG. Identify a schematic image. Data of the schematic image is transmitted from the server 14 to the terminal device 16 , and the schematic image is displayed on the device display screen 52 as the device image 54 . Schematic image data may be stored in advance in the terminal device 16 . In this case, when the image forming apparatus 10 is identified, the device image 54 stored in the terminal device 16 is displayed on the device display screen 52 . Data of the schematic image may be stored in a device other than the server 14 or the terminal device 16 .

Further, when the device is identified, information indicating the name of the device may be transmitted from the server 14 to the terminal device 16 , and the name of the device may be displayed on the device display screen 52 of the terminal device 16 . In the example shown in FIG. 8, the image forming apparatus 10 is a multifunction machine, and its name "multifunction machine (B)" is displayed.

When the functions of the image forming apparatus 10 are specified, the control unit 48 of the terminal device 16 causes the UI unit 46 of the terminal device 16 to display a function display screen 56 as shown in FIG. 56 to display information about the function. As information about the function, for example, a button image for instructing execution of the function is displayed. Since the multifunction machine (B) as the image forming apparatus 10 has, for example, a print function, a scan function, a copy function, and a facsimile function, button images for instructing execution of these functions are displayed as functions. displayed on screen 56 . For example, when the user uses the terminal device 16 to specify a button image representing a print function and instructs execution of the print function, execution instruction information indicating an execution instruction for the print function is sent from the terminal device 16 to the image forming apparatus 10. sent. The execution instruction information includes control data for executing the print function, data such as image data to which the print function is applied, and the like. Upon receiving the execution instruction information, the image forming apparatus 10 executes printing according to the execution instruction information.

FIG. 10 shows another example of the function display screen. As shown in FIG. 8, this function display screen 58 is a screen displayed on the UI unit 46 of the terminal device 16 when using a single device. As described above, the device to be used (for example, the image forming apparatus 10) is specified, and the functions of the device to be used are specified. Further, function information indicating a function associated with the user identification information by the user who uses the device to be used, that is, a function that can be used by the user may be specified. Furthermore, since the functions possessed by the device to be used are specified, functions not possessed by the device to be used may be specified among the function group to be provided. These pieces of information may be displayed on the function display screen 58 .

On the function display screen 58 shown in FIG. 10, a button image 60 representing function A, a button image 62 representing function B, and a button image 64 representing function C are displayed as examples of function information. there is Function A is a function that the device to be used (for example, the identified image forming apparatus 10) has and that can be used by the user. Function B is a function that the device to be used has and cannot be used by the user. By receiving the provision of the function B to the user, the use of the function B by the user becomes possible. If the function B is a paid function, the user can purchase the function B to use the function B. If the function B is a free function, the user can receive the function B free of charge. , function B can be used. Function C is a function that the device to be used does not have, that is, a function that the device to be used does not support. The control unit 48 of the terminal device 16 may change the display mode of the button image depending on whether the function represented by the button image is a function of the device to be used. Further, the control unit 48 may change the display mode of the button image depending on whether the function represented by the button image is a function that can be used by the user. For example, the control unit 48 may change the color or shape of the button image. In the example shown in FIG. 10, button images 60, 62 and 64 are displayed in different colors. As an example, a button image representing a function that the target device has and that can be used by the user (for example, the button image 60 representing function A) is displayed in blue. A button image (the button image 62 representing function B) representing a function that the target device has and cannot be used by the user is displayed in yellow. A button image representing a function that the device to be used does not have (for example, the button image 64 representing function C) is displayed in gray. As another example, the control unit 48 may change the shapes of the button images 60, 62, 64, or may change the font of the function display name. Of course, you may change a display mode by another method. As a result, the availability of each function can be notified to the user with good visibility.

For example, when the user designates the button image 60 representing the function A using the terminal device 16 and gives an instruction to execute the function A, the execution instruction information indicating the execution instruction of the function A is sent from the terminal device 16 to the user. device. The execution instruction information includes control data for executing function A, data such as image data to which processing by function A is applied, and the like. When the device to be used receives the execution instruction information, it executes the function A according to the execution instruction information. For example, if the device to be used is the image forming apparatus 10 and the function A is the scan transfer function, the image forming unit 20 of the image forming apparatus 10 executes the scan function, thereby generating scan data (image data). generated. The scan data is transmitted from the image forming apparatus 10 to a set destination (for example, the terminal device 16).

Further, when the user uses the terminal device 16 to specify the button image 62 representing the function B and instructs to provide the function B, the providing process is executed. When the providing process is performed by the server 14 , the terminal device 16 accesses the server 14 . As a result, a screen (for example, a website) for receiving provision of the function B is displayed on the UI unit 46 of the terminal device 16 as information for enabling the user to use the function B. FIG. The function B can be used by the user by performing the providing procedure on this screen. For example, a web browser program is stored in the terminal device 16, and access from the terminal device 16 to the server 14 is realized by using the web browser. When the user accesses the server 14 using a web browser, a function providing screen (for example, website) is displayed on the UI unit 46 of the terminal device 16, and the function is provided via the website. Of course, the providing process may be performed by a server or the like other than the server 14 . As another example, the UI unit 46 of the terminal device 16 includes a usage permission request screen (for example, Web site) may be displayed. Permission to use function B is requested from the administrator or the like via this use permission request screen, and when the permission is obtained, use of function B by the user becomes possible.

Hereinafter, with reference to FIG. 11, the processing when the cooperation function is used will be described. FIG. 11 shows an example of devices to be linked. As an example, it is assumed that the image forming apparatus 10 and a projector as a device 12 (hereinafter sometimes referred to as a projector 12) are used as devices to be linked. The image forming apparatus 10, the projector 12, and the terminal device 16 are devices that exist in the physical space.

For example, the housing of the image forming apparatus 10 is provided with a marker 50 such as a two-dimensional barcode, and the housing of the projector 12 is provided with a marker 66 such as a two-dimensional barcode. The marker 66 is information in which the device identification information of the projector 12 is encoded. When marker-type AR technology or marker-less AR technology is used, the user captures images of the image forming apparatus 10 and the projector 12 to be linked with the camera 42 of the terminal device 16 (for example, a smartphone). In the example shown in FIG. 11 , the imaging area of the camera 42 includes both the image forming apparatus 10 and the projector 12 , and the image forming apparatus 10 and the projector 12 are photographed together. Thereby, image data representing each of the markers 50 and 66 is generated. A device display screen 68 is displayed on the display unit of the UI unit 46 of the terminal device 16, and a device image 70 associated with the image forming apparatus 10 and a device image 72 associated with the projector 12 are displayed on the device display screen 68. . The equipment images 70 and 72 are, for example, images generated by photographing with the camera 42 (they may be images having the size at the time of photographing, or may be enlarged or reduced images).

Image data generated by photographing by the camera 42 is transmitted from the terminal device 16 to the server 14 . In the server 14, the control unit 36 applies decoding processing to the image data to extract the device identification information of the image forming apparatus 10 and the device identification information of the projector 12. Identify. As another example, appearance image data representing appearances of the image forming apparatus 10 and the projector 12 may be generated and transmitted from the terminal device 16 to the server 14 . In this case, in the server 14, the controller 36 identifies the device identification information of the image forming apparatus 10 and the device identification information of the projector 12 by referring to the appearance image association information. Thereby, the image forming apparatus 10 and the projector 12 are identified.

Further, the specifying unit 38 of the server 14 identifies the functions of the image forming apparatus 10 and the functions of the projector 12 by referring to the cooperation function management information 34 (for example, the cooperation function management table shown in FIG. 7). Specify (identify) the linkage function to be used. This point will be described in detail with reference to FIG. Assume that the image forming apparatus 10 is, for example, a "multifunction machine (B)", and the projector 12 is, for example, a "projector (C)". The specifying unit 38 specifies the linking function associated with the combination of the MFP (B) and the projector (C) in the linking function management table shown in FIG. As a result, a linking function to be executed by linking the MFP (B) and the projector (C) is specified. Information about the specified cooperation function is transmitted from the server 14 to the terminal device 16 . Of course, the terminal device 16 may perform the processing for identifying the device and the cooperative function.

In addition, instead of the image generated by the image capturing by the camera 42, the device display screen 68 displays a prepared image (for example, a schematic image (for example, an icon)) associated with the identified image forming apparatus 10, An image captured by an external camera may be displayed as the device image 70 . Similarly, an image prepared in advance associated with the identified projector 12 or an image captured by an external camera may be displayed as the device image 72 . As described above, the schematic image data may be transmitted from the server 14 to the terminal device 16, may be stored in advance in the terminal device 16, or may be stored in another device. good too.

Further, when the device is identified, information indicating the name of the device may be transmitted from the server 14 to the terminal device 16 , and the name of the device may be displayed on the device display screen 68 of the terminal device 16 . In the example shown in FIG. 11, the name of the image forming apparatus 10 "MFP (B)" and the name of the projector 12 "Projector (C)" are displayed.

Note that even when a plurality of devices are photographed, the identifying unit 38 of the server 14 may refer to the device function management information 32 to identify the functions of each device. In the example shown in FIG. 11 , the identifying unit 38 may identify the functions of the image forming apparatus 10 and the functions of the projector 12 . Information regarding the identified functionality may be transmitted from server 14 to terminal device 16 .

When the cooperation function is specified, the control unit 48 of the terminal device 16 causes the UI unit 46 of the terminal device 16 to display a function display screen 74 as shown in FIG. Display information. As information about the linking function, for example, a button image for instructing execution of the linking function is displayed. By linking the multifunction device (B) and the projector (C), for example, a linking function of projecting an image generated by scanning by the multifunction device (B) using the projector (C), or an image projected by the projector (C). It becomes possible to execute a linking function of printing an image with the MFP (B). Button images for instructing the execution of these linked functions are displayed on the function display screen 74 . For example, when a user designates a button image using the terminal device 16 and instructs execution of a linked function, execution instruction information indicating an instruction to execute the linked function is sent from the terminal device 16 to the image forming apparatus 10 and the projector 12. sent. Upon receiving the execution instruction information, the image forming apparatus 10 and the projector 12 execute the cooperation function designated by the user.

A device to be coordinated may be specified by a user's operation. For example, by photographing the image forming apparatus 10 and the projector 12 with the camera 42, as shown in FIG. An attached device image 72 is displayed. Note that the image associated with the device may be an image captured by the camera 42, or an image prepared in advance (eg, a schematic image (eg, icon)) associated with the identified device. may When the user designates the device images 70 and 72 on the device display screen 68, the image forming apparatus 10 and the projector 12 are designated as devices to be linked. For example, when the user designates the equipment image 70 , the marker-type AR technique or the markerless-type AR technique is applied to the equipment image 70 , thereby specifying (identifying) the image forming apparatus 10 . Similarly, when the user designates the equipment image 72 , the marker-type AR technique or the markerless-type AR technique is applied to the equipment image 72 to identify (identify) the projector 12 . As a result, the cooperation function executed by the image forming apparatus 10 and the projector 12 is specified, and information about the cooperation function is displayed on the UI unit 46 of the terminal device 16 .

As another example, the device images 70 and 72 are specified by the user touching the device image 70 on the device display screen 68 and operating with a finger or the like (for example, tracing with a finger or the like) from the device image 70 to the device image 72 . , the image forming apparatus 10 and the projector 12 may be specified as devices to be linked. The order in which the device images 70 and 72 are touched and the direction in which the device images are traced may be reversed from the above example. Of course, screen contact means other than a finger, such as a pen for tracing the device display screen 68, may be used. By connecting the device image 70 and the device image 72 by the user, the device images 70 and 72 may be specified, and the image forming apparatus 10 and the projector 12 may be specified as devices to be linked. The user may specify the device images 70 and 72 by overlapping the device image 70 and the device image 72, and may specify the image forming apparatus 10 and the projector 12 as devices to be linked. You can specify the device to be linked by drawing a circle, or you can specify the device to be linked by specifying the device image linked to the device you want to link within a preset time. good. When canceling the cooperation, the user may specify the device to be canceled on the device display screen 68, or press the cancel cooperation button. If a device that is not to be linked is included in the image, the user may specify the device on the device display screen 68 to exclude the device from the group of devices to be linked. A device to be released may be designated by a preset operation such as placing a cross mark.

Each device to be linked may be photographed separately. For example, by dividing the photographing by the camera 42 into a plurality of times, each device to be linked is identified. When photographing by the camera 42 is divided into a plurality of times, the device identification information of the equipment identified in each photographing is stored in the storage unit of the server 14 or the terminal device 16 . For example, the image forming apparatus 10 is photographed while the image forming apparatus 10 is included in the photographing area of the camera 42 , and then the projector 12 is photographed while the projector 12 is included in the photographing area of the camera 42 . As a result, image data for the image forming apparatus 10 and image data for the projector 12 are generated, and the image forming apparatus 10 and the projector 12 are combined by applying the marker-type AR technique or the marker-less AR technique to each image data. A linking function that uses the specified (identified) functions of the image forming apparatus 10 and the projector 12 is specified (identified). For example, it is not necessarily the case that the devices to be linked are arranged close to each other and that both the image forming apparatus 10 and the projector 12 are included in the imaging area of the camera 42 . It may be possible to change the angle of the imaging area of the camera 42, or to enlarge or reduce the imaging area. A possible solution is to identify the device of the

As another example, a device to be linked may be preset as a basic linked device. For example, it is assumed that the image forming apparatus 10 is preset as a basic cooperation device. The device identification information of the basic cooperation device may be stored in advance in the server 14 or the storage unit of the terminal device 16 . The user may use the terminal device 16 to specify the basic cooperation device. When the basic cooperation device is set, the user uses the camera 42 of the terminal device 16 to photograph the cooperation target device other than the basic cooperation device. As a result, the device to be linked is specified (identified), and the linking function using the functions of the basic linking device and the shooting device is specified (identified).

Note that in the examples shown in FIGS. 11 and 12, the linking function is a function that uses a device as hardware, but the linking function is a function that uses a function realized by software (application). good too. For example, instead of a device image, a functional image (for example, an image such as an icon) associated with a function realized by software is displayed on the UI unit 46 of the terminal device 16, and a plurality of functional images are specified by the user. , a linked function that uses a plurality of functions associated with the plurality of functional images may be specified (identified). For example, a linked function may be specified by specifying a device image associated with a function displayed on a home screen of a smartphone or a desktop screen of a personal computer. Of course, the device image linked to the device as hardware and the functional image linked to the function realized by the software are displayed on the UI unit 46 of the terminal device 16, and the device image and the functional image are specified by the user. In this case, a linked function that uses a device linked to the device image and a function linked to the function image may be identified.

In the above example, marker-type AR technology or markerless-type AR technology is used, but location information AR technology may also be used. For example, the terminal device 16 has a GPS function, acquires terminal position information indicating the position of the terminal device 16 itself, and transmits the terminal position information to the server 14 . The control unit 36 of the server 14 refers to the position correspondence information indicating the correspondence between the device position information indicating the installation position of the device and the device identification information, and based on the position of the terminal device 16, a preset range Identifies each device arranged within the device as a cooperation candidate device. For example, it is assumed that a multifunction device, a PC, a printer, and a scanner are arranged within a preset range based on the position of the terminal device 16 . In this case, multi-function peripherals, PCs, printers, and scanners are specified as cooperation candidate devices. The device identification information of each cooperation candidate device is transmitted from the server 14 to the terminal device 16 and displayed on the UI section 46 of the terminal device 16 . As the device identification information, an image of the cooperation candidate device may be displayed, or a character string such as the device ID may be displayed. The user designates a cooperation target device from the group of cooperation candidate devices displayed on the UI section 46 . The device identification information of the cooperation target device specified by the user is transmitted from the terminal device 16 to the server 14, and the server 14 identifies the cooperation function based on the device identification information of the cooperation target device. Information about the cooperation function is displayed on the UI unit 46 of the terminal device 16 . Note that the identification processing of the cooperation candidate device and the identification processing of the cooperation function may be performed by the terminal device 16 .

It should be noted that if the equipment to be photographed cannot be identified even by applying AR technology or the like, the equipment image representing the equipment to be photographed does not have to be displayed on the equipment display screen. This improves the visibility of the identified device. For example, when an identified device and an unidentified device coexist and each of them is captured by the camera 42, the device image representing the unidentified device is hidden. As a result, the device image representing the identified device is displayed without being buried in the device image representing the unidentified device, thereby improving the visibility of the identified device. Also, a device image representing the identified device may be emphasized and displayed. For example, the device image representing the identified device may be displayed in a specific color, the edges of the device image may be emphasized, or the device image may be enlarged and displayed, The device image may be displayed three-dimensionally, or the device image may be vibrated and displayed. This improves the visibility of the identified device.

Processing when executing the functions of the device will be described below. As an example, processing when executing the cooperation function will be described. In this case, a connection request is transmitted from the terminal device 16 to the cooperation target device, and the terminal device 16 and the cooperation target device are connected. This connection processing will be described below with reference to FIG. FIG. 13 is a sequence diagram showing the processing.

First, the user uses the terminal device 16 to instruct activation of an application (program) for executing the device function. The control unit 48 of the terminal device 16 activates the application according to the instruction (S01). The application may be stored in advance in the storage unit 44 of the terminal device 16, or may be downloaded from the server 14 or the like.

Next, by applying the marker type AR technology, the markerless type AR technology, or the location information AR technology, the device to be linked is identified (S02). Of course, a device to be linked may be identified by technology other than AR technology. When applying the marker type AR technology or the markerless type AR technology, for example, the user takes an image of the cooperation target device with the camera 42 of the terminal device 16 . As an example, when the image forming apparatus 10 (multifunction machine (B)) and the projector 12 (projector (C)) are used as linked devices, the user takes an image of the image forming apparatus 10 and the projector 12 with the camera 42 . Device identification information for each of the image forming apparatus 10 and the projector 12 is acquired, and the image forming apparatus 10 and the projector 12 are identified as devices to be linked. When the positional information AR technology is applied, the positional information of each of the image forming apparatus 10 and the projector 12 is obtained, the device identification information of each of the image forming apparatus 10 and the projector 12 is specified based on the positional information, and the image is displayed. Forming device 10 and projector 12 are identified.

For example, when the user gives an instruction to display the linked function, linked functions that use the functions of the identified devices are identified. Information about the identified cooperation function is displayed on the UI unit 46 of the terminal device 16 (S03). The process of identifying the cooperative function may be performed by the server 14 or by the terminal device 16 .

Next, in the terminal device 16, when the cooperation function to be executed is specified by the user, the terminal device 16 sends a connection request to the cooperation target devices (for example, the image forming apparatus 10 and the projector 12) that execute the cooperation function. information is transmitted (S04). For example, when address information indicating the address of a device to be linked is stored in the server 14 , the terminal device 16 acquires the address information of the device to be linked from the server 14 . When the device identification information includes address information, the terminal device 16 may acquire each address information from the identification information of the device to be linked. As another example, the terminal device 16 may store address information of devices to be linked. Of course, the terminal device 16 may acquire the address information of the cooperation target device by another method. The terminal device 16 uses the address information of the devices to be linked (eg, the image forming device 10 and the projector 12) to transmit information indicating a connection request to the devices to be linked (eg, the image forming device 10 and the projector 12).

The image forming apparatus 10 and the projector 12 that have received the information indicating the connection request permit or do not permit the connection with the terminal device 16 (S05). For example, if the image forming apparatus 10 and the projector 12 correspond to devices for which connection is not permitted, or if the number of devices requesting connection exceeds the upper limit, connection is not permitted. Note that if the connection from the terminal device 16 is permitted, the change operation may be prohibited so that the setting information specific to the image forming apparatus 10 and the projector 12 is not changed from the terminal device 16 . For example, it may be prohibited to change the color parameters of the image forming apparatus 10 or the set time when transitioning to power saving. This improves the security of the device to be linked. As another example, when a device is linked, changing setting information may be restricted compared to when the device is used alone without being linked. For example, fewer setting items may be allowed to be changed than when the device is used alone. Also, browsing of personal information of other users such as operation history may be prohibited. This improves the security of the user's personal information.

Result information indicating whether or not the connection is permitted is transmitted from the image forming apparatus 10 and the projector 12 to the terminal device 16 (S06). When the connection to the image forming apparatus 10 and the projector 12 is permitted, communication is established between the terminal device 16 and the image forming apparatus 10 and the projector 12 .

Next, the user uses the terminal device 16 to instruct execution of the link function (S07). In response to this instruction, execution instruction information indicating an instruction to execute the cooperative function is transmitted from the terminal device 16 to the image forming apparatus 10 and the projector 12 (S08). The execution instruction information transmitted to the image forming apparatus 10 includes information (e.g., job information) indicating a process to be executed by the image forming apparatus 10 , and the execution instruction information transmitted to the projector 12 includes contains information (for example, job information) that indicates the process to be executed in .

The image forming apparatus 10 and the projector 12 that have received the execution instruction information execute the functions according to the execution instruction information (S09). For example, the image forming apparatus 10 and the image forming apparatus 10 may be included in the cooperative function, such as the function of transferring scan data from the image forming apparatus 10 (multifunction machine (B)) to the projector 12 (PC (A)) and projecting the data by the projector 12 . If a process of transmitting and receiving data to and from the projector 12 is included, communication is established between the image forming apparatus 10 and the projector 12 . In this case, for example, the execution instruction information transmitted to the image forming apparatus 10 includes address information of the projector 12, and the execution instruction information transmitted to the projector 12 includes address information of the image forming apparatus 10. Communication is established between the image forming apparatus 10 and the projector 12 using the address information.

When the execution of the cooperation function is completed, information indicating completion of execution of the cooperation function is transmitted from the image forming apparatus 10 and the projector 12 to the terminal device 16 (S10). Information indicating that the execution of the cooperation function has been completed is displayed on the UI unit 46 of the terminal device 16 (S11). If the information indicating the completion of execution is not displayed even after a preset time has passed since the execution instruction was given, the control unit 48 of the terminal device 16 causes the UI unit 46 to display information indicating an error, Execution instruction information or information indicating a connection request may be transmitted to the image forming apparatus 10 and the projector 12 again.

Next, the user confirms whether or not to cancel the cooperation state between the image forming apparatus 10 and the projector 12 (S12), and a process is executed according to the presence or absence of cancellation (S13). When canceling the linked state, the user uses the terminal device 16 to give a cancellation instruction. As a result, communication between the terminal device 16 and the image forming device 10 and projector 12 is released. Similarly, communication between image forming apparatus 10 and projector 12 is also canceled. If the cooperative state is not canceled, the execution instruction may be given continuously.

Also, the number of devices to be linked may be increased. For example, the device identification information of the third device may be acquired, and a linking function executed by linking three devices including the image forming apparatus 10 and the projector 12 may be specified. Information indicating that the image forming apparatus 10 and the projector 12 have already been identified as having a cooperative function is stored in the server 14 and the terminal device 16 .

The device identification information indicating the device to be linked and the linked function information indicating the linked function that has been executed may be stored in the terminal device 16, the server 14, or the like. For example, the user account information (user identification information) of the user who uses the terminal device 16 is acquired, and the user account information, the device identification information indicating the device to be linked, and the linkage function information indicating the executed linkage function. , may be created and stored in the terminal device 16, the server 14, or the like. The history information may be created by the terminal device 16 or may be created by the server 14 . By referring to the history information, it is possible to specify what kind of cooperation function was executed using what kind of device group.

Note that the devices to be linked (for example, the image forming apparatus 10 and the projector 12) may store the user account information of the user who requested the connection and the terminal identification information indicating the terminal device 16 that requested the connection as history information. good. By referring to this history information, the user who used the device is identified. For example, history information may be utilized to identify a user when identifying a user who was using the device when the device broke down, or when performing billing processing for consumables and the like. The history information may be stored in the server 14 or the terminal device 16, or may be stored in another device.

For example, the user account information is stored in advance in the storage unit 44 of the terminal device 16, and the control unit 48 of the terminal device 16 functions as an example of user identification means, and reads the user's user account information from the storage unit 44. , the user who uses the terminal device 16 is identified. When user account information of a plurality of users is stored in the storage unit 44, the user uses the terminal device 16 to specify his own user account information. Thereby, the user account information of the user is read and the user is identified. As another example, the control unit 48 of the terminal device 16 may identify the user by reading the user account information of the user logged into the terminal device 16 . As yet another example, if only one piece of user account information is stored in the same terminal device 16, the control unit 48 of the terminal device 16 may identify the user by reading the user account information. . If a user account has not been set and user account information has not been created, initial settings are performed, and user account information is created.

The usage history of the linked function may be managed for each user, and the information indicating the linked function used in the past by the user indicated by the read user account information may be displayed on the UI unit 46 of the terminal device 16 . Information indicating the usage history may be stored in the terminal device 16 or may be stored in the server 14 . Further, information indicating a link function that is used more frequently than a preset use frequency may be displayed. By providing such a shortcut function, it is possible to reduce the user's trouble of operating the cooperation function.

When a single function is executed, information indicating an instruction to execute the single function is transmitted from the terminal device 16 to the device that executes the single function. The device executes a single function according to the execution instruction.

<Second embodiment>
A device system according to the second embodiment will be described below. The equipment system according to the second embodiment has the same configuration as the equipment system according to the first embodiment. In the second embodiment, when the use of a device is permitted, that is, when the authentication of the user or the terminal device 16 to the device is successful, the cooperative function and the independent function that can be executed using the device can be used. It becomes possible. The determination of permission to use it (that is, authentication processing for the user or the terminal device 16) may be performed by the device, by the server 14, or by another device such as an authentication server. good. The second embodiment will be described in detail below.

The device display screen 68 is shown in FIG. For example, a multifunction device (B), a projector (C), a camera (D), and a hair dryer (E) are identified as devices, and the device display screen 68 displays the identified devices (the multifunction device (B), the projector (C ), the camera (D) and the dryer (E)) are displayed. Note that the foliage plant (F) represented by the image 80 is not identified as a device. The device identification processing is the same as the identification processing (for example, the identification processing using AR technology) according to the first embodiment. Further, the device image may be an image representing the device obtained by photographing, or may be an image (such as an icon) that schematically represents the device.

When the device is identified as described above, the control unit 48 of the terminal device 16 causes the UI unit 46 to display a device selection screen. FIG. 15 shows the device selection screen 82 . The device selection screen 82 is a screen for selecting a device that the user wants to connect (that is, a device that the user wants to use) from one or more identified devices. In the example shown in FIG. 14, the MFP (B), the projector (C), the camera (D), and the dryer (E) are identified as devices, so information indicating them (for example, device images, device names, etc.) ) is displayed on the device selection screen 82 . The user selects the device to be connected on the device selection screen 82 . The device selection screen 82 corresponds to an example of a screen on which candidates for use-requested devices are displayed, and the devices displayed on the device selection screen 82 correspond to candidates for use-requested devices. In the example shown in FIG. 15, a check box is displayed for each device, and the device to be connected is selected by the user specifying the check box. In the example shown in FIG. 15, the multi-function device (B) and the camera (D) are selected by the user, and the multi-function device (B) and the camera (D) correspond to devices to be used (connected).

When a device to be connected is selected by the user, the terminal device 16 uses the address information of the selected device to transmit information indicating a usage permission request to the selected device. The use permission request can also be called an authentication request or a connection request. The device that receives the use permission request permits the use by the user who requested the connection (that is, permits the connection with the terminal device 16) or does not permit the use by the user that requested the connection (that is, the terminal device 16). connection). For example, the information indicating the usage permission request includes user identification information (including, for example, user account information, user ID, etc.) for identifying the user who requested the connection. The presence or absence of usage permission is determined by performing authentication processing using the user identification information. For example, when the user identification information of the user who requested the connection is registered in the device that received the connection request, the authentication succeeds and the user is permitted to use the device. When the use of the device is permitted, communication is established between the device and the terminal device 16, and the device and the terminal device 16 are connected. If the user identification information of the user who requested the connection is not registered in the device that receives the connection request, the authentication fails, and use of the device by that user is not permitted (prohibited). In this case, communication is not established between the device and the terminal device 16, and the device and the terminal device 16 are not connected.

As another example, the information indicating the usage permission request includes terminal identification information for identifying the terminal device 16 that has transmitted the connection request, and the device receiving the connection request uses the terminal identification information. The presence or absence of permission for use may be determined by performing authentication processing with the user. For example, when the terminal identification information of the terminal device 16 that sent the connection request is registered in the device that received the connection request, the authentication succeeds and the use of the device by that terminal device 16 is permitted. If the terminal identification information of the terminal device 16 that sent the connection request is not registered in the device that received the connection request, the authentication fails and the use of the device by that terminal device 16 is not permitted (prohibited).

Result information indicating permission or non-permission of use is transmitted from the device to be connected to the terminal device 16 .

In the example shown in FIG. 15, information indicating a use permission request is transmitted to the multifunction device (B) and the camera (D), and the presence or absence of use permission is determined in each of the multifunction device (B) and the camera (D). Result information is transmitted to the terminal device 16 from each of the multifunction device (B) and the camera (D).

Further, when a device to be connected is specified by the user, the specifying unit 38 of the server 14 specifies (identifies) functions that can be executed using the device to be connected, as in the first embodiment. For example, when a user selects a plurality of devices as devices to be connected, the specifying unit 38 of the server 14 refers to the link function management information 34 (for example, the link function management table shown in FIG. 7). , specify (identify) a cooperative function that can be executed by using the plurality of devices. In the example shown in FIG. 15, the multifunction device (B) and the camera (D) are selected by the user, so the cooperative functions executable by using the multifunction device (B) and the camera (D) are specified. Further, when one device is specified by the user as a device to be connected, the specifying unit 38 of the server 14 refers to the device function management information 32 (for example, the device function management table shown in FIG. 6). , specifies (identifies) the function (single function) that the device has. Information indicating the linked function or information indicating the independent function is transmitted from the server 14 to the terminal device 16 .

When the use of the device is permitted by the authentication process described above, the control unit 48 of the terminal device 16 causes the UI unit 46 to display information indicating functions executable by using the device. For example, when the use of the multifunction device (B) and the camera (D) is permitted, the control unit 48 of the terminal device 16 selects a cooperative function that can be executed by using the multifunction device (B) and the camera (D). The information shown is displayed on the UI unit 46 . For example, the control unit 48 of the terminal device 16 causes the UI unit 46 to display a function display screen 84 as shown in FIG. The function display screen 84 displays information indicating cooperative functions that can be executed by using the multifunction device (B) and the camera (D). When the user gives an execution instruction of the linked function, the linked function is executed by the multifunction device (B) and the camera (D). Further, when the communication between the device for executing the cooperation function and the terminal device 16 is cut off and the connection between the device and the terminal device 16 is canceled, the control unit 48 of the terminal device 16 displays the function display screen 84 is deleted from the UI section 46 . In this case, it becomes impossible to give an instruction to execute the cooperation function.

When the use of the device is not permitted by the authentication process described above, the control unit 48 of the terminal device 16 causes the UI unit 46 to display information to that effect. At this time, the control unit 48 causes the UI unit 46 to display the information indicating the devices whose use is permitted and the information indicating the devices whose use is not permitted, separately. For example, when the use of the multifunction device (B) is permitted but the use of the camera (D) is not permitted, the information indicating that the use of the multifunction device (B) is permitted and the use of the camera (D) are permitted. Information indicating that the permission has not been granted is displayed on the UI section 46 . At this time, information indicating independent functions that can be executed using the multifunction device (B) may be displayed on the UI section 46 .

Also, when one device is selected by the user on the device selection screen 82 and the use of that device is permitted, the independent functions of that device are displayed on the UI section 46 .

The authentication process described above may be performed by the server 14 . In this case, device identification information indicating the device to be connected selected by the user and information indicating the usage permission request are transmitted from the terminal device 16 to the server 14. Using the information, it is determined whether or not the device indicated by the device identification information is permitted to be used. For example, the users and terminal devices 16 that can be used are registered in advance for each device, and the control unit 36 of the server 14 determines whether or not use is permitted by referring to the registration information. If the user who requested the connection or the terminal device 16 is registered as an available user or terminal device for the device to be connected, use of the device is permitted. If the user requesting connection or the terminal device 16 is not registered as a user or terminal device that can use the device to be connected, use of the device is not permitted (prohibited).

The terminal device 16 may perform the process of identifying the linked function or the independent function.

Although two devices are selected in the example shown in FIG. 15, the same process is performed when three or more devices are selected. When three or more devices are selected and the use of two or more devices is permitted, the information indicating the cooperative function that can be executed by using the two or more permitted devices is displayed on the terminal. It is displayed on the UI unit 46 of the device 16 . In this way, the cooperation function changes according to the number and type of devices permitted to use. Further, when the use of one device is permitted, information indicating the single function of the one device whose use is permitted is displayed on the UI section 46 of the terminal device 16 .

The above processing according to the second embodiment may be applied to functions realized by software. In other words, authentication processing is performed for software selected by the user as software to be used, and if the authentication succeeds and the use of the software is permitted, the linked function or independent function that can be executed by using the software. may be displayed. As a screen for selecting software, a screen similar to the screen shown in FIG. 15 is displayed, and candidates for software to be used are displayed on the screen. For example, a plurality of candidates are selected from a plurality of pieces of software installed in the terminal device and displayed on the screen based on usage history, user's preferences, and the like. Of course, all installed software may be displayed. A plurality of software is selected by the user on the screen. For example, when a plurality of pieces of software are selected by the user and use of the plurality of pieces of software is permitted, information indicating cooperative functions executable by using the plurality of pieces of software is displayed on the UI unit 46 of the terminal device 16. be. Also, when one piece of software is selected by the user and the use of the piece of software is permitted, the functions realized by the piece of software are displayed on the UI unit 46 of the terminal device 16 . Further, the above process according to the second embodiment may be applied to a cooperative function that can be executed by combining a device as hardware and a function realized by software. That is, when the use of both the target device and the software is permitted, the UI section 46 of the terminal device 16 displays information indicating the cooperative functions that can be executed using the device and the software.

As described above, according to the second embodiment, when an image associated with a candidate device to be connected is displayed, a plurality of devices are selected by the user from the candidates, and use of the plurality of devices is permitted. , information indicating cooperative functions that can be executed using the plurality of devices is displayed. By doing so, the user is provided with information on available linkage functions.

Also, a time limit may be set for the authentication process. For example, when the use of a plurality of devices is permitted within a predetermined period of time, the control unit 48 of the terminal device 16 sends information indicating cooperative functions that can be executed using the plurality of devices to the UI unit 46. display. Also, when the use of one device is permitted within a predetermined time, the control unit 48 of the terminal device 16 causes the UI unit 46 to display information indicating the single function of the one device.

Note that when the MFP (B) and the camera (D) are selected as devices to be connected as shown in FIG. 15, the MFP (B) and the camera (D) can be used in the linked function management table. , the identifying unit 38 of the server 14 determines that there is no cooperative function that can be executed by using the MFP (B) and the camera (D). In this case, the control unit 36 of the server 14 outputs a message indicating that the cooperative function cannot be executed by the MFP (B) and the camera (D). This message is displayed on the UI section 46 of the terminal device 16 . Even in such a case, it may be possible to use the cooperation function depending on the operation status of the device, the environment in which the device is installed (surrounding environment), changes (updates) in the function of the device, and the like. For example, when the multifunction device (B) and the hair dryer (E) are selected as devices to be connected, initially there is no cooperative function executable by the multifunction device (B) and the hair dryer (E). Also, when dew condensation occurs in the environment where the multi-function device (B) is installed, the dew condensation can be removed or prevented by the dryer (E). In this case, since it is possible to use the cooperative function that can be executed by using the multifunction device (B) and the hair dryer (E), information indicating the cooperative function is displayed on the UI unit 46 of the terminal device 16. good too. For example, the control unit 36 of the server 14 monitors the operation status of each device, the environment in which each device is set (surrounding environment), the update status of the functions of each device, etc. Based on the monitoring results, , may determine whether the linkage function is available or not. Taking the combination of the MFP (B) and the dryer (E) as an example, the control unit 36 controls the MFP (B ), it is determined that the cooperative function can be used, and the cooperative function using the dryer (E) is specified (identified). The same applies to the operating status of the devices, and when the identified or specified device group corresponds to a specific operating status, the control unit 36 determines that the cooperation function using the device group can be used. The same is true when the function of the device is updated and the function after the update enables the use of the linked function.

Related processing will be described below.

(Related process 1: Display switching process for information about linkage function)
Related processing 1 will be described below. In the second embodiment, the display of the information regarding the cooperation function may be switched according to the order of selection of the plurality of devices. This processing will be described in detail below with reference to FIGS. 17 to 19. FIG.

FIG. 17 shows a cooperation function management table as another example of the cooperation function management information 34. As shown in FIG. In this cooperation function management table, as an example, information indicating a combination of device IDs, information indicating the name of a device to be cooperated (for example, the type of each device), information indicating a cooperation function (linkage function information), connection Information indicating the order is associated with information indicating the order of priority. The device ID and device name correspond to an example of device identification information. The order of connection corresponds to the order of device selection. For example, when the user selects a plurality of devices in order on the device selection screen 82 shown in FIG. 15, the order of selection corresponds to the order of connection. The priority is the display priority of the information about the cooperation function. For example, a device with a device ID of "A" is a PC (personal computer), and a device with a device ID of "B" is a multifunction device. By linking the PC (A) and the MFP (B), for example, a "scan transfer function" and a "printing function" are realized as linked functions. The "scan transfer function" is a function for transferring image data generated by scanning by the multifunction device (B) to the PC (A). The "printing function" is a function of transmitting data (for example, image data and document data) stored in the PC (A) to the multifunction device (B) and printing the data on the multifunction device (B). For example, when a device is connected from the multifunction device (B) to the PC (A), that is, when each device is selected by the user in the order of the multifunction device (B) and the PC (A), the "scan transfer function" The priority of "printing function" is "first", and the priority of "printing function" is "second". In this case, the information regarding the "scan transfer function" is preferentially displayed over the information regarding the "printing function". Conversely, when devices are connected from PC (A) to MFP (B), in other words, when each device is selected by the user in the order of PC (A) and MFP (B), " The priority of the "printing function" is set to "1st", and the priority of the "scan transfer function" is set to "2nd". In this case, the information regarding the "printing function" is preferentially displayed over the information regarding the "scan transfer function".

FIG. 18 shows an example of a screen displayed on the UI unit 46 of the terminal device 16. As shown in FIG. For example, it is assumed that the multifunction device (B) and the PC (A) are identified and selected by the user as devices to be connected, and the use of the multifunction device (B) and the PC (A) is permitted. For example, in the device selection screen 82 shown in FIG. 15, when the user selects each device in the order of the multifunction device (B) and the PC (A), the order of selection is specified as the connection order. Information indicating the connection order of the devices is transmitted from the terminal device 16 to the server 14 .

When the devices to be linked (for example, the multifunction device (B) and the PC (A)) are designated and permitted to be used as described above, the specifying unit 38 of the server 14 performs the linked function management shown in FIG. In the table, the cooperation function associated with the combination of PC (A) and MFP (B) is identified. As a result, a linking function to be executed by linking the PC (A) and the MFP (B) is specified. Further, when the connection order of the devices is specified by the user, the specifying unit 38 specifies the priority associated with the connection order in the cooperation function management table. A specific example will be described with reference to FIG. 17. Since the PC (A) and the MFP (B) are specified as devices to be linked, the linked function executed by them is called the "scan transfer function." It is a "print function". Also, since the device is connected from the MFP (B) to the PC (A) (B → A), the priority of the "scan transfer function" is "first", and the priority of the "print function" is It is "second place".

The information about the linked function specified as described above and the information indicating the priority order are transmitted from the server 14 to the terminal device 16 . The control unit 48 of the terminal device 16 causes the UI unit 46 to display the information about the cooperation function as information about the candidate cooperation function according to the priority.

For example, as shown in FIG. 18, the control unit 48 of the terminal device 16 causes the UI unit 46 to display a function display screen 86, and causes the function display screen 86 to display information about the cooperation function candidate. Since the priority of "scan forwarding function" is "1st" and the priority of "printing function" is "2nd", the information related to "scan forwarding function" has priority over the information related to "printing function". (for example, at the top). For example, as information about the "scan transfer function", a description of the "scan transfer function" is displayed, which reads "transfer data scanned by the multifunction device (B) to the PC (A)." Also, as information about the "printing function", an explanation of the "printing function" is displayed, which reads "print data in PC (A)."

When a user designates a cooperative function and gives an execution instruction, the designated cooperative function is executed. For example, when the "YES" button is pressed by the user, the cooperation function associated with the "YES" button is executed. Also, a "return" button is displayed on the function display screen 86, and when the user presses the "return" button, the device connection processing is stopped.

Note that the identification processing of the cooperation function and the identification processing of the priority order may be performed by the terminal device 16 .

FIG. 19 shows an example of another operation. For example, in the device selection screen 82 shown in FIG. 15, if the user selects each device in the order of PC (A) and multi-function device (B), the order of selection is specified as the connection order. Information indicating the connection order of the devices is transmitted from the terminal device 16 to the server 14 . Referring to the linked function management table shown in FIG. 17, the priority of "printing function" is "first", and the priority of "scan transfer function" is "second". In this case, as shown in FIG. 19, in the function display screen 88, the information regarding the "printing function" is preferentially displayed (for example, higher) than the information regarding the "scan transfer function".

As described above, the display order of the information related to the cooperation function is changed according to the order of selection of the devices. The order in which devices are connected also serves as the order of functions used by each device and the order in which data is transferred between linked devices. It will also serve as an operation to do. Therefore, by changing the display order of the information on the link function according to the connection order, the information on the link function that is expected to be used by the user is preferentially displayed. In other words, information relating to the link function that is likely to be used by the user is preferentially displayed. For example, if each device is selected in the order of multifunction device (B) and PC (A), the function of multifunction device (B) is used before PC (A), and the function of multifunction device (B) is used from PC (B). It is expected that users will use the cooperation function "transfer data to (A)". In addition, when each device is selected in the order of PC (A) and multifunction device (B), the function of PC (A) is used before multifunction device (B), and the function of multifunction device is used from PC (A) It is expected that users will use the cooperation function "transfer data to (B)". Therefore, by changing the display order of the information about the link function according to the order of selecting the devices, the information about the link function that is likely to be used by the user is preferentially displayed.

The display switching process described above may be applied to functions realized by software. For example, on the function selection screen, according to the selection order of the first function realized by the first software and the second function realized by the second software (that is, according to the selection order of the first software and the second software) ), the display of information about the link function is switched. Further, the display switching process described above may be applied to a cooperative function that can be executed by combining a device as hardware and a function realized by software.

Although two devices are selected in the examples shown in FIGS. 17 to 19, if three or more devices are selected, the display of the cooperation function is switched according to the order of selection.

(Related process 2: Linked process using device part)
Related processing 2 will be described below. A different function may be assigned to each position in the device image associated with the device. When a position within the device image is designated by the user, information regarding the cooperative function using the function corresponding to the position designated by the user is displayed. This processing will be described in detail below.

FIG. 20 shows an example of the device function management table. Data of this device function management table is stored in the server 14 as device function management information 32 . In this device function management table, as an example, the device ID, information indicating the device name (for example, the type of device), information indicating the position within the device image, and information indicating the function corresponding to the position within the device image ( function information) and an image ID are associated with each other. The position within the device image is a specific position (specific part) within the device image that is associated with the device. is a specific position of A different function is associated with each specific position in the device image.

FIG. 21 shows an example of a device display screen 68 displayed on the UI section 46 of the terminal device 16. As shown in FIG. For example, the multifunction device (B) and the PC (A) are identified, and device images 70 and 90 are displayed on the device display screen 68 thereof. Also, the portions included in the multifunction machine (B) and the PC (A) are identified. Part identification is also realized by using the identification technology (for example, AR technology) according to the first embodiment. For example, each part is identified by photographing each part of the device and applying markerless AR technology.

A device image 90 is an image associated with PC (A). For example, a "print function" is assigned to a specific position (partial image 70a) in the device image 70 corresponding to the main body portion of the multifunction machine (B). A "scan function" is assigned to a specific position (partial image 70b) corresponding to the document cover, the document glass, and the automatic document feeder of the multifunction machine (B) in the device image 70 . A "stapling function" is assigned to a specific position (partial image 70c) corresponding to the post-processing device in the equipment image 70. FIG. The "stapling function" is a function of stapling output sheets. Further, in the device image 90, a specific position (partial image 90a) corresponding to the body portion of the PC (A) is assigned a "data storage function". A "screen display function" is assigned to a specific position (partial image 90b) corresponding to the display section of the PC (A) in the device image 90. FIG. A "data storage function" is a function for storing data sent from another device in the PC (A). The "screen display function" is a function for displaying data sent from another device on the PC (A).

Note that the control unit 48 of the terminal device 16 may cause the device display screen 68 to display the name of the function (for example, print, scan, etc.) assigned to a specific position in the device image. This provides the user with information that makes it easy to understand what function corresponds to a specific position. Of course, the name of the function does not have to be displayed.

When the device and each part are identified as described above, the control unit 48 of the terminal device 16 causes the UI unit 46 to display a device selection screen. FIG. 22 shows the device selection screen 82 . In the example shown in FIG. 15 described above, information indicating the device (information indicating the entire device) is displayed on the device selection screen 82. In the example shown in FIG. is displayed on the device selection screen 82 . In the example shown in FIG. 21, the multifunction device (B) and the PC (A) are identified, and furthermore, each part thereof is identified, so that the entire multifunction device (B), the entire PC (A), and the multifunction device (B) are identified. Information indicating each part of the machine (B) and each part of the PC (A) (for example, the device image, the partial image of the device, the name, etc.) is displayed on the device selection screen 82 .

The user selects a connected device or part on the device selection screen 82 . The device or part selected here corresponds to the device or part to be connected. In the example shown in FIG. 22, the main body of the multifunction device (B) and the main body of the PC (A) are selected by the user. The main body of the machine (B) and the main body of the PC (A) correspond to the part for which the use is requested. In this case, if the authentication of the multifunction device (B) and the PC (A) is successful, the use of the multifunction device (B) and the PC (A) is permitted.

On the other hand, the specifying unit 38 of the server 14 specifies, for example, in the link function management table shown in FIG. 7, a link function that can be executed by using the PC (A) and the multifunction device (B). The identifying unit 38 also refers to the device function management table shown in FIG. 20 to identify the function assigned to the portion (position) specified by the user. Then, the specifying unit 38 selects the body of the PC (A) and the multifunction device (B) selected by the user from among the group of cooperative functions that can be executed by using the PC (A) and the multifunction device (B). By using the main body, the priority of executable linked functions is raised, and the priority of linked functions that do not use them is lowered.

The information about the linked function specified as described above and the information indicating the priority order are transmitted from the server 14 to the terminal device 16 . Then, when the use of the MFP (B) and the PC (A) is permitted, the control unit 48 of the terminal device 16 causes the UI unit 46 to display information about the cooperation function according to the order of priority. In the above example, the information indicating the cooperative function that can be executed by using the main body of PC (A) and the main body of MFP (B) is preferentially displayed (for example, at the top).

As another example, authentication may be performed on portions selected by the user. In the above example, the main body of multifunction device (B) and the main body of PC (A) are authenticated. may be allowed. In this case, the control unit 48 of the terminal device 16 causes the UI unit 46 to display information indicating cooperative functions that can be executed by using the main body of the multifunction device (B) and the main body of the PC (A). The authentication process described above may be performed by each device, or may be performed by the server 14 .

Note that the linking function may be a function that uses a combination of parts of the same device or different devices, or a function that uses a combination of the entire device and parts of the device. It may be a function that utilizes a combination of all devices.

Also, by combining the related processes 1 and 2, the display of the information related to the cooperation function may be switched according to the order of selection of the device or part.

Further, when only one device or one part is selected by the user or permitted to be used, information indicating a single function that can be executed by the one device or one part is displayed in the UI section of the terminal device 16. 46.

According to the cooperative processing using the parts of the device as described above, when the device has a plurality of functions, the device can be specified individually.

(Related process 3: another example of cooperative process using device parts)
Another example of cooperative processing using partial images will be described below as related processing 3 with reference to FIGS. 23 and 24 .

FIG. 23 shows an example of the device function management table. Data of this device function management table is stored in the server 14 as device function management information 32 . In the device function management table, for example, a device ID, information indicating a device name (for example, the type of device), information indicating the name of a part of the device (for example, the type of the part), and information for identifying the part. A partial ID as partial identification information, information indicating a function assigned to the part (function possessed by the part), and a partial image ID for identifying a partial image associated with the part are associated with each other. It is A partial image is an image representing the appearance of a portion of the device obtained by photographing with a camera. Of course, a partial image that schematically represents a part of the device may be associated with the part. For example, different functions are assigned to different parts of the equipment.

To give a specific example, the screen display function is assigned to the display unit of PC (A), and information indicating the screen display function is associated with the partial image ID of the partial image linked to the display unit. It is The screen display function is a function of displaying information on the PC (A). A data storage function is assigned to the main body of PC (A), and information indicating the data storage function is associated with the partial image ID of the partial image associated with the main body. The data saving function is a function for saving data in the PC (A).

A print function is assigned to the main body of the MFP (B), and information indicating the print function is associated with the partial image ID of the partial image associated with the main body. A scanning function is assigned to the reading unit of the multifunction device (B) (for example, the portion corresponding to the document cover, the manuscript glass, and the automatic document feeder of the multifunction device (B)), and the portion linked to the reading unit Information indicating the scanning function is associated with the partial image ID of the image. A stapling function is assigned to the post-processing device of the MFP (B), and information indicating the stapling function is associated with the partial image ID of the partial image associated with the post-processing device. The stapling function is a function of binding output sheets by stapling.

The functions assigned to the pieces of equipment are identified (identified), for example, by using markerless AR techniques. For example, when a portion of the equipment is captured by a camera (for example, the camera 42 of the terminal device 16), appearance image data representing that portion is transmitted from the terminal device 16 to the server 14. FIG. The specifying unit 38 of the server 14 specifies (identifies) the function associated with the appearance image data in the device function management table. Thereby, the function assigned to the photographed portion is specified (identified). For example, when the camera 42 captures an image of the main body of the multifunction device (B), external image data representing the main body of the multifunction device (B) is transmitted from the terminal device 16 to the server 14 . The specifying unit 38 of the server 14 specifies the print function associated with the appearance image data in the device function management table. As a result, it is specified that the function assigned to the main body of the MFP (B) is the print function.

Of course, the functions assigned to parts of the equipment may be identified (identified) by using marker-based AR techniques. For example, each part of the device is provided with a marker such as a two-dimensional bar code in which part identification information (for example, part ID) for identifying the part is coded. When a marker provided on a part is photographed by a camera and the marker-type AR technology is applied, the part identification information (for example, part ID) of that part is obtained. Application of the marker-type AR technology may be performed by the terminal device 16 or may be performed by the server 14 . When the partial identification information is acquired in this way, the identification unit 38 of the server 14 identifies (identifies) the function associated with the partial identification information (eg, partial ID) in the device function management table.

FIG. 24 shows an example of the cooperation function management table. The data of this linkage function management table is stored in the server 14 as linkage function management information 34 . This linked function management table is information indicating linked functions that utilize functions possessed by a plurality of parts. information indicating a linking function that uses functions of a plurality of parts included in the combination are associated with each other. Of course, in the linked function management table, there are information indicating a combination of a part of the device and the whole device, and information indicating a linked function that uses the function of the part of the device and the function of the whole device. may be associated with each other.

To give a specific example, the combination of the display unit of the PC (A) and the main unit of the MFP (B) is assigned a print function as a cooperative function, and the display unit of the PC (A) Information indicating the combination of the partial ID and the partial ID of the main body of the multi-function device (B) is associated with information indicating the print function as the cooperative function. The print function as a cooperative function is, for example, a function of transmitting data saved in the PC (A) to the multifunction device (B) and printing the data by the multifunction device (B).

A print function as a linked function is assigned to the combination of the main unit of the multifunction device (B) and the main unit of the projector (C). Information indicating the combination with the partial ID of the main body in C) is associated with information indicating the print function as the cooperative function. The print function as the cooperative function is, for example, a function of transmitting data projected by the projector (C) to the multifunction device (B) and printing the data by the multifunction device (B).

A scanning projection function as a cooperative function is assigned to the combination of the reading unit of the multifunction device (B) and the main unit of the projector (C). Information indicating the combination with the partial ID of the main body in (C) is associated with information indicating the scan projection function as the cooperative function. The scan projection function as the cooperative function is, for example, a function of transmitting data generated by scanning by the multifunction device (B) to the projector (C) and projecting the data by the projector (C).

Note that the linking function may be a function that uses functions possessed by a plurality of parts included in the same device, or a function that utilizes functions possessed by a plurality of different parts of the device. Also, the linking function may be a function that utilizes functions of three or more parts.

For example, when multiple parts of a device (for example, multiple parts of multiple different devices or multiple parts of the same device) are specified (identified) using marker-type AR technology or markerless-type AR technology , the specifying unit 38 of the server 14 specifies (identifies) the link function associated with the identified combination of the plurality of parts in the link function management table. As a result, a linking function that uses the functions of the identified (for example, photographed) portions is specified (identified). For example, the main body of the multifunction machine (B) and the main body of the projector (C) are photographed by the camera 42 of the terminal device 16, and the main body of the multifunction machine (B) and the main body of the projector (C) are identified. In this case, the specifying unit 38 of the server 14 specifies, in the linked function management table, the print function or the like as the linked function associated with the combination of the main body of the MFP (B) and the main body of the projector (C). do.

In the process using FIGS. 23 and 24 as well, when a device or part is identified, a device selection screen 82 is displayed on the UI unit 46 of the terminal device 16 as shown in FIG. When a device or part is selected by the user on the device selection screen 82 and the use of the selected device or part is permitted, information indicating a cooperative function that can be executed by using the selected device or part is displayed. , is displayed on the UI unit 46 of the terminal device 16 .

<Third Embodiment>
A device system according to the third embodiment will be described below. The equipment system according to the third embodiment has the same configuration as the equipment system according to the first embodiment. In the third embodiment, as in the second embodiment, when the use of the device is permitted, that is, when the authentication of the user or the terminal device 16 to the device is successful, the device can be used to execute It is possible to use the linked function and the independent function. The determination of permission to use it (that is, authentication processing for the user or the terminal device 16) may be performed by the device, by the server 14, or by another device such as an authentication server. good. In the third embodiment, close proximity wireless communication is used, for example, to perform communication between the terminal device 16 and each device to identify the device and authenticate the user and the terminal device 16 . The third embodiment will be described in detail below.

The instrument is shown in FIG. A PC (A), a multifunction device (B), a projector (C), and a terminal device 16 are shown as examples. The terminal device 16 is, for example, a mobile terminal device such as a smart phone or a mobile phone. The PC (A) is provided with a proximity wireless module 91a, the multifunction device (B) is provided with proximity wireless modules 91b, 91c, and 91d, and the projector (C) is provided with a proximity wireless module 91e. ing. Each proximity wireless module is a communication interface having a function of performing proximity wireless communication. Also, the communication unit 40 of the terminal device 16 has a function of performing close proximity wireless communication.

The procedure for using the equipment will be described below. First, the user activates an application installed in the terminal device 16 (an application for using the linked function or the independent function), and the proximity wireless module installed in the device to be connected and the terminal device 16 The terminal device 16 is brought close to the proximity wireless module installed in the device to be connected to a distance at which close proximity wireless communication is established. At this time, the user may physically bring the terminal device 16 into contact with the location where the proximity wireless module is installed in the device, or may perform the close proximity wireless communication without physically touching the terminal device 16 with that location. The terminal device 16 may be brought closer to the point up to a distance where is established. Hereinafter, for convenience of explanation, an operation of bringing the terminal device 16 closer to the proximity wireless module to a distance at which close proximity wireless communication is established between the proximity wireless module and the terminal device 16 will be referred to as a “touch operation”.

Note that when a touch operation is performed on a device, the device or the terminal device 16 may emit sound or light, or the device or the terminal device 16 may vibrate. By doing so, the user is notified that the touch operation has been properly performed.

When close proximity wireless communication is established between the close proximity wireless module installed in the device to be connected and the terminal device 16, information indicating a usage permission request (for example, information including user identification information and terminal identification information) is It is transmitted from the terminal device 16 to the device to be connected by short-range wireless communication, and authentication processing is performed in the device to be connected, as in the second embodiment. In the following, for convenience of explanation, authentication processing by touch operation is referred to as “touch authentication”.

If the authentication succeeds and the use of the device to be connected is permitted, result information including information indicating permission to use and device identification information for identifying the device to be connected (including the address information of the device) is transmitted from the device to be connected to the terminal device 16 by short-range wireless communication. As a result, the device identification information of the connection target device is stored in the terminal device 16 as the device identification information of the available device. The terminal device 16 also transmits the device identification information of the device to be connected to the server 14 . As a result, in the server 14, the device to be connected is identified, and the functions of the device are specified.

If authentication fails and use of the connection target device is not permitted, information indicating disapproval is transmitted from the connection target device to the terminal device 16 . The UI unit 46 of the terminal device 16 displays information indicating authentication failure, unavailability, and the like.

Note that the above authentication processing may be performed by the server 14, as in the second embodiment. In this case, the terminal device 16 acquires device identification information from the device to be connected by close proximity wireless communication, and transmits the device identification information and information indicating the usage permission request to the server 14 . The server 14 performs an authentication process, and if the authentication succeeds, it becomes possible to use the function using the device to be connected.

When a plurality of devices are identified by repeating the above operations, the identification unit 38 of the server 14 refers to the link function management information 34 (for example, the link function management table shown in FIG. 7) to identify the plurality of devices. Identify the linkage functions that can be executed by using the equipment. Information indicating the cooperation function is transmitted from the server 14 to the terminal device 16 and displayed on the UI section 46 of the terminal device 16 .

Further, when a touch operation is performed again on a once identified device and close proximity wireless communication is established again between the once identified device and the terminal device 16, the device becomes a connection target device ( For example, it may be excluded from equipment used for cooperative functions and equipment for executing independent functions). When close proximity wireless communication is established again between the once identified device and the terminal device 16 , the terminal device 16 acquires device identification information from the device and transmits the device identification information to the server 14 . Upon receiving the device identification information, the server 14 excludes the device indicated by the device identification information from the devices to be used. When a plurality of devices other than the excluded devices are identified, the identification unit 38 of the server 14 identifies a cooperative function that can be executed using the plurality of devices, and identifies one device other than the excluded devices. is identified, identify a single function that can be performed by that one device. Information indicating the function (linked function or independent function) specified in this way is transmitted from the server 14 to the terminal device 16 and displayed on the UI section 46 of the terminal device 16 .

A specific example will be described below with reference to FIGS. 26 and 27. FIG. 26 and 27 are diagrams showing examples of function display screens.

For example, the user performs a touch operation on the MFP (B) and the projector (C), the authentication on the MFP (B) and the projector (C) succeeds, and the use of these devices is permitted. do. In this case, a function display screen 92 is displayed on the UI unit 46 of the terminal device 16 as shown in FIG. Information indicating the linkage function is displayed. When the user gives an instruction to execute the linking function on the function display screen 92, the linking function is executed. Note that the multi-function device (B) is provided with a plurality of close proximity wireless modules. Information can be transmitted and received between (B) and the terminal device 16 using close proximity wireless communication.

When close proximity wireless communication is established again between the once identified MFP (B) and the terminal device 16, the MFP (B) is excluded from the devices to be connected. In this case, when only the projector (C) is identified, information indicating the function (single function) of the projector (C) is displayed on the UI section 46 of the terminal device 16 . The same applies when close proximity wireless communication is established again between the projector (C) and the terminal device 16 .

As described above, according to the third embodiment, the device is identified by a simple touch operation, the user and the terminal device 16 are authenticated, and the information indicating the cooperative function is displayed.

Further, by applying the above-described related process 1, according to the order of touch operations on each device, that is, according to the order of identification of each device (in other words, the device for which the use permission request has been made (depending on the order of ), the display of information about the cooperation function may be switched. For example, when the touch operation is performed in the order of the MFP (B) and the projector (C) and each device is identified, the touch operation is performed in the order of the projector (C) and the MFP (B) and each device is identified. Information indicating a different cooperation function may be displayed depending on whether the device is identified.

Further, the part of the device may be identified by applying the related process 2 or the related process 3, and the information indicating the cooperative functions that can be executed using that part may be displayed. For example, a close proximity wireless module is provided in each part of a device, and the close proximity wireless module stores partial identification information (for example, partial ID) for identifying the part in which it is installed, and the other party of close proximity wireless communication (for example, a terminal). device 16). By doing so, the partial identification information for identifying each portion is acquired, and each portion is identified.

In the example shown in FIG. 25, a proximity wireless module is provided in each part of the multifunction device (B). Specifically, a proximity wireless module 91b is provided in the main body portion of the multifunction device (B), a proximity wireless module 91c is provided in the scanning portion of the multifunction device (B), and a A proximity wireless module 91d is provided in the processing device. For example, when the user performs a touch operation on a location where the proximity wireless module 91b is installed and close proximity wireless communication is established between the terminal device 16 and the proximity wireless module 91b, the information indicating the usage permission request is , is transmitted from the terminal device 16 to the near field wireless module 91b by near field wireless communication, and authentication processing is performed in the multifunction device (B). This authentication process is a process for determining whether or not to permit use of the main body portion where the proximity wireless module 91b is provided. If the authentication succeeds, that is, if the use of the main body is permitted, the information indicating permission to use, the device identification information of the multifunction device (B), and the partial identification information of the main body are transmitted by close proximity wireless communication. It is transmitted from the MFP (B) to the terminal device 16 . The device identification information and the partial identification information are transmitted to the server 14, and the server 14 identifies the MFP (B) and the main body, and specifies the functions of the main body.

When a plurality of parts are identified by repeating the above operation, the identification unit 38 of the server 14 refers to the cooperation function management information 34 (for example, the cooperation function management table shown in FIG. 23) to identify the plurality of parts. Identify the executable linkage function by using the part. Information indicating the cooperation function is transmitted from the server 14 to the terminal device 16 and displayed on the UI section 46 of the terminal device 16 . A plurality of portions may be selected from the same device or may be selected from a plurality of devices different from each other. Of course, the device part and the device as a whole may be selected, and information indicating the cooperative function executable by the combination of the part and the whole device may be displayed.

Further, when a touch operation is performed again on the once identified device and close proximity wireless communication is established again between the once identified part and the terminal device 16, the part is connected to the part to be connected ( For example, it may be excluded from the part used for the cooperative function or the part for executing the independent function). When close proximity wireless communication is established again between the close proximity wireless module provided in the once identified portion and the terminal device 16, the terminal device 16 acquires device identification information and partial identification information from the close proximity wireless module. , and transmits the device identification information and the partial identification information to the server 14 . When receiving the device identification information and the partial identification information, the server 14 excludes the portion indicated by the partial identification information from the portions to be used in the device indicated by the device identification information. If a plurality of devices or portions other than the excluded portions are identified, the identification unit 38 of the server 14 identifies executable cooperative functions using the plurality of devices or portions, and identifies a single function that can be performed by the single device or part. Information indicating the function (linked function or independent function) specified in this way is transmitted from the server 14 to the terminal device 16 and displayed on the UI section 46 of the terminal device 16 .

A combination of the related processes 1 and 2 or a combination of the related processes 1 and 3 described above may be applied. In this case, according to the order of touch operations on the parts of the device, that is, according to the order of identification of the parts of the device (in other words, according to the order of the parts of the device for which usage permission requests have been made), You can switch the display of information about the linkage function.

It should be noted that if the use of the device is not permitted, the device that is permitted to be used may be guided. If the use of the device is not permitted, the device identification information of the device and information indicating disapproval are transmitted from the device to the terminal device 16 , and the device identification information and information indicating disapproval are sent to the terminal device 16 . to the server 14. The server 14 transmits, to the terminal device 16, device identification information indicating, for example, a device of the same type as the device for which use is not permitted and which can be used by the user of the terminal device 16 or by the terminal device 16. . Device identification information indicating available devices is displayed on the UI unit 46 of the terminal device 16 . Information may be displayed indicating where the available equipment is located.

Similarly, if a portion of the equipment is not permitted to be used, the portion of the equipment that is permitted to be used may be guided. If the use of a portion of the device is not permitted, the device identification information of the device, the partial identification information of the portion, and information indicating disapproval are transmitted from the device to the terminal device 16 and further to the server 14. be. The server 14 is, for example, a device of the same type as the portion for which use is not permitted and has the same type of portion as the portion for which use is not permitted, and is used by the user of the terminal device 16 and the terminal device 16. Device identification information indicating possible devices is transmitted to the terminal device 16 . Device identification information indicating available devices is displayed on the UI unit 46 of the terminal device 16 . Information may be displayed indicating where the available equipment is located.

Further, information indicating a function (a linked function or a single function) that can be executed using a device touched within a predetermined time limit may be displayed on the UI section 46 of the terminal device 16 . The start time of the time limit may be, for example, the time when the touch authentication succeeds for the first time or the time specified by the user. The end of the time limit may be, for example, a point in time when a predetermined period of time has passed since the first successful touch authentication, or may be a point in time specified by the user. The length of time limit may be changed by the user. The identifying unit 38 of the server 14 identifies functions that can be executed using the device for which touch authentication has succeeded within the time limit. If the touch authentication for a plurality of devices is successful within the time limit, the identification unit 38 identifies a cooperative function that can be executed using the plurality of devices, and information indicating the cooperative function is sent to the UI unit of the terminal device 16. 46. When the touch authentication for one device is successful within the time limit, the specifying unit 38 specifies the function (single function) of the one device, and the information indicating the single function is sent to the UI unit 46 of the terminal device 16. Is displayed.

For example, if the touch authentication for the MFP (B) and the projector (C) is successful within the time limit, as shown in FIG. is displayed on the UI unit 46 of the terminal device 16 . After the time limit has passed, if the touch authentication for the MFP (B), the projector (C) and the PC (A) succeeds again, the server 14 performs the MFP (B), the projector (C) and the PC. Executable linkage functions are identified using (A). In this case, as shown in FIG. 27, information indicating the linked function is displayed on the function display screen 92. FIG. In the example shown in FIG. 27, the previously specified linked function (the linked function that can be executed using the MFP (B) and the projector (C)) is displayed as the first linked function, and is specified later. The linked function (linked function that can be executed using the multifunction device (B), the projector (C), and the PC (A)) is displayed as the second linked function. Of course, the order of display is not limited to this order, and the linked function specified earlier may be displayed lower than the linked function specified later.

A time limit may apply to touch authentication on parts of the device. In this case, similarly to the above, when touch authentication is successful for a plurality of parts within the time limit, information indicating cooperative functions that can be executed using the plurality of parts is displayed on the UI unit 46 of the terminal device 16. be.

<Fourth Embodiment>
A device system according to the fourth embodiment will be described below. The equipment system according to the fourth embodiment has the same configuration as the equipment system according to the first embodiment. In the fourth embodiment, information indicating a device necessary for executing the cooperation function is displayed on the UI unit 46 of the terminal device 16, and when communication is performed with the device using close proximity wireless communication, the Execution of the cooperative function that can be executed using the device is controlled.

A procedure for using the device in the fourth embodiment will be described below. First, the user activates an application installed in the terminal device 16 (an application for using the cooperative function or the independent function). As a result, a list of cooperative functions is displayed on the UI unit 46 of the terminal device 16 . For example, the control unit 48 of the terminal device 16 causes the UI unit 46 to display a function display screen 94 and displays a list of cooperative functions on the function display screen 94, as shown in FIG. The user selects a link function to be executed from the list. Of course, the user may directly input information indicating the cooperation function to be executed into the terminal device 16 . On the function display screen 94, information indicating devices required for executing the linked function is displayed for each linked function. For example, in order to execute the function of "projecting a scanned image" as a cooperative function, a "multifunction machine" and a "projector" are required. Information indicating a list of linked functions and device identification information of each device necessary for executing each linked function are transmitted from the server 14 to the terminal device 16 and displayed on the UI unit 46, for example. Of course, such information may be stored in the terminal device 16 in advance.

The equipment necessary for executing the linkage function may be defined by the type of equipment (for example, the type of equipment such as "multifunction machine" or "projector") or by the model number of the equipment. It may be stipulated by information for uniquely identifying the device (for example, a unique name or unique ID for each device). If the type of device required to execute the linkage function is defined by the type of device, the function display screen 94 displays information indicating the type of device (for example, "multi-function device") as the required device. . If the equipment required to execute the linked function is specified by a specific equipment, the function display screen 94 displays a unique name (for example, “MFP B”, etc.) or a unique name for identifying the specific equipment. ID etc. are displayed.

On the function display screen 94, when the user selects the cooperation function to be executed (for example, selects the determination button "Yes" associated with the cooperation function to be executed), the cooperation function to be executed is confirmed, and the cooperation function is selected. Equipment required for execution is determined. After that, the user performs a touch operation as in the third embodiment. When a touch operation is performed, device identification information (including address information of the device) is transmitted from the device on which the touch operation was performed to the terminal device 16, and the touch operation is performed based on the device identification information. device is identified. This identification processing may be performed by the server 14 as in the above-described embodiment, or may be performed by the terminal device 16 . Also, as in the third embodiment, touch authentication may be used to authenticate the user and the terminal device 16 with respect to the device, or such authentication may not be performed.

When the equipment necessary for executing the linkage function is defined by the equipment type, the equipment type indicated by the device identification information transmitted to the terminal device 16 from the equipment on which the touch operation was performed determines whether the linkage function is performed. If the type matches the type of device required for execution, the device on which the touch operation was performed is determined to be the device required for executing the linked function. If they do not match, it is determined that the device on which the touch operation was performed is not the device necessary for executing the cooperation function. This determination process may be performed by the control unit 48 of the terminal device 16 or may be performed by the control unit 36 of the server 14 .

When a device required for executing the linkage function is specified by a specific device, the name of the device indicated by the device identification information transmitted to the terminal device 16 from the device on which the touch operation was performed, the unique ID, etc. , and the name, unique ID, etc. of the device required to execute the link function, the device on which the touch operation was performed is determined to be the device required to execute the link function. If they do not match, it is determined that the device on which the touch operation was performed is not the device necessary for executing the cooperation function.

When the model number or the like of the device is used, it is determined whether or not the device on which the touch operation is performed corresponds to the device necessary for executing the cooperation function by the same processing.

In order to execute the cooperation function when all the devices necessary for executing the cooperation function selected by the user are touch-operated and all the relevant devices are identified, that is, by the determination process described above. If it is determined that the touch operation has been performed on all the devices necessary for performing the cooperation function, the terminal device 16 transmits information indicating a connection request to each device necessary for executing the cooperation function, and furthermore, performs the cooperation function. to each device. Thereby, each device executes the cooperation function. In the example shown in FIG. 28, since the devices necessary for executing the linkage function are a "multifunction device" and a "projector", a touch operation is performed on the "multifunction device" and the "projector" to identify them. At the stage of completion, information indicating an execution instruction of the cooperation function is transmitted to the "multifunction machine" and the "projector", and the cooperation function is executed by the "multifunction machine" and the "projector".

As described above, according to the fourth embodiment, the information indicating the devices necessary for executing the cooperation function is displayed, and the cooperation function can be executed by a simple touch operation.

Further, when the touch operation is performed on all the devices necessary for executing the cooperation function and all the devices are identified, the control unit 48 of the terminal device 16 performs confirmation as shown in FIG. The screen 96 may be displayed on the UI section 46 . In the confirmation screen 96, when the user gives an instruction to execute the cooperation function (for example, when the user selects "yes"), the terminal device 16 transmits information indicating a connection request to each device, Sends information indicating an instruction to execute the linkage function to the device. By doing so, it is possible to prevent the cooperation function from being automatically executed without the user's intention. In the confirmation screen 96, when the user gives an instruction to cancel the cooperation function (for example, when the user selects "No"), the designation of the cooperation function is cancelled.

Also, a time limit for touch operations may be set. For example, if a touch operation is performed on all devices necessary for executing the linked function within a predetermined time limit after the user selects the linked function, the linked function is executed. , the above confirmation screen may be displayed.

In addition, the terminal device 16 instructs the identified devices to execute the cooperation function before the touch operation is performed on all the devices necessary for executing the cooperation function and all the devices are identified. to cause the device to perform preprocessing. For example, when the linked function selected by the user is a function that can be executed by using the first device and the second device in that order, a touch operation is performed on the first device and the first When the device is identified, the terminal device 16 causes the first device to execute the first function (that is, the function to be executed by the first device) among the cooperation functions prior to the first device. Thereafter, when a touch operation is performed on the second device and the second device is identified, the terminal device 16 uses the execution result of the first device to identify the second device possessed by the second device in the cooperation function. It causes the second device to perform a function (that is, a function to be performed by the second device). In the example shown in FIG. 28, the "multifunction machine" corresponds to the first device, and the "projector" corresponds to the second device. In this case, when a touch operation is performed on the "multi-function device" and the "multi-function device" is identified, the terminal device 16 transmits information indicating an instruction to execute the scan process to the "multi-function device". The "multi-function device" that has received the execution instruction generates image data by executing the scanning process. Next, when a touch operation is performed on the "projector" and the "projector" is identified, the terminal device 16 transmits information indicating an instruction to execute the image projection process to the "projector". The "projector" that has received the execution instruction receives the image data from the "multifunction machine" and projects an image based on the image data. The information indicating the execution instruction sent to the "multifunction device" includes the address information of the "projector" that is the destination of the image data, and the "multifunction device" uses the address information to Send the image data to the "projector". Of course, the image data may be transmitted from the "multifunction machine" to the "projector" via the terminal device 16 or the server 14. FIG.

If the user selects a linkage function that is not suitable for preceding processing, the linkage function is executed when all the devices required for executing the linkage function are touch-operated and all devices are identified. An execution instruction is given from the terminal device 16 to each device. For example, when the cooperative function is a function of stapling printed matter after printing by a printer, if there is no stapling as a post-processing device, printing is performed prior to a touch operation on the post-processing device. Even if it is executed by the printer, it is not possible to create a printed material on which the stapling process has been performed. For example, if a linked function that is not suitable for preceding processing is predetermined and the linked function is selected by the user, the preceding processing is not executed, and all devices required to execute the linked function are When the touch operation is performed and all the devices are authenticated, the terminal device 16 gives an instruction to each device to execute the cooperation function.

Note that when a touch operation is performed on a device other than the device necessary for executing the linkage function, information indicating that fact may be displayed on the UI unit 46 of the terminal device 16, or the device may be After identification, information indicating the identification result may be stored in the terminal device 16 .

After the execution of the linked function is completed, the information indicating the linked function, the device identification information of each device (including the address information of the device) necessary for executing the linked function, and the identification result of each device are indicated. The information may be stored in the terminal device 16 or the server 14 as history information. The history information may be used to give an instruction to execute the cooperation function. For example, when a link function included in the history is selected and an execution instruction is given, the terminal device 16 transmits information indicating the link function execution instruction to each device necessary for executing the link function. . At this time, since each device has already been identified, identification again is unnecessary.

Further, a part of the device may be identified by applying the related process 2 or the related process 3, and an executable cooperation function may be executed using that part. For example, in the function display screen 94 shown in FIG. 28, the parts of the devices necessary for executing the cooperation function are displayed. Further, as in the third embodiment, each part of the device is provided with a proximity wireless module, and the proximity wireless module has partial identification information (for example, part ID) for identifying the part in which it is installed, It is transmitted to the other party of close proximity wireless communication (for example, the terminal device 16). In this case, when a touch operation is performed on all parts of the device necessary for executing the linked function and all the parts are identified, the terminal device 16 sends information indicating an execution instruction of the linked function to the relevant device. Send to all devices. The part of the equipment that receives the instruction to execute it executes the function assigned to it. Also, a confirmation screen 96 may be displayed as shown in FIG.

At the stage when touch operations are performed on all parts and all the relevant parts are recognized, an instruction to execute the linked function may be given to each device, or before all the parts are recognized, It is also possible to have a part that has a function performed by it (preceding processing). For example, when the linked function selected by the user is a function that can be executed by using the first part of the device and the second part of the device in that order, if the preceding process is performed, the first part When the first part is identified by performing a touch operation on the Make it run before the first part. After that, when a touch operation is performed on the second portion and the second portion is identified, the terminal device 16 uses the execution result of the first portion to display the second portion included in the second portion among the cooperation functions. Cause the second part to perform the function (ie, the function that the second part should perform). Note that the first part and the second part may be parts of the same device, or may be parts of different devices.

In addition, if a time limit is set and, within the time limit, touch operations are performed on all parts of the device necessary for executing the linked function and all parts are identified, then the linked function may be performed.

The fourth embodiment may be applied to performing a single function. For example, the UI unit 46 of the terminal device 16 displays a list of independent functions and information indicating devices required for executing the independent functions for each independent function. When a single function is selected by the user from the list and a device necessary for executing the single function is identified by performing a touch operation, the terminal device 16 selects the single function. Sends information indicating an execution instruction to the device. The device that has received the execution instruction executes the independent function selected by the user.

In the second, third, and fourth embodiments described above, depending on the positional relationship between the user (terminal device 16) and the device, the use of the device, that is, the cooperative function that can be executed using the device or the use of a single function of the device may be prohibited. For example, an available area is determined for each device, and information indicating the available area for each device is stored in the server 14 . Positional information of the terminal device 16 is acquired by the GPS function, and the positional information is sent from the terminal device 16 to the server 14 . The control unit 36 of the server 14 compares the available area for the device to be connected with the position of the terminal device 16, and if the terminal device 16 exists in the area, permits the use of the device, If the terminal device 16 does not exist within that area, the use of that device is not permitted (prohibited). For example, an area within a predetermined distance based on the position of the device may be determined as a usable area, an area having an arbitrary shape or size that includes the device, or an area that does not include the device may be used. It may be defined as possible area. The same applies to the positional relationship between the user (terminal device 16) and the equipment.

Note that the linked function selected by the user from the linked functions may be a function executed by a combination of the entire device and parts of the device. In this case, when a touch operation is performed and recognized on the device and part, the cooperation function is executed by the device and part.

<Fifth Embodiment>
A device system according to the fifth embodiment will be described below. The equipment system according to the fifth embodiment has the same configuration as the equipment system according to the first embodiment. In the fifth embodiment, when a plurality of devices are identified by a plurality of users, display of cooperative functions executable by using the plurality of devices is controlled.

A procedure for using the device in the fifth embodiment will be described below with reference to FIG. 30 . As an example, it is assumed that a plurality of devices are identified by operations by users α and β. The terminal device 16A is operated by the user α, and the terminal device 16B is operated by the user β. The terminal devices 16A and 16B have the same configuration as the terminal device 16. FIG.

First, the user α identifies the device by operating the terminal device 16A. The device identified here is multi-function device B. As the identification processing, the identification processing in the first to fourth embodiments described above is used. For example, the device may be identified by using AR technology, or the device may be identified by performing a touch operation. Of course, the device may be identified by other identification techniques. The identification process may be performed by the server 14 or may be performed by the terminal device 16A. Also, as in the third embodiment, authentication of the user α and the terminal device 16A may be performed. When the MFP B is identified, a device display screen 98 is displayed on the UI section 46 of the terminal device 16A. A device image associated with the identified MFP B is displayed on the device display screen 98 . The device image may be an image obtained by photographing the multifunction device B, or an image (for example, an icon) that schematically represents the multifunction device B. FIG. Further, the identification information of the user α who performed the identification operation on the MFP B (for example, the name and user ID of the user α) and the identification information of the group to which the user α belongs (for example, the name of the group and the group ID) are It may be displayed on the device display screen 98 in association with the image associated with the MFP B. FIG. More on groups later.

When the multi-function device B is identified as the device as described above, the user α sends the identification result to the user β of the collaboration partner. Specifically, the terminal device 16A transmits information indicating the identification result of the MFP B to the terminal device 16B in accordance with the transmission instruction from the user α. The information indicating the identification result includes device identification information of MFP B (including address information of MFP B). It is assumed that each of the terminal devices 16A and 16B stores the address information of the other party.

Next, the user β identifies the device by operating the terminal device 16B. The device identified here is a notebook PC (A). The device may be identified by AR technology, the device may be identified by touch operation, or the device may be identified by another identification technology. The identification process may be performed by the server 14 or by the terminal device 16B. Also, authentication of the user β and the terminal device 16B may be performed. When the notebook PC (A) is identified, the device display screen 100 is displayed on the UI section 46 of the terminal device 16B. The device display screen 100 displays a device image associated with the MFP B identified by the operation by the user α and a device image associated with the notebook PC (A) identified by the operation by the user β. The device image associated with the notebook PC (A) may be an image obtained by photographing the notebook PC (A), or an image (for example, an icon) that schematically represents the notebook PC (A). may In addition, the identification information of user β (for example, the name and user ID of user β) who performed the identification operation on notebook PC (A) and the identification information of the group to which user β belongs are linked to notebook PC (A). It may be displayed on the device display screen 100 in association with the image.

When the notebook PC (A) is identified, information indicating the identification result may be transmitted from the terminal device 16B to the terminal device 16A. The information indicating the identification result includes the device identification information of the notebook PC (A) (including the address information of the notebook PC (A)). In this case, the device image associated with the multifunction device B and the device image associated with the notebook PC (A) are displayed on the device display screen 98 displayed on the UI unit 46 of the terminal device 16A.

Further, the specifying unit 38 of the server 14 refers to the linking function management information 34 (for example, the linking function management table shown in FIG. 7), and based on the above identification result, the MFP B and the notebook PC ( A) is used to specify executable cooperation functions. When the identification processing is performed by the terminal devices 16A and 16B, information indicating the identification result is transmitted to the server 14, and the server 14 identifies the cooperation function based on the identification result. Note that the cooperation function may be specified by the terminal device 16A or the terminal device 16B.

When the server 14 identifies the cooperation function, information indicating the cooperation function is transmitted from the server 14 to the terminal devices 16A and 16B and displayed on the UI units 46 of the terminal devices 16A and 16B. The information indicating the cooperation function may be transmitted to both terminal devices 16A and 16B and displayed on both terminal devices, or may be transmitted to one of the terminal devices and displayed on that terminal device. may For example, the information indicating the linked function may be transmitted to and displayed on a terminal device of a predetermined user, transmitted to and displayed on the terminal device that performed the identification process last, or It may be transmitted to and displayed on the terminal device that performed the identification process, or it may be transmitted and displayed on the terminal device that was used to identify the device that outputs the final product by executing the collaboration function. , may be transmitted to and displayed on the terminal device of the user who has the authority to instruct the execution of the cooperation function.

For example, if the final process of multiple processes included in the link function is printing, the printer or multi-function peripheral generates printed matter as a product. In this case, information indicating the linking function is displayed on the terminal device of the user who has performed the identification operation on the printer or multifunction peripheral that generates the printed matter as the product.

Further, the cooperation function may be changed according to the user who performed the identification operation last. For example, the user identification information of the user who performs the identification operation last and the information indicating the linking function are associated with each other, and the information indicating the association is stored in the server 14 . The terminal device 16 of the user who performed the last identification operation transmits the user identification information of the user to the server 14, and information indicating the linked function associated with the user identification information is displayed on the terminal device 16. . For example, information indicating different linkage functions may be displayed depending on whether the user who performed the last identification operation corresponds to a user with management authority or a user without management authority. By doing so, different linkage functions are displayed depending on whether or not the user has administrative authority. Of course, regardless of the presence or absence of management authority, if a linking function that can be used by each user is defined, the linking function may be changed according to the user who last performed the identification operation according to the definition.

FIG. 31 shows the function display screen 102. As shown in FIG. The function display screen 102 is displayed on both or one of the terminal devices 16A and 16B. The function display screen 102 displays information indicating the linked function specified as described above. Note that the function display screen 102 is displayed on the UI unit 46 of the terminal device 16B that performed the identification process last, and then a notification indicating that the use of the cooperative function is enabled is sent from the terminal device 16B to the terminal device 16A. , and then the function display screen 102 may be displayed on the UI unit 46 of the terminal device 16A.

At least one of the users who have performed the identification operation instructs execution of the link function. In the example shown in FIG. 30, user α or user β instructs execution. The user α or the user β uses a terminal device owned by the user to select a linked function to be executed from the list of linked functions displayed on the function display screen 102 and instruct execution thereof. As a result, information indicating an instruction to execute the cooperative function is sent to each device. The information indicating the execution instruction includes address information of each device (for example, address information of notebook PC (A) and multifunction device B). The information indicating the execution instruction may be sent directly from the terminal device that instructed the execution to each device, may be sent to each device via the server 14, or may be sent to each device via another terminal device. It may be sent to a device, or it may be sent from a device to another device. For example, when the user β instructs execution using the terminal device 16B, information indicating the execution instruction is transmitted from the terminal device 16B to the notebook PC (A), and the terminal device 16A or the notebook PC (A) is sent to the MFP B via the Of course, the information indicating the execution instruction may be sent to the notebook PC (A) and the multifunction machine B via the server 14 .

Information indicating that an execution instruction has been given is transmitted from the terminal device 16 of the user who instructed the execution to the terminal device 16 of the user who has not instructed the execution, and is displayed. For example, when the user β instructs execution using the terminal device 16B, information indicating that the execution instruction has been given is transmitted from the terminal device 16B to the terminal device 16A and displayed on the UI section 46 of the terminal device 16A. be. For example, as shown in FIG. 32, a confirmation screen 104 is displayed on the UI unit 46 of the terminal device 16A, and information indicating that an execution instruction has been given is displayed on the confirmation screen 104. FIG.

Note that the cooperation function may be executed when a user who has the authority to instruct the execution of the cooperation function instructs the execution, or when the instruction is given using the terminal device 16 to which the authority is granted. , a coordination function may be performed.

Multiple users may direct execution. For example, the cooperation function may be executed when all the users who have performed the identification operation have instructed the execution. In the example shown in FIG. 30, the cooperation function may be executed when the user α uses the terminal device 16A to instruct execution and the user β uses the terminal device 16B to instruct execution. For example, when it is confirmed that execution instructions have been given from both users α and β by communicating with each other, MFP B and notebook PC (A) are linked. perform a function.

Groups are described below. Terminal devices 16 and users may be grouped. For example, the terminal devices 16 may be grouped according to identification information of the terminal devices 16 (e.g., Mac address, performance, compatibility, etc.), or user identification information (e.g., user account information, department, gender, age, etc.). , companies to which they belong, etc.). For example, even when multiple users use the same terminal device 16 , the users may be grouped according to the user account information used when logging into the terminal device 16 . The terminal devices 16 and users may be grouped in advance, or may be grouped during identification of the device or after the identification of the device is completed. Each user and each terminal device 16 may belong to one group, or may belong to a plurality of groups. In the example shown in FIG. 30, both users α and β belong to group X. In the example shown in FIG.

A group may be managed by each terminal device 16 or may be managed by the server 14 . For example, when users are grouped, the user identification information includes group identification information for identifying the group to which the user having the user identification information belongs. Further, when the terminal device 16 is grouped, the terminal identification information includes group identification information for identifying the group to which the terminal device 16 having the terminal identification information belongs.

Group identification information indicating the group to which each user belongs and group identification information indicating the group to which each terminal device 16 belongs may be stored in each terminal device 16 and server 14 . For example, for each user, group management information indicating the correspondence between user identification information and group identification information indicating the group to which the user belongs, or for each terminal device, group identification information indicating the group to which the terminal device belongs and the terminal identification information Group management information indicating association with information may be stored in each terminal device 16 or server 14 . By referring to the group management information, the group to which each user and each terminal device 16 belongs is specified.

Processing using groups will be described below. For example, when a plurality of users performing an identification operation belong to a group that can cooperate with each other, when a plurality of devices are identified by the identification operations of the plurality of users, the cooperation function is specified and the cooperation function is identified. is displayed. Groups that can cooperate are, for example, the same group. Of course, when each user belongs to a separate group and cooperation between groups is possible, those groups correspond to groups that can be cooperated.

The process of identifying the group to which each user and each terminal device 16 belongs may be performed by the server 14, each terminal device 16, or each device. When the server 14 performs the specific process, for example, group identification information indicating the group to which the user or the terminal device 16 belongs is sent from each terminal device 16 to the server 14 together with information indicating the device identification result. Based on the group identification information transmitted from each terminal device 16, the control unit 36 of the server 14 determines whether or not each user who performed the identification operation and each terminal device 16 belong to a mutually cooperative group. do. When each user or each terminal device 16 belongs to a mutually cooperative group, information indicating the cooperation function is transmitted from the server 14 to each terminal device 16 and displayed on the UI section 46 of each terminal device 16 . When each user or each terminal device 16 does not belong to a mutually cooperative group, information indicating that fact is transmitted from the server 14 to each terminal device 16 and displayed on the UI section 46 of each terminal device 16 . In this case, the information indicating the cooperation function is not displayed on the UI section 46 of each terminal device 16 .

For example, user α belongs to groups X, Y, and Z, and user β belongs to groups M, L, and X. Since the users α and β belong to the same group X as each other, when a plurality of devices are identified by performing an identification operation by the users α and β, a cooperative function that can be executed using the plurality of devices. is displayed on the UI units 46 of the terminal devices 16A and 16B.

As described above, according to the fifth embodiment, when identification operations are performed by a plurality of users, information indicating the cooperation function is displayed. By doing so, for example, even if a plurality of devices necessary for executing the cooperation function are installed at locations far from each other, the cooperation function can be executed. For example, if one of the multiple devices is installed at a certain office (e.g. Tokyo office) and the other is installed at another office (e.g. Yokohama office) However, the cooperation function is executed by performing the identification operation at each office. To give a specific example, if multifunction machine B is installed at the office in Tokyo and notebook PC (A) is installed at the office in Yokohama, the notebook PC installed at the office in Yokohama The data stored in (A) can be printed by the multifunction machine B installed in the office in Tokyo.

Further, by performing the identification operation by a plurality of users, the security regarding the cooperation function can be improved as compared with the case where the identification operation is performed by one user. For example, the execution of the linked function is permitted when identification operations are performed by multiple users, and the execution of the linked functions is completely prohibited when the identification operation is performed by one user, or some functions are disabled. Restrictions can improve security. The need for identification operations by multiple users may be determined according to the type of cooperation function, the device used, the degree of confidentiality of data to be handled, and the like. For example, when the confidentiality of the cooperation function, the equipment, and the data is relatively high, identification operations by a plurality of users are required, and execution of the cooperation function becomes possible when the identification operation is performed. On the other hand, if the confidentiality of the collaboration function, device, and data is relatively low, the collaboration function can be executed when an identification operation is performed by one or more users.

A device that has been identified once may be able to be used for the cooperation function without performing the identification operation again within the group to which the user who performed the identification operation or the terminal device 16 belongs. In other words, when at least one user among a plurality of users belonging to the same group performs an identification operation and the device is identified, other users can use the device without identifying the device again. can be used to execute the linkage function. For example, identified devices are managed for each group, and management information for the management is stored in the server 14 . In the management information, for example, group identification information and device identification information indicating the identified device are associated with each other for each group. By referring to the management information, the identified device is specified for each group. In addition, if a predetermined period of time has passed since the device was identified, the device cannot be used for the linked function, and if the device is identified again, it will be possible to use the linked function. You can become

Moreover, you may combine 2nd Embodiment and 5th Embodiment. In this case, when a plurality of users each perform an authentication operation (i.e. request permission to use), and each user and each terminal device 16 are authenticated and permitted to use each device, the plurality of permitted devices are used. Information indicating the executable linkage functions is displayed. The same applies to the case of using the parts of the equipment. Information indicating the linkage function is displayed.

Moreover, you may combine 3rd Embodiment and 5th Embodiment. In this case, when a plurality of users each perform a touch operation (that is, use permission request) and each user or each terminal device 16 is touch-authenticated and the use of each device is permitted, execution is possible using a plurality of devices. information indicating the relevant linkage function is displayed. The same applies to the case of using the parts of the equipment, and when each user or each terminal device 16 is touch-authenticated and the use of the parts of each equipment is permitted, a cooperative function that can be executed using a plurality of parts is shown. Information is displayed.

Moreover, you may combine 4th Embodiment and 5th Embodiment. In this case, when a plurality of devices necessary for executing a cooperative function are identified by touch operations by each of the plurality of users, the cooperative function is executed. For example, information indicating devices necessary for executing the cooperation function is displayed on the terminal devices 16A and 16B. In the case where the devices required for executing the linked function are the multifunction device B and the notebook PC (A), the multifunction device B is identified by the touch operation by the user α, and the notebook PC (A) is identified by the touch operation by the user β. is identified, its associated function is executed. The same is true for the use of device parts, and when a plurality of device parts necessary for executing a linked function are identified by a touch operation by each of a plurality of users, the linked function is executed.

By applying the above-described related processing 1, the display of information related to the cooperation function may be switched according to the order of identification of each device. For example, in the case where the multifunction device B is identified first by the identification operation by the user α, and the notebook PC (A) is identified later by the identification operation by the user β, the notebook PC (A) is first identified by the identification operation by the user β. information indicating a different linkage function may be displayed depending on whether the MFP B is identified later by the identification operation by the user α.

Further, a part of the device may be identified by applying the related process 2 or the related process 3, and information indicating a cooperative function that can be executed using that part may be displayed. For example, when a portion of multifunction device B (for example, a main body portion) is identified by an identification operation by user α, and a portion of notebook PC (A) (for example, a display unit) is identified by an identification operation by user β, multifunction device B Information indicating the cooperative function that can be executed using the main body portion and the display portion of the notebook PC (A) is displayed.

In addition, when any one device among a plurality of devices is identified and the part of the other device is identified, it indicates the cooperation function that can be executed using the part of the one device and the other device. Information may be displayed. For example, when a part of multifunction machine B (for example, a main body part) is identified by an identification operation by user α, and a notebook PC (A) is identified by an identification operation by user β, the main part of multifunction machine B and the notebook PC (A ) is displayed to display information indicating the linkage functions that can be executed.

The processing according to the fifth embodiment may be applied to functions realized by software. In other words, the linking function may be a function executed by linking a plurality of pieces of software. In this case, when a plurality of users perform authentication operations and are authenticated, information indicating the cooperation function is displayed. For example, a case where software A installed in the terminal device 16A and software B installed in the terminal device 16B are linked will be described. User α authenticates software A on terminal device 16A, and user α is authenticated. User β authenticates software B on terminal device 16B, and user β is authenticated. is displayed on at least one of the terminal devices 16A and 16B. The user may be pre-authenticated for the software, or the authentication operation may be performed when the software is activated. In the authentication operation, for example, the user is authenticated by entering authentication information such as a user ID and password. The identification unit 38 of the server 14 receives information indicating that the authentication has succeeded and information indicating the software from each terminal device, and identifies cooperative functions that can be executed using a plurality of pieces of software that have been successfully authenticated. Information indicating the linked function is displayed on the terminal device.

For example, assume that software A is document creation software (application) and software B is spreadsheet software (application). In this case, information is displayed that indicates the cooperative functions that can be executed using the document creation software and the spreadsheet software. For example, a linking function that inserts a document created using word processing software into a table created using spreadsheet software, or a table created using spreadsheet software that can be inserted into a table created using word processing software. A linking function such as inserting into a document created using a plurality of software corresponds to a linking function that can be executed using a plurality of software. As another example, where presentation software and word processing software are combined, the document generated by the word processing software may be pasted into the data generated by the presentation application software.

In the above example, multiple pieces of software installed on two or more terminal devices are used. may be For example, the user α is authenticated by performing an authentication operation on the software A installed on the terminal device 16, and the user β is authenticated by performing an authentication operation on the software B installed on the same terminal device 16. In this case, the terminal device 16 may display information indicating cooperative functions that can be executed using the software A and the software B. FIG. In this way, the plurality of pieces of software used for the link function may be software installed in one terminal device 16 or software installed in a plurality of terminal devices 16 .

Further, information indicating the cooperation function may be displayed when a user having management authority is authenticated. For example, when the user who performed the last authentication operation among a plurality of users who perform the authentication operation has management authority, the information indicating the cooperation function is displayed on the terminal device 16, and the last authentication operation is performed. If the user does not have administrative authority, the information indicating the linkage function may not be displayed. Of course, when at least one user among a plurality of users who perform the authentication operation has administrative authority, the information indicating the linked function may be displayed on the terminal device 16, or a predetermined ratio may be displayed. Information indicating the link function may be displayed on the terminal device 16 when the above users have management authority, or information indicating the link function when all users have management authority. may be displayed on the terminal device 16 .

Also, in the case of using software, similarly to the case of realizing the cooperation function using the above-described device, the technology related to the group, the related process 1, and the like may be applied. For example, when multiple users who perform authentication belong to a group that can cooperate (for example, the same group), the authentication operations by the multiple users have authenticated the use of multiple software used for the linkage function. In this case, information indicating the cooperation function may be displayed. Also, in the case where multiple pieces of software for which authentication operations have been performed belong to a group that can be linked (for example, the same group), if the use of the multiple pieces of software is authenticated, information indicating the linked function is displayed. may Also, by applying the related process 1, the cooperation function may be changed according to the order of authentication for a plurality of pieces of software. In addition, the linkage function may be changed according to the user who performed the last authentication operation, and information indicating the linkage function may be displayed on the terminal device of the user who performed the authentication operation on the software that outputs the deliverable. may be

Further, the processing according to the fifth embodiment may be applied to a cooperative function that can be executed by combining a device as hardware and a function realized by software. For example, when a device is identified or authenticated to the device by the identification operation or the authentication operation by the first user, and the second user is authenticated to the software by the authentication operation of the second user, the device and the Information indicating a cooperative function that can be executed using the software may be displayed on the terminal device.

Also, the identified first software (eg, software A) is designated by a first user (eg, user α), and the identified second software (eg, software B) is designated by a second user (eg, user β). In this case, the terminal device may display information indicating cooperative functions that can be executed using the first software and the second software. For example, if the terminal device where the software is installed cannot run the software, the software is not identified by the terminal device, and the image (e.g. icon) associated with the software is not displayed on the terminal device. Or, even if the image is displayed, it cannot be executed on the terminal device, or the extension (information indicating the type of file, etc.) associated with the data (electronic file) created by the software is displayed. Sometimes it doesn't. Such software is not used for cooperation functions. On the other hand, if the software can be executed on the terminal device where the software is installed, the software is identified by the terminal device, and the image linked to the software is displayed on the terminal device, or the image is displayed on the terminal device. It may be displayed and can be executed on the terminal device, or an extension associated with the data created by the software may be displayed. Such software is software that can be used for the linkage function. For example, when software A identified by the terminal device 16A is specified by the user α and software B identified by the terminal device 16B is specified by the user β, software A and software B are executable. Information indicating the linked function is displayed on the terminal device. The software A and B are installed in the same terminal device (for example, either one of the terminal devices 16A and 16B) and are identified by the same terminal device. When software A and software B are designated by either one of them, information indicating the cooperative functions that can be executed using software A and software B may be displayed on the terminal device. Even in this case, when a plurality of users (for example, users α and β) specify software A and B, information indicating the cooperative function may be displayed.

As another example, a first software (eg software A) is identified by an identification operation by a first user (eg user α), and a second software (eg software B) is identified by an identification operation by a second user (eg user β). If identified, information may be displayed on the terminal device indicating the cooperative functions that can be performed using the first software and the second software. The identification operation is, for example, software installation work on the terminal device. As another example, when software is installed in a terminal device and the user gives an instruction to identify the software as an identification operation, identification processing is executed, and if the software is executable on the terminal device, the software may be identified by the terminal device. When a plurality of pieces of software are identified, information indicating cooperative functions that can be executed using the plurality of pieces of software is displayed on the terminal device.

Each of the image forming apparatus 10, the server 14, and the terminal device 16 described above is realized by cooperation of hardware and software, for example. Specifically, each of the image forming apparatus 10, the server 14, and the terminal device 16 includes one or more processors such as a CPU (not shown). The functions of the image forming apparatus 10, the server 14, and the terminal device 16 are implemented by the one or more processors reading and executing a program stored in a storage device (not shown). The program is stored in a storage device via a recording medium such as a CD or DVD, or via a communication path such as a network. As another example, each unit of the image forming apparatus 10, the server 14, and the terminal device 16 may be implemented by hardware resources such as processors, electronic circuits, and ASICs (Application Specific Integrated Circuits). A device such as a memory may be used in its implementation. As still another example, each unit of the image forming apparatus 10, the server 14, and the terminal device 16 may be implemented by a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), or the like.

10, 12 device, 14 server, 16 terminal device, 36 control unit, 38 identification unit.

Claims (23)

having a processor;
The processor
Identified by performing an identification operation on at least one first terminal operated by another user who belongs to the same group before performing an identification operation on the first device in the real space necessary for using the cooperation function by the own device. In a case where the information of the second device in the physical space is shared, when the identification operation for the first device in the physical space is newly completed by the device, the first device identified by the device and the first device are identified by the device. Notifying information of the cooperative function that can be executed in combination with the second device identified by the terminal;
Information processing equipment. The processor
If there is no user who has administrative authority to operate the device necessary for using the cooperation function among the user who operates the own device and one or more of the other users, the execution of the cooperation function is not permitted.
The information processing device according to claim 1 . If the position of the device that instructs the execution of the linkage function is outside the range of the area where the use of the equipment necessary for using the linkage function is permitted, the linkage function is not executed.
The information processing apparatus according to claim 1 or 2. By capturing an image of the first device with the own device, the first device captured with the own device is identified,
By photographing the second device with the first terminal, the second device photographed with the first terminal is identified;
The information processing apparatus according to any one of claims 1 to 3. having a processor;
The processor
Acquiring information indicating that the first device has been identified by performing an identification operation on the first device with the first terminal operated by the first user;
Acquiring information indicating that the second device has been identified by performing an identification operation on the second device with a second terminal operated by a second user after identifying the first device;
When the first user and the second user belong to at least one same group, proposing a cooperation function executable by a combination of devices shared by the same group;
Information processing equipment. having a processor;
The processor
Acquiring information indicating that the first device has been identified by performing an identification operation on the first device with the first terminal operated by the first user;
Acquiring information indicating that the second device has been identified by performing an identification operation on the second device with a second terminal operated by a second user after identifying the first device;
use of the linking function if at least one of the first user or the second user does not have administrative authority when executing the linking function executable by a combination of a plurality of identified devices; limit the
Information processing equipment. having a processor;
The processor
Before performing authentication operation on the first software necessary for using the cooperative function on the own device, use is authenticated by performing authentication operation on the first terminal operated by at least one other user belonging to the same group. 2 When the information of the software is shared, when the self-apparatus newly completes the authentication operation for the first software, the use of the first software and the first terminal whose use has been authenticated on the self-apparatus is permitted. Notifying information of the cooperative function that can be executed in combination with the authenticated second software;
Information processing equipment. The processor
If one or more of the user operating the own device and the other users do not have a user who has administrative authority to operate the software necessary for using the cooperation function, execution of the cooperation function is not permitted.
The information processing apparatus according to claim 7. If the position of the device instructing execution of the linkage function is outside the range of the area where the use of the software necessary for using the linkage function is permitted, the linkage function is not executed.
The information processing apparatus according to claim 7 or 8. having a processor;
The processor
Acquiring information indicating that use of the first software has been authenticated by authenticating the first software on the first terminal operated by the first user;
Acquiring information indicating that the use of the second software has been authenticated by performing an authentication operation on the second software at the second terminal operated by the second user after the use of the first software has been authenticated;
When the first user and the second user belong to at least one same group, proposing a cooperative function executable by a combination of software shared by the same group;
Information processing equipment. having a processor;
The processor
Acquiring information indicating that use of the first software has been authenticated by authenticating the first software on the first terminal operated by the first user;
Acquiring information indicating that the use of the second software has been authenticated by performing an authentication operation on the second software at the second terminal operated by the second user after the use of the first software has been authenticated;
If at least one of the first user or the second user does not have administrative authority when executing a linkage function executable by a combination of a plurality of pieces of software whose use has been authenticated, the linkage function restrict the use of
Information processing equipment. the computer
Identified by performing an identification operation on at least one first terminal operated by another user who belongs to the same group before performing an identification operation on the first device in the real space necessary for using the cooperation function by the own device. In a case where the information of the second device in the physical space is shared, when the identification operation for the first device in the physical space is newly completed by the device, the first device identified by the device and the first device are identified by the device. Notifying information of the cooperative function that can be executed in combination with the second device identified by the terminal;
A program to make it work. the computer
Acquiring information indicating that the first device has been identified by performing an identification operation on the first device with the first terminal operated by the first user;
Acquiring information indicating that the second device has been identified by performing an identification operation on the second device with a second terminal operated by a second user after identifying the first device;
When the first user and the second user belong to at least one same group, proposing a cooperation function executable by a combination of devices shared by the same group;
A program to make it work. the computer
Acquiring information indicating that the first device has been identified by performing an identification operation on the first device with the first terminal operated by the first user;
Acquiring information indicating that the second device has been identified by performing an identification operation on the second device with a second terminal operated by a second user after identifying the first device;
use of the linking function if at least one of the first user or the second user does not have administrative authority when executing the linking function executable by a combination of a plurality of identified devices; limit the
A program to make it work. the computer
Before performing authentication operation on the first software necessary for using the cooperative function on the own device, use is authenticated by performing authentication operation on the first terminal operated by at least one other user belonging to the same group. 2 When the information of the software is shared, when the self-apparatus newly completes the authentication operation for the first software, the use of the first software and the first terminal whose use has been authenticated on the self-apparatus is permitted. Notifying information of the cooperative function that can be executed in combination with the authenticated second software;
A program to make it work. the computer
Acquiring information indicating that use of the first software has been authenticated by authenticating the first software on the first terminal operated by the first user;
Acquiring information indicating that the use of the second software has been authenticated by performing an authentication operation on the second software at the second terminal operated by the second user after the use of the first software has been authenticated;
When the first user and the second user belong to at least one same group, proposing a cooperative function executable by a combination of software shared by the same group;
A program to make it work. the computer
Acquiring information indicating that use of the first software has been authenticated by authenticating the first software on the first terminal operated by the first user;
Acquiring information indicating that the use of the second software has been authenticated by performing an authentication operation on the second software at the second terminal operated by the second user after the use of the first software has been authenticated;
If at least one of the first user or the second user does not have administrative authority when executing a linkage function executable by a combination of a plurality of pieces of software whose use has been authenticated, the linkage function restrict the use of
A program to make it work. Identified by performing an identification operation on at least one first terminal operated by another user who belongs to the same group before performing an identification operation on the first device in the real space necessary for using the cooperation function by the own device. In a case where the information of the second device in the physical space is shared, when the identification operation for the first device in the physical space is newly completed by the device, the first device identified by the device and the first device are identified by the device. Notifying information of the cooperative function that can be executed in combination with the second device identified by the terminal;
control method. Acquiring information indicating that the first device has been identified by performing an identification operation on the first device with the first terminal operated by the first user;
Acquiring information indicating that the second device has been identified by performing an identification operation on the second device with a second terminal operated by a second user after identifying the first device;
When the first user and the second user belong to at least one same group, proposing a cooperation function executable by a combination of devices shared by the same group;
control method. Acquiring information indicating that the first device has been identified by performing an identification operation on the first device with the first terminal operated by the first user;
Acquiring information indicating that the second device has been identified by performing an identification operation on the second device with a second terminal operated by a second user after identifying the first device;
use of the linking function if at least one of the first user or the second user does not have administrative authority when executing the linking function executable by a combination of a plurality of identified devices; limit the
control method. Before performing authentication operation on the first software necessary for using the cooperative function on the own device, use is authenticated by performing authentication operation on the first terminal operated by at least one other user belonging to the same group. 2 When the information of the software is shared, when the self-apparatus newly completes the authentication operation for the first software, the use of the first software and the first terminal whose use has been authenticated on the self-apparatus is permitted. Notifying information of the cooperative function that can be executed in combination with the authenticated second software;
control method. Acquiring information indicating that use of the first software has been authenticated by authenticating the first software on the first terminal operated by the first user;
Acquiring information indicating that the use of the second software has been authenticated by performing an authentication operation on the second software at the second terminal operated by the second user after the use of the first software has been authenticated;
When the first user and the second user belong to at least one same group, proposing a cooperative function executable by a combination of software shared by the same group;
control method. Acquiring information indicating that use of the first software has been authenticated by authenticating the first software on the first terminal operated by the first user;
Acquiring information indicating that the use of the second software has been authenticated by performing an authentication operation on the second software at the second terminal operated by the second user after the use of the first software has been authenticated;
If at least one of the first user or the second user does not have administrative authority when executing a linkage function executable by a combination of a plurality of pieces of software whose use has been authenticated, the linkage function restrict the use of
control method.

Images