JP6171764B2 - Image processing system, portable terminal, server device, and program - Google Patents

Description

  The present invention relates to an image processing system, a portable terminal, a server device, and a program, and more particularly to a technique for linking a plurality of image processing apparatuses using a portable terminal.

  Conventionally, as a technique for managing or operating an image processing apparatus such as a multifunction peripheral, for example, using AR (Augmented Reality) technology, a captured image obtained by photographing the image processing apparatus with a portable terminal is used. A technique is known in which the status of the captured image processing device and the operation panel are combined and displayed so that the state of the image processing device can be checked intuitively and the image processing device can be operated. There is (for example, Patent Document 1). According to this prior art, by photographing an image processing apparatus with a portable terminal, it is possible to grasp whether or not the image processing apparatus is on standby, and by performing an operation on an operation panel displayed on the portable terminal. The image processing apparatus can execute a print job or the like.

JP 2012-29164 A

  However, in the above prior art, even if a mobile terminal is used, a plurality of image processing apparatuses installed at different places cannot be linked with each other. Therefore, for example, there is a problem in that it is not convenient in that a document file stored in one image processing apparatus cannot be printed out by another image processing apparatus.

  Therefore, the present invention has been made to solve the above-described conventional problems, and an object thereof is to provide an image processing system, a portable terminal, a server device, and a program capable of linking a plurality of image processing devices. Is.

  To achieve the above object, an invention according to claim 1 is an image processing system including a server device, a portable terminal, and a plurality of image processing devices, wherein the server device includes the plurality of image processing devices. Storage means for storing registration information in which specific information for specifying each of the image processing apparatuses is registered in advance, and information acquisition means for acquiring device information from each of the plurality of image processing apparatuses, The terminal includes: an imaging unit that captures an image; a display unit that displays an image; an operation detection unit that detects an operation on the display unit; and the plurality of image processing devices based on an operation detected by the operation detection unit When the first image processing apparatus included in the image is captured by the imaging unit, the information for specifying the first image processing apparatus is transmitted to the server apparatus before First device information corresponding to the first image processing device is acquired from a server device, and a captured image obtained by photographing the first image processing device and an image corresponding to the first device information are combined. A first control unit that generates one composite image; and a second image processing device included in the plurality of image processing devices based on an operation detected by the operation detection unit. Specific information for specifying the second image processing apparatus is transmitted to the server apparatus, second device information corresponding to the second image processing apparatus is acquired from the server apparatus, and the second image processing apparatus is acquired. A second synthesized image obtained by synthesizing the photographed image obtained by photographing the image corresponding to the second device information, and displaying the second synthesized image together with the first synthesized image on the display means. Control means, wherein the second control means displays the first composite image and the second composite image by the operation detection means when the first composite image and the second composite image are displayed on the display means. As an operation on each of the two composite images is detected, operation information based on the operation is transmitted to the server device, and the server device performs the first and second image processing based on the operation information. In this configuration, the devices are operated in a coordinated manner.

  According to a second aspect of the present invention, in the image processing system according to the first aspect, in the registration information, position information regarding each installation position of the plurality of image processing apparatuses is registered as the specific information. The portable terminal further includes position detection means for detecting a current position, and the first control means detects the current position detected by the position detection means when the first image processing device is photographed by the imaging means. The first device information is acquired from the server device by transmitting to the server device, and when the second control unit photographs the second image processing device by the imaging unit, the position detection unit The second device information is acquired from the server device by transmitting the current position detected by the server device to the server device. It is.

  According to a third aspect of the present invention, in the image processing system according to the first aspect, the first control unit analyzes the photographed image obtained by photographing the first image processing apparatus by the imaging unit. Specific information for specifying the first image processing apparatus is acquired and transmitted to the server apparatus, and the second control unit analyzes a captured image captured by the second image processing apparatus by the imaging unit. Thus, the specific information for specifying the second image processing apparatus is acquired and transmitted to the server apparatus.

  According to a fourth aspect of the present invention, in the image processing system according to the first aspect, when the first control unit captures the first image processing apparatus with the first image processing apparatus, By performing communication, specific information for specifying the first image processing apparatus is acquired and transmitted to the server apparatus, and the second control means uses the imaging means to transmit the second image processing apparatus. When photographing, the second image processing apparatus communicates with the second image processing apparatus to acquire specific information for specifying the second image processing apparatus and transmit the specific information to the server apparatus. .

  According to a fifth aspect of the present invention, in the image processing system according to any one of the first to fourth aspects, the information acquisition unit uses file information stored in each of the plurality of image processing apparatuses as the device information. The first control means obtains the first image by synthesizing an image corresponding to the file information stored in the first image processing device with the captured image obtained by photographing the first image processing device. The second control means generates a composite image, and synthesizes an image corresponding to the file information stored in the second image processing device with the photographed image obtained by photographing the second image processing device. The second synthesized image is generated.

  The invention according to claim 6 is the image processing system according to claim 5, wherein the second control means displays the first composite image and the second composite image on the display means. When the operation detected by the operation detection means is an operation of moving an image corresponding to file information included in one of the first composite image and the second composite image to the other, it corresponds to the file information Operation information for instructing to move or copy a file between the first and second image processing apparatuses is generated and transmitted to the server apparatus.

  According to a seventh aspect of the present invention, in the image processing system according to any one of the first to sixth aspects, the information acquisition unit obtains functional information related to a function executable by each of the plurality of image processing apparatuses. The first control means synthesizes an image corresponding to function information executable by the first image processing device with a captured image obtained by photographing the first image processing device, and The composite image is generated, and the second control unit synthesizes an image corresponding to the function information executable by the second image processing device with respect to the captured image obtained by capturing the second image processing device. A configuration is characterized in that a second composite image is generated.

  The invention according to claim 8 is the image processing system according to any one of claims 1 to 7, wherein the server device transmits the first or second device information to the mobile terminal. The composite image corresponding to the device information is transmitted, and the first or second control unit combines the first composite image or the second image by combining the composite image with the captured image obtained by the imaging unit. In this configuration, a composite image is generated.

  The invention according to claim 9 is the image processing system according to claim 8, wherein the composition image includes text corresponding to the device information.

  According to a tenth aspect of the present invention, in the image processing system according to any one of the first to ninth aspects, the first control unit transmits the first composite image to the server device and stores the first composite image. The second control means acquires the first composite image from the server device when displaying the second composite image on the display means, and displays the second composite image together with the first composite image. The configuration is as follows.

  According to an eleventh aspect of the present invention, in the image processing system according to the tenth aspect, when the first control unit transmits the first composite image to the server device, the first composite image is combined with the first composite image. In this configuration, information related to a composite position of an image corresponding to one device information is transmitted to the server device.

  The invention according to claim 12 is the image processing system according to any one of claims 1 to 11, wherein the server device refers to the registration information based on the first specific information received from the portable terminal. A first information processing means for identifying the first image processing apparatus and transmitting the first device information corresponding to the first image processing apparatus to the portable terminal; and a second information receiving means for receiving from the portable terminal Second information processing for identifying the second image processing apparatus with reference to the registration information based on identification information and transmitting the second device information corresponding to the second image processing apparatus to the portable terminal Means, wherein the first control means transmits the first composite image to the server device, and the second information processing means is based on the second specific information received from the portable terminal. Second image In association with the identification of the physical device, the first composite image received from the portable terminal is associated with the second image processing device, and the second device information corresponding to the second image processing device is associated with the portable device. When transmitting to the terminal, the first composite image associated with the second image processing apparatus is transmitted to the portable terminal.

  According to a thirteenth aspect of the present invention, there is provided a portable terminal capable of communicating with a server device that controls a plurality of image processing apparatuses, an imaging unit that captures an image, a display unit that displays an image, and an operation on the display unit. When the first image processing device included in the plurality of image processing devices is photographed by the imaging unit based on an operation detection unit to be detected and an operation detected by the operation detection unit, the first image processing device Specific information for identifying the first image processing apparatus is transmitted to the server apparatus, first device information corresponding to the first image processing apparatus is acquired from the server apparatus, and a captured image obtained by capturing the first image processing apparatus And a plurality of images based on an operation detected by the operation detection unit, and a first control unit that generates a first combined image by combining the image corresponding to the first device information with the first device information. When the second image processing device included in the processing device is photographed by the imaging unit, the server device transmits specification information for specifying the second image processing device, and the server device transmits the second information processing device. Obtaining second device information corresponding to the image processing apparatus, generating a second synthesized image obtained by synthesizing a captured image obtained by photographing the second image processing apparatus and an image corresponding to the second device information; Second display means for displaying the second composite image together with the first composite image on the display means, wherein the second control means displays the first composite image and the second composite image as the display means. When the operation detection unit detects an operation on each of the first composite image and the second composite image, the operation information based on the operation is sent to the server device. And a construction for causing the cooperative operation of the first and second image processing apparatus.

  The invention according to claim 14 is the portable terminal according to claim 13, further comprising position detection means for detecting a current position, wherein the first control means captures the first image processing device by the imaging means. The current position detected by the position detecting means is transmitted to the server apparatus as identification information for identifying the first image processing apparatus, and the second control means is configured to transmit the second image processing. When the apparatus is photographed by the imaging means, the current position detected by the position detecting means is transmitted to the server apparatus as identification information for identifying the second image processing apparatus. is there.

  According to a fifteenth aspect of the present invention, in the portable terminal according to the thirteenth aspect, the first control unit analyzes the captured image captured by the first image processing device by the imaging unit, thereby the first control unit. Specific information for specifying one image processing apparatus is acquired and transmitted to the server apparatus, and the second control unit analyzes a captured image captured by the second image processing apparatus by the imaging unit. Thus, the specific information for specifying the second image processing apparatus is acquired and transmitted to the server apparatus.

  According to a sixteenth aspect of the present invention, in the portable terminal according to the thirteenth aspect, the first control means communicates with the first image processing apparatus when the first image processing apparatus is photographed by the imaging means. To acquire specific information for specifying the first image processing apparatus and transmit the specific information to the server apparatus, and the second control means captures the second image processing apparatus by the imaging means. Then, by communicating with the second image processing device, specific information for specifying the second image processing device is acquired and transmitted to the server device.

The invention according to claim 17 is a server device that controls a plurality of image processing apparatuses by communicating with a mobile terminal, and specific information for specifying each of the plurality of image processing apparatuses is registered in advance. Based on first storage information received from the portable terminal, storage means for storing registration information, information acquisition means for acquiring device information from each of the plurality of image processing apparatuses, and the registration information First information processing means for identifying a first image processing apparatus included in a plurality of image processing apparatuses and transmitting device information corresponding to the first image processing apparatus to the portable terminal, and receiving from the portable terminal Based on the second identification information, the registration information is referred to identify a second image processing device included in the plurality of image processing devices, and a device corresponding to the second image processing device is identified. Second information processing means for transmitting information to the portable terminal; and device information corresponding to the second image processing apparatus is transmitted to the portable terminal by the second information processing means, and then operation information is transmitted from the portable terminal. And a control unit that causes the first and second image processing apparatuses to perform a cooperative operation based on the operation information. The second information processing unit includes the first image processing apparatus. A first synthesized image obtained by synthesizing an image of device information corresponding to the first image processing apparatus with respect to the photographed photographed image is received from the portable terminal and held, and the second synthesized information is received from the portable terminal. In association with specifying the second image processing device by receiving the specifying information, the first composite image is associated with the second image processing device, and device information corresponding to the second image processing device is obtained. The when transmitting to the mobile terminal, it is the first composite image associated with the second image processing apparatus configured characterized that you send to the mobile terminal.

According to an eighteenth aspect of the present invention, there is provided storage means for storing registration information in which specific information for specifying each of a plurality of image processing apparatuses is registered in advance, and the plurality of image processing by communicating with a portable terminal. A program executed in a server device that controls the device, wherein the server device is information acquisition means for acquiring device information from each of the plurality of image processing devices, and first specific information received from the portable terminal First information for identifying a first image processing device included in the plurality of image processing devices with reference to the registration information and transmitting device information corresponding to the first image processing device to the mobile terminal; A second image processing device included in the plurality of image processing devices with reference to the registration information based on second specific information received from the processing means and the portable terminal; A second information processing unit that identifies and transmits device information corresponding to the second image processing apparatus to the portable terminal, and device information corresponding to the second image processing apparatus is transmitted by the second information processing unit. In response to receiving operation information from the portable terminal after being transmitted to the portable terminal, the first and second image processing apparatuses are caused to function as a cooperative operation based on the operation information, and A second information processing unit configured to generate, from the portable terminal, a first synthesized image obtained by synthesizing an image of device information corresponding to the first image processing apparatus with a photographed image obtained by photographing the first image processing apparatus; As the second image processing device is specified by receiving and holding the second specifying information from the portable terminal, the first composite image is converted into the second image processing. Transmitting the first composite image associated with the second image processing device to the portable terminal when transmitting device information corresponding to the second image processing device to the portable terminal. This is a characteristic configuration.

  The invention according to claim 19 is communicable with a server device that controls a plurality of image processing devices, and has an imaging means for capturing an image, a display means for displaying an image, and an operation detection for detecting an operation on the display means. A first image processing device included in the plurality of image processing devices based on an operation detected by the operation detection unit. When shooting by the imaging unit, the first device information corresponding to the first image processing apparatus is acquired from the server apparatus by transmitting specific information for specifying the first image processing apparatus to the server apparatus. First control means for generating a first synthesized image obtained by synthesizing a photographed image obtained by photographing the first image processing apparatus and an image corresponding to the first device information; and And specifying for identifying the second image processing device when the second image processing device included in the plurality of image processing devices is photographed by the imaging unit based on an operation detected by the operation detection unit. Information is transmitted to the server device, second device information corresponding to the second image processing device is acquired from the server device, and a captured image obtained by photographing the second image processing device and the second device A second synthesized image obtained by synthesizing the image corresponding to the information is generated, and the second synthesized image is displayed on the display unit together with the first synthesized image. When the first synthesized image and the second synthesized image are displayed on the display means, the operation detecting means performs an operation on each of the first synthesized image and the second synthesized image. Along with being known, and transmits the operation information based on the operation to the server apparatus, a structure, characterized in that to work together with the first and second image processing apparatus.

  According to the present invention, a plurality of image processing apparatuses can be linked using a mobile terminal, and convenience is improved.

1 is a diagram illustrating a configuration concept of an image processing system. It is a block diagram which shows an example of the hardware constitutions and functional constitution of a server apparatus. It is a figure which shows an example of device registration information. It is a block diagram which shows an example of the hardware constitutions and functional structure of a portable terminal. It is a flowchart which shows an example of the process sequence performed before a user moves from a 1st base to a 2nd base. It is a figure which shows an example of the 1st synthesized image produced | generated in a portable terminal. It is a figure which shows an example of the 1st attached information linked | related with a 1st synthesized image. It is a flowchart which shows an example of the process sequence performed after a user moves from a 1st base to a 2nd base. It is a figure which shows an example of the 2nd synthesized image produced | generated in a portable terminal. It is a figure which shows an example of the 2nd attached information linked | related with a 2nd synthesized image. It is a figure which shows the example of a display screen in a portable terminal after image | photographing the 2nd image processing apparatus. It is a figure which shows the aspect which acquires specific information by a portable terminal image | photographing the 1st and 2nd image processing apparatus. It is a figure which shows the aspect which acquires specific information by a portable terminal communicating with the 1st and 2nd image processing apparatus. It is a flowchart which shows an example of the process sequence performed before a user moves from a 1st base to a 2nd base in 2nd Embodiment. It is a flowchart which shows an example of the process sequence performed after a user moves from a 1st base to a 2nd base in 2nd Embodiment. It is a flowchart which shows an example of the process sequence performed after a user moves from a 1st base to a 2nd base in 3rd Embodiment. It is a flowchart which shows an example of the process sequence performed after a user moves from a 1st base to a 2nd base in 4th Embodiment. It is a figure which shows the example of a display screen of the portable terminal in 5th Embodiment. It is a figure which shows an example of the 2nd attached information produced | generated in 5th Embodiment.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings. In the embodiments described below, members that are common to each other are denoted by the same reference numerals, and redundant descriptions thereof are omitted.

(First embodiment)
FIG. 1 is a diagram illustrating a conceptual configuration of an image processing system according to the first embodiment. This image processing system includes a plurality of image processing devices 1 and 2, a server device 3, and a mobile terminal 4. The image processing apparatuses 1 and 2 are configured by, for example, a multi-function peripheral or the like, and can store image data such as a document or perform print output. In the present embodiment, a case where the plurality of image processing apparatuses 1 and 2 are installed at locations apart from each other is illustrated. For example, the first image processing apparatus 1 is installed at a first site, and the second image processing apparatus 2 is installed at a second site. FIG. 1 illustrates the case where two image processing apparatuses 1 and 2 are provided in the image processing system, but the number of image processing apparatuses is not limited to two, and three or more. It doesn't matter.

  The server device 3 is a device that manages the plurality of image processing devices 1 and 2 and controls the plurality of image processing devices 1 and 2. The server apparatus 3 manages the image processing apparatuses 1 and 2 in association with position information indicating the installation positions of the image processing apparatuses 1 and 2. The server device 3 can communicate with each of the plurality of image processing devices 1 and 2 via a network 5 such as a LAN (Local Area Network) or the Internet. The server apparatus 3 acquires necessary information from the image processing apparatuses 1 and 2 via the network 5 or causes the image processing apparatuses 1 and 2 to perform necessary operations. The image processing apparatuses 1 and 2 can communicate with each other via the network 5 without using the server apparatus 3.

  The server device 3 can communicate with the mobile terminal 4 via a network 6 such as the Internet. Then, based on the information received from the mobile terminal 4, the server device 3 transmits information regarding the image processing devices 1 and 2, display images, and the like to the mobile terminal 4, Control the operation.

  The portable terminal 4 is a portable information processing terminal configured by, for example, a smartphone or a tablet terminal. The portable terminal 4 is exclusively used by one user, for example, and is used at any of the first base and the second base by being carried by the user. The portable terminal 4 also has a camera function for taking an image and a communication function for performing communication via a network 6 such as the Internet.

  In the image processing system of the present embodiment, in the above configuration, the first image processing apparatus 1 and the second image processing apparatus 2 installed at distant points are mutually connected using the portable terminal 4 carried by the user. It is possible to make it work together.

  The outline will be described. First, when the user uses the mobile terminal 4 to photograph the first image processing apparatus 1 installed at the first base, the mobile terminal 4 communicates with the server apparatus 3. . Through this communication, the mobile terminal 4 acquires device information related to the first image processing apparatus 1 and a tag image (composition image) TG1 corresponding to the device information from the server apparatus 3, and the first image processing apparatus A first synthesized image DG1 obtained by synthesizing the tag image (composition image) TG1 with the photographed image SG1 obtained by photographing 1 is generated and displayed. For example, the mobile terminal 4 generates and displays the first composite image DG1 using a display processing technique based on AR. The first composite image DG1 obtained in this way is stored in the mobile terminal 4 or the server device 3.

  Here, the tag image TG1 combined with the photographed image SG1 is a BOX (file storage area) provided in the first image processing apparatus 1, a file stored in the BOX, or the first image processing apparatus. 1 is an image like an icon corresponding to each of the functions executable in 1, for example, an image generated in advance in the server device 3. The mobile terminal 4 may generate the tag image TG1 each time based on the device information received from the server device 3. In the present embodiment, a case where a tag image corresponding to device information is generated in advance in the server apparatus 3 is exemplified.

  After the first composite image DG1 is generated at the first site as described above, the user moves to the second site and is installed at the second site using the mobile terminal 4 as indicated by the arrow F in FIG. When the second image processing apparatus 2 is photographed, the portable terminal 4 communicates with the server apparatus 3 again. Through this communication, the mobile terminal 4 acquires device information related to the second image processing device 2 from the server device 3 and a tag image (composition image) TG2 corresponding to the device information, and the second image processing device. A second synthesized image DG2 obtained by synthesizing the tag image (composition image) TG2 with the photographed image SG2 obtained by photographing 2 is generated and displayed. At this time, the mobile terminal 4 displays the second composite image DG2 together with the first composite image DG1 generated in advance at the first base. That is, when the user captures the second image processing apparatus 2 at the second base, the mobile terminal 4 includes the first composite image DG1 generated in advance at the first base and the second composite generated at the second base. Both the image DG2 and the image DG2 are displayed.

  The image processing system according to the present embodiment is configured so that, for example, when the first composite image DG1 and the second composite image DG2 are both displayed on the mobile terminal 4, the user includes one file included in the first composite image DG1. When the tag image corresponding to is dragged and dropped onto the tag image corresponding to one BOX included in the second composite image DG2, operation information based on the operation is transmitted from the portable terminal 4 to the server device 3, and the server device 3 causes the first image processing apparatus 1 and the second image processing apparatus 2 to cooperate with each other based on the operation information. For example, in the case of the file operation as described above, the server device 3 copies or moves the file stored in the first image processing device 1 to the designated BOX of the second image processing device 2. As described above, the first image processing apparatus 1 and the second image processing apparatus 2 are linked to each other.

  Hereinafter, such an image processing system will be described in more detail. FIG. 2 is a block diagram illustrating an example of a hardware configuration and a functional configuration of the server device 3. As shown in FIG. 2, the server device 3 includes a CPU 10, a memory 11, a communication interface 12, and a storage unit 13. The CPU 10 controls the operation of each unit by executing a predetermined program. In particular, the CPU 10 in this embodiment functions as the information acquisition unit 14, the first information processing unit 15, the second information processing unit 16, and the control unit 17 by executing a predetermined program. The memory 11 stores temporary data generated when the CPU 10 performs various arithmetic processes. The communication interface 12 is for communicating with each of the first and second image processing apparatuses 1 and 2 through the network 5 and with the portable terminal 4 through the network 6. The storage unit 13 is a non-volatile storage unit configured by, for example, a hard disk drive (HDD), and stores the above-described program and the like. In the present embodiment, as shown in FIG. 2, device registration information 18 is stored in the storage unit 13 in advance. The storage unit 13 is provided with a tag image storage area 19 for storing tag images corresponding to the device information of the image processing apparatuses 1 and 2 registered in the device registration information 18.

  The information acquisition unit 14 communicates with each of the first and second image processing apparatuses 1 and 2 registered in advance in the device registration information 18 via the communication interface 12, and the image processing apparatuses 1 and 2 communicate with the device. Information is acquired and recorded in the device registration information 18. FIG. 3 is a diagram illustrating an example of the device registration information 18. Information relating to the first and second image processing apparatuses 1 and 2 is registered in the device registration information 18. For example, the device registration information 18 includes a device ID 18 a uniquely assigned to each image processing device 1, 2, position information 18 b regarding the installation position of each image processing device 1, 2, and each image processing device 1, 1. 2 is registered in advance with an IP address 18c for communicating with the terminal 2. The device ID 18a, the position information 18b, and the IP address 18c are all specific information that can identify the image processing devices 1 and 2.

  The information acquisition unit 14 periodically communicates with the first and second image processing apparatuses 1 and 2 based on information registered in advance in the device registration information 18, and device information 18 d is transmitted from the image processing apparatuses 1 and 2. Is recorded in the device registration information 18. The device information 18d recorded in the device registration information 18 is, for example, file information and function information. The file information is information related to files stored in the first and second image processing apparatuses 1 and 2, and information related to the BOX in which each file is stored and information related to a user who can access the BOX. Is included. Even when a file is not stored in the BOX, information about the BOX and information about a user who can access the BOX are recorded as file information. On the other hand, the function information is information regarding functions (for example, printing, scanning, etc.) that can be executed by each of the first and second image processing apparatuses 1 and 2. The information acquisition unit 14 acquires the file information and function information as described above from each of the first and second image processing apparatuses 1 and 2 as device information 18 d and records it in the device registration information 18. At this time, the information acquisition unit 14 assigns a unique BOX ID to each BOX and assigns a unique file ID to each file. Furthermore, a unique function ID is assigned to each function. Then, the information acquisition unit 14 records the BOX ID, file ID, and function ID in the device registration information 18 in association with the device IDs 18a of the first and second image processing devices 1 and 2, respectively.

  The information acquisition unit 14 generates tag images TG1 and TG2 corresponding to the device information 18d in advance in association with registration or update of the device information 18d of the image processing apparatuses 1 and 2 with respect to the device registration information 18. And stored in the tag image storage area 19. Further, the information acquisition unit 14 stores the tag images TG1 and TG2 in a state associated with the image processing devices 1 and 2 when storing the tag images TG1 and TG2 in the tag image storage area 19. For example, the tag image TG1 shown in FIG. 1 is stored in the tag image storage area 19 as a tag image of the first image processing apparatus 1, and the tag image TG2 is stored as a tag image of the second image processing apparatus 2. Stored in area 19.

  Returning to FIG. 2, the first information processing unit 15 functions in conjunction with receiving specific information for specifying the first image processing apparatus 1 from the mobile terminal 4, and the device is based on the received specific information. By referring to the registration information 18, the first image processing apparatus 1 that the mobile terminal 4 is about to shoot is specified. Then, the first information processing unit 15 extracts device information corresponding to the first image processing apparatus 1 from the device registration information 18 and reads a tag image corresponding to the extracted device information from the tag image storage area 19. The device information and the tag image are transmitted to the portable terminal 4 as information relating to the first image processing apparatus 1. The second information processing unit 16 functions in conjunction with receiving specific information for specifying the second image processing apparatus 2 from the portable terminal 4, and device registration information 18 is obtained based on the received specific information. By referencing, the second image processing device 2 that the mobile terminal 4 is about to shoot is specified. Then, the second information processing unit 16 extracts from the device information device registration information 18 corresponding to the second image processing apparatus 2 and reads out the tag image corresponding to the extracted device information from the tag image storage area 19. Device information and a tag image are transmitted to the portable terminal 4 as information relating to the second image processing apparatus 2. In the present embodiment, the first information processing unit 15 and the second information processing unit 16 will be described separately from each other. However, since the processing performed by each of the processing units 15 and 16 has commonality, You may implement | achieve as a process part.

  Further, the control unit 17 receives the operation information from the portable terminal 4 after the information related to the second image processing device 2 is transmitted to the portable terminal 4 by the second information processing unit 16, and based on the operation information. Thus, the first and second image processing apparatuses 1 and 2 are operated in cooperation. In other words, the control unit 17 controls the execution of the process designated by the user by linking the two image processing apparatuses 1 and 2 installed at locations apart from each other.

  FIG. 4 is a block diagram illustrating an example of a hardware configuration and a functional configuration of the mobile terminal 4. As illustrated in FIG. 4, the mobile terminal 4 includes a CPU 20, a memory 21, a camera 22, a display unit 23, an operation detection unit 24, a position detection sensor 25, a communication interface 26, and a storage unit 27. I have. The CPU 20 controls the operation of each unit by executing various programs. The memory 21 stores temporary data generated when the CPU 20 performs various arithmetic processes. The camera 22 is an imaging means for taking an image, and is provided on the back side of the mobile terminal 4, for example. The display unit 23 is composed of, for example, a color liquid crystal display provided on the front side of the mobile terminal 4 and displays various images. The display unit 23 includes a touch panel sensor on the display screen. The operation detection unit 24 detects a user operation performed on the display screen of the display unit 23. For example, a touch position when a touch operation is performed on the display screen and a movement of the touch position. The release position when the touch operation is released can be detected. The position detection sensor 25 is a sensor that detects the current position of the mobile terminal 4 and is configured by, for example, a GPS (Global Positioning System) reception sensor. The communication interface 12 communicates with the server device 3 via the network 6. The storage unit 27 is a non-volatile storage unit configured by, for example, a solid state drive (SSD). The storage unit 27 is preinstalled with a program 28 for causing the mobile terminal 4 to communicate with the server apparatus 3 and causing the first and second image processing apparatuses 1 and 2 to operate in a coordinated manner.

  The CPU 20 activates the cooperative application 30 by reading and executing the program 28 from the storage unit 27 based on an instruction operation by the user. The cooperative application 30 includes a first control unit 31 and a second control unit 32. The first control unit 31 and the second control unit 32 function alternatively based on a selection operation by the user. For example, before the user moves from the first base to the second base, if the user selects to start the cooperative application 30 at the first base and shoots the first image processing apparatus 1, the cooperative application 30 The control unit 31 is caused to function. When the user moves from the first base to the second base and then selects to shoot the second image processing apparatus 2 by starting the cooperative application 30 at the second base, the cooperative application 30 32 is made to function.

  The first control unit 31 activates the camera 22 based on the operation detected by the operation detection unit 24 and sets the first image processing apparatus 1 in a state in which the first image processing apparatus 1 can be photographed. Further, the first control unit 31 acquires the current position detected by the position detection sensor 25, and the specific information for specifying the first image processing apparatus 1 that is the shooting target of the camera 22 based on the current position. To the server device 3 as follows. Thereby, the first control unit 31 can acquire the device information corresponding to the first image processing apparatus 1 and the tag image corresponding to the device information from the server apparatus 3. And the 1st control part 31 produces | generates and preserve | saves the 1st synthesized image DG1 by synthesize | combining tag image TG1 received from the server apparatus 3 with picked-up image SG1 which image | photographed the 1st image processing apparatus 1. FIG.

  On the other hand, the second control unit 32 activates the camera 22 based on the operation detected by the operation detection unit 24 and sets the second image processing apparatus 2 in a state where it can be photographed. In addition, the second control unit 32 acquires the current position detected by the position detection sensor 25, and the current position is specified information for specifying the second image processing apparatus 2 that is a subject to be captured by the camera 22. To the server device 3 as follows. Thereby, the second control unit 32 can acquire the device information corresponding to the second image processing apparatus 2 and the tag image corresponding to the device information from the server apparatus 3. Then, the second control unit 32 generates the second combined image DG2 by combining the tag image TG2 received from the server device 3 with the captured image SG2 obtained by capturing the second image processing device 2. In addition, the second control unit 32 displays the first synthesized image DG1 generated in advance and the second synthesized image DG2 generated this time on the display unit 23 together.

  Furthermore, when the second control unit 32 displays the first composite image DG1 and the second composite image DG2 on the display unit 23, the operation detection unit 24 controls each of the first composite image DG1 and the second composite image DG2. As the operation is detected, operation information based on the operation is transmitted to the server apparatus 3, and the first and second image processing apparatuses 1 and 2 are operated in cooperation with each other. In the present embodiment, the first control unit 31 and the second control unit 32 are described separately from each other. However, since the processes performed by these control units 31 and 32 have commonality, You may implement | achieve as a control part.

  Next, an example of specific operations in the portable terminal 4 and the server device 3 having the above-described configuration will be described. First, FIG. 5 is a processing procedure performed at the first site before the user moves from the first site to the second site, and includes the first control unit 31 in the portable terminal 4 and the first information in the server device 3. 4 is a flowchart illustrating an example of a processing procedure performed by the processing unit 15. As shown in FIG. 5, first, the user operates the mobile terminal 4 to start the cooperative application 30 in the first mode, thereby causing the first control unit 31 of the cooperative application 30 to function (step S10). The first control unit 31 activates the camera 22 (step S11) and acquires the current position of the mobile terminal 4 from the position detection sensor 25 (step S12). And the 1st control part 31 transmits various information to server apparatus 3 (Step S13). At this time, the information transmitted to the server device 3 includes information indicating the current position and user information such as a user ID for specifying the user.

  When the server device 3 receives the information transmitted from the mobile terminal 4, the server device 3 first performs user authentication based on the user information (step S14). Subsequent processing is performed on the condition that the user authentication is successful. When the user authentication is successful, the first information processing unit 15 described above functions in the server device 3 and specifies the first image processing device 1 that the mobile terminal 4 is to shoot based on the information indicating the current position ( Step S15). That is, the first information processing unit 15 refers to the position information 18 b registered in the device registration information 18, and displays the image processing apparatus installed at the position closest to the current position of the mobile terminal 4 as the first image. The processing device 1 is specified. If the position detection sensor 25 provided in the mobile terminal 4 further includes a geomagnetic sensor capable of detecting the attitude of the mobile terminal 4, an image processing device installed in the shooting direction of the mobile terminal 4 is used. The first image processing apparatus 1 can also be specified.

  The first information processing unit 15 extracts device information 18d corresponding to the identified first image processing apparatus 1. At this time, the first information processing unit 15 extracts only information on the BOX, file, and function that can be used by the user authenticated by the user authentication, and extracts information on the BOX, file, and function that cannot be used by the authenticated user. do not do. Then, the first information processing unit 15 transmits the device information 18d extracted from the device registration information 18 to the mobile terminal 4 (step S16). The first information processing unit 15 reads the tag image (composition image) TG1 corresponding to the device information 18d extracted in step S16 from the tag image storage area 19, and transmits the tag image TG1 to the mobile terminal 4 (step). S17).

  When the first control unit 31 of the portable terminal 4 receives the device information 18d and the tag image TG1 from the server device 3, the captured image SG1 obtained by capturing the first image processing device 1 and the tag image corresponding to the device information 18d. A first combined image is generated by combining with TG1 (step S18).

  FIG. 6 is a diagram illustrating an example of the first composite image DG <b> 1 generated in the mobile terminal 4. The first composite image DG1 is obtained by combining the captured image SG1 of the first image processing apparatus 1 with the tag image TG1 based on the device information 18d of the first image processing apparatus 1. In the example of FIG. 6, the case where only the file information corresponding to the first image processing apparatus 1 is combined as the tag image TG1 is illustrated. The tag image TG1 includes a tag image TG11 corresponding to BOX1 provided in the first image processing apparatus 1, and a tag image TG12 corresponding to File1 stored in the BOX1, and the tag image TG11. The image shows the relationship between TG12 and TG12 in a tree structure.

  When the first control unit 31 generates the first composite image DG1 as described above, the first control unit 31 generates first attached information related to the first composite image DG1 (step S19). FIG. 7 is a diagram illustrating an example of the first attached information 33. The first attached information 33 is information that is managed integrally with the first composite image DG1, and is generated based on the device information 18d received from the server device 3 and the composite result of the tag image TG1. The first attached information 33 includes, for example, an image ID 33a for specifying the first composite image DG1, a device ID 33b for specifying the first image processing device 1, and an IP address 33c of the first image processing device 1. And the user ID 33d and the combined information 33e are information associated with each other. Information that can identify individual tag images TG11 and TG12 combined with the photographed image SG1 is recorded in the combination information 33e. For example, a combination image ID for specifying each tag image, a tag image of each tag image, and the like. Coordinate information for specifying the synthesis position, information indicating the type of each tag image, and information such as BOX ID and file ID are recorded. With reference to such first attached information 33, when a touch operation or the like is performed on the first composite image DG1, an image processing apparatus to be controlled can be specified, and an operation on each tag image can be performed. It can be detected. Then, the first control unit 31 associates the first composite image DG1 generated as described above and the first auxiliary information 33 with each other and stores them in the storage unit 27 or the like (step S20). This completes the processing that should be performed before the user moves from the first base to the second base.

  Next, FIG. 8 is a processing procedure performed at the second site after the user moves from the first site to the second site, and the second control unit 32 in the mobile terminal 4 and the second information process in the server device 3. 4 is a flowchart illustrating an example of a processing procedure performed by a unit 16 and a control unit 17. As illustrated in FIG. 8, first, the user operates the mobile terminal 4 to start the cooperative application 30 in the second mode, thereby causing the second control unit 32 of the cooperative application 30 to function (step S30). The second control unit 32 acquires the current position of the mobile terminal 4 from the position detection sensor 25 (step S31), and reads the first composite image DG1 stored in advance by the processing at the first base (step S32). . Then, the second control unit 32 transmits information indicating the current position and the first composite image DG1 to the server 3 (step S33). At this time, the second control unit 32 also transmits the first attached information 33, user information, and the like managed integrally with the first composite image DG1 to the server device 3.

  When the server device 3 receives the information transmitted from the mobile terminal 4, the server device 3 performs user authentication based on the user information (step S 34), and when the user authentication is successful, the second information processing unit 16 described above in the server device 3. Works. The second information processing unit 16 specifies the second image processing device 2 that the mobile terminal 4 is to shoot based on the information indicating the current position (step S35). That is, the second information processing unit 16 refers to the position information 18b registered in the device registration information 18, and displays the image processing apparatus installed at the position closest to the current position of the mobile terminal 4 as the second image. The processing device 2 is specified. When the second information processing unit 16 can identify the second image processing device 2, the second composite image DG <b> 1 and the first auxiliary information 33 received from the mobile terminal 4 are identified by the identified second image processing. The information is stored in association with the device 2 (step S36). At this time, the first composite image DG1 and the first auxiliary information 33 may be associated as information on the second base instead of associating with the second image processing apparatus 2.

  And in the portable terminal 4, the 2nd control part 32 starts the camera 22 (step S37). Accordingly, the second control unit 32 may transmit information indicating the current position to the server device 3 again.

  Then, the second information processing unit 16 extracts device information 18 d corresponding to the second image processing apparatus 2 that is about to be photographed by the mobile terminal 4. At this time, the second information processing unit 16 extracts only information on the BOX, file, and function that can be used by the user authenticated by the user authentication, and extracts information on the BOX, file, and function that cannot be used by the authenticated user. do not do. Then, the second information processing unit 16 transmits the device information 18d of the second image processing apparatus 2 extracted from the device registration information 18 to the portable terminal 4 (Step S38). Further, the second information processing section 16 reads the tag image (composition image) TG2 corresponding to the device information 18d extracted in step S38 from the tag image storage area 19, and transmits the tag image TG2 to the mobile terminal 4 (step). S39). Further, the second information processing unit 16 reads out the first composite image DG1 and the first auxiliary information 33 associated with the second image processing apparatus 2 or the second base in step S36, and transmits them to the portable terminal 4 (step S36). S40).

  When the second control unit 32 of the mobile terminal 4 receives the device information 18d and the tag image TG2 from the server device 3, the captured image SG2 obtained by photographing the second image processing device 2 and the tag image (composition image) TG2 Are combined to generate a second composite image (step S41).

  FIG. 9 is a diagram illustrating an example of the second composite image DG <b> 2 generated in the mobile terminal 4. The second composite image DG2 is obtained by synthesizing the tag image TG2 based on the device information 18d of the second image processing device 2 with the captured image SG2 of the second image processing device 2. In the example of FIG. 9, the case where only the file information corresponding to the second image processing apparatus 2 is combined as the tag image TG2 is illustrated. This tag image TG2 includes a tag image TG21 corresponding to BOX2 provided in the second image processing apparatus 2, a tag image TG22 corresponding to BOX3, and a tag image TG23 corresponding to File2 stored in BOX2. , And a tag image TG24 corresponding to File3 stored in BOX2, and an image showing the relationship between tag images TG21 to TG24 in a tree structure.

  When the second control unit 32 generates the second composite image DG2 as described above, the second control unit 32 then generates second attached information related to the second composite image DG2 (step S42). FIG. 10 is a diagram illustrating an example of the second attached information 34. The second attached information 34 is information managed integrally with the second composite image DG2, and is generated based on the device information 18d received from the server device 3 and the composite result of the tag image TG2. The second attached information 34 includes, for example, an image ID 34a for specifying the second composite image DG2, a device ID 34b for specifying the second image processing device 2, and an IP address 34c of the second image processing device 2. And the user ID 34d and the combined information 34e are information associated with each other. Information that can specify individual tag images TG21 to TG24 combined with the photographed image SG2 is recorded in the combination information 34e. For example, a combination image ID for specifying each tag image and a combination of the tag images are recorded. Coordinate information for specifying the position, information indicating the type of each tag image, and information such as BOX ID and file ID are recorded. With reference to such second attached information 34, when a touch operation or the like is performed on the second composite image DG2, an image processing apparatus to be controlled can be specified, and an operation on each tag image can be performed. It can be detected. Then, when the second control unit 32 generates the second composite image DG2 and the second auxiliary information 34 as described above, the first composite image DG1 and the second composite image DG2 received from the server device 3 are displayed side by side. The information is displayed on the unit 23 (step S43).

  FIG. 11 is a diagram illustrating an example of a display screen displayed on the mobile terminal 4 after shooting the second image processing apparatus 2 at the second site. FIG. 11A illustrates the case where only the tag image based on the file information is displayed, and FIG. 11B illustrates the case where not only the file information but also the tag image based on the function information is displayed at the same time. ing. In these display screen examples, the first composite image DG1 and the second composite image DG2 are displayed side by side, and each tag image TG1, TG2 includes text such as a BOX name and a file name. Therefore, the user must grasp at a glance what BOX is provided in each of the first and second image processing apparatuses 1 and 2 and what file is stored in each BOX. Can do.

  Then, in a state where the first composite image DG1 and the second composite image DG2 are displayed on the display unit 23, the user performs a drag-and-drop operation on the tag image of the file, for example. Files can be moved or copied with respect to the second image processing apparatus 2. In addition, when the user performs a drag-and-drop operation to superimpose tag images of a plurality of files, the first or second image processing apparatus 1 or 2 can cause the plurality of files to be combined or difference-extracted. Can do. Further, in the case of the display screen as shown in FIG. 11B, the tag image corresponding to “File 1” of the first image processing apparatus 1 is changed to the tag image corresponding to “print” of the second image processing apparatus 2. By performing a drag-and-drop operation upward, the file stored in the first image processing apparatus 1 can be printed out by the second image processing apparatus 2.

  When the operation detection unit 24 detects the above operation (step S44), the second control unit 32 generates operation information based on the operation. At this time, the second control unit 32 determines the first composite image DG1 and the second composite information DG1 based on the display positions and display sizes of the first composite image DG1 and the second composite image DG2 and the first attached information 33 and the second attached information 34. The display position of each tag image synthesized with each of the second synthesized images DG2 is specified. Then, based on the coordinate positions of the start and end points of the drag-and-drop operation in the screen of the display unit 23 detected by the operation detection unit 24, the tag image to be moved, the tag image to be moved, and the like are detected and performed by the user. It is specified what kind of operation the received operation is to cause each of the first and second image processing apparatuses 1 and 2 to perform.

  For example, when the user operation detected as described above is an operation of dragging and dropping the tag image of the file onto the tag image of the BOX, the second control unit 32 moves the first or second file. It is specified that the operation is to be performed by each of the image processing apparatuses 1 and 2. When the user operation is an operation of dragging and dropping the tag images of a plurality of files so as to overlap each other, the second control unit 32 performs the operation on one of the first and second image processing apparatuses 1 and 2. As the operation to be performed, the combination processing and difference extraction processing of the plurality of files are specified. Further, when the user operation is an operation of dragging and dropping the tag image of the file onto the tag image of the print, the second control unit 32 specifies an operation for printing out the designated file by the designated image processing apparatus. . And the 2nd control part 32 produces | generates operation information based on the operation | movement identified in that way, and transmits to the server apparatus 3 (step S45).

  When the server device 3 receives the operation information from the mobile terminal 4, the server device 3 causes the control unit 17 to function. The control unit 17 specifies the first and second image processing apparatuses 1 and 2 designated by the operation information as a control target (step S46), and further performs the first and second image processing based on the operation information. The devices 1 and 2 are operated in a coordinated manner so as to perform processing designated by the user (step S47). As a result, the first and second image processing apparatuses 1 and 2 exchange files with each other. Therefore, after moving to the second site, the user can print out the file stored in the first image processing device 1 installed at the first site using the second image processing device 2. As a result, convenience is improved.

  Here, the position detection sensor 25 is provided in the portable terminal 4 in the above, and the portable terminal 4 is detected by the position detection sensor 25 when the first and second image processing apparatuses 1 and 2 are photographed. Although an example has been described in which the server apparatus 3 can identify the image processing apparatus that the mobile terminal 4 is to shoot by transmitting the position to the server apparatus 3, the present invention is not limited to this. That is, the mobile terminal 4 may not include the position detection sensor 25. In that case, the portable terminal 4 can acquire specific information for specifying the first and second image processing apparatuses 1 and 2 by adopting the following mode.

  FIG. 12 is a diagram illustrating a mode in which the mobile terminal 4 acquires specific information such as the device ID 18a and the IP address 18c when the first and second image processing devices 1 and 2 are photographed. The image processing apparatuses 1 and 2 have identification information 9 such as a two-dimensional barcode in which their own apparatus ID 18a and IP address 18c are embedded in advance at predetermined locations on the surface of the apparatus casing. When the user photographs each of the first and second image processing apparatuses 1 and 2 using the portable terminal 4, as shown in FIG. 12, the identification information 9 affixed to each image processing apparatus 1 and 2 is displayed. Photographing is performed so as to be included in the photographed images SG1 and SG2. The mobile terminal 4 extracts the identification information 9 by analyzing the captured images SG1 and SG2, and acquires the device ID 18a and the IP address 18c embedded in the identification information 9. Then, the mobile terminal 4 transmits the device ID 18a, the IP address 18c, and the like as specific information to the server device 3. That is, the first control unit 31 acquires specific information for specifying the first image processing device 1 by analyzing the captured image SG1 captured by the first image processing device 1 by the camera 22. It transmits to the server device 3. In addition, the second control unit 32 analyzes the captured image SG2 captured by the second image processing apparatus 2 with the camera 22, thereby acquiring specific information for specifying the second image processing apparatus 2 to obtain a server. Transmit to device 3. Since the device ID 18a and the IP address 18c are registered in advance in the device registration information 18 of the server device 3 as described above, the image processing device that the portable terminal 4 is to shoot is specified by referring to them. be able to.

  FIG. 13 shows that the mobile terminal 4 communicates with the first and second image processing apparatuses 1 and 2 to obtain specific information such as an apparatus ID 18a and an IP address 18c from the first and second image processing apparatuses 1 and 2. It is a figure which shows the aspect acquired. The first and second image processing apparatuses 1 and 2 store in advance specific information such as their own apparatus ID 18a and IP address 18c in their internal memories. Then, when the user activates the cooperative application 30 of the mobile terminal 4 and tries to photograph each of the first and second image processing apparatuses 1 and 2, the mobile terminal 4, as shown in FIG. Communication is performed with the image processing apparatuses 1 and 2 to be imaged by communication or the like, and specific information is acquired from the image processing apparatuses 1 and 2. Then, the portable terminal 4 transmits the specific information acquired from the image processing apparatuses 1 and 2 to the server apparatus 3. That is, the first control unit 31 specifies the first image processing device 1 by communicating with the first image processing device 1 when the first image processing device 1 is photographed by the camera 22. The specific information is acquired and transmitted to the server device 3. The second control unit 32 communicates with the second image processing device 2 to identify the second image processing device 2 when the second image processing device 2 is photographed by the camera 22. Information is acquired and transmitted to the server device 3. Thereby, the server apparatus 3 can specify the image processing apparatus that the mobile terminal 4 is about to shoot.

  As described above, the image processing system of the present embodiment is excellent in convenience because the plurality of image processing apparatuses 1 and 2 installed at bases separated from each other can be operated in cooperation using the mobile terminal 4. Yes. In addition, for the user, by performing an intuitive operation on the first composite image DG1 and the second composite image DG2 displayed side by side on the display unit 23 of the mobile terminal 4, the plurality of image processing apparatuses 1 and 2 can be controlled. Because it can be linked, it has excellent operability.

  In the above, the case where the first composite image DG1 and the second composite image DG2 are generated one by one for each of the first image processing apparatus 1 and the second image processing apparatus 2 has been illustrated, but each is different. A plurality of first composite images DG1 may be generated in advance for a plurality of image processing apparatuses. In this case, when the user moves to the second base and attempts to photograph the second image processing apparatus 2, the user selects the first composite image DG1 from the plurality of first composite images DG1 to select the first composite image DG1. There is an advantage that one image processing apparatus to be linked with the second image processing apparatus 2 can be selected.

(Second Embodiment)
Next, a second embodiment will be described. In the first embodiment, the case where the first composite image DG1 generated by the user photographing the first image processing apparatus 1 at the first base is stored in the mobile terminal 4 is mainly exemplified. However, if the first composite image DG1 is held in the mobile terminal 4, the memory resources of the mobile terminal 4 and the like are pressed. Therefore, in the present embodiment, a mode in which the first composite image DG1 generated at the first base is stored in the server device 3 will be described. In this embodiment, the hardware configuration and functional configuration of the server device 3 and the mobile terminal 4 are the same as those described in the first embodiment.

  FIG. 14 is a processing procedure performed at the first site before the user moves from the first site to the second site in the second embodiment, and the first control unit 31 in the mobile terminal 4 and the server device 3 4 is a flowchart illustrating an example of a processing procedure performed by the first information processing unit 15. In the flowchart of FIG. 14, steps S50 to S59 are the same as steps S10 to S19 shown in FIG. When the first control unit 31 of the mobile terminal 4 generates the first composite image DG1 related to the first image processing apparatus 1 and the first attached information 33 corresponding to the first composite image DG1, the first composite image DG1 and the first attached information 33 are transmitted to the server device 3 (step S60). Upon receiving the first composite image DG1 and the first auxiliary information 33 from the mobile terminal 4, the server device 3 associates them with each other and stores them in the storage unit 13 (step S61). The server device 3 stores each of the first composite image DG1 and the first auxiliary information 33 in association with the user.

  FIG. 15 is a processing procedure performed at the second site after the user has moved from the first site to the second site in the second embodiment, and the second control unit 32 in the portable terminal 4 and the first in the server device 3. 2 is a flowchart illustrating an example of a processing procedure performed by the information processing unit 16 and the control unit 17. As shown in FIG. 15, first, the user operates the mobile terminal 4 to activate the cooperative application 30 in the second mode, thereby causing the second control unit 32 of the cooperative application 30 to function (step S70). The second control unit 32 acquires the current position of the mobile terminal 4 from the position detection sensor 25 (step S71), and transmits information indicating the current position to the server device 3 (step S72). At this time, the second control unit 32 also transmits user information to the server device 3.

  When the server apparatus 3 receives the user information from the portable terminal 4, the server apparatus 3 performs user authentication (step S 73). When the user authentication is successful, the second information processing unit 16 described above functions in the server apparatus 3. The second information processing unit 16 searches whether or not the first composite image DG1 and the first auxiliary information 33 associated with the user specified by the user authentication are stored, and the user has previously stored at the first base. The first composite image DG1 and the first auxiliary information 33 generated by photographing the first image processing device 1 are specified (step S74). In addition, the second information processing unit 16 specifies the second image processing device 2 that the mobile terminal 4 is about to capture based on the information indicating the current position received from the mobile terminal 4 (step S75). When the second image processing device 2 can be identified, the second information processing unit 16 uses the identified second image processing device to store the first composite image DG1 and the first auxiliary information 33 stored in advance. Is stored in association with 2 (step S76). At this time, the first composite image DG1 and the first auxiliary information 33 may be associated as information on the second base instead of associating with the second image processing apparatus 2.

  Thereafter, the same processing as in the first embodiment is performed. That is, the processing performed in steps S77 to S87 in FIG. 15 is the same as the processing performed in steps S37 to S47 in FIG. That is, when the camera 22 is activated on the portable terminal 4 and the second image processing apparatus 2 is photographed, the device information 18d of the second image processing apparatus 2 and the tag image TG2 are transmitted from the server apparatus 3 accordingly. At the same time, the first composite image DG1 and the first auxiliary information 33 associated with the second image processing apparatus 2 are transmitted in the previous step S76. Then, the mobile terminal 4 generates the second composite DG2, and displays the second composite image DG2 and the first composite image DG1 received from the server device 3 side by side on the display unit 23. Thereafter, when the mobile terminal 4 detects an operation by the user, the mobile terminal 4 transmits operation information based on the operation to the server device 3 to link the first image processing device 1 and the second image processing device 2 with each other. Make it work.

  As described above, in the present embodiment, since the first composite image DG1 is stored in the server device 3 in advance, it is possible to prevent the memory resource of the mobile terminal 4 from being compressed. In particular, when a plurality of first composite images DG1 are generated in advance for a plurality of different image processing apparatuses, the effect is increased.

  In the present embodiment, not only the first composite image DG1 but also the first attached information 33 corresponding to the first composite image DG1 is stored in the server device 3. Therefore, for example, when the user additionally registers another user's ID with respect to the user ID 33d of the first attached information 33 shown in FIG. 7, the first composite image DG1 and the first attached image stored in the server device 3 are stored. The information 33 can be used by the other user. Therefore, a user who has never been to the first site can link the first image processing apparatus 1 installed at the first site, further improving convenience.

(Third embodiment)
Next, a third embodiment will be described. In the first and second embodiments, since the first composite image DG1 and the first auxiliary information 33 are generated before the user moves from the first base to the second base, the movement from the first base to the second base. If, for example, a file stored in the first image processing apparatus 1 is changed, the changed file may not be used in cooperation. Therefore, in the present embodiment, a mode in which the first composite image DG1 is updated to the latest state when the first and second image processing apparatuses 1 and 2 are cooperatively operated at the second site will be described.

  Also in the present embodiment, the hardware configuration and functional configuration of the server device 3 and the mobile terminal 4 are the same as those described in the first embodiment. In the present embodiment, the processing performed by the mobile terminal 4 and the server device 3 when the user is at the first site is the same as that in the second embodiment. That is, in the present embodiment, an example in which the first composite image DG1 and the first attached information 33 generated at the first base are stored in the server device 3 in advance will be described.

  FIG. 16 is a processing procedure performed at the second site after the user has moved from the first site to the second site in the third embodiment, and the second control unit 32 in the mobile terminal 4 and the first in the server device 3. 2 is a flowchart illustrating an example of a processing procedure performed by the information processing unit 16 and the control unit 17. As illustrated in FIG. 16, first, the user operates the mobile terminal 4 to start the cooperative application 30 in the second mode, thereby causing the second control unit 32 of the cooperative application 30 to function (step S100). The second control unit 32 acquires the current position of the mobile terminal 4 from the position detection sensor 25 (step S101), and transmits information indicating the current position to the server device 3 (step S102). At this time, the second control unit 32 also transmits user information to the server device 3.

  When the server apparatus 3 receives the user information from the portable terminal 4, the server apparatus 3 performs user authentication (step S103). When the user authentication is successful, the second information processing unit 16 described above functions in the server apparatus 3. The second information processing unit 16 reads the first composite image DG1 and the first auxiliary information 33 associated with the user specified by the user authentication (step S104), and the first image based on the first auxiliary information 33 The processing device 1 is specified (step S105). Then, the server apparatus 3 causes the information acquisition unit 14 to function and checks whether or not the device information 18d of the first image processing apparatus 1 has been updated (step S106). As a result, for example, when there is a deletion, addition, or change of a file stored in the first image processing device 1, the information acquisition unit 14 acquires the latest device information from the first image processing device 1, The device information 18d of the device registration information 18 is updated (step S107). At this time, the information acquisition unit 14 generates a tag image TG1 corresponding to the updated device information 18d and stores it in the tag image storage area 19. For example, when a new file is added to the first image processing apparatus 1, a tag image TG1 corresponding to the new file is additionally stored. When the file of the first image processing apparatus 1 is not updated, the device information 18d of the device registration information 18 is not updated. In that case, the processing is the same as that of the second embodiment (FIG. 15) thereafter.

  After that, the second information processing unit 16 functions again in the server device 3 and specifies the second image processing device 2 that the mobile terminal 4 is to shoot based on information indicating the current position received from the mobile terminal 4 ( Step S108). When the second image processing device 2 can be identified, the second information processing unit 16 uses the identified second image processing device to store the first composite image DG1 and the first auxiliary information 33 stored in advance. Is stored in association with 2 (step S109). At this time, the first composite image DG1 and the first auxiliary information 33 may be associated as information on the second base instead of associating with the second image processing apparatus 2.

  And in the portable terminal 4, the 2nd control part 32 starts the camera 22 (step S110). Accordingly, the second control unit 32 may transmit information indicating the current position to the server device 3 again.

  Then, the second information processing unit 16 extracts the device information 18d corresponding to the second image processing device 2 that is about to be photographed by the mobile terminal 4 and transmits it to the mobile terminal 4 (step S111). The second information processing unit 16 reads the tag image TG2 corresponding to the device information 18d of the second image processing device 2 from the tag image storage area 19, and transmits the tag image TG2 to the portable terminal 4 (step S112). . Furthermore, the second information processing unit 16 reads out the first composite image DG1 and the first auxiliary information 33 associated with the second image processing device 2 or the second base in step S109, transmits them to the mobile terminal 4, and The updated device information 18d related to the first image processing apparatus 1 and the tag image TG1 corresponding to the device information 18 are transmitted to the portable terminal 4 (step S113).

  When the second control unit 32 of the portable terminal 4 receives the updated device information 18 d related to the first image processing apparatus 1 and the tag image TG1 corresponding to the device information 18 from the server apparatus 3, the second control section 32 receives from the server apparatus 3. The first composite image DG1 is updated (step S114). That is, the photographed image SG1 and the tag image TG1 included in the first composite image DG1 are once separated, and a new tag image TG1 corresponding to the latest device information 18d is synthesized with the separated photographed image SG1. One composite image DG1 is updated to the latest state. Further, the second control unit 32 newly generates the first attached information 33 based on the updated first composite image DG1, and updates the first attached information 33 (step S115).

  Next, the second control unit 32 generates the second composite image DG2 based on the device information 18d of the second image processing device 2 received from the server device 3 (step S116), and corresponds to the second composite image DG2. Second attached information 34 to be generated is generated (step S117). Then, the second control unit 32 displays the first composite image DG1 and the second composite image DG2 side by side on the display unit 23 (step S118). The subsequent processes (steps S119 to S122) are the same as the processes of steps S41 to S44 shown in FIG. That is, when the portable terminal 4 detects an operation by the user, the server device 3 transmits the operation information based on the operation to the server device 3, so that the server device 3 has the first image processing device 1 and the second image processing device. 2 are controlled so as to cooperate with each other.

  As described above, in this embodiment, when the user tries to photograph the second image processing apparatus 2 at the second base, the device information of the first image processing apparatus 1 in which the server apparatus 3 is installed at the first base. Is updated, and if the device information is updated, the latest device information and the latest tag image corresponding thereto are transmitted to the mobile terminal 4. Then, the mobile terminal 4 updates and displays the first composite image DG1 based on the latest device information and the tag image. Therefore, in the present embodiment, even if the file stored in the first image processing apparatus 1 is changed while the user is moving from the first base to the second base, Since the first and second image processing apparatuses 1 and 2 can be linked in a state in which the change is reflected, it is excellent in convenience.

(Fourth embodiment)
Next, a fourth embodiment will be described. In the first to third embodiments, when an operation by the user is detected in a state where the first composite image DG1 and the second composite image DG2 are displayed side by side on the mobile terminal 4, the mobile terminal 4 Based on the display position and display size of the first composite image DG1 and the second composite image DG2, and the first attached information 33 and the second attached information 34, the second control unit 32 performs the first operation performed by the user. And what operation is to be performed by each of the second image processing apparatuses 1 and 2. In the present embodiment, a mode in which processing for specifying such an operation is performed by the server device 3 will be described.

  Also in the present embodiment, the hardware configuration and functional configuration of the server device 3 and the mobile terminal 4 are the same as those described in the first embodiment. In the present embodiment, the processing performed by the mobile terminal 4 and the server device 3 when the user is at the first site is the same as that in the second embodiment.

  FIG. 17 is a processing procedure performed at the second site after the user has moved from the first site to the second site in the fourth embodiment, and the second control unit 32 in the portable terminal 4 and the first in the server device 3. 2 is a flowchart illustrating an example of a processing procedure performed by the information processing unit 16 and the control unit 17. In the flowchart of FIG. 17, the processes in steps S130 to S142 are the same as the processes in steps S70 to S82 shown in FIG.

  When the second control unit 32 of the mobile terminal 4 generates the second composite image DG2 and the second auxiliary information 34 related to the second image processing device 2 (steps S141 and S142), the generated second composite image DG2 and The second attached information 34 is transmitted to the server device 3 (step S143). As a result, the server device 3 holds the first composite image DG1, the first attached information 33, the second composite image DG2, and the second attached information 34. Further, when the second control unit 32 displays the first composite image DG1 and the second composite image DG2 side by side on the display unit 23 (step S144), the display position and display of the first composite image DG1 and the second composite image DG2 are displayed. Display position information indicating the size and the like is transmitted to the server device 3 (step S145). Thereby, the server apparatus 3 can grasp | ascertain what display position and display size of each of the 1st synthesized image DG1 and the 2nd synthesized image DG2 are displayed in the display part 23 of the portable terminal 4. FIG.

  When the operation detection unit 24 detects an operation on the display screen of the display unit 23 (step S146), the second control unit 32 generates operation information based on the operation. At this time, the second control unit 32 acquires coordinate positions such as a start point and an end point of the drag and drop operation performed on the display screen from the operation detection unit 24, and generates operation information including the coordinate positions. Then, the second control unit 32 transmits the operation information to the server device 3 (step S147).

  When receiving the operation information from the portable terminal 4, the control unit 17 of the server device 3 analyzes the operation information (step S148). In other words, the control unit 17 specifies the first and second image processing apparatuses 1 and 2 that are the targets of the cooperative operation based on the first attached information 33 and the second attached information 34 (step S149). The control unit 17 also determines the first composite image DG1 and the second composite image based on the display positions and display sizes of the first composite image DG1 and the second composite image DG2, and the first attached information 33 and the second attached information 34. The display position of each tag image combined with each of DG2 is specified. Based on the coordinate position included in the operation information, the tag image to be moved, the tag image to be moved, and the like are detected, and the operation performed by the user is performed on each of the first and second image processing apparatuses 1 and 2. It is specified what operation is to be performed (step S150). Thereafter, the control unit 17 causes the first and second image processing apparatuses 1 and 2 to operate in a coordinated manner, and controls the execution of processing designated by the user (step S151).

  Thus, in the present embodiment, when an operation by the user is detected in a state where the first composite image DG1 and the second composite image DG2 are displayed side by side on the mobile terminal 4, the operation performed by the user The server apparatus 3 determines what kind of cooperative operation the first and second image processing apparatuses 1 and 2 are to perform. Therefore, there is an advantage that the processing load on the portable terminal 4 is reduced.

  In this embodiment as well, as described in the third embodiment, when the user tries to photograph the second image processing apparatus 2 at the second base, the server apparatus 3 is installed at the first base. Whether or not the device information of the first image processing apparatus 1 has been updated is confirmed. If the device information has been updated, the latest device information may be transmitted to the mobile terminal 4. As a result, even if the file stored in the first image processing apparatus 1 is changed while the user is moving from the first base to the second base, the change is reflected. In this state, the first and second image processing apparatuses 1 and 2 can be operated in cooperation.

(Fifth embodiment)
Next, a fifth embodiment will be described. In the first to fourth embodiments, the case where each of the first composite image DG1 and the second composite image DG2 is handled as separate images independent from each other is illustrated. In the present embodiment, for example, a mode in which the first composite image DG1 generated first is handled as one of the tag images (composition images) included in the second composite image DG2 will be described.

  In the present embodiment, when the user photographs the second image processing device 2 at the second base, the first composite image DG1 and the second composite image DG2 are displayed on the mobile terminal 4 in a state as shown in FIG. The That is, the second control unit 32 of the mobile terminal 4 performs the tag image TG2 corresponding to the device information 18d of the second image processing device 2 with respect to the captured image SG2 obtained by capturing the second image processing device 2, and the server device. Each of the first composite image DG1 received from 3 is combined as a tag image. Thus, the first composite image DG1 generated in advance by photographing the first image processing device 1 becomes the tag image TG3 synthesized with the photographed image SG2 of the second image processing device 2, and the second composition. It is displayed on the display unit 23 of the portable terminal 4 as a part of the image DG2.

  FIG. 19 is a diagram illustrating an example of the second attached information 34 when the second composite image DG2 is generated as described above. In the second attached information 34, composite information 34f related to the first composite image DG1 composited with the captured image SG2 is recorded. Information for specifying the first composite image DG1 is recorded in the composite image ID of the composite information 34f. Therefore, the first attached information 33 (FIG. 7) corresponding to the first composite image DG1 can be referred to by referring to the composite image ID of the composite information 34f. Accordingly, when the user touches within the range of the tag image TG3 of the first composite image DG1 in the display state as shown in FIG. 18, the second control unit 32 first refers to the second attached information 34, It can be detected that the first composite image DG1 is displayed at the touch position. Then, by referring to the first attached information 33 based on the composite information 34f, the second control unit 32 can detect which of the tag images included in the first composite image DG1 has been touched. it can.

As described above, in the present embodiment, the first composite image DG1 is handled as one of the tag images included in the second composite image DG2, and the second attached information 34 corresponding to the second composite image DG2 Link information for linking the first attached information 33 corresponding to one composite image DG1 is recorded. Therefore, as in the above embodiments, when an operation by the user is detected with the display screen as shown in FIG. 18 displayed on the mobile terminal 4, the operation performed by the user is the first and second operations. It is possible to normally detect what kind of cooperative operation the image processing apparatuses 1 and 2 are to perform.
(Modification)
As mentioned above, although one embodiment related to the present invention was described, the present invention is not limited to the contents described in the above embodiment, and various modifications can be applied.

  For example, in each of the embodiments described above, the case where two image processing apparatuses are operated in cooperation with each other is illustrated. However, if the above-described technique is applied, three or more image processing apparatuses can be operated in cooperation with each other at the same time.

  In the above-described embodiment, a case where a plurality of image processing apparatuses 1 and 2 are operated in cooperation to perform file movement, copy, combination, difference extraction, print output, and the like is illustrated. However, jobs that can be performed by operating the plurality of image processing apparatuses 1 and 2 in a cooperative manner are not limited to those described above. For example, file conversion, text conversion, translation processing, and the like can also be performed by the above-described cooperation operation.

  Further, in the above embodiment, the case where the tag image corresponding to the device information 18d of each image processing apparatus 1 and 2 is generated in advance in the server apparatus 3 and held in the tag image storage area 19 is exemplified. It is not limited. For example, if such a tag image is configured to be generated based on the device information 18d received by the mobile terminal 4 from the server device 3, the processing load for generating the tag image in the server device 3 is reduced. Such a configuration may be adopted.

DESCRIPTION OF SYMBOLS 1, 2 Image processing apparatus 3 Server apparatus 4 Portable terminal 13 Memory | storage part (storage means)
14 Information acquisition unit (information acquisition means)
15 1st information processing part (1st information processing means)
16 2nd information processing part (2nd information processing means)
17 Control unit (control means)
18 Device registration information (registration information)
22 Camera (imaging means)
23 Display section (display means)
24 Operation detection unit (operation detection means)
25 Position detection sensor (position detection means)
28 program 31 first control unit (first control means)
32 2nd control part (2nd control means)
DG1 first composite image DG2 second composite image

Claims (19)

An image processing system comprising a server device, a portable terminal, and a plurality of image processing devices,
The server device is
Storage means for storing registration information in which specific information for specifying each of the plurality of image processing apparatuses is registered in advance;
Information acquisition means for acquiring device information from each of the plurality of image processing apparatuses;
With
The portable terminal is
Imaging means for taking an image;
Display means for displaying an image;
Operation detecting means for detecting an operation on the display means;
Specific information for specifying the first image processing device when the first image processing device included in the plurality of image processing devices is photographed by the imaging unit based on an operation detected by the operation detection unit. To the server device, the first device information corresponding to the first image processing device is acquired from the server device, and the photographed image obtained by photographing the first image processing device and the first device information First control means for generating a first synthesized image obtained by synthesizing an image corresponding to
Specific information for specifying the second image processing device when the second image processing device included in the plurality of image processing devices is photographed by the imaging unit based on an operation detected by the operation detection unit. To the server device, the second device information corresponding to the second image processing device is acquired from the server device, and the photographed image obtained by photographing the second image processing device and the second device information A second control unit that generates a second composite image obtained by combining the image corresponding to the second composite image and displays the second composite image together with the first composite image on the display unit;
With
When the second control means is displaying the first composite image and the second composite image on the display means, the operation detection means performs an operation on each of the first composite image and the second composite image. Is detected, the operation information based on the operation is transmitted to the server device,
The server apparatus causes the first and second image processing apparatuses to perform a cooperative operation based on the operation information. In the registration information, position information regarding each installation position of the plurality of image processing apparatuses is registered as the specific information.
The portable terminal further includes position detection means for detecting a current position,
The first control unit transmits the current position detected by the position detection unit to the server device when the first image processing device is photographed by the imaging unit, thereby causing the first control unit to transmit the first position from the server device. Get device information
The second control unit transmits the current position detected by the position detecting unit to the server device when the second image processing device is photographed by the imaging unit, thereby causing the second control unit to transmit the second position from the server device. The image processing system according to claim 1, wherein device information is acquired. The first control unit obtains identification information for identifying the first image processing apparatus by analyzing a captured image captured by the first image processing apparatus by the imaging unit, and To the device,
The second control unit acquires specific information for specifying the second image processing device by analyzing a captured image captured by the second image processing device by the imaging unit, and the server The image processing system according to claim 1, wherein the image processing system transmits the image to an apparatus. The first control unit is configured to identify the first image processing device by communicating with the first image processing device when the first image processing device is photographed by the imaging unit. Obtain information and send it to the server device;
The second control unit is configured to identify the second image processing device by communicating with the second image processing device when photographing the second image processing device by the imaging unit. The image processing system according to claim 1, wherein information is acquired and transmitted to the server device. The information acquisition means acquires file information stored in each of the plurality of image processing apparatuses as the device information,
The first control unit synthesizes an image corresponding to file information stored in the first image processing device with a captured image obtained by photographing the first image processing device, and generates the first composite image. Generate
The second control means synthesizes an image corresponding to the file information stored in the second image processing device with the photographed image obtained by photographing the second image processing device to obtain the second composite image. The image processing system according to claim 1, wherein the image processing system is generated.   The second control means displays the first composite image and the second composite image on the display means, and the operation detected by the operation detection means is the first composite image and the second composite image. When the operation is to move an image corresponding to file information included in one of the composite images to the other, the file corresponding to the file information is moved or copied between the first and second image processing apparatuses. 6. The image processing system according to claim 5, wherein operation information instructing this is generated and transmitted to the server device. The information acquisition unit acquires function information regarding a function executable by each of the plurality of image processing apparatuses as the device information,
The first control means generates the first synthesized image by synthesizing an image corresponding to the function information executable by the first image processing apparatus with a captured image obtained by photographing the first image processing apparatus. And
The second control unit generates the second composite image by synthesizing an image corresponding to the function information executable by the second image processing device with a captured image obtained by photographing the second image processing device. The image processing system according to claim 1, wherein the image processing system is an image processing system. When the server device transmits the first or second device information to the mobile terminal, the server device transmits an image for synthesis corresponding to the device information,
The said 1st or 2nd control means produces | generates the said 1st synthesized image or the 2nd synthesized image by synthesize | combining the said image for a synthesis | combination with the picked-up image obtained by the said imaging means. The image processing system according to any one of 1 to 7.   The image processing system according to claim 8, wherein the composition image includes text corresponding to the device information. The first control means transmits and stores the first composite image to the server device,
When the second control means displays the second composite image on the display means, the second control means acquires the first composite image from the server device and displays the second composite image together with the first composite image. The image processing system according to claim 1, wherein the image processing system is characterized in that:   When the first control unit transmits the first composite image to the server device, the first control unit transmits information related to the composite position of the image corresponding to the first device information combined with the first composite image to the server device. The image processing system according to claim 10. The server device is
Based on the first identification information received from the portable terminal, the registration information is referred to identify the first image processing apparatus, and the first device information corresponding to the first image processing apparatus is First information processing means for transmitting to the mobile terminal;
Based on the second identification information received from the mobile terminal, the second image processing apparatus is identified with reference to the registration information, and the second device information corresponding to the second image processing apparatus is Second information processing means for transmitting to the mobile terminal;
Further comprising
The first control means transmits the first composite image to the server device,
The second information processing means specifies the second image processing device based on the second specifying information received from the portable terminal, and the first information is received from the portable terminal. When the second device information corresponding to the second image processing apparatus is transmitted to the portable terminal, the first composite image associated with the second image processing apparatus is The image processing system according to claim 1, wherein the image processing system transmits the image to the portable terminal. A portable terminal capable of communicating with a server device that controls a plurality of image processing devices,
Imaging means for taking an image;
Display means for displaying an image;
Operation detecting means for detecting an operation on the display means;
Specific information for specifying the first image processing device when the first image processing device included in the plurality of image processing devices is photographed by the imaging unit based on an operation detected by the operation detection unit. To the server device, the first device information corresponding to the first image processing device is acquired from the server device, and the photographed image obtained by photographing the first image processing device and the first device information First control means for generating a first synthesized image obtained by synthesizing an image corresponding to
Specific information for specifying the second image processing device when the second image processing device included in the plurality of image processing devices is photographed by the imaging unit based on an operation detected by the operation detection unit. To the server device, the second device information corresponding to the second image processing device is acquired from the server device, and the photographed image obtained by photographing the second image processing device and the second device information A second control unit that generates a second composite image obtained by combining the image corresponding to the second composite image and displays the second composite image together with the first composite image on the display unit;
With
When the second control means is displaying the first composite image and the second composite image on the display means, the operation detection means performs an operation on each of the first composite image and the second composite image. A mobile terminal that transmits operation information based on the operation to the server device and causes the first and second image processing devices to operate in cooperation with each other. It further comprises position detection means for detecting the current position,
The first control means uses the current position detected by the position detection means as identification information for identifying the first image processing apparatus when the first image processing apparatus is photographed by the imaging means. Sent to the server device,
The second control means uses the current position detected by the position detection means as identification information for identifying the second image processing apparatus when the second image processing apparatus is photographed by the imaging means. The mobile terminal according to claim 13, wherein the mobile terminal is transmitted to the server device. The first control unit obtains identification information for identifying the first image processing apparatus by analyzing a captured image captured by the first image processing apparatus by the imaging unit, and To the device,
The second control unit acquires specific information for specifying the second image processing device by analyzing a captured image captured by the second image processing device by the imaging unit, and the server The mobile terminal according to claim 13, wherein the mobile terminal transmits to a device. The first control unit is configured to identify the first image processing device by communicating with the first image processing device when the first image processing device is photographed by the imaging unit. Obtain information and send it to the server device;
The second control unit is configured to identify the second image processing device by communicating with the second image processing device when photographing the second image processing device by the imaging unit. The mobile terminal according to claim 13, wherein information is acquired and transmitted to the server device. A server device that controls a plurality of image processing devices by communicating with a mobile terminal,
Storage means for storing registration information in which specific information for specifying each of the plurality of image processing apparatuses is registered in advance;
Information acquisition means for acquiring device information from each of the plurality of image processing apparatuses;
Based on the first identification information received from the portable terminal, the registration information is referred to identify a first image processing device included in the plurality of image processing devices, and corresponds to the first image processing device. First information processing means for transmitting device information to the portable terminal;
Based on the second identification information received from the portable terminal, the second image processing apparatus included in the plurality of image processing apparatuses is identified with reference to the registration information, and the second image processing apparatus is supported. Second information processing means for transmitting device information to the portable terminal;
After the device information corresponding to the second image processing apparatus is transmitted to the mobile terminal by the second information processing means, the operation information is received from the mobile terminal, and the first information is received based on the operation information. Control means for operating the first and second image processing apparatuses in cooperation with each other;
Equipped with a,
The second information processing means outputs a first synthesized image obtained by synthesizing an image of device information corresponding to the first image processing apparatus to a photographed image obtained by photographing the first image processing apparatus. And receiving the second specifying information from the portable terminal, and specifying the second image processing device by receiving the second specifying information from the portable terminal. associated with the device, the device information corresponding to the second image processing apparatus when transmitting to the portable terminal, Rukoto to transmit the first composite image associated with the second image processing apparatus to the portable terminal Server device characterized by. A storage unit that stores registration information in which specific information for specifying each of a plurality of image processing devices is registered in advance is executed in a server device that controls the plurality of image processing devices by communicating with a mobile terminal. The server device is a program to be executed.
Information acquisition means for acquiring device information from each of the plurality of image processing apparatuses;
Based on the first identification information received from the portable terminal, the registration information is referred to identify a first image processing device included in the plurality of image processing devices, and corresponds to the first image processing device. First information processing means for transmitting device information to the portable terminal;
Based on the second identification information received from the portable terminal, the second image processing apparatus included in the plurality of image processing apparatuses is identified with reference to the registration information, and the second image processing apparatus is supported. Second information processing means for transmitting device information to the portable terminal; and
After the device information corresponding to the second image processing apparatus is transmitted to the mobile terminal by the second information processing means, the operation information is received from the mobile terminal, and the first information is received based on the operation information. Control means for operating the first and second image processing apparatuses in cooperation with each other;
Function as
The second information processing means outputs a first synthesized image obtained by synthesizing an image of device information corresponding to the first image processing apparatus to a photographed image obtained by photographing the first image processing apparatus. And receiving the second specifying information from the portable terminal, and specifying the second image processing device by receiving the second specifying information from the portable terminal. Transmitting the first composite image associated with the second image processing device to the mobile terminal when transmitting device information corresponding to the second image processing device to the mobile terminal. A featured program. In a portable terminal that can communicate with a server device that controls a plurality of image processing devices, and includes an imaging unit that captures an image, a display unit that displays an image, and an operation detection unit that detects an operation on the display unit A program to be executed, wherein the portable terminal is
Specific information for specifying the first image processing device when the first image processing device included in the plurality of image processing devices is photographed by the imaging unit based on an operation detected by the operation detection unit. To the server device, the first device information corresponding to the first image processing device is acquired from the server device, and the photographed image obtained by photographing the first image processing device and the first device information First control means for generating a first synthesized image obtained by synthesizing an image corresponding to
Specific information for specifying the second image processing device when the second image processing device included in the plurality of image processing devices is photographed by the imaging unit based on an operation detected by the operation detection unit. To the server device, the second device information corresponding to the second image processing device is acquired from the server device, and the photographed image obtained by photographing the second image processing device and the second device information A second control unit that generates a second composite image obtained by combining the image corresponding to the second composite image and displays the second composite image together with the first composite image on the display unit;
Function as
When the second control means is displaying the first composite image and the second composite image on the display means, the operation detection means performs an operation on each of the first composite image and the second composite image. A program that transmits operation information based on the operation to the server device and causes the first and second image processing devices to operate in cooperation with each other.

Images