JP2016207044A - Image forming system and augmented reality program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image forming system and an augmented reality program with which a user can easily recognize the order of execution of the user's print jobs by an image forming apparatus.SOLUTION: An image forming system comprises a portable device that includes an imaging part and a display part, and an MFP that executes print jobs. The portable device includes job information acquisition means that acquires job information indicating print jobs to be executed by the MFP and the scheduled order of execution of the print jobs by the MFP, and augmented reality means that displays, on the display part, a composite image obtained by composing a job information image based on the job information acquired by the job information acquisition means with a photographic image at a position corresponding to the MFP. The augmented reality means displays a specific user's print job larger than other print jobs in the job information image to be displayed on the display part (S146 and S148).SELECTED DRAWING: Figure 9

Description

  The present invention relates to an image forming system and an augmented reality program for combining a state of an image forming apparatus at a position corresponding to the image forming apparatus in a captured image.

  2. Description of the Related Art Conventionally, an image forming system that synthesizes the state of an image forming apparatus at a position corresponding to the image forming apparatus in a captured image is known (see Patent Documents 1 and 2).

JP 2012-029164 A JP 2013-161246 A

  However, in the conventional image forming system, when there are a plurality of print jobs scheduled to be executed by the image forming apparatus, it is difficult for the user to recognize the order of execution of the user's print jobs by the image forming apparatus. There is.

  SUMMARY An advantage of some aspects of the invention is that it provides an image forming system and an augmented reality program that allow a user to easily recognize the order of execution of a user's print job by an image forming apparatus.

  The image forming system of the present invention includes an electronic device including an imaging device and a display device, and an image forming apparatus that executes a print job, and the electronic device includes the print job executed by the image forming device, Job information acquisition means for acquiring job information indicating the scheduled execution order of the print jobs by the image forming apparatus, and shooting of a job information image based on the job information acquired by the job information acquisition means by the imaging device Augmented reality means for displaying on the display device a composite image synthesized at a position corresponding to the image forming apparatus in the image, the augmented reality means having a specific use in the job information image to be displayed on the display device The print job of the user is displayed larger than the other print jobs.

  With this configuration, the image forming system of the present invention captures a job information image based on job information indicating a print job executed by the image forming apparatus and a scheduled order of execution of the print job by the image forming apparatus by the imaging device. When a job information image to be displayed on a display device is combined with an image and displayed on a display device, the user's print job is displayed larger than other print jobs, so that the user's print job is executed by the image forming apparatus. Can be easily recognized by the user.

  In the image forming system according to the aspect of the invention, the electronic device may include the input device and the job information image displayed on the display device by the augmented reality unit according to an operation input by the input device. Order changing means for changing the order may be provided.

  With this configuration, the image forming system of the present invention changes the scheduled order of execution of the print job by the image forming apparatus according to the operation input by the input device with respect to the job information image displayed on the display device. The operation of changing the order of the print jobs of the users displayed larger than other print jobs in the job information image displayed on the display device can be facilitated.

  In the image forming system of the present invention, the input device may constitute a touch panel together with the display device.

  With this configuration, the image forming system of the present invention displays the user's print job larger than other print jobs in the job information image displayed on the touch panel, so that it is easy to touch the user's print job on the touch panel. The user can easily change the order of the print jobs.

  In the image forming system of the present invention, the augmented reality means is scheduled to be executed by the image forming apparatus before the print job of the specific user in the job information image to be displayed on the display device. When the amount of the print job is equal to or greater than a specific amount, the print job of the specific user is displayed larger than the other print jobs, and when the amount is less than the specific amount, the specific Displaying the print job of the user larger than the other print jobs may be stopped.

  With this configuration, the image forming system of the present invention can execute the user's print job only when the amount of the print job scheduled to be executed by the image forming apparatus before the user's print job is equal to or greater than a specific amount. Since it is displayed larger than other print jobs, if the time until the user's print job is executed by the image forming apparatus is long, the user should change the order of execution of the user's print job by the image forming apparatus. Can be easily judged.

  In the image forming system of the present invention, the amount may be an execution time of the print job scheduled to be executed by the image forming apparatus before the print job of the specific user.

  With this configuration, the image forming system of the present invention displays the user's print job larger than other print jobs when the user's print job is executed after a specific time by the image forming apparatus. When the time until the user's print job is executed by the image forming apparatus is long, the user can easily determine to change the order of execution of the user's print job by the image forming apparatus.

  An augmented reality program of the present invention is an augmented reality program executed by an electronic apparatus including an imaging device and a display device, and includes a print job executed by an image forming apparatus and execution of the print job by the image forming apparatus. Job information acquisition means for acquiring job information indicating the scheduled order, and a job information image based on the job information acquired by the job information acquisition means corresponds to the image forming apparatus in a captured image by the imaging device The electronic device functions as an augmented reality unit that displays a composite image synthesized at a position on the display device, and the augmented reality unit includes the print job of a specific user in the job information image displayed on the display device. Is displayed larger than other print jobs. That.

  With this configuration, the augmented reality program of the present invention captures a job information image based on job information indicating a print job executed by the image forming apparatus and a scheduled order of execution of the print job by the image forming apparatus by the imaging device. When a job information image to be displayed on a display device is combined with an image and displayed on a display device, the user's print job is displayed larger than other print jobs, so that the user's print job is executed by the image forming apparatus. Can be easily recognized by the user.

  The image forming system and the augmented reality program according to the present invention allow the user to easily recognize the order of execution of the user's print job by the image forming apparatus.

1 is a block diagram of an image forming system according to an embodiment of the present invention. FIG. 2 is a block diagram of the MFP shown in FIG. 1. It is a figure which shows an example of the job information shown in FIG. It is a block diagram of the server shown in FIG. It is a block diagram of the portable apparatus shown in FIG. 3 is a flowchart of the operation of the MFP shown in FIG. 2 when receiving print data. 4 is a flowchart of the operation of the MFP shown in FIG. 2 when executing a print job. 6 is a flowchart of the operation of the mobile device shown in FIG. 5 when acquiring MFP location information and job information. It is a flowchart of operation | movement of the portable apparatus shown in FIG. 5 in the case of implement | achieving augmented reality. FIG. 6 is a diagram illustrating an example of a job information image generated by the mobile device illustrated in FIG. 5 when the execution time of the preceding job of the login user job is equal to or longer than a specific time. (A) It is a figure which shows an example of the job information image produced | generated by the portable apparatus shown in FIG. 5, when the login user job is not included. (B) It is a figure which shows an example of the job information image produced | generated by the portable apparatus shown in FIG. 5, when the execution time of the preceding job of a login user job is less than specific time. It is a figure which shows an example of the synthesized image which synthesize | combined the job information image with the picked-up image by the portable apparatus shown in FIG. It is a figure which shows an example of the synthesized image which synthesize | combined the image which shows waiting in the picked-up image with the portable apparatus shown in FIG. 6 is a flowchart of the operation of the mobile device shown in FIG. 5 when the order of execution of print jobs by the MFP is changed. (A) It is a figure which shows an example in the state where the user is touching the synthetic | combination image shown in FIG. (B) It is a figure which shows an example of the state in which the swipe was performed from the state shown to Fig.15 (a).

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

  First, the configuration of the image forming system 10 according to the present embodiment will be described.

  FIG. 1 is a block diagram of an image forming system 10 according to the present embodiment.

  As shown in FIG. 1, an image forming system 10 includes a plurality of MFPs including an MFP (Multifunction Peripheral) 20, a server 40 such as a PC (Personal Computer) that manages the plurality of MFPs, and a portable device such as a smartphone. Device 50. A plurality of MFPs of the image forming system 10, the server 40, and the portable device 50 are connected to be communicable with each other via a network 11 such as a LAN (Local Area Network) or the Internet. The portable device 50 constitutes an electronic device of the present invention.

  The configuration of each of the plurality of MFPs in the image forming system 10 is the same as the configuration of the MFP 20. Therefore, in the following, the MFP 20 will be described on behalf of a plurality of MFPs of the image forming system 10.

  FIG. 2 is a block diagram of the MFP 20.

  As shown in FIG. 2, the MFP 20 is a display device such as an operation unit 21 that is an input device such as buttons for inputting various operations by the user and an LCD (Liquid Crystal Display) that displays various information. A display unit 22, a scanner 23 that is a reading device that reads an image from a document, a printer 24 that is a printing device that executes printing on a recording medium such as paper, an external facsimile apparatus (not shown), a public telephone line, and the like A fax communication unit 25 that is a fax device that performs fax communication via a communication line, a communication unit 26 that is a communication device that communicates with an external device via the network 11 (see FIG. 1), and various data are stored. EEPROM (Electrically Erasable Pro) rammable Read Only Memory), an HDD (Hard Disk Drive) storage unit 27 is a nonvolatile storage device such as, and a control unit 28 which controls the entire MFP 20.

  The storage unit 27 stores position information 27 a of the MFP 20, job information 27 b indicating a print job executed by the MFP 20, and a print queue 27 c that stores print data targeted for the print job in the order of execution by the MFP 20. doing.

  The control unit 28 includes, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory) storing a program and various data, and a RAM (Random Access Memory) used as a work area of the CPU. Yes. The CPU can execute a program stored in the ROM or the storage unit 27.

  FIG. 3 is a diagram illustrating an example of the job information 27b.

  As shown in FIG. 3, the job information 27b includes the order of scheduled execution of print jobs by the MFP 20, the user ID as user identification information, the number of prints per copy in the print job, and the print job. The number of copies is included for each print job.

  FIG. 4 is a block diagram of the server 40.

  As shown in FIG. 4, the server 40 includes an operation unit 41 that is an input device such as a mouse and a keyboard for inputting various operations by a user, and a display unit that is a display device such as an LCD that displays various information. 42, a communication unit 43 that is a communication device that communicates with an external device via the network 11 (see FIG. 1), and a storage unit 44 that is a non-volatile storage device such as an HDD that stores various data. And a control unit 45 that controls the entire server 40.

  The storage unit 44 stores authentication information 44a for authenticating the user, such as a combination of a user ID and a password. Further, the storage unit 44 stores MFP position information 44b and job information 44c indicating a print job executed by the MFP for each MFP included in the image forming system 10 (see FIG. 1).

  The control unit 45 includes, for example, a CPU, a ROM that stores programs and various data, and a RAM that is used as a work area of the CPU. The CPU executes a program stored in the ROM or the storage unit 44.

  FIG. 5 is a block diagram of the portable device 50.

  As shown in FIG. 5, the portable device 50 includes an operation unit 51 that is an input device such as a button for inputting various operations, a display unit 52 that is a display device such as an LCD that displays various information, and an imaging. The current position of the mobile device 50 in the real space and the imaging unit 53 that is a device, the wireless communication unit 54 that is a communication device that communicates with an external device via the network 11 (see FIG. 1) by wireless communication. A position detection unit 55 that is a position detection device such as a GPS (Global Positioning System) receiver to detect, and a direction detection unit 56 that is a direction detection device such as an acceleration sensor that detects the current direction of the mobile device 50 in the real space. A storage unit 57 that is a non-volatile storage device such as an HDD storing programs and various types of data; And a control unit 58 that controls the entire band device 50.

  The operation unit 51 includes an input device that forms a touch panel together with the display unit 52.

  The storage unit 57 stores an augmented reality (AR) program 57a executed by the control unit 58. The augmented reality program 57a may be installed in the portable device 50 at the manufacturing stage of the portable device 50, or may be additionally installed in the portable device 50 from an external storage medium such as a USB (Universal Serial Bus) memory. Then, it may be additionally installed on the mobile device 50 from the network 11.

  The control unit 58 includes, for example, a CPU, a ROM that stores programs and various data, and a RAM that is used as a work area of the CPU. The CPU can execute a program stored in the ROM or the storage unit 57.

  The control unit 58 executes the augmented reality program 57a stored in the storage unit 57, thereby acquiring job information. The job information acquisition unit 58a acquires job information. The job information image is based on the job information acquired by the job information acquisition unit 58a. The augmented reality means 58b for displaying on the display section 52 a composite image synthesized at a position corresponding to the MFP in the image captured by the imaging section 53, and the job information image displayed on the display section 52 by the augmented reality means 58b. It functions as order changing means 58c for changing the order of print jobs in accordance with the operation input by the operation unit 51.

  Next, the operation of the image forming system 10 will be described.

  First, the operation of the MFP 20 when receiving print data will be described.

  FIG. 6 is a flowchart of the operation of the MFP 20 when receiving print data.

  When the user transmits print data to the MFP 20 from a computer (not shown), the MFP 20 executes the operation shown in FIG.

  As shown in FIG. 6, the control unit 28 of the MFP 20 receives the transmitted print data and the user authentication information transmitted in association with the print data via the communication unit 26 (see FIG. 6). S101).

  Next, the control unit 28 requests the server 40 for user authentication by transmitting the authentication information received in S101 to the server 40 via the communication unit 26 (S102).

  Here, when receiving the authentication information transmitted from the MFP 20 via the communication unit 43, the control unit 45 of the server 40 performs user authentication based on the received authentication information. Specifically, the control unit 45 determines that the user authentication is successful when the received authentication information is included in the authentication information 44a on the storage unit 44, and is used when it is not included. It is determined that the authentication of the user has failed. Then, the control unit 45 returns the authentication result to the MFP 20 via the communication unit 43.

  After receiving the authentication result transmitted from the server 40 via the communication unit 26 after the processing of S102, the control unit 28 determines whether or not the received result is a successful authentication (S103).

  If the control unit 28 determines in S103 that authentication is not successful, that is, authentication failure, the control unit 28 discards the print data received in S101 (S104), and ends the operation shown in FIG.

  If the control unit 28 determines that the authentication is successful in S103, the control unit 28 stores the print data received in S101 at the end of the print queue 27c (S105), and the job information 27b regarding the print data stored in the print queue 27c in S105. Update (S106).

  Next, the control unit 28 transmits the position information 27a and the job information 27b to the server 40 via the communication unit 26 (S107), and ends the operation shown in FIG.

  When the control unit 45 of the server 40 receives the position information and job information transmitted from the MFP 20 in S107 via the communication unit 43, the control unit 45 stores the received position information and job information as the position information 44b and job information 44c of the MFP 20. Store in the unit 44.

  Note that the MFP 20 may transmit the position information 27a to the server 40 by an operation different from the operation shown in FIG. For example, the MFP 20 may periodically transmit the position information 27a to the server 40.

  Next, the operation of the MFP 20 when executing a print job will be described.

  FIG. 7 is a flowchart of the operation of the MFP 20 when executing a print job.

  The MFP 20 executes the operation shown in FIG. 7 when print data is stored in the print queue 27c.

  As shown in FIG. 7, the control unit 28 of the MFP 20 executes printing by the printer 24 based on the first print data stored in the print queue 27c, whereby the first information indicated by the job information 27b. A print job is executed (S111).

  Next, the control unit 28 deletes the print data that has been printed in S111 from the print queue 27c (S112), and updates the job information 27b to reflect that the print data has been deleted from the print queue 27c in S112. (S113).

  Next, the control unit 28 transmits the job information 27b to the server 40 via the communication unit 26 (S114).

  Therefore, when the job information transmitted from the MFP 20 in S114 is received via the communication unit 43, the control unit 45 of the server 40 stores the received job information in the storage unit 44 as job information 44c of the MFP 20.

  After the process of S114, the control unit 28 of the MFP 20 determines whether print data is stored in the print queue 27c (S115).

  When determining in S115 that the print data is stored in the print queue 27c, the control unit 28 executes the process of S111.

  If the control unit 28 determines in S115 that print data is not stored in the print queue 27c, the control unit 28 ends the operation shown in FIG.

  It should be noted that the MFP 20 does not transmit the entire job information 27b to the server 40 in the operations shown in FIG. 6 and FIG. good. In such a case, the server 40 can update the job information 44c of the MFP 20 based on the change content transmitted from the MFP 20.

  Next, the operation of the portable device 50 when acquiring the MFP position information and job information will be described.

  FIG. 8 is a flowchart of the operation of the portable device 50 when acquiring position information and job information of the MFP.

  The user of the portable device 50 can instruct the portable device 50 to execute the augmented reality program 57a through the operation unit 51. When the portable device 50 starts to execute the augmented reality program 57a, the portable device 50 performs the operation shown in FIG.

  As shown in FIG. 8, the job information acquisition unit 58a of the portable device 50 displays a screen for prompting the user to input authentication information on the display unit 52 (S131), and the authentication information is received via the operation unit 51. Until it is determined that the authentication information has been input, it is determined whether authentication information has been input via the operation unit 51 (S132).

  If the job information acquisition unit 58a determines in S132 that the authentication information has been input, the job information acquisition unit 58a transmits the authentication information input via the operation unit 51 to the server 40 via the wireless communication unit 54. The server 40 is requested for authentication (S133).

  Here, when the control unit 45 of the server 40 receives the authentication information transmitted from the mobile device 50 via the communication unit 43, the control unit 45 performs user authentication as described above based on the received authentication information. To do. Then, the control unit 45 returns the authentication result to the portable device 50 via the communication unit 43. Note that when the authentication is successful, the control unit 45 logs in the authentication target user until the authentication target user logs out.

  After receiving the authentication result transmitted from the server 40 via the wireless communication unit 54 after the processing of S133, the job information acquisition unit 58a determines whether or not the received result is a successful authentication ( S134).

  If the job information acquisition unit 58a determines in S134 that the authentication is not successful, that is, the authentication has failed, the job information acquisition unit 58a executes the process of S131.

  If the job information acquisition unit 58a determines in S134 that the authentication is successful, the image capturing unit 53 takes a picture based on the position of the portable device 50 detected by the position detection unit 55 and the direction detected by the direction detection unit 56. Based on the direction, the server 40 is requested via the wireless communication unit 54 for position information and job information of the MFP existing within the imaging range of the imaging unit 53 (S135).

  Therefore, the control unit 45 of the server 40 returns the MFP location information 44b and job information 44c requested in S135 to the portable device 50 via the communication unit 43.

  Then, after receiving the MFP position information and job information transmitted from the server 40 via the wireless communication unit 54 (S136), the job information acquisition unit 58a determines in S137 that the specific period has elapsed. The process of S135 is executed.

  In the above, the portable device 50 requests the server 40 for position information and job information of the MFP existing within the shooting range of the imaging unit 53. However, the position of the portable device 50 is not limited to the shooting range. The server 40 may be requested to request the position information and job information of the MFP existing within a specific range from the server 40, or the server 40 may receive the position information and job information of all the MFPs managed by the server 40. It may be requested.

  Next, the operation of the mobile device 50 when realizing augmented reality will be described.

  FIG. 9 is a flowchart of the operation of the portable device 50 when realizing augmented reality.

  When the portable device 50 starts to execute the augmented reality program 57a, the portable device 50 performs the operation shown in FIG.

  As shown in FIG. 9, the augmented reality means 58b of the portable device 50 starts displaying an image captured by the imaging unit 53 on the display unit 52 (S141).

  Next, the augmented reality means 58b detects the position of the portable device 50 detected by the position detection unit 55, the shooting direction of the imaging unit 53 based on the direction detected by the direction detection unit 56, and the MFP acquired in S136. Based on the position information, it is determined whether or not the MFP is included in the image captured by the imaging unit 53 (S142).

  If the augmented reality unit 58b determines in S142 that the captured image includes the MFP, whether or not the MFP job information included in the captured image includes a print job is determined based on the job information acquired in S136. Judgment is made (S143).

  If the augmented reality unit 58b determines in S143 that a print job is included, the print job associated with the user ID of the logged-in user (hereinafter referred to as “logged-in user job”) is photographed. It is determined whether it is included in the job information of the MFP included in the image (S144).

  If the augmented reality means 58b determines in S144 that a login user job is included, in the MFP job information included in the photographed image, a print job (hereinafter referred to as a print job) scheduled to be executed by the MFP before the login user job is included. It is determined whether or not the execution time of “preceding job” is equal to or longer than a specific time such as 2 minutes (S145).

  Here, the augmented reality means 58b calculates the execution time of the print job by dividing the total number of prints obtained by multiplying the number of copies per copy in the print job by the number of copies in the print job by the print speed of the MFP. can do.

  For example, the MFP included in the photographed image is the MFP 20, and the latest job information received by the MFP 20 in S136 is the same as the job information 27b shown in FIG. When the ID is USER001, the login user job is the fifth print job. The total number of printed sheets of the first print job is 10 sheets × 1 copy = 10 sheets. Similarly, the total number of prints of the second, third, and fourth print jobs is 200, 5, and 200, respectively. Therefore, the total number of prints of the preceding job of the login user job is 415. Here, when the printing speed of the MFP 20 is 20 ppm (pages per minute), the execution time of the preceding job of the login user job is 415 sheets / 20 ppm = 20.75 minutes.

  Note that the printing speed of the MFP is managed for each MFP by the server 40 and may be transmitted from the server 40 to the portable device 50, or may be managed for each MFP by the portable device 50.

  If the augmented reality unit 58b determines in S145 that the specific time or longer is reached, for example, as shown in FIG. 10, the augmented reality unit 58b generates a job information image 60 in which the login user job is larger than other print jobs (S146).

  In the job information image 60 illustrated in FIG. 10, columns 61 to 65 each indicate a print job. Columns 61 to 65 indicate print jobs that are executed in the earlier order by the MFP in the lower column. Columns 61 to 65 include the number of copies per copy in the print job and the number of copies in the print job. The print jobs shown in the columns 61 to 64 are not login user jobs. The print job shown in the column 65 is a login user job. The column 65 is larger than any of the columns 61 to 64, and the background color is different from any of the columns 61 to 64. The column 65 includes a character string “your job” indicating that it is a login user job. On the other hand, the columns 61 to 64 do not include information indicating which user's print job.

  If the augmented reality unit 58b determines in S144 that the login user job is not included or determines in S145 that the login user job is less than the specific time, for example, as shown in FIG. 11, the size of all print jobs is determined. The aligned job information image is generated (S147).

  FIG. 11A is a diagram illustrating an example of the job information image 70 when the login user job is not included. In the job information image 70, columns 71 to 74 indicate print jobs, respectively. Columns 71 to 74 indicate print jobs that are executed in the earlier order by the MFP in the lower column. Columns 71 to 74 include the number of copies per copy in the print job and the number of copies in the print job. The print jobs shown in the columns 71 to 74 are not login user jobs. The columns 71 to 74 do not include information indicating which user's print job it is.

  FIG. 11B is a diagram illustrating an example of the job information image 80 when the execution time of the preceding job of the login user job is less than a specific time. In the job information image 80, columns 81 to 83 each indicate a print job. Columns 81 to 83 indicate print jobs that are executed in the earlier order by the MFP in the lower column. Columns 81 to 83 include the number of copies per copy in the print job and the number of copies in the print job. The print jobs shown in the columns 81 and 83 are not login user jobs. The print job shown in the column 82 is a login user job. The column 82 has a different background color from either of the columns 81 and 83. The column 82 includes a character string “your job” indicating that it is a login user job. On the other hand, the columns 81 and 83 do not include information indicating which user's print job it is. The column 82 is the same size as the columns 81 and 83, unlike the column 65 of the job information image 60 shown in FIG. That is, unlike the job information image 60, the job information image 80 is stopped from displaying the login user job larger than the other print jobs.

  When the augmented reality unit 58b generates the job information image in S146 or S147, the augmented reality unit 58b combines the job information image generated in S146 or S147 with the captured image (S148). Here, the augmented reality means 58b combines the job information image generated in S146 or S147 at a position corresponding to the target MFP of the job information image. Accordingly, the composite image generated in S148 is displayed on the display unit 52, for example, as shown in FIG.

  If the augmented reality unit 58b determines in S143 that the print job is not included, the augmented reality unit 58b synthesizes an image indicating the standby state with the captured image (S149). Here, the augmented reality means 58b synthesizes an image indicating standby in a position corresponding to the target MFP of this image. Therefore, for example, as illustrated in FIG. 13, the composite image generated in S <b> 149 is displayed on the display unit 52.

  If the augmented reality means 58b determines that the MFP is not included in the photographed image in S142, or executes the process of S148 or S149 and then determines that the specific period has elapsed in S150, it executes the process of S142.

  Next, the operation of the portable device 50 when the order of execution of print jobs by the MFP is changed will be described.

  FIG. 14 is a flowchart of the operation of the portable device 50 when the order of execution of print jobs by the MFP is changed.

  As illustrated in FIG. 14, the order changing unit 58 c of the mobile device 50 determines that an operation for changing the order of print jobs is input to the operation unit 51 for the job information image displayed on the display unit 52. It is determined whether or not an operation for changing the order of print jobs has been input to the operation unit 51 (S161).

  For example, the user can input an operation for changing the order of print jobs to the operation unit 51 as shown in FIG. That is, when the composite image shown in FIG. 12 is displayed on the display unit 52, the user places the region corresponding to any column of the job information image on the display unit 52, which is a touch panel, in FIG. After touching as shown, the upper and lower order of the columns can be changed by swiping as shown in FIG. Here, as described above, the upper and lower order of the columns in the job information image corresponds to the execution order of the print jobs shown in the columns.

  When the order changing unit 58c determines in S161 that an operation for changing the order of print jobs has been input to the operation unit 51, the order changing unit 58c causes the wireless communication unit 54 to change the order of the print jobs in accordance with the operation input by the operation unit 51. Through the server 40 (S162), and executes the process of S161.

  When the control unit 45 of the server 40 receives the request from the portable device 50 in S <b> 162 via the communication unit 43, the control unit 45 updates the job information 44 c of the target MFP in response to the request from the portable device 50. The target MFP is requested via the communication unit 43 to change the order of the requested print jobs. Therefore, the control unit of the target MFP updates its print queue and job information in response to a request from the server 40.

  As described above, the image forming system 10 converts the job information image based on the job information indicating the print job executed by the MFP and the scheduled order of execution of the print job by the MFP into a photographed image by the imaging unit 53. When combining and displaying on the display unit 52 (S148), in the job information image displayed on the display unit 52, the login user job is displayed larger than other print jobs (S146 and S148). It is possible for the user to easily recognize the execution order of the job.

  The image forming system 10 changes the scheduled order of execution of the print job by the MFP according to the operation input by the operation unit 51 with respect to the job information image displayed on the display unit 52 (S162). The operation of changing the order of login user jobs displayed larger than the other print jobs in the job information image displayed in FIG.

  In particular, since the image forming system 10 displays a login user job larger than other print jobs in the job information image displayed on the display unit 52 that is a touch panel, it is easy to touch the login user job on the touch panel. It is possible to facilitate the operation of changing the order of login user jobs.

  Further, since the image forming system 10 can execute an operation for changing the order of login user jobs on the display unit 52 that is a touch panel, the order of print jobs can be changed even for MFPs that do not include a touch panel. Can be facilitated.

  Note that the image forming system 10 can execute the operation of changing the order of the print jobs displayed on the display unit 52 even when the display unit 52 is not a touch panel.

  The image forming system 10 displays the logged-in user job larger than other print jobs only when the amount of the preceding job of the logged-in user job is equal to or greater than a specific amount (YES in S145). Can be easily determined by the user to change the order of execution of login user jobs by the MFP.

  In particular, when the login user job is executed after a specific time by the MFP, the image forming system 10 displays the login user job larger than the other print jobs. Therefore, the login user job is executed by the MFP. When it takes a long time, the user can easily determine that the order of execution of login user jobs by the MFP is changed.

  Note that the image forming system 10 may adopt an amount other than the execution time of the print job as the amount of the preceding job of the login user job. For example, in the image forming system 10, the total number of prints of the preceding job of the login user job or the number of jobs of the preceding job of the login user job may be adopted as the amount of the preceding job of the login user job.

  The image forming system 10 may display the login user job larger than other print jobs regardless of whether the amount of the preceding job of the login user job is equal to or greater than a specific amount. If the user's own print job is displayed larger than the other print jobs, the user can easily execute the operation of changing the order of the print jobs so that the user's print job is preferentially printed, for example. Can do.

  The image forming system 10 generates the job information image to be displayed on the mobile device 50 by the mobile device 50 itself, but may be generated by the server 40.

  In the present embodiment, the image forming system 10 employs a location-based AR based on position information as an augmented reality method. However, a vision-based AR based on image processing may be employed.

  The image forming system 10 may realize at least a part of the functions of the server 40 by at least one of a plurality of MFPs. The image forming system 10 may not include the server 40 when all the functions of the server 40 are realized by at least one of a plurality of MFPs. For example, the image forming system 10 may be configured such that each MFP and the portable device 50 directly exchange information.

  In the present embodiment, the image forming system 10 includes a portable device as the electronic device of the present invention. However, an electronic device other than the portable device such as a PC may be included as the electronic device of the present invention.

  In this embodiment, the image forming system 10 includes an MFP as the image forming apparatus of the present invention. However, an image forming apparatus other than the MFP, such as a dedicated printer, may be included as the image forming apparatus of the present invention. .

10 image forming system 20 MFP (image forming apparatus)
27b Job information 44c Job information 50 Portable device (electronic device)
51 Operation unit (input device)
52 Display unit (display device)
53 Imaging unit (imaging device)
57a Augmented reality program 58a Job information acquisition means 58b Augmented reality means 58c Order change means 60, 70, 80 Job information image

Claims (6)

An electronic device including an imaging device and a display device;
An image forming apparatus that executes a print job,
The electronic device is
Job information acquisition means for acquiring job information indicating the print job executed by the image forming apparatus and the scheduled order of execution of the print job by the image forming apparatus;
Augmented reality means for displaying on the display device a synthesized image obtained by synthesizing a job information image based on the job information acquired by the job information acquisition means at a position corresponding to the image forming apparatus in an image captured by the imaging device. Prepared,
The augmented reality means displays the print job of a specific user larger than the other print jobs in the job information image displayed on the display device. The electronic device is
An input device;
The order changing means for changing the order according to an operation input by the input device with respect to the job information image displayed on the display device by the augmented reality means. Image forming system.   The image forming system according to claim 2, wherein the input device constitutes a touch panel together with the display device.   In the job information image to be displayed on the display device, the augmented reality unit has a print job amount to be executed by the image forming apparatus prior to the print job of the specific user equal to or greater than a specific amount. The print job of the specific user is displayed larger than the other print jobs, and if the amount is less than the specific amount, the print job of the specific user is 4. The image forming system according to claim 1, wherein display larger than the print job is stopped.   The image forming system according to claim 4, wherein the amount is an execution time of the print job scheduled to be executed by the image forming apparatus before the print job of the specific user. An augmented reality program executed by an electronic device including an imaging device and a display device,
Job information acquisition means for acquiring job information indicating a print job executed by the image forming apparatus and a scheduled order of execution of the print job by the image forming apparatus; and
Augmented reality means for displaying on the display device a synthesized image obtained by synthesizing a job information image based on the job information acquired by the job information acquisition means at a position corresponding to the image forming apparatus in an image captured by the imaging device. Make the electronics work,
The augmented reality means displays the print job of a specific user larger than the other print jobs in the job information image displayed on the display device.

Images