JP2018027639A - Information processing apparatus, image formation system, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To suppress errors of operation in an image forming apparatus for forming an image on a continuous sheet of paper, compared with a case where no image is displayed on a display part of a portable terminal on the basis of a photographing result by an imaging part of the portable terminal, and a progress situation of the operation.SOLUTION: A control part of a wearable terminal includes: a unit specification part for specifying a unit of an image forming apparatus having a plurality of units and for forming an image on a continuous sheet of paper; and a display control part relating to operation performed in the specified unit by the unit specification part and for forming an image to be displayed on a display part of the wearable terminal.SELECTED DRAWING: Figure 11

Description

  The present invention relates to an information processing apparatus, an image forming system, and a program.

  Conventionally, there is an image forming system that transmits error information to an information processing apparatus such as a mobile phone that can communicate with the image forming apparatus when an error in a job related to image processing executed by the image forming apparatus is detected. (See Patent Document 1).

JP 2015-186208 A

By the way, in an image forming apparatus that has a plurality of units and forms an image on continuous paper, for example, loading, removing, and reworking continuous paper are complicated, and work is performed while moving between the plurality of units. It is necessary to make a mistake in the work (for example, the work contents to be performed next and the next work target unit are mistaken or forgotten).
The present invention relates to an image forming apparatus that forms an image on continuous paper as compared with a case where an image is not displayed on a display unit of a portable terminal based on a photographing result of a photographing unit of a portable terminal and a progress status of work. The purpose is to suppress work errors.

The invention according to claim 1 includes a unit specifying unit that specifies a unit of an image forming apparatus that has a plurality of units and forms an image on continuous paper, and the unit specified by the unit specifying unit. It is an information processing apparatus provided with the image generation means which produces | generates the said image for displaying on the said display part of the portable terminal provided with the display part regarding the work performed.
The invention according to claim 2 further includes specifying means for specifying a work target unit on which an operation by an operator is performed, and the image generating means is configured such that the unit specified by the specifying means is the unit specifying means. The information processing apparatus according to claim 1, wherein an image to be generated is made different depending on whether or not the unit is specified by.
According to a third aspect of the present invention, the image generating means generates a guide image for guiding work when the unit specified by the unit specifying means is a unit to be worked by an operator. The information processing apparatus according to claim 1 or 2.
According to a fourth aspect of the present invention, when the unit specified by the unit specifying unit is not a unit to be operated by an operator, the image generating unit generates an instruction image indicating the unit to be operated. The information processing apparatus according to any one of claims 1 to 3.
The invention according to claim 5 further includes a determination unit that determines whether the operation of the operator in the unit is correct or not, and the image generation unit relates to the operation performed in the unit specified by the unit specification unit. 5. The information processing apparatus according to claim 1, wherein, in generating the image, the image to be generated is changed according to whether the operation in the unit is correct or not.
According to a sixth aspect of the present invention, the image generation means includes a case where the unit specified by the unit specifying means does not match the case where the unit determined by the determination means that there is an error in work. The information processing apparatus according to claim 5, wherein an image to be generated is changed.
According to a seventh aspect of the present invention, the image generating means generates a different image depending on whether or not the unit specified by the unit specifying means is a unit to be worked on by the operator. The information processing apparatus according to claim 5, wherein:
The invention according to claim 8 is characterized in that the image generating means generates different images according to the setting of the image forming apparatus or the unit specified by the unit specifying means. The information processing apparatus according to any one of the above.
According to a ninth aspect of the present invention, an image forming apparatus having a plurality of units for forming an image on continuous paper, a unit specifying unit for specifying the unit of the image forming apparatus, and the unit specifying unit An image forming system comprising: an image generating unit that generates an image related to work performed in the identified unit and displayed on a display unit of a mobile terminal.
According to a tenth aspect of the present invention, there is provided a function of identifying a unit of an image forming apparatus that has a plurality of units and forms an image on continuous paper for a computer, and an operation performed by the identified unit. And a function for generating an image to be displayed on the display unit of the mobile terminal.
The invention described in claim 11 is a program that is executed by a computer device that controls a portable terminal including a display unit and a photographing unit, and is an image obtained by the photographing unit having a plurality of units. And an acquisition function for acquiring an image obtained by photographing the unit of the image forming apparatus that forms an image on continuous paper by the photographing unit, and an operator operating the unit through the portable terminal This is a program for causing a computer to realize a display function of displaying an image related to work performed in the unit on the display unit when the unit is viewed.
According to a twelfth aspect of the present invention, an image related to work performed in the unit of the image forming apparatus having a plurality of units and forming an image on continuous paper is displayed on the display unit of the portable terminal. This is a program for causing a computer to realize a generation function for generating an image for output and an output function for outputting an image generated by the generation function.

According to the first aspect of the present invention, compared to a case where no image is displayed on the display unit of the mobile terminal based on the imaging result of the imaging unit of the mobile terminal and the progress of the work, the image is displayed on the continuous paper. Work errors in the image forming apparatus to be formed can be suppressed.
According to the invention which concerns on Claim 2, the image displayed on a portable terminal can be varied according to whether the unit specified by the specifying means is a unit specified by the unit specifying means.
According to the invention which concerns on Claim 3, compared with the case where the image for guiding work is not produced | generated, the operator can work with a unit easily.
According to the invention which concerns on Claim 4, the operator can grasp | ascertain the unit of work object.
According to the invention which concerns on Claim 5, the operator can grasp | ascertain the correctness of work.
According to the invention of claim 6, images to be displayed on the mobile terminal can be displayed depending on whether the unit specified by the unit specifying means matches the unit determined to have a work error or not. Can be different.
According to the invention which concerns on Claim 7, the image displayed on a portable terminal can be varied according to whether the unit specified by the unit specifying means is a unit to be worked.
According to the eighth aspect of the present invention, an image corresponding to the image forming apparatus or unit can be generated.
According to the invention which concerns on Claim 9, compared with the case where an image is not displayed on the display part of a portable terminal based on the imaging | photography result by the imaging | photography part of a portable terminal, and the progress of work, an image is displayed with respect to continuous paper. Work errors in the image forming apparatus to be formed can be suppressed.
According to the invention which concerns on Claims 10-12, compared with the case where an image is not displayed on the display part of a portable terminal based on the imaging | photography result by the imaging | photography part of a portable terminal, and the progress of work, with respect to continuous paper Work errors in the image forming apparatus for forming an image can be suppressed.

1 is a diagram illustrating an example of an overall configuration of an image forming system to which the exemplary embodiment is applied. 1 is a diagram illustrating an internal structure of an image forming apparatus to which the exemplary embodiment is applied. It is a figure showing an example of an operation panel of a paper feeder to which this embodiment is applied. It is the figure which showed the internal structure of the inversion apparatus with which this Embodiment is applied. It is the schematic which showed an example of the background where the 1st inversion roll to which this Embodiment is applied, and the 1st inversion roll is arrange | positioned in the inversion apparatus. It is the figure which showed an example of the mark provided adjacent to a 1st inversion roll. It is the figure which showed schematic structure of the wearable terminal to which this Embodiment is applied. 1 is a block diagram illustrating a functional configuration of an image forming system to which the exemplary embodiment is applied. It is the flowchart shown about the process performed by the control part of the wearable terminal to which this Embodiment is applied. (A)-(c) is the figure which showed an example of the pattern recognized in the pattern analysis part. (A)-(d) is the figure which showed the image displayed on the display part of a wearable terminal. (A)-(c) is the figure which showed the image displayed on the display part of a wearable terminal. (A)-(b) is the figure which showed the image displayed on the display part of a wearable terminal. It is the figure which showed the other process example implemented with an image forming system.

Embodiments of the present invention will be described below with reference to the accompanying drawings.
<Configuration of image forming system>
FIG. 1 is a diagram illustrating an example of the overall configuration of an image forming system 1 to which the exemplary embodiment is applied.
As shown in FIG. 1, an image forming system 1 according to the present embodiment includes a print server 3 that manages a print job that is processing based on a print instruction (output instruction), and an operation target that is operated by an operator. An image forming apparatus 5 that executes a printing process (image forming process) on the continuous paper S under the control of the print server 3 is an example. The image forming system 1 is used as an example of a portable terminal that is used by being attached to a wearer who performs various operations in the image forming apparatus 5 and displays an operation support image or the like for assisting various operations by the operator. Wearable terminal 7 is provided.
In the image forming system 1, the print server 3, the image forming apparatus 5, and the wearable terminal 7 are connected to be communicable with each other via a wireless communication line or the like.

<Configuration of image forming apparatus>
FIG. 2 is a diagram illustrating an internal structure of the image forming apparatus 5 to which the exemplary embodiment is applied. The image forming apparatus 5 of the present embodiment forms an image on the conveyed continuous paper S. In the image forming apparatus 5 of the present embodiment, the continuous paper S is conveyed at a high speed of, for example, about 100 m / min, and high-speed printing of several thousand pages / min is possible. In the present embodiment, the continuous paper S means paper that is continuous along the conveyance direction of the image forming apparatus 5. The continuous paper S may be provided with perforations, creases, etc. as long as it is continuous in the transport direction.

  As shown in FIGS. 1 and 2, the image forming apparatus 5 is configured by combining a plurality of apparatuses. Specifically, the image forming apparatus 5 includes a first image forming apparatus 51 that forms an image on one side of the continuous paper S, and a continuous paper S on which an image is formed by the first image forming apparatus 51. And a second image forming apparatus 52 that forms an image on one side or the other side. Further, the image forming apparatus 5 takes up the paper feeding device 53 that supplies the continuous paper S to the first image forming apparatus 51 and the continuous paper S after the image is formed by the second image forming apparatus 52. And a recovery device 54 for recovery. Further, the image forming apparatus 5 includes a reversing device 55 that reverses the front and back of the continuous paper S on which the image is formed by the first image forming device 51 and conveys it to the second image forming device 52 as necessary. Yes. Furthermore, the image forming apparatus 5 includes a paper feeding device 53 and a first image forming device 51, a first image forming device 51 and a reversing device 55, and a reversing device 55 and a second image forming device 52. And a plurality of relay portions (not shown) that relay between the second image forming apparatus 52 and the collection apparatus 54.

  In addition, the image forming apparatus 5 receives an operation input from the operator and controls information such as a display panel 56 (see FIG. 1) that displays information to the operator, operations of each unit of the image forming apparatus 5, and printing. A control unit 60 (see FIG. 8 described later) that performs communication with the server 3 is provided.

  As shown in FIGS. 1 and 2, the first image forming apparatus 51 includes a first image forming unit 511 that forms an image on one side of the conveyed continuous paper S, and a first image forming unit 511. And a first drying unit 512 for drying the continuous paper S on which an image is formed. Further, the first image forming apparatus 51 includes a plurality of transport rolls 513 that transport the continuous paper S. Further, the first image forming apparatus 51 includes an operation panel 515 that receives an operation when the operator performs a loading operation of the continuous paper S or the like in the first image forming apparatus 51. Furthermore, the first image forming apparatus 51 includes a housing 516 that houses a first image forming unit 511, a first drying unit 512, a transport roll 513, and the like. As shown in FIG. 1, the housing 516 has an open / close door 516a that can be opened by an operator or the like when the continuous paper S is loaded.

The first image forming unit 511 forms an image on the continuous paper S by a so-called inkjet method. Specifically, the first image forming unit 511 includes an inkjet head (not shown) including a plurality of nozzles that eject ink as droplets.
The first drying unit 512 dries the ink discharged on the continuous paper S by the first image forming unit 511 by heating. Specifically, the first drying unit 512 includes a heater (not shown) that generates heat when energized.

  The second image forming apparatus 52 has the same configuration as the first image forming apparatus 51. That is, the second image forming apparatus 52 has a second image forming unit 521 that has an ink jet head and forms an image on the continuous paper S by a so-called ink jet method, and is discharged onto the continuous paper S by the second image forming unit 521. And a second drying unit 522 that dries the ink by heating. Further, the second image forming apparatus 52 includes a plurality of transport rolls 523 that transport the continuous paper S. Further, the second image forming apparatus 52 includes an operation panel 525 that receives an operation when the operator performs a loading operation of the continuous paper S or the like in the second image forming apparatus 52. The second image forming apparatus 52 includes an opening / closing door 526a, and a housing 526 that houses the second image forming unit 521, the second drying unit 522, the transport roll 523, and the like.

  The sheet feeding device 53 supplies the first sheet forming apparatus 51 via the relay unit while rewinding the continuous sheet S wound in a roll shape. The paper feeding device 53 supports the continuous paper S wound in a roll shape and conveys the rotatable roll member 531 and the continuous paper S rewound from the roll member 531 toward the first image forming apparatus 51. And a plurality of transport rolls 532. The paper feeding device 53 includes an operation panel 535 that receives an operation when the operator feeds the continuous paper S. Further, the sheet feeding device 53 includes an openable / closable door 536 a and includes a roll member 531, a transport roll 532, and a casing 536 that accommodates the continuous paper S supported by the roll member 531.

  FIG. 3 is a diagram showing an example of the operation panel 535 of the paper feeding device 53 (see FIG. 1) to which the present embodiment is applied. As shown in FIG. 3, the operation panel 535 is provided with a sidelay button 535a for operating the movement of the roll member 531 in the axial direction. Further, the operation panel 535 includes a shaft arm switch 535b for switching up / down of the roll member 531; a brake switch 535c for switching brake on / off of the roll member 531; and the continuous paper S in the roll member 531. And a paper press switch 535d for switching the paper presser on / off. Further, on the operation panel 535, a stop button 535e for stopping the paper feeding operation by the roll member 531; a preparation button 535f for performing standby of the paper feeding operation by the roll member 531; An inching button 535g for slightly feeding the paper S and a slow button 535h for feeding the continuous paper S at a low speed by rotating the roll member 531 at a low speed are provided. Furthermore, the operation panel 535 is provided with an emergency stop button 535 i for urgently stopping the operation of the paper feeding device 53.

The collection device 54 collects the continuous paper S on which the image is formed by the second image forming device 52 while winding it in a roll shape. Specifically, the collection device 54 winds the continuous paper S into a roll shape and rotates the roll member 541 and conveys the continuous paper S discharged from the second image forming device 52 toward the roll member 541. And a plurality of transport rolls 542. The collection device 54 includes an operation panel 545 that receives an operation when an operator performs a continuous paper loading operation or the like using the collection device 54. Furthermore, the collection device 54 includes an openable / closable door 546a, and includes a roll member 541, a transport roll 542, and a housing 546 that accommodates the continuous paper S supported by the roll member 541.
In the image forming apparatus 5 according to the present embodiment, the paper feeding device 53 supplies the rolled continuous paper S while rewinding, and the collecting device 54 collects the continuous paper S while winding it into a roll. However, the form of the continuous paper S is not limited to this. For example, the paper feeding device 53 may supply the continuous paper S folded in a bellows shape along the perforations, and the collecting device 54 may supply the continuous paper S in a bellows shape along the perforations. You may collect it while folding it.

  The reversing device 55 reverses the front and back of the continuous paper S on which the image has been formed by the first image forming device 51, as necessary, and conveys it to the second image forming device 52. The reversing device 55 includes a plurality of reversing rolls (first reversing roll 551 to fifth reversing roll 555; see FIG. 4 described later) through which the continuous paper S is guided.

The image forming apparatus 5 according to the present embodiment is operated by the wearable terminal 7 for each of the first image forming apparatus 51, the second image forming apparatus 52, the paper feeding apparatus 53, the collecting apparatus 54, and the reversing apparatus 55. A mark M is provided for specifying a region (unit) of the image forming apparatus 5 that is visually recognized by a person.
For example, in the first image forming apparatus 51, the mark M is attached to each of the first image forming unit 511, the first drying unit 512, and the transport roll 513. Similarly, in the second image forming apparatus 52, the mark M is attached to the second image forming unit 521, the second drying unit 522, and the transport roll 523. In the paper feeding device 53, a mark M is attached to the roll member 531 and the operation panel 535 (see also FIG. 3). Further, in the reversing device 55, the details will be described later, but a mark M is attached adjacent to each of the first reversing roll 551 to the fifth reversing roll 555.
In the image forming apparatus 5, each mark M is provided inside the housing of each apparatus. For example, in the first image forming apparatus 51, the mark M attached to each unit is provided inside the housing 516. When the opening / closing door 516a of the housing 516 is opened, the respective marks M are exposed to the outside so that they can be visually recognized.

  In the image forming system 1 according to the present embodiment, the unit of the image forming apparatus 5 visually recognized by the operator is identified by detecting and analyzing the mark M photographed by the photographing unit 72 of the wearable terminal 7. Here, in the present embodiment, the unit of the image forming apparatus 5 means a structural unit of the image forming apparatus 5 distinguished by function and arrangement. For example, the units of the image forming apparatus 5 include the first image forming unit 511 and the first drying unit 512 of the first image forming apparatus 51, the second image forming unit 521 and the second drying unit 522 of the second image forming apparatus 52. Each of the first reversing roll 551 to the fifth reversing roll 555 of the reversing device 55, the paper feeding device 53, the collecting device 54, the relay unit, and the like correspond to each other.

FIG. 4 is a diagram illustrating an internal structure of the reversing device 55 to which the present embodiment is applied, and corresponds to a view of the reversing device 55 illustrated in FIG. 2 viewed from the IV direction.
As described above, the reversing device 55 of the present embodiment has the five reversing rolls (first reversing roll 551 to fifth reversing roll 555) that guide the continuous paper S and reverse the front and back of the continuous paper S as necessary. ). Specifically, the reversing device 55 is guided by a first reversing roll 551 and a first reversing roll 551 that guide the continuous paper S discharged from the first image forming apparatus 51 (see FIG. 1) to the downstream side. And a second reversing roll 552 that changes the traveling direction of the continuous paper S by 90 °. Further, the reversing device 55 includes a third reversing roll 553 that changes the traveling direction of the continuous paper S guided by the second reversing roll 552 by 180 °, and a continuous guided by the third reversing roll 553. A fourth reversing roll 554 is provided which is wound around the paper S and changes its traveling direction by 90 °. Further, the reversing device 55 includes a fifth reversing roll 555 that conveys the continuous paper S guided by the fourth reversing roll 554 toward the second image forming device 52 (see FIG. 2).

  In the reversing device 55 of the present embodiment, the first reversing roll 551, the second reversing roll 552, the third reversing roll 553, and the fourth reversing roll are used depending on whether the front and back of the continuous paper S are reversed. The loading method of the continuous paper S with respect to 554 and the 5th inversion roll 555 is different. FIG. 4 shows a case where the reversing device 55 reverses the front and back of the continuous paper S.

  FIG. 5 is a schematic diagram illustrating an example of a first reverse roll 551 to which the present embodiment is applied and a background 550 in which the first reverse roll 551 is disposed in the reverse apparatus 55. The background 550 is a scene that can be seen behind the first reversing roll 551 when the operator visually recognizes the first reversing roll 551. For example, the inner wall surface of the casing (not shown) of the reversing device 55 is This is the case.

  The first reversing roll 551 of the present embodiment has a cylindrical shape as a whole, and its outer peripheral surface is made of a material in which light reflection is suppressed. And as shown in FIG. 5, the some black part 551a which exhibits black, and the several white part 551b which exhibits white are provided in the outer peripheral surface of the 1st inversion roll 551. As shown in FIG. Each black portion 551 a and white portion 551 b are provided along the axial direction of the first reversing roll 551. In other words, the black portion 551a and the white portion 551b are provided along a direction that intersects the conveyance direction of the continuous paper S guided by the first reversing roll 551. Further, the black portions 551a and the white portions 551b are provided alternately in the circumferential direction on the outer peripheral surface of the first reversing roll 551.

  Further, as shown in FIG. 5, the background 550 on which the first reversing roll 551 is provided in the reversing device 55 is an intermediate color having a high brightness compared to the black portion 551a and a low brightness compared to the white portion 551b. Yes.

  In the present embodiment, since the first reversing roll 551 includes the black portion 551a and the white portion 551b, the contrast between the outer peripheral surface of the first reversing roll 551 and the continuous paper S guided by the first reversing roll 551 is increased. Become clear. Further, by setting the background 550 to an intermediate color, the contrast between the outer peripheral surface of the first reversing roll 551 and the background 550 and the contrast between the continuous paper S and the background 550 become clear. By adopting a configuration in which the first reversing roll 551 and the background 550 can be identified by color analysis in this way, for example, compared with the case where the first reversing roll 551 is a single color or the background 550 is white or black. Thus, image analysis by the wearable terminal 7 to be described later is performed accurately and at high speed.

  In addition, although the 1st inversion roll 551 was demonstrated here, the other 2nd inversion roll 552-the 5th inversion roll 555 also have the same structure. Although not described in detail, other roll members that guide the continuous paper S in the image forming apparatus 5 such as the transport roll 513 of the first image forming apparatus 51 and the transport roll 523 of the second image forming apparatus 52. Has the same configuration.

  Further, as described above, in the reversing device 55 of the present embodiment, the mark M is provided adjacent to each of the first reversing roll 551 to the fifth reversing roll 555. As shown in FIG. 4, in the reversing device 55 of the present embodiment, the patterns of the marks M provided adjacent to the first reversing roll 551 to the fifth reversing roll 555 are different from each other.

FIG. 6 is a view showing an example of the mark M provided adjacent to the first reversing roll 551. As shown in FIGS. 6 and 4, the mark M includes an arrow portion M1 indicating the conveyance direction of the continuous paper S, and a numerical portion M2 indicating the order in which the continuous paper S passes through the first reverse roll 551 in the reversing device 55. have. Since the continuous paper S passes through the first reversing roll 551 for the first time in the reversing device 55, a number “1” is represented in the number portion M <b> 2 as shown in FIG. 6. Further, since the continuous paper S passing through the first reversing roll 551 is conveyed from left to right in FIG. 4, as shown in FIG. 4, the mark M is placed so that the tip of the arrow M1 is directed to the right. Is provided.
Further, as shown in FIG. 4, in the mark M provided adjacent to the second reversing roll 551, the numeral “2” is represented in the numeral portion M2. Similarly, in the mark M provided adjacent to the third reversing roll 553 to the fifth reversing roll 555, numerals “3”, “4”, and “5” are represented in the numeral portion M2, respectively.

  Although details will be described later, in the present embodiment, when the mark M shown in FIG. 6 is detected in the video shot by the shooting unit 72 of the wearable terminal 7, the control unit 80 of the wearable terminal 7 forms an image. The first reversing roll 551 is specified as a unit of the device 5.

<Configuration of wearable terminal>
FIG. 7 is a diagram showing a schematic configuration of wearable terminal 7 to which the present embodiment is applied. As shown in FIG. 7, the wearable terminal 7 according to the present embodiment has a glasses-like shape as a whole, and is used by being worn on the operator's head.
The wearable terminal 7 includes a lens unit 71 provided at a position corresponding to the left and right eyes of the operator when the wearable terminal 7 is mounted, and an imaging unit that captures all or a part of a region visually recognized by the operator via the lens unit 71. 72 and a display unit 73 that displays an image superimposed on a scene visually recognized by the operator via the lens unit 71. The wearable terminal 7 includes a control unit 80 (see FIG. 8 described later) that controls each unit.
It should be noted that the imaging region by the imaging unit 72 may be wider than the region visually recognized by the operator via the lens unit 71 so that more information can be acquired, or the operator can acquire more information via the lens unit 71. Detailed information may be acquired by narrowing the region to be visually recognized.

The lens unit 71 is made of a light transmissive material. Thus, the operator wearing the wearable terminal 7 can visually recognize the front scene through the lens unit 71.
The photographing unit 72 is configured by a small camera such as a CCD camera, for example, and is provided adjacent to the lens unit 71 so as to face in a direction along the line of sight of the operator wearing the wearable terminal 7. Then, the photographing unit 72 photographs a moving image of a scene visually recognized by the operator via the lens unit 71 and outputs the photographed video to the control unit 80.
The display unit 73 is formed so as to overlap the lens unit 71, and is made of a light-transmitting material when no image is displayed. The display unit 73 displays an image so as to overlap with a scene (actual image) visually recognized by the operator via the lens unit 71 based on display control by the control unit 80.

<Functional configuration of image forming system>
FIG. 8 is a block diagram illustrating a functional configuration of the image forming system 1 to which the exemplary embodiment is applied.
The print server 3 according to the present embodiment includes a communication control unit 31 that controls communication with the wearable terminal 7, the image forming apparatus 5, and the like. The communication control unit 31 outputs to the wearable terminal 7 information related to the apparatus configuration of the image forming apparatus 5, information related to a print job performed in the image forming apparatus 5, information related to a work process in the image forming apparatus 5, and the like.
The print server 3 also includes an apparatus control unit 33 that controls the state of the image forming apparatus 5 and the execution of a print job in the image forming apparatus 5.

  The control unit 80 of the wearable terminal 7 includes a video analysis unit 81 that analyzes the video captured by the imaging unit 72. Furthermore, the control unit 80 of the wearable terminal 7 includes a display control unit 83 as an example of an image generation unit that controls an image displayed on the display unit 73. Further, the control unit 80 of the wearable terminal 7 includes a communication control unit 85 that performs communication with the print server 3. Furthermore, the control unit 80 includes a process determination unit 87 as an example of a work specifying unit that determines a work process in the image forming apparatus 5 based on communication by the communication control unit 85 or the like.

  The video analysis unit 81 includes a mark detection unit 811 that detects a mark M included in a video that is a shooting result captured by the shooting unit 72, and a shooting unit based on the mark M detected by the mark detection unit 811. And a unit specifying unit 813 as an example of a unit specifying unit for specifying a unit of the image forming apparatus 5 photographed at 72. The video analysis unit 81 includes a pattern analysis unit 815 that performs pattern analysis on the video captured by the imaging unit 72, and a determination unit that determines whether the operation of the unit is correct based on the analysis result of the pattern analysis unit 815. And an operation determination unit 817 as an example.

  The display control unit 83 stores data related to an image to be displayed on the display unit 73 in advance, and causes the display unit 73 to display an image based on an analysis result or the like by the video analysis unit 81. Although details will be described later, as an image displayed on the display unit 73 by the display control unit 83, for example, an instruction image P1 (refer to FIG. 11A described later) indicating a unit operated by the operator, the operator Guidance image P2 for guiding the operation by (see FIG. 11B described later), appropriate image P3 indicating that the operation by the operator is correct (see FIG. 11C described later), and the operation by the operator is incorrect Inappropriate image P4 indicating the effect (see FIG. 11D described later) and the like.

The communication control unit 85 communicates with the print server 3 and acquires information regarding the image forming apparatus 5 output from the print server 3.
The process determination unit 87 determines an operation state or the like in the unit based on an analysis result by the video analysis unit 81 or information on the image forming apparatus 5 acquired by the communication control unit 85.

  By the way, in the image forming system 1 of the present embodiment, since the image forming apparatus 5 is large, the path through which the continuous paper S is guided is long. Further, for example, when the continuous paper S is loaded in the image forming apparatus 5, the operation is not limited to one place, and the operator needs to perform the operation while moving around the image forming apparatus 5. is there. Furthermore, the structure of the image forming apparatus 5 is complicated, and the operation for loading the continuous paper S is complicated. For example, an inexperienced operator is likely to make an error in the operation.

  On the other hand, in the image forming system 1 of the present embodiment, information related to each operation performed by the operator on the image forming apparatus 5 is displayed on the display unit 73 of the wearable terminal 7 worn by the operator. Further, based on the result of photographing by the photographing unit 72 of the wearable terminal 7, an operation error or the like is detected, and the detection result is displayed on the display unit 73. Accordingly, the operator can perform an operation while referring to the image displayed on the display unit 73 of the wearable terminal 7, and smoothly perform operations such as the loading operation of the continuous paper S in the image forming apparatus 5. be able to. Further, errors in the operation of loading the continuous paper S in the image forming apparatus 5 are suppressed.

  Hereinafter, processing performed in the image forming system 1 of the present embodiment will be described in detail. Note that processing performed in the image forming system 1 described below is realized by cooperation of software and hardware resources. That is, the CPUs in the control computers provided in the wearable terminal 7 and the print server 3 execute programs that realize the functions of the wearable terminal 7 and the print server 3, and these functions are realized.

FIG. 9 is a flowchart illustrating processing performed by the control unit 80 of the wearable terminal 7 to which this exemplary embodiment is applied.
When the wearable terminal 7 is activated by the operator, communication by the communication control unit 85 is performed, and information regarding the image forming apparatus 5 is acquired from the print server 3 (step 101). Here, the information regarding the image forming apparatus 5 includes information regarding the apparatus configuration of the image forming apparatus 5, information regarding a print job performed in the image forming apparatus 5, information regarding a work process in the image forming apparatus 5, and the like. Specific examples of information relating to the work process in the image forming apparatus 5 include information relating to a stage (hereinafter, simply referred to as a work stage) in the work of loading the continuous paper S. The information regarding the work stage is, for example, information indicating the progress of the continuous paper S loading operation, and includes information indicating what operation should be performed in which unit.

  Subsequently, based on the information acquired in step 101, the process determination unit 87 specifies the current work stage of the image forming apparatus 5 (step 102). For example, among a plurality of work stages in the loading operation of the continuous paper S, a stage for inserting the continuous paper S wound in a roll shape around the roll member 531 of the paper feeding device 53, a first reverse roll 551 in the reverse device 55. The stage or the like through which the continuous paper S passes is specified.

Next, photographing by the photographing unit 72 is performed (step 103). As described above, in the wearable terminal 7 according to the present embodiment, a scene visually recognized through the lens unit 71 by the operator wearing the wearable terminal 7 is photographed as a moving image by the photographing unit 72.
The video imaged by the imaging unit 72 is output to the video analysis unit 81 (step 104).

  Subsequently, in the video analysis unit 81, the mark M is detected from the video shot by the shooting unit 72 by the mark detection unit 811 (step 105). When the mark M cannot be detected from the video (NO in step 105), the process returns to step 103, and the shooting by the shooting unit 72 and the output of the video are continued.

When the mark M is detected by the mark detection unit 811 (YES in step 105), the image forming apparatus 5 included in the video imaged by the imaging unit 72 by the unit specifying unit 813 based on the detected mark M. Are identified (step 106). Specifically, the image of the mark M detected by the mark detection unit 811 is analyzed. Based on the type (shape, pattern, color, etc.) of the mark M and the information regarding the apparatus configuration of the image forming apparatus 5 acquired in step 101, any of the image forming apparatuses 5 is recorded on the video imaged by the imaging unit 72. Whether the unit is included is specified. For example, when the mark M shown in FIG. 6 is detected, the first reversing roll 551 of the reversing device 55 is specified as a unit.
In this example, the unit that the user is viewing through the wearable terminal 7 is identified based on the unit included in the video captured by the imaging unit 72 (based on the analysis result of the video captured by the imaging unit 72). Although done, the unit may be specified by other methods. For example, an ID (identification information) is attached to each unit, and the ID is sent to the wearable terminal 7 using BLE (Bluetooth (registered trademark) Low Energy) or the ID of each unit is read by a sensor or the like. For example, the unit may be specified.

Subsequently, the process determination unit 87 determines whether or not the unit specified in step 106 is a unit to be operated in the work stage specified in step 102 (step 107).
When the identified unit is not the operation target unit (NO in step 107), based on the control by the display control unit 83, the display unit 73 indicates that the identified unit is not the operation target. An image P1 (see FIG. 11A described later) is displayed (step 115). Examples of the instruction image P1 include an image indicating the position and name of a unit that is an operation target. A specific example of the instruction image P1 will be described later.

  On the other hand, when the specified unit is a unit to be operated (YES in step 107), the pattern analysis unit 815 of the video analysis unit 81 performs pattern analysis of the video shot by the shooting unit 72. (Step 108). The pattern analysis performed in step 108 will be described later.

Next, based on the result of pattern analysis in step 108, the operation determination unit 817 determines whether or not an operation by the operator has already been performed in the target unit (step 109).
If the operation by the operator has not yet been performed on the unit (NO at step 109), a guide image P2 for guiding the operation by the operator to the display unit 73 based on the control by the display control unit 83 (described later) 11 (b)) is displayed (step 110). As the guide image P2, for example, an image indicating a direction in which the continuous sheet S is passed through the first reversing roll 551 of the reversing device 55, an image instructing switching of each switch on the operation panel 535 of the paper feeding device 53, or the like. Can be mentioned. A specific example of the guide image P2 will be described later.
Thereafter, the process returns to step 108 and the processing is continued.

  On the other hand, when the operation by the operator has already been performed in the unit (YES in step 109), it is determined whether or not the operation by the operator has been correctly performed based on the result of the pattern analysis in step 108 ( Step 111). For example, each switch is correctly switched on the operation panel 535 of the paper feeding device 53 as to whether or not the continuous paper S is passed through the first reversing roll 551 to the fifth reversing roll 555 of the reversing device 55 in the correct position and orientation. It is determined whether or not there is. A specific example of determining whether or not the operation by the operator has been performed correctly will be described later.

  If the operation by the operator is not performed correctly (NO in step 111), an inappropriate image P4 indicating that the operation is incorrect is displayed on the display unit 73 based on the control by the display control unit 83 (a diagram to be described later). 11 (d)) is displayed (step 112). Thereafter, the process returns to step 108 and the processing is continued. A specific example of the unsuitable image P4 will be described later.

On the other hand, if the operation by the operator is correctly performed (YES in step 111), an appropriate image P3 (described later) is displayed on the display unit 73 based on the control by the display control unit 83. 11c) is displayed (step 113). A specific example of the appropriate image P3 will be described later.
Next, the process determination unit 87 advances the work stage specified in step 102 to the next work stage (step 114). When the work stage is advanced by the process determination unit 87 in step 114, the next work stage that has been advanced is specified by the process determination unit 87.

In this embodiment, as in step 107 described above, first, it is determined whether or not the unit specified in step 106 is a unit to be operated in the work stage specified in step 102. When the identified unit is the unit to be operated, the correctness of the operation in the target unit was determined.
By the way, this process is an example, and the process shown in FIG. 14 (a diagram showing another process example performed in the image forming system 1) may be performed.

In the process shown in FIG. 14, first, the process of step 201 is executed.
Specifically, in the processing of step 201, as in step 102 described above, the process determination unit 87 causes the current operation of the image forming apparatus 5 (operation scheduled to be performed next, operation stage). (Hereinafter, this operation is referred to as “specific operation”). Further, in step 201, it is confirmed whether or not there is an operation determined to be an error (operation determined not to be performed correctly) among the operations performed so far by the operator (error of the error). Presence or absence is determined).

If it is determined in step 202 that there is an operation determined to be an error (when it is determined Yes in step 202), whether or not the operation determined to be an error is the specific work. Is determined (step 203). If it is determined in step 203 that the operation determined to be an error is the specific work, the unit that the user is viewing through the wearable terminal 7 is specified in the same manner as in step 106 (hereinafter, referred to as “the operation”). This unit is referred to as a “specific unit”) (step 204).
When it is determined in step 202 that there is no operation determined to be an error (when it is determined No in step 202), a predetermined process without error is executed (step 207).

  Next, in step 205, it is determined whether or not the specific unit is a unit to be operated (a unit to be operated, a unit on which the specific operation is performed). If it is determined in step 205 that the specific unit is a unit to be operated, the error content is displayed in step 206 as described later in the same manner as in step 112, and further, The error solution method is displayed (step 206).

  On the other hand, when it is determined in step 205 that the specific unit is not the unit to be operated, the status of the specific unit is displayed and / or the display informing the operator of the unit to be operated is displayed. Is performed on the display unit 73 of the wearable terminal 7 (step 208).

If it is determined in step 203 that the operation determined to be an error is not the specific work, the unit that the user is viewing through the wearable terminal 7 in step 209 as in step 204 above. The specific unit that is is specified.
Next, in step 210, it is determined whether or not the specific unit is a unit to be operated (a unit to be operated, a unit on which the specific operation is performed).
When it is determined in step 210 that the specific unit is a unit to be operated (a unit to be operated), the display of the work content in the specific unit and / or the error generating unit is A display indicating whether it is a unit or not is performed (step 211).

If it is determined in step 210 that the specific unit is not a unit to be operated, it is determined whether or not the unit on which the operation determined to be an error is performed is the specific unit ( Step 212).
If it is determined in step 212 that the unit on which the operation determined to be an error has been performed is a specific unit, the error content is displayed on the display unit 73 of the wearable terminal 7, and the error The solution is displayed (step 213).
On the other hand, if it is determined in step 212 that the unit on which the operation determined to be an error has been performed is not a specific unit, the display unit 73 of the wearable terminal 7 displays the specific unit (the unit being viewed by the operator). ) Status, display indicating which unit the error has occurred, and / or display indicating the work target unit (step 214).

<About pattern analysis>
Next, an example of pattern analysis performed by the pattern analysis unit 815 will be described.
The pattern analysis unit 815 recognizes a roll member such as the first reversing roll 551 or the continuous paper S included in the video imaged by the imaging unit 72 as a simplified pattern. Based on the recognized pattern, the relationship between the roll member and the continuous paper S is grasped, and whether or not the operation is performed in the image forming apparatus 5 and whether the operation is correct or not is determined.

  FIGS. 10A to 10C are diagrams illustrating an example of patterns recognized by the pattern analysis unit 815. Here, an example of pattern analysis performed in the pattern analysis unit 815 when the operator wearing the wearable terminal 7 is viewing the first reversing roll 551 of the reversing device 55 will be described. Here, FIG. 10A shows a pattern in a state where the continuous paper S does not pass through the first reversing roll 551, and FIG. 10B shows the continuous paper S above the first reversing roll 551. FIG. 10C shows a pattern in a state in which the continuous paper S passes under the first reversing roll 551.

As described above, the first reversing roll 551 has the black portion 551a (see FIG. 5) and the white portion 551b (see FIG. 5). In the reversing device 55 (see FIG. 4), the first reversing roll 551 is provided on the background 550 (see FIG. 5) of intermediate color.
And in the pattern analysis part 815, as shown to Fig.10 (a)-(c), the 1st inversion roll 551 is made into the rectangular-shaped figure pattern (it shows with the code | symbol 551p) by which black and white were arranged alternately. Be recognized. Furthermore, the continuous paper S is recognized as a white rectangular graphic pattern (indicated by reference numeral Sp).

  For example, in a state where the continuous paper S has not passed through the first reversing roll 551, as shown in FIG. 10A, only the graphic pattern 551p of the first reversing roll 551 is captured from the image photographed by the photographing unit 72. The figure pattern Sp of the continuous paper S (see FIG. 10B) is not recognized. From this result, it is determined in step 109 described above that the operation of passing the continuous paper S through the first reversing roll 551 has not been performed yet.

  Further, in a state where the continuous paper S passes above the first reversing roll 551, the graphic pattern 551p of the first reversing roll 551 and the graphic pattern Sp of the continuous paper S are recognized from the video imaged by the imaging unit 72. Is done. Specifically, as shown in FIG. 10B, it is recognized that the graphic pattern Sp of the continuous paper S blocks the graphic pattern 551p of the first reversing roll 551. From this result, it is recognized that the continuous paper S is passing above the first reversing roll 551, and it is determined that the operation by the operator is correctly performed in step 111 described above.

  Further, when the continuous paper S passes below the first reversing roll 551, the graphic pattern 551p of the first reversing roll 551 and the graphic pattern Sp of the continuous paper S are recognized from the video imaged by the photographing unit 72. Is done. Specifically, as shown in FIG. 10C, the graphic pattern 551p of the first reversing roll 551 is recognized so as to overlap the graphic pattern Sp of the continuous paper S. From this result, it is recognized that the continuous paper S is passing below the first reversing roll 551, and it is determined in step 111 described above that the operation by the operator is not performed correctly.

<Regarding Image Displayed on Display Unit 73>
Next, an example of an image displayed on the display unit 73 will be described. FIGS. 11A to 11D are diagrams illustrating images displayed on the display unit 73 of the wearable terminal 7. In the example shown in FIGS. 11A to 11D, an image is displayed on the display unit 73 so as to overlap with the scene visually recognized by the operator via the lens unit 71 (see FIG. 7) of the wearable terminal 7. 11 (a) to 11 (d) also show scenes visually recognized by the operator.
11A to 11D show a case where the operator wearing the wearable terminal 7 is viewing the first reversing roll 551 (see FIG. 4) in the reversing device 55 of the image forming apparatus 5. ing. In this example, the mark M provided adjacent to the first reversing roll 551 is detected in step 105 described above, and the first reversing roll 551 is specified as a unit in step 106.

FIG. 11A shows an example of the instruction image P1 displayed on the display unit 73. For example, the operator visually recognizes the first reversing roll 551 of the reversing device 55 even though the work stage in the paper feeding device 53 is specified in step 102 described above, and the first reversing roll in step 106. If 551 is specified as a unit, it is determined in step 107 that it is not a unit to be operated.
When it is determined that the unit is not an operation target, as shown in FIG. 11A, an instruction image P1 that indicates that the first reversing roll 551 is not an operation target is displayed. In this example, as the instruction image P1, a character image indicating the name of the paper feeding device 53 that is the operation target “the operation target is a paper feeding device” and the paper feeding device 53 that is the operation target are installed. An arrow image indicating the direction in which the image is present is displayed.
Note that the instruction image P1 is not limited to an image indicating a unit to be operated, but an image that simply indicates that the unit is not an operation target (for example, a character image “This roll is not an operation target”). Only may be displayed.

  Further, in this example, when the operator wearing the wearable terminal 7 is viewing the first reversing roll 551 of the reversing device 55 (when viewing the first reversing roll 551 displayed on the display unit 73). ), The case where the instruction image P1 is displayed has been described, but the case where the instruction image P1 is displayed is not limited thereto. For example, when an operator wearing the wearable terminal 7 is viewing a whole image of the image forming apparatus 5, when viewing a plurality of units at the same time, or viewing a place other than the image forming apparatus 5. In some cases, the instruction image P1 may be displayed. In other words, the instruction image P <b> 1 may be displayed when the units of the plurality of image forming apparatuses 5 are identified in Step 106 described above or when the units cannot be identified.

  FIGS. 11B to 11D are diagrams showing examples of the guide image P2, the appropriate image P3, and the inappropriate image P4 displayed on the display unit 73, respectively. In this example, a case where the work stage that allows the continuous paper S to pass above the first reversing roll 551 is specified in step 102 described above is shown. In this case, it is determined in step 107 described above that the first reversing roll 551 is a unit to be operated.

  When it is determined in step 109 described above that an operation for passing the continuous paper S through the first reversing roll 551 is not yet performed as an operation by the operator based on the result of the pattern analysis, FIG. As shown in b), a guide image P2 for guiding an operation of passing the continuous paper S is displayed. Specifically, as the guide image P2, an arrow image indicating the direction and position of passing the continuous paper S is displayed. In this example, it is necessary to pass the continuous paper S from the left to the right above the first reversing roll 551. Therefore, as shown in FIG. 11B, the guide image P2 is curved upward and turned right so as to overlap the first reversing roll 551 that is visually recognized through the lens unit 71 of the wearable terminal 7. An arrow image is displayed.

  In addition, when it is determined in step 111 described above that the operation by the operator is correctly performed based on the result of the pattern analysis, as shown in FIG. An appropriate image P3 showing is displayed. In this example, the continuous paper S is passed from the left to the right above the first reversing roll 551. For this reason, as shown in FIG. 11C, as the appropriate image P3, a character image “Good” indicating that the operation has been performed correctly and an arrow image indicating the conveyance direction of the continuous paper S are displayed. The

  Furthermore, when it is determined in step 111 described above that the operation by the operator is not performed correctly based on the result of the pattern analysis, the operation is not performed correctly as shown in FIG. An inappropriate image P4 indicating the effect is displayed. In this example, the continuous paper S is passed from the left to the right below the first reversing roll 551. For this reason, as shown in FIG. 11D, as the inappropriate image P4, a character image “NG” indicating that the operation is not performed correctly, and an arrow indicating the passing position of the correct continuous paper S An image is displayed.

  Next, another example of the image displayed on the display unit 73 will be described. FIGS. 12A to 12C are diagrams showing images displayed on the display unit 73 of the wearable terminal 7. In the example shown in FIGS. 12A to 12C, an image is displayed on the display unit 73 so as to overlap with a scene visually recognized by the operator via the lens unit 71 (see FIG. 7) of the wearable terminal 7. 12 (a) to 12 (c) also show scenes visually recognized by the operator.

  12A to 12C, the operator wearing the wearable terminal 7 visually recognizes the second reversing roll 552 in the reversing device 55 (see FIG. 1) of the image forming apparatus 5 (see FIG. 1). Shows the case. In this example, the work stage that allows the continuous paper S to pass from the upper side to the lower side of the second reversing roll 552 is identified in step 102 described above, and the mark M provided adjacent to the second reversing roll 552 in step 105. Is detected, and the second reversing roll 552 is identified as a unit in step 106.

  If it is determined in step 109 described above that the operation of passing the continuous paper S through the second reversing roll 552 has not yet been performed as an operation by the operator based on the result of the pattern analysis, FIG. As shown in FIG. 5, a guide image P2 for guiding an operation of passing the continuous paper S is displayed. In this example, it is necessary to pass the continuous paper S from the upper side to the lower side with respect to the second reversing roll 552. For this reason, as shown in FIG. 12A, an arrow image from the top to the bottom is displayed as the guide image P2 so as to overlap the second reversing roll 552 that is visually recognized through the lens portion 71 of the wearable terminal 7. Is done.

  Further, when it is determined in step 111 described above that the continuous paper S is passed from the upper side to the lower side with respect to the second reversing roll 552 and the operation by the operator is correctly performed based on the result of the pattern analysis. As shown in FIG. 12B, an appropriate image P3 is displayed. In this example, as the appropriate image P3, a character image “Good” indicating that the operation has been performed correctly and an arrow image indicating the conveyance direction of the continuous paper S are displayed.

  Furthermore, when it is determined in step 111 described above that the continuous paper S is passed from the lower side to the upper side with respect to the second reversing roll 552 and the operation by the operator is not correctly performed based on the result of the pattern analysis. As shown in FIG. 12C, the inappropriate image P4 is displayed. In this example, a character image “NG” indicating that the operation is not performed correctly and an arrow image indicating the correct passing position of the continuous paper S are displayed as the inappropriate image P4.

  Next, another example of the image displayed on the display unit 73 will be described. FIGS. 13A to 13B are diagrams showing images displayed on the display unit 73 of the wearable terminal 7. In the example shown in FIGS. 13A to 13B, an image is displayed on the display unit 73 so as to overlap with a scene visually recognized by the operator via the lens unit 71 (see FIG. 7) of the wearable terminal 7. 13 (a) and 13 (b) also show a scene visually recognized by the operator.

  In FIGS. 13A to 13B, the operator wearing the wearable terminal 7 visually recognizes the operation panel 535 in the paper feeding device 53 (see FIG. 1) of the image forming apparatus 5 (see FIG. 1). Shows the case. In step 105, the mark M provided on the operation panel 535 is detected. In step 106, the operation panel 535 is specified as a unit.

  FIG. 13A is an example showing an image displayed when the work stage for raising the roll member 531 is specified in step 102 described above. In the work stage for raising the roll member 531, the operator can perform an operation of switching the axis arm switch 535b to “up” and an operation of pushing the inching button 535g to slightly feed the continuous paper. .

  Therefore, in this case, as shown in FIG. 13A, as the guide image P2, a point image indicating the shaft arm switch 535b and the shaft arm switch 535b are rotated from the “down” side to the “up” side. A “Rotate CW” character image and an arrow image indicating the rotation direction of the shaft arm switch 535b are displayed. Further, as the guide image P2, a point image indicating the inching button 535g and a character image of “Paper Step Forward” indicating that the inching button 535g is pressed to slightly feed the continuous paper are displayed.

Thereafter, when the operator performs an operation to rotate the shaft arm switch 535b from the “down” side to the “up” side, the work stage is advanced to the next work stage in step 114 described above.
Along with this, the image displayed on the display unit 73 is switched. In this example, as shown in FIG. 13B, as the guide image P2, a point image indicating the brake switch 535c and “Rotate CCW” indicating that the brake switch 535c is rotated from the “on” side to the “off” side. "And an arrow image indicating the rotation direction of 535c are displayed. Even in this work stage, it is possible to perform an operation of pushing the inching button 535g and slightly feeding the continuous paper. Therefore, a point image indicating the inching button 535g and a character image “Paper Step Forward” indicating that the inching button 535g is pressed to slightly feed the continuous paper are continuously displayed as the guide image P2.

As shown in FIGS. 13A to 13B, when a plurality of types of operations can be performed in the unit specified in step 106 on the work stage specified in step 102, the display unit A plurality of types of guide images P <b> 2 may be displayed on 73.
Although illustration is omitted, when a plurality of types of operations can be performed in the unit, it is determined whether or not to execute the operation corresponding to each operation (step 109), or whether the operation is correct or incorrect (step 109). Step 111) can be performed. In this case, the instruction image P1, the guide image P2, the appropriate image P3, or the inappropriate image P4 can be displayed on the display unit 73 corresponding to each operation.

As described above, in the image forming system 1 according to the present embodiment, the unit of the image forming apparatus 5 visually recognized by the operator is specified, and the display unit 73 of the wearable terminal 7 worn by the operator has the specified unit. Displays images related to operations. As a result, the operator can perform an operation on the image forming apparatus 5 while referring to the image displayed on the display unit 73. In this case, it is possible to suppress work errors in the image forming apparatus 5 as compared with a case where an image related to an operation in the specified unit is not displayed on the display unit 73.
Further, in the image forming system 1 of the present embodiment, the correctness / incorrectness of the operation in each unit of the image forming apparatus 5 is determined based on the photographing result by the photographing unit 72 of the wearable terminal 7, and an image based on this result is displayed. Displayed on the unit 73. Thus, the operator can grasp the operation status in each unit, and the occurrence of an operation error in the continuous paper S loading operation or the like is suppressed. In addition, starting an image forming operation in the image forming apparatus 5 in a state in which there is an error in operation is suppressed.

  In this embodiment, the image such as the instruction image P1, the guide image P2, the appropriate image P3, or the inappropriate image P4 displayed on the display unit 73 may be a still image or a moving image (animation). May be.

In the present embodiment, in addition to the images related to operations such as the instruction image P1, the guide image P2, the appropriate image P3, or the inappropriate image P4, the image indicating information related to the status set in each apparatus in the image forming apparatus 5. Alternatively, an image indicating information related to a print job performed in the image forming apparatus 5 may be displayed together. For example, these images can be displayed on the display unit 73 based on the information acquired by the communication control unit 85 in step 101.
In this case, the operator can check the status set in each apparatus of the image forming apparatus 5 and the print job of the image forming apparatus 5 in addition to the information related to the operation. In comparison, operations in each unit of the image forming apparatus 5 can be performed more smoothly.

  Further, in the wearable terminal 7 of the present embodiment, based on the control by the display control unit 83, the display unit 73 overlaps with the scene visually recognized through the lens unit 71 by the operator wearing the wearable terminal 7. Images such as the instruction image P1, the guide image P2, the appropriate image P3, and the inappropriate image P4 are displayed. However, for example, an image of a scene (actual image) photographed by the photographing unit 72 is displayed on the display unit 73, and the instruction image P1 and the guide image P2 described above are superimposed on the real image displayed on the display unit 73, as appropriate The image P3, the inappropriate image P4, and the like may be displayed.

  Further, in the wearable terminal 7 of the present embodiment, the mark M photographed by the photographing unit 72 is detected, and the unit in the image forming apparatus 5 is specified based on the detected mark M. However, the mark M is not necessarily used for specifying the unit in the image forming apparatus 5. That is, the unit of the image forming apparatus 5 is specified by pattern analysis of the arrangement, size, etc. of each component, continuous paper S, etc., with respect to the image of the unit of the image forming apparatus 5 photographed by the photographing unit 72. May be.

  In the present embodiment, the processing of analyzing the video captured by the imaging unit 72 is performed by the control unit 80 of the wearable terminal 7, but part of the processing performed by the control unit 80 is performed. Alternatively, the whole process may be performed by the print server 3. In other words, in this embodiment, the information processing apparatus may be configured by the control unit 80 of the wearable terminal 7, the information processing apparatus may be configured by the print server 3, and the control unit 80 of the wearable terminal 7. And the print server 3 may constitute an information processing apparatus.

  Further, in the present embodiment, the wearable terminal 7 that is used by being worn by an operator as a portable terminal that displays images such as the instruction image P1, the guidance image P2, the appropriate image P3, and the inappropriate image P4 will be described as an example. However, the present invention is not limited to this. For example, a medium that includes a display unit 73 that displays an image and a photographing unit 72 that captures an image and can be operated by the operator to operate the image forming apparatus 5 can be replaced with a smartphone or a mobile terminal instead of the wearable terminal 7. You may employ | adopt a mobile phone, a tablet terminal, a digital camera, etc.

DESCRIPTION OF SYMBOLS 1 ... Image forming system, 3 ... Print server, 5 ... Image forming apparatus, 7 ... Wearable terminal, 71 ... Lens part, 72 ... Shooting part, 73 ... Display part, 80 ... Control part

Claims (12)

Unit specifying means for specifying the unit of the image forming apparatus that has a plurality of units and forms an image on continuous paper;
An image generation unit that generates an image related to an operation performed in the unit specified by the unit specifying unit, the image generation unit generating the image to be displayed on the display unit of the portable terminal including the display unit. Information processing device. Further comprising a specifying means for specifying a work target unit on which the work by the operator is performed;
2. The image generation unit according to claim 1, wherein the image generation unit varies the image to be generated depending on whether or not the unit specified by the specification unit is a unit specified by the unit specification unit. Information processing device.   The said image generation means produces | generates the guidance image for guiding work, when the said unit specified by the said unit specification means is a unit of work object by an operator. Information processing device.   The said image generation means produces | generates the instruction | indication image which shows the unit of the said work target, when the said unit specified by the said unit specification means is not the unit of the work target by an operator. The information processing apparatus according to item 1. A determination unit for determining whether the operation by the operator in the unit is correct or not;
The image generating means, when generating the image related to the work performed in the unit specified by the unit specifying means, varies the image to be generated according to the correctness of the work in the unit. The information processing apparatus according to any one of claims 1 to 4.   The image generation unit changes an image to be generated depending on whether the unit specified by the unit specifying unit matches the unit determined by the determination unit when there is a work error or not. The information processing apparatus according to claim 5.   6. The image generating unit varies the image to be generated depending on whether or not the unit specified by the unit specifying unit is a unit to be worked on by an operator. The information processing apparatus described in 1.   8. The information according to claim 1, wherein the image generation unit generates a different image according to a setting of the image forming apparatus or the unit specified by the unit specification unit. Processing equipment. An image forming apparatus having a plurality of units and forming an image on continuous paper;
Unit specifying means for specifying the unit of the image forming apparatus;
An image forming system comprising: an image generating unit that generates an image related to work performed by the unit specified by the unit specifying unit and displayed on a display unit of a portable terminal. Against the computer,
A function of identifying the unit of the image forming apparatus that has a plurality of units and forms an image on continuous paper;
The program which implement | achieves the function which produces | generates the image relevant to the operation | work performed by the specified said unit, and displaying on the display part of a portable terminal. A program that is executed by a computer device that controls a portable terminal including a display unit and a photographing unit,
An image obtained by the photographing unit, which is obtained by photographing the unit of the image forming apparatus that has a plurality of units and forms an image on continuous paper by the photographing unit. Acquisition function,
When an operator who operates the unit views the unit through the mobile terminal, a display function for displaying an image related to work performed in the unit on the display unit;
A program to make a computer realize. A generation function that generates an image related to work performed in the unit of the image forming apparatus that has a plurality of units and forms an image on continuous paper and is displayed on the display unit of the mobile terminal; ,
An output function for outputting an image generated by the generation function;
A program to make a computer realize.

Images