JP2019036849A - Image forming system - Google Patents

Abstract

To provide an image forming system that eliminates inconvenience for a user.SOLUTION: An image forming system comprises an image forming apparatus and a wearable terminal. The wearable terminal includes a projection control unit. The projection control unit controls to three-dimensionally projects, on a lens, abnormality eliminating processing image data received by a wearable terminal receiving unit and cause a user to visually recognize the abnormality eliminating processing image data. A compound machine control unit of the image forming apparatus includes an abnormality presence/absence determination unit 31, a procedure construction unit 32, and an extraction unit 33. The abnormality presence/absence determination unit 31 determines whether abnormality occurs in the image forming apparatus from photographed image data received by an image forming apparatus receiving unit. When the abnormality presence/absence determination unit 31 determines that abnormality occurs, the procedure construction unit 32 constructs a procedure for processing to eliminate the abnormality. The extraction unit 33 extracts the abnormality eliminating processing image data stored in a storage unit on the basis of the procedure for the processing constructed by the procedure construction unit 32.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an image forming system.

  In an image forming apparatus typified by a multifunction peripheral, light is applied to a photoconductor based on image data to form an electrostatic latent image on the photoconductor. Thereafter, charged toner is supplied onto the formed electrostatic latent image to form a visible image, which is then transferred and fixed on paper, and output to the outside of the apparatus.

  Here, a technique relating to operation guidance of the image forming apparatus is disclosed in Japanese Patent Laying-Open No. 2013-250849 (Patent Document 1).

  The guidance display system disclosed in Patent Document 1 is a guidance display system that includes a first device and a display device, and displays guidance for operating the first device on the display device. The guidance display system includes a first acquisition unit for acquiring a captured image, a first analysis unit for specifying the first device included by analyzing the captured image, and the first A second acquisition means for acquiring the state of the apparatus; a third acquisition means for acquiring a guidance image according to the state of the first apparatus; and the guidance image is combined with the captured image. Display means for generating a display screen and displaying the display screen on the display device. The display means includes specifying means for specifying a position for synthesizing the guidance image with the captured image, and the specifying means is specified from the state of the first device in the captured image. It is presumed that the hand will be approached based on the position of the operation part, which is a part that requires operation with respect to the state, and the position where the operator is likely to approach the operation part. The position away from the position to be identified is specified as the position for the composition.

JP 2013-250849 A

  In an image forming apparatus, an abnormality such as a paper jam may occur during image formation. In such a case, if the abnormality is not eliminated, the next image formation cannot be performed, and the so-called down time is prolonged. In addition, it is conceivable to call a service person to solve the abnormality, but the state in which the image forming apparatus cannot be used will continue until the service person arrives. Such a situation is undesirable for the user.

  In the guidance display system disclosed in Patent Literature 1, a display screen of a mobile terminal device is used as a display device. However, the display screen of the mobile terminal device has a limited displayable area, which may be inconvenient for the user. Moreover, since it is displayed two-dimensionally, it may be difficult to understand as guidance.

  An object of the present invention is to provide an image forming system that eliminates inconvenience for the user.

  An image forming system according to the present invention includes an image forming apparatus and a wearable terminal. The image forming apparatus includes an image forming unit that forms an image on a sheet. The wearable terminal can communicate with the image forming apparatus. The wearable terminal includes a lens that can be visually recognized by the user's eyes when worn on the user. The wearable terminal includes an imaging unit, a wearable terminal transmission control unit, a wearable terminal reception unit, and a projection control unit. The imaging unit captures an image. The wearable transmission control unit controls to transmit the captured image data captured by the imaging unit to the image forming apparatus. The wearable terminal receiving unit receives the abnormality-resolved image data, which is image data related to a process for eliminating a plurality of types of abnormalities of the image forming apparatus during image formation by the image forming unit, transmitted from the image forming apparatus. The projection control unit controls the abnormality-resolved image data received by the wearable terminal receiving unit to be projected three-dimensionally onto the lens so that the user can visually recognize the abnormality-resolved image data. The image forming apparatus includes a storage unit, an image forming apparatus reception unit, an abnormality presence / absence determination unit, a procedure construction unit, an extraction unit, and an image forming device transmission control unit. The storage unit stores the abnormality elimination processing image data. The image forming apparatus receiving unit receives captured image data transmitted from the wearable terminal. The abnormality presence / absence determining unit determines whether or not an abnormality has occurred in the image forming apparatus from the captured image data received by the image forming apparatus receiving unit. If it is determined by the abnormality presence / absence determination unit that an abnormality has occurred, the procedure construction unit constructs a procedure for eliminating the abnormality. The extraction unit extracts the abnormality-resolved image data stored in the storage unit based on the processing procedure constructed by the procedure construction unit. The image forming apparatus transmission control unit controls to transmit the abnormality-resolved image data extracted by the extraction unit to the wearable terminal.

  According to such an image forming system, a process for photographing an abnormality occurring in the image forming apparatus and eliminating the abnormality on the image forming apparatus side based on the photographed image is constructed. Then, the abnormality-resolved image data is projected onto the lens three-dimensionally by the wearable terminal. Then, when the user himself / herself resolves the abnormality that has occurred in the image forming apparatus, the abnormality can be appropriately resolved. Therefore, such an image forming system can eliminate inconvenience for the user.

1 is a schematic diagram illustrating an appearance of an image forming system including a multifunction peripheral when an image forming apparatus included in the image forming system according to an embodiment of the present invention is applied to the multifunction peripheral. It is a block diagram which shows the structure of the image forming system shown in FIG. 2 is a block diagram illustrating a configuration of a multifunction machine control unit. FIG. 5 is a flowchart illustrating a processing flow when an abnormality occurs in the multifunction peripheral. It is a figure which shows an example of the abnormality elimination process image data projected on the lens three-dimensionally.

  Embodiments of the present invention will be described below. FIG. 1 is a schematic view showing an external appearance of an image forming system 26 including a multifunction peripheral when an image forming apparatus included in the image forming system according to an embodiment of the present invention is applied to the multifunction peripheral. FIG. 2 is a block diagram showing a configuration of the image forming system 26 shown in FIG.

  Referring to FIGS. 1 and 2, the image forming system 26 is capable of communicating with the multifunction device 11 including the image forming unit 15 that forms an image and the multifunction device 11. The wearable terminal 41 including a pair of lenses 45 capable of visually recognizing an object is included. The lens 45 also functions as a display for projecting the abnormality-resolved image data.

  First, the configuration of the multifunction machine 11 will be described. The multifunction machine 11 includes a multifunction machine control unit 12, an operation unit 13, an image reading unit 14, an image forming unit 15, a paper feed cassette 16, a manual feed tray 24, a hard disk 17 serving as a storage unit, and a network 25. A network interface unit 18 for connecting to the image forming apparatus, and a multifunction device communication unit 23 operating as an image forming apparatus receiving unit. The multifunction device control unit 12 controls the entire multifunction device 11. The multi-function device control unit 12 includes a CPU (Central Processing Unit) and the like, and includes a main memory 19 that temporarily stores data. The operation unit 13 includes a touch panel type display screen 21 that displays information transmitted from the multifunction peripheral 11 side and user input contents. The operation unit 13 accepts input from the user regarding image formation such as the number of copies to be printed and image forming conditions such as gradation. The image reading unit 14 includes an ADF (Auto Document Feeder) 22 as a document transport device that transports a document set at the set position to the read position. The image reading unit 14 reads an image of a document set on the ADF 22 or the mounting table. A plurality of paper feed cassettes 16 are provided, each of which can store a plurality of sheets. The manual feed tray 24 is provided on the side portion of the multifunction machine 11 and can set paper for forming an image by manual feed. The image forming unit 15 forms an image on a sheet conveyed from the paper feed cassette 16 or the manual feed tray 24 based on the image data of the original read by the image reading unit 14 or the image data received via the network 25. To do. The hard disk 17 stores data related to image formation such as transmitted image data and input image forming conditions. Further, the hard disk 17 stores abnormality-resolved image data that is image data related to a process for resolving a plurality of types of abnormalities of the multifunction machine 11 during image formation by the image forming unit 15. The abnormality elimination processing image data includes moving images. The multi-function device communication unit 23 receives the captured image data transmitted from the wearable terminal 41 by NFC (Near Field Communication) communication, for example.

  Next, the configuration of the multifunction device control unit 12 provided in the multifunction device 11 will be described. FIG. 3 is a block diagram illustrating a configuration of the multifunction machine control unit 12. Referring to FIG. 3, the multifunction device control unit 12 includes an abnormality presence / absence determination unit 31, a procedure construction unit 32, an extraction unit 33, and a multifunction device transmission control unit 34 as an image forming apparatus transmission control unit. The abnormality presence / absence determination unit 31 determines whether an abnormality has occurred in the multifunction device 11 from the captured image data received by the multifunction device communication unit 23. If it is determined by the abnormality presence / absence determination unit 31 that an abnormality has occurred, the procedure constructing unit 32 constructs a procedure for processing to eliminate the abnormality. The extraction unit 33 extracts the abnormality-resolved image data stored in the hard disk 17 based on the processing procedure constructed by the procedure construction unit 32. The multifunction device transmission control unit 34 performs control so that the abnormality-resolved image data extracted by the extraction unit 33 is transmitted to the wearable terminal 41. These configurations will be described in detail later.

  Next, the configuration of the wearable terminal 41 will be described. The wearable terminal 41 is a so-called glasses-type wearable terminal 41. The wearable terminal 41 is worn on the user's head with the pair of temple portions 49a and 49b placed on the user's ears. The user can wear the wearable terminal 41 on the user's head and visually recognize the object through the lens 45. An image received by the wearable terminal 41 can be displayed on the lens 45. The wearable terminal 41 may be a so-called head mounted display.

  The wearable terminal 41 includes a wearable terminal control unit 42, a wearable terminal communication unit 43, a wearable terminal storage unit 44, a lens 45, and a photographing unit 46. The wearable terminal control unit 42 includes a CPU and the like, and controls the entire wearable terminal 41. The wearable terminal communication unit 43 that operates as a wearable terminal reception unit receives the abnormality-resolved image data transmitted from, for example, the multifunction machine 11 by NFC communication. That is, the above-described multifunction peripheral communication unit 23 and wearable terminal communication unit 43 perform transmission / reception of data such as photographed image data and abnormality resolution processed image data. Note that the multifunction device communication unit 23 and the wearable terminal communication unit 43 may be configured to transmit and receive data by Wi-Fi. The wearable terminal storage unit 44 stores, for example, abnormality-resolved image data transmitted from the multifunction machine 11. The photographing unit 46 can photograph an image viewed through the lens 45. In other words, the wearable terminal 41 has a so-called camera function. The captured image data is stored in the wearable terminal storage unit 44.

  The wearable terminal control unit 42 includes a projection control unit 47 and a wearable terminal transmission control unit 48. The projection control unit 47 controls the abnormality-resolved image data received by the wearable terminal communication unit 43 to be projected three-dimensionally onto the lens 45 so that the user can visually recognize the abnormality-resolved image data. The wearable terminal transmission control unit 48 controls to transmit the captured image data captured by the imaging unit 46 to the multifunction device 11.

  Next, a case where an abnormality has occurred in the multifunction machine 11 during image formation in the image forming unit 15 using the above-described image forming system 26 will be described. Here, a description will be given of a case where the paper stored in the manual feed tray 24 is stopped for some reason and the conveyance is stopped in the middle of feeding, and as a result, an abnormality that a paper jam has occurred.

  FIG. 4 is a flowchart illustrating a process flow when an abnormality occurs in the multifunction machine 11. Referring to FIG. 4, first, imaging unit 46 included in wearable terminal 41 attached to the user captures an image of multifunction device 11 (in FIG. 4, step S <b> 11, hereinafter “step” is omitted). . Then, the wearable terminal transmission control unit 48 transmits the captured image data captured by the imaging unit 46 to the multifunction machine 11 (S12). Then, the MFP communication unit 23 receives the transmitted captured image data by NFC communication (S13).

  Thereafter, the abnormality presence / absence determination unit 31 determines whether or not an abnormality has occurred in the multifunction device 11 from the captured image data received by the multifunction device communication unit 23 (S14). In this case, for example, an image in the vicinity of the manual feed tray 24 is analyzed, and it is determined from the image in which the paper is stopped at a halfway position that an abnormality called paper jam in the manual feed tray 24 has occurred (in S14, YES).

  After that, if it is determined by the abnormality presence / absence determination unit 31 that an abnormality has occurred, the procedure construction unit 32 constructs a procedure for eliminating the abnormality (S15). In this case, a procedure for removing paper jammed in the manual feed tray 24 is constructed. Specifically, the procedure is constructed by opening the side cover and the front cover to confirm where the paper is jammed, and in order the image data regarding points to be noted when removing the paper. Then, based on the processing procedure constructed by the procedure construction unit 32, the extraction unit 33 extracts the abnormality elimination processing image data stored in the hard disk 17 (S16). Thereafter, the multifunction device transmission control unit 34 performs control to transmit the abnormality-resolved image data extracted by the extraction unit 33 to the wearable terminal 41 (S17).

  Then, the wearable terminal communication unit 43 included in the wearable terminal 41 receives the abnormality processing procedure image data transmitted from the multifunction machine 11 (S18). After reception, the projection control unit 47 controls the received image data, that is, the abnormality-resolved image data to be projected three-dimensionally on the lens 45 so that the user can visually recognize the abnormality-resolved image data (S19). ).

  FIG. 5 is a diagram illustrating an example of the abnormality-resolved image data projected three-dimensionally on the lens 45. Referring to FIG. 5, the lens 45 has an outer shape 51 of the multifunction device 11 within the field of view, and two abnormality-resolved image data 52 a and 52 b indicated by alternate long and short dash lines. The abnormality elimination image data 52a and 52b are respectively composed of arrows and alphabets such as “A” and “B”, and are shown three-dimensionally. That is, when the user changes the viewing angle of the multifunction machine 11, the appearance of the abnormality-resolved image data 52a and 52b also changes. The user first opens the side cover in the direction of the arrow from the abnormality-removed image projected onto the lens 45, checks the jammed paper, and then opens the front cover in the direction of the arrow. Further, it is possible to grasp whether or not there is a jammed sheet.

  Then, the user performs a process of eliminating the abnormality based on the abnormality elimination processing image data 52a and 52b. Specifically, the jammed paper is removed. Thereafter, in this case, after a lapse of a predetermined time, the process returns to S11 again, the multifunction machine 11 is photographed, and the abnormality presence / absence determination unit 31 determines the presence / absence of abnormality from the photographed captured image data (S12 to S14). If it is determined that the abnormal state has been resolved (NO in S14), the process is terminated.

  According to such an image forming system 26, a process for photographing an abnormality occurring in the multifunction machine 11 and eliminating the abnormality on the multifunction machine 11 side based on the photographed image is constructed. The wearable terminal 41 projects the abnormality-resolved image data on the lens 45 in a three-dimensional manner. Then, when the user himself / herself resolves the abnormality that has occurred in the multifunction machine 11, the abnormality can be appropriately resolved. Therefore, such an image forming system 26 can eliminate inconvenience for the user.

  In addition, since the abnormality elimination processing image data includes the abnormality elimination processing image data of the moving image, it is possible to easily recognize the processing for eliminating the abnormality. Therefore, the abnormality can be solved more appropriately.

  Further, the hard disk 17 stores audio data related to the abnormality elimination processing image data, the extraction unit 33 extracts audio data related to the abnormality elimination processing image data, and the multifunction peripheral transmission control unit 34 performs the abnormality elimination processing. Control is performed so as to transmit sound data related to the abnormality-resolved image data together with the image data, and the projection control unit 47 performs control so as to emit sound based on the sound data when the abnormality-resolved image data is projected onto the lens. Also good. By doing so, it is possible to make it easy to recognize the process for eliminating the abnormality even by voice. Therefore, the abnormality can be solved more appropriately.

  Note that the multifunction machine 11 may further include a determination unit that determines from the captured image data transmitted from the wearable terminal 41 whether the process for eliminating the abnormality is correct. The multifunction device 11 may further include a warning control unit that controls to warn that if the determination unit determines that the process for eliminating the abnormality is not correct. In this way, if the process for eliminating the abnormality is wrong, this can be pointed out by a warning. Therefore, the downtime can be further reduced.

  The wearable terminal 41 further includes a temperature detection unit that detects the temperature in a non-contact manner, and the projection control unit 47 performs control so that the temperature data detected by the temperature detection unit is projected onto the lens 45 as an image. May be. By doing so, for example, as a process for eliminating the abnormality, it is possible to call attention when an operation of touching the vicinity of the fixing roller that is included in the image forming unit 15 and reaches a high temperature occurs. Therefore, it is possible to proceed with the process of eliminating the abnormality more efficiently.

  It should be understood that the embodiments disclosed herein are illustrative in all respects and are not restrictive in any aspect. The scope of the present invention is defined by the scope of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the scope of the claims.

  The image forming system according to the present invention is particularly effectively used when it is required to eliminate the user's inconvenience.

11 MFP, 12 MFP control unit, 13 operation unit, 14 image reading unit, 15 image forming unit, 16 paper cassette, 17 hard disk, 18 network interface unit, 19 main memory, 21 display screen, 22 ADF, 23 MFP communication department,
24 manual feed tray, 25 network, 26 image forming system, 31 abnormality presence / absence determination unit, 32 procedure construction unit, 33 extraction unit, 34 MFP transmission control unit, 41 wearable terminal, 42 wearable terminal control unit, 43 wearable terminal communication unit, 44 Wearable terminal storage unit, 45 lens, 46 photographing unit, 47 projection control unit, 48 wearable transmission control unit, 49a, 49b temple unit, 51 outer shape, 52a, 52b abnormality elimination processing image data.

Claims (6)

An image forming apparatus including an image forming unit that forms an image on a sheet, and a wearable terminal including a lens that can communicate with the image forming apparatus and that can be visually recognized by the user's eyes when worn by the user An image forming system,
The wearable terminal is
A shooting section for shooting images;
A wearable terminal transmission control unit that controls the captured image data captured by the imaging unit to be transmitted to the image forming apparatus;
A wearable terminal receiving unit that receives anomaly-resolved image data that is image data relating to a process of eliminating a plurality of types of anomalies of the image forming apparatus during image formation by the image forming unit transmitted from the image forming apparatus ,
A projection control unit configured to three-dimensionally project the abnormality elimination processing image data received by the wearable terminal reception unit onto the lens so that the user visually recognizes the abnormality elimination processing image data;
The image forming apparatus includes:
A storage unit for storing the abnormality-resolved image data;
An image forming apparatus receiving unit that receives the captured image data transmitted from the wearable terminal;
An abnormality presence / absence determination unit that determines whether or not an abnormality has occurred in the image forming apparatus from the captured image data received by the image forming apparatus reception unit;
If it is determined by the abnormality presence / absence determination unit that an abnormality has occurred, a procedure construction unit that constructs a procedure for processing to eliminate the abnormality;
Based on the procedure of the process constructed by the procedure construction unit, an extraction unit that extracts the abnormality elimination processing image data stored in the storage unit;
An image forming system comprising: an image forming apparatus transmission control unit configured to control transmission of the abnormality elimination processed image data extracted by the extraction unit to the wearable terminal. The image forming system according to claim 1, wherein the abnormality elimination processing image data includes moving image abnormality elimination processing image data. The storage unit stores audio data related to the abnormality elimination processing image data,
The extraction unit extracts the audio data related to the abnormality elimination processing image data,
The image forming apparatus transmission control unit controls to transmit the sound data related to the abnormality resolution processing image data together with the abnormality resolution processing image data,
3. The image forming system according to claim 1, wherein the projection control unit performs control so as to emit a sound based on the sound data when the abnormality-resolved image data is projected onto the lens. The said image forming apparatus is further equipped with the determination part which determines whether the process which eliminates the said abnormality is correct from the said picked-up image data transmitted from the said wearable terminal. The image forming system according to item. 5. The image forming system according to claim 4, further comprising: a warning control unit that controls to warn that if the determination unit determines that the process for eliminating the abnormality is not correct. The wearable terminal further includes a temperature detection unit that detects temperature without contact,
The image forming system according to any one of claims 1 to 5, wherein the projection control unit controls the temperature data detected by the temperature detection unit to be projected as an image on the lens.

Images