JP2013105292A - Display system, program and information distribution device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To add a designation display in an appropriate operation portion according to a status of an image formation device.SOLUTION: A display system 1 has an electronic apparatus, a terminal device and an information distribution device connected through a network. The information distribution device receives status information from the electronic apparatus, and determines an operation portion of the electronic apparatus according to the received status information of the electronic apparatus. The terminal device inputs an image by imaging the electronic apparatus, and displays the input image on an operation display part 303. At least one of the information distribution device and the terminal device adds a desired designation display to the determined operation portion of the electronic apparatus in the input image and displays the desired designation display on the operation display part 303.

Description

  The present invention relates to a display system, a program, and an information distribution apparatus.

  2. Description of the Related Art Conventionally, a system for connecting an electronic device having a communication function, such as an image forming apparatus, to an information distribution server using a communication line such as a public line or the Internet, and providing information necessary for the electronic device from the information distribution server. Proposed.

  In the above system, for example, when an abnormality such as a paper set or a printing jam occurs in the image forming apparatus, an operation procedure for canceling the abnormality is displayed on the display screen, so that the user can easily cancel the abnormality.

  For example, operating procedure information can be obtained by attaching QR (Quick Response) codes (registered trademark) to multiple locations, such as inside an image forming device or internal parts, and reading the QR codes using a mobile phone camera In addition, a system that facilitates jam processing by displaying a moving image related to a jam processing cancellation procedure of an image forming apparatus on a mobile phone is disclosed.

  For example, in Patent Document 1, in an environment where a plurality of image forming apparatuses are used, an image forming apparatus in an error state that is in front of the operator's eyes is easily identified from among the plurality of image forming apparatuses. Providing a display system that can select appropriate procedure display according to each operation status, transfer it to a portable terminal, and perform appropriate procedure display according to each operation status for a plurality of image forming apparatuses It is intended to be. Here, notation means (for example, QR code) indicating the information of the image forming apparatus is provided in the image forming apparatus or in an internal component, but the image forming apparatus, the mobile phone, and the information distribution server are connected by a network.

  However, as in Patent Document 1, in the method of applying the QR code to the inside of the image forming apparatus, some parts cannot be attached, it is difficult to find depending on the application place, or the product landscape when attached to the front door or the side door. (Design) was a problem that was damaged.

  In view of the above problems, an object of the present invention is to provide a display system, a program, and an information distribution apparatus capable of giving a designation display to an appropriate operation site according to the state of the image forming apparatus.

According to one aspect of the present invention, there is provided a display system in which an electronic device, a terminal device, and an information distribution device are connected via a network,
The electronic device is
A transmission unit that transmits state information indicating the state of the electronic device;
The information distribution apparatus includes:
A receiving unit for receiving state information transmitted from the electronic device;
A determination unit for determining an operation part of the electronic device based on the state information of the electronic device received by the reception unit;
With
The terminal device
An input unit for inputting an image by photographing the electronic device;
An operation display unit on the terminal device side for displaying the input image,
At least one of the information distribution device and the terminal device is:
A control unit is provided that adds a desired designation display to the operation part of the electronic device determined by the determination unit in the input image and displays the operation display unit on the terminal device side. A display system is provided.

  According to the present invention, a location to be processed can be easily specified by attaching a designation display to an appropriate operation site according to the state of the image forming apparatus.

1 is an overall configuration diagram of a display system according to an embodiment. 1 is an overall configuration diagram of a display system according to an embodiment. The internal block diagram of the smart phone which concerns on one Embodiment. The software block diagram in the control part of the smart phone of FIG. The lineblock diagram of the information distribution server concerning one embodiment. The other lineblock diagram of the information distribution server concerning one embodiment. The figure which showed the operation display part at the time of error generation. The flowchart which showed the operation procedure display process which concerns on one Embodiment. The flowchart which showed the operation procedure display process which concerns on one Embodiment. The figure which showed the frame display of the site | part detection. The figure which showed the hierarchical structure of the operation procedure. The figure which showed the internal data structure of the operation procedure. The figure which showed the hierarchical structure of the operation procedure for every work classification. The figure which showed the hierarchy transfer conditions for every work classification. The figure which showed the management state of the operation procedure. The flowchart which showed the operation procedure request process which concerns on one Embodiment. The flowchart which showed the work record management process which concerns on one Embodiment. The figure which showed an example of the work record. The figure which showed an example of the operation procedure display. The flowchart which showed the operation procedure update process which concerns on one Embodiment.

  Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, the duplicate description is abbreviate | omitted by attaching | subjecting the same code | symbol.

[System overall configuration]
First, the overall configuration of a display system according to an embodiment of the present invention will be described with reference to FIG. FIG. 1 shows an example of the overall configuration of a display system according to the present embodiment. In the display system 1 according to the present embodiment, an image forming apparatus 100, an information distribution server 200, and a smartphone 300, which is an example of a mobile terminal device, are connected to be communicable via a network. First, an outline of the display system 1 will be briefly described.

[System Overview]
When an error or the like occurs in the image forming apparatus 100, the operation display unit of the image forming apparatus 100 includes the error contents and unique data of the image forming apparatus 100 such as a QR code (IP address, serial number, presence / absence of peripheral devices, etc.) Is displayed, the QR code is read by the camera of the smartphone 300, and thereby the image forming apparatus 100 photographed by the smartphone 300 may be specified.

  In this state, when the image forming apparatus 100 is photographed with the camera of the smartphone 300, the information distribution server 200 includes unique information identifying the image forming apparatus 100 sent from the smartphone 300 and an error sent from the image forming apparatus 100. Get status information. The information distribution server 200 determines a part to be operated of the image forming apparatus 100 based on such information.

  After the determination, the information distribution server 200 transfers the determined operation part information to the smartphone 300. The smartphone 300 detects whether or not the determined operation part of the image forming apparatus 100 is photographed. When the smartphone 300 detects a part to be operated, the smartphone 300 displays a frame on the operation part and displays the frame on the operation display unit of the smartphone 300. .

  According to this, it is not always necessary to affix a QR code to the inside of the image forming apparatus 100 and internal parts. In addition, it is possible to determine an operation part suitable for the situation of the specified image forming apparatus 100 and attach a frame display to the determined operation part of the image forming apparatus 100.

[System Details]
Hereinafter, the display system will be described in detail. The display system 1 includes an image forming apparatus 100, a smartphone 300 with a camera, an information distribution server 200, and a base station 400 for communication of the smartphone 300. Here, since the image forming apparatus 100 and the smartphone with camera 300 are managed by an IP address or a unique ID number registered in a SIM (Subscriber Identity Module card) card, there may be a plurality of devices in the system. .

  In FIG. 1, the image forming apparatus 100 includes a control unit 101, a document reading unit 102, an image processing unit 103, a printing unit 104, an image storage unit 105, a detection unit 106, an operation display unit 107, and a communication unit 108. Yes.

  In this embodiment, an image forming apparatus will be described as an example of an electronic apparatus having a communication function. However, an electronic apparatus having a communication function includes a printer, a facsimile apparatus, a digital copying machine, and a scanner apparatus having a communication function. Electronic devices with communication functions such as digital multifunction devices, network home appliances, vending machines, medical equipment, power supplies, air conditioning systems, gas / water / electric metering systems, etc. Also good.

  In this embodiment, the smartphone with camera 300 is described as an example of the terminal device. However, the terminal device is a mobile phone that can have a camera function and a network communication function, and a PHS (Personal Handyphone System). PDA (Personal Data Assistance) and handheld personal computers, music players, ebook readers (electronic book terminals), digital cameras, and the like may be used. Here, the image forming apparatus 100 and the smartphone with camera 300 may be managed by an IP address, a unique ID number registered in the SIM card, or the like, and a plurality of each may be connected.

  The control unit 101 has storage areas such as a main CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a HDD (Hard Disk Drive), and the like (not shown), and is written in the ROM in advance. Each input / output device is controlled in accordance with the program, and data input / output during this time is temporarily stored in a predetermined memory area of the RAM.

  An original reading unit 102 reflects light emitted from a light source lamp (not shown) by an original, converts the reflected light from the original into electrical information by a photoelectric conversion element such as a CCD or CIS, and outputs image data as image data. To 103. The image processing unit 103 performs image processing such as density conversion and color conversion to convert the input image data into data suitable for print output, and outputs the image data to the print unit 104.

  The printing unit 104 transfers a toner image onto a recording sheet based on the input image data and performs printout. The image storage unit 105 is a memory that stores the image data processed by the image processing unit 103.

  The detection unit 106 includes various sensors that detect the state of the image forming apparatus 100, and outputs information detected by the sensors to the control unit 101. For example, a paper jam is detected based on the result that there is no paper using paper sensors provided in various places in the paper conveyance path. In addition, the presence or absence of recording paper is detected by a sensor provided in the paper feed cassette. Further, based on the output of the toner density sensor, it is detected whether or not the toner out has been resolved. The detection unit 106 detects whether various consumables have been used after a predetermined period.

  The operation display unit 107 includes input means such as input keys and switches, and display means such as a liquid crystal display panel. The operation display unit 107 displays the status of the apparatus, available paper size, copy magnification, and the like. Can accept operations. The display means may be a liquid crystal touch panel that allows input by touching the liquid crystal screen.

  The communication unit 108 is an interface for connecting to a network such as a LAN (Local Area Network) line through a NIC (Network Interface Card) or the like. The communication unit 108 is connected to an information distribution server (corresponding to an information distribution apparatus) 200 via a network, and has a function for the image forming apparatus 100 and the information distribution server 200 to communicate. The communication unit 108 is connected to the mobile phone 300 through the base station 400 so as to be communicable.

  The communication unit 108 includes a reception unit 108a and a transmission unit 108b. The transmission unit 108 b transmits state information indicating the state of the image forming apparatus 100. The status information may include identification information of the image forming apparatus 100. Further, the state information may include information related to peripheral devices of the image forming apparatus 100. The status information may include information related to paper jam and information related to consumables used in the image forming apparatus 100 (for example, out of toner, paper shortage). The receiving unit 108a can receive operation procedure information and the like transmitted from the information distribution server 200.

  The information distribution server 200 is configured by a normal computer including a CPU (Central Processing Unit) (not shown) and other peripheral devices, and is communicably connected to the image forming apparatus 100 via a network. The information distribution server 200 is connected to the mobile phone 300 via the base station 400 so as to be communicable.

  The information distribution server 200 receives state information indicating the state of the image forming apparatus 100 from the image forming apparatus 100, receives information on the smartphone 300, a request for operation procedure information, and a request for operation part information from the smartphone 300. The operation procedure information and operation part information are transmitted to.

  The smartphone 300 can communicate with the base station 400 via the mobile phone network, and requests the information distribution server 200 for operation procedure information and operation site information of the image forming apparatus 100, or is sent from the information distribution server 200. The received operation part information is received, and based on the received operation part information, a frame is displayed (see FIG. 10) on the target part on the image captured by the camera, or the operation procedure information is received and displayed. To do.

  In the present embodiment, as shown in FIG. 10, for example, square frame displays W1, W2, and W3 are performed as display methods for specifying a part or the like as an error location, but the user looks at the operation display unit of the smartphone 300. As long as it is possible to identify where the operation site is, the display method may take any form, such as displaying a round frame, hatching display or blinking display, or displaying an arrow.

  In addition, the function of performing frame display may be provided in the information distribution server 200 instead of the smartphone 300. The smartphone 300 transfers the captured image to the information distribution server 200, and detects the part and displays the frame-displayed image in the smartphone 300. You may make it forward to.

  Furthermore, the smartphone 300 has a function of photographing a barcode (two-dimensional code, QR code) or the like described on the display unit of the operation display unit 107 of the image forming apparatus 100 and converting it to code information represented by the photographed image. Shall be provided.

  The image processing function for specifying a part and displaying a frame described in the present embodiment is performed by photographing the barcode described on the display unit of the operation display unit 107 of the image forming apparatus 100 with the camera of the smartphone 300. The smartphone 300 can specify the image forming apparatus 100. Since the shape of the image forming apparatus 100, the shape and color of the operation part, and the position of the operation part with respect to the image forming apparatus 100 are known, the image recognition technology has been improved recently. It is possible to display.

  The method for identifying the image forming apparatus 100 is identified by photographing and reading a QR (Quick Response) code displayed on the operation display unit 107 by the smartphone 300 in this embodiment. For example, the user can directly input information (IP address, serial number, presence / absence of peripheral device) that the user can recognize as the specific image forming apparatus 100 using the smartphone 300, or the like. Alternatively, a method may be used in which the image forming apparatus 100 connected to the network is specified by being displayed in a list on the smartphone 300 and allowing the user to select it. For the operation procedure information displayed on the smartphone 300, any method of moving image data (actual shooting, animation), still image data, and voice guidance may be used.

[Modification of overall system configuration]
In FIG. 1, the information distribution server 200 is provided as a separate computer from the image forming apparatus 100 as a normal computer. However, the information distribution server may be built in the image forming apparatus. FIG. 2 shows a system configuration example in which the information distribution server 109 is built in the image forming apparatus 100. The image forming apparatus B 500 has the same internal configuration as the image forming apparatus 100 shown in FIG. 1 that does not include the information distribution server 109, and is connected to the image forming apparatus A 100 and the smartphone 300 via a network.

[Internal configuration of smartphone]
Next, the internal configuration of the smartphone 300 will be described with reference to FIG. The smartphone 300 communicates with the base station 400 shown in FIG. 1 via a mobile phone network, and can be connected to the network via the base station 400. The smartphone 300 has a control unit 301, an input unit 302, an operation display unit (operation panel) 303, a communication unit 304, an operation procedure management unit 305, and a work record holding unit 306, as well as a well-known mobile phone configuration, and not shown. A speaker, a microphone, and the like are provided.

  The control unit 301 can be configured with a CPU, a ROM, and a memory such as a RAM (not shown). The operation display unit (operation panel) 303 includes input means such as input keys and switches, and display means such as a liquid crystal display panel. Identification information of the image forming apparatus 100 is displayed on the operation display unit (operation panel) 303. The smartphone 300 has display means for displaying an input image taken with a camera function.

  The input unit 302 has a camera function and inputs an image by photographing the image forming apparatus 100. The input unit 302 can input identification information of the image forming apparatus 100 by photographing the display screen of the operation display unit 303. For example, the smartphone 300 preferably includes an application of a camera function that can capture an image of the image forming apparatus 100 with a camera, detect a specific operation site, and display a frame on the captured image. When not provided, the information distribution server 200 has a function of receiving an image from the smartphone 300, detecting a specific operation site, displaying a frame, and returning the result to the smartphone 300 via the communication unit 304. In this way, a specific operation site can be displayed in a frame.

  The communication unit 304 includes a reception unit 304a and a transmission unit 304b. The transmission unit 304 b may transmit a distribution request for operation procedure information to the information distribution server 200 in response to an abnormality in the image forming apparatus 100. The receiving unit 304a may receive the operation procedure information transmitted from the information distribution server 200.

  The operation procedure management unit 305 stores operation procedure information for each work type performed by the user in the form of images, moving images, and sounds. The work record holding unit 306 records a display history of operation procedure information displayed by the operation display unit 303 for each type of work performed by the user. The work record holding unit 306 may record a display history of operation procedure information displayed on the operation display unit 107 of the image forming apparatus 100.

  The smartphone 300 captures a barcode (two-dimensional code, QR code) or the like described on the display unit of the operation display unit of the image forming apparatus 100 with the camera of the input unit 302, and displays the code information represented by the captured image. It shall have the function to convert.

  The smartphone 300 can receive the operation procedure information transmitted from the information distribution server 200, and can display the received operation procedure information on the operation display unit 107 of the image forming apparatus 100 or the operation display unit 303 of the smartphone 300. .

[Configuration of smartphone control unit]
Next, the configuration of the control unit 301 in the smartphone 300 will be described with reference to FIG. FIG. 4 shows a software configuration related to the control unit 301 of the smartphone 300. The application software is mainly composed of four layers, stored in the ROM of the control unit 301, expanded in the RAM, and controlled by the CPU. The OS 320 is a platform environment for smartphones and mobile terminals, but is not limited thereto.

  The communication module 321 is a module having communication means such as infrared rays, HTTP, TCP / IP, and wireless LAN, and is a module used at the time of communication in response to a request from an application. The communication module 321 is used when the communication unit 304 in the smartphone 300 is used, and communicates with the information distribution server 200 and the like via the communication unit 304.

  The portable terminal module 322 is a software module group specialized for portable terminals, and is a module not mentioned in the present embodiment.

  The data management module 323 is a module for managing template information customized by the user and template information forcibly set by the administrator.

  The application management module 324 is a module for monitoring user operations by setting information such as restrictions and activation conditions for each application based on information set in the data management module.

  The application group 325 means a collection of applications such as Java (registered trademark) held on smartphones and mobile terminals. The application group 325 is a module that is monitored by the application management module 324 and operates as requested by the application management module 324. The application can be installed from the communication unit 304 and the communication module 321 via the network and on the Internet.

  In this embodiment, the copier management application 328 in the application group 325 is a parent application, the camera application 326 is a child application, the parent application starts the child application, and the camera application 326 is dependent on the copier management application. It is set to work.

  The copier management application 328 is an application that can control the operation procedure display management unit 305 and the work record holding unit 306 in the smartphone 300.

  The camera application 326 is an application that can control the camera function of the input unit 302 in the smartphone 300.

[Information distribution server configuration]
Next, the configuration of the information distribution server will be described with reference to FIG. FIG. 5 is a configuration diagram of the information distribution server 200. The information distribution server 200 includes a communication unit 201, an operation procedure / operation part information storage unit 209, a state information registration unit 203, an operation procedure / operation part determination unit 204, and a control unit 250.

  The communication unit 201 includes a status information receiving unit 202, an operation part information request receiving unit 208, an operation part information transmitting unit 207, an operation procedure information transmitting unit 206, and an operation procedure request receiving unit 205.

  The status information receiving unit 202 in the communication unit 201 receives information such as a jam error or toner out of the image forming apparatus or a plurality of images from the communication unit 108 of the image forming apparatus 100 via the network as illustrated in FIG. Identification information (IP address and product information) that can be recognized as a specific image forming apparatus and information on peripheral devices (ARDF, sorter, folding machine) connected as options to each apparatus are received from the forming apparatus. The status information receiving unit 202 corresponds to a receiving unit that receives status information transmitted from the image forming apparatus 100. The input unit 302 of the smartphone 300 inputs the identification information of the image forming apparatus 100 by photographing the operation display unit 107 of the image forming apparatus 100. The input identification information of the image forming apparatus 100 is the status. The information is sent to the information distribution server 200 via the information receiving unit 202. The identification information and peripheral device information may be included in the state information indicating the state of the image processing apparatus 100 and transmitted / received to / from other devices.

  The status information registration unit 203 registers the information received by the status information receiving unit 202 in the storage area of the information distribution server 200.

  The operation procedure / operation site determination unit 204 determines error information of the image forming apparatus 100 from information in the state information registration unit 203, and should be operated to solve the error and the operation procedure for solving the error. A part (operation part) is determined. The operation procedure / operation part determination unit 204 corresponds to a determination unit that determines the operation part of the image forming apparatus 100 based on the state information of the image forming apparatus 100 received by the state information receiving unit 202. The operation procedure / operation part determination unit 204 may determine an operation part of a specific image forming apparatus 100 from a plurality of image forming apparatuses 100 connected to the network based on identification information of the image forming apparatus 100.

  The control unit 250 causes the operation display unit 303 of the smartphone 300 to display a frame display on the operation site of the image forming apparatus 100 determined by the operation procedure / operation site determination unit 204 in the input image of the smartphone 300. Can do. In this case, first, the unique information of the image forming apparatus 100 is acquired using the imaging function of the smartphone 300 and transmitted to the information distribution server 200 together with the image captured by the smartphone 300. The control unit 250 adds a frame display to the operation part of the image forming apparatus 100 determined for the transmitted image and displays the frame on the display screen of the smartphone 300.

  The image processing related to the frame display can be executed by the control unit 250 instead of the control unit 250 or by the control unit 301 on the smartphone 300 side. In that case, first, the unique information of the image forming apparatus 100 displayed on the image forming apparatus 100 is acquired using the imaging function of the smartphone 300, and transmitted to the information distribution server 200 together with the image captured by the smartphone 300. The information distribution server 200 adds a frame display to the determined operation part of the image forming apparatus 100 in the image and causes the operation display unit 303 of the smartphone 300 to display the frame display.

  At that time, it is detected whether the operation part of the image forming apparatus 100 determined by the operation procedure / operation part determination unit 204 is displayed in the image input by the smartphone 300, and if it is detected, the determination in the image A frame display is attached to the operation site of the image forming apparatus 100 that has been selected.

  As shown in FIG. 2, when the information distribution server 109 is built in the image forming apparatus, first, an input image captured by the smartphone 300 is transmitted to the information distribution server 109. The information distribution server 109 adds a frame display to the determined operation part of the image forming apparatus 100 in the image and causes the operation display unit 303 of the smartphone 300 to display the frame display.

  The information distribution server 200 is connected to the communication unit 304 of the smartphone 300 via a network, receives an operation site information request from the smartphone 300 by the operation site information request reception unit 208, and receives an operation procedure request from the operation procedure request reception unit 205. Receive at.

  When the operation part information request is received by the operation part information request receiving unit 208, the operation procedure / operation part determination unit 204 determines error information of the image forming apparatus 100 from the information of the state information registration unit 203 and resolves the error. From the determination result of the operation procedure, the part to be operated is determined to solve the error. Accordingly, the operation procedure / operation part information storage unit 209 extracts necessary operation part information, and the operation part information transmission unit 207 transmits the extracted operation part information to the smartphone 300.

  When the operation procedure information request receiving unit 205 receives the operation procedure information request, the operation procedure / operation site determination unit 204 determines error information of the image forming apparatus 100 from the information in the state information registration unit 203 and determines the error. Determine the operating procedure to resolve. Thereby, necessary operation procedure information is extracted from the operation procedure / operation part information storage unit 209, and the operation procedure information transmission unit 206 transmits the extracted operation procedure information to the smartphone 300. The operation procedure information transmission unit 206 corresponds to a transmission unit that transmits the operation procedure of the image forming apparatus 100 with respect to the state of the image forming apparatus 100 to the smartphone 300.

[Configuration of Information Distribution Server (Modification)]
Next, another configuration (modification) of the information distribution server will be described with reference to FIG. FIG. 6 is a diagram showing another configuration of the information distribution server 200. In this example, an image processing unit 211 is provided.

  The information distribution server 200 according to the modification includes a communication unit 201, an operation procedure / operation part information storage unit 209, a state information registration unit 203, an operation procedure / operation part determination unit 204, and an image processing unit 211. The communication unit 201 includes a state information receiving unit 202, an operation procedure information request receiving unit 205, an operation procedure information transmitting unit 206, and an image transmitting / receiving unit 210.

  The status information receiving unit 202 in the communication unit 201 receives information such as a jam error or toner out of the image forming apparatus 100 from the communication unit 108 of the image forming apparatus 100 via the network as shown in FIG. Identification information (IP address and product information) recognizable as a specific image forming apparatus and information on peripheral devices (ARDF, sorter, folding machine) connected as options to each apparatus are received from the forming apparatus 100.

  The status information registration unit 203 registers the information received by the status information receiving unit 202 in the storage area of the information distribution server 200.

  The operation procedure / operation part determination unit 204 determines error information of the image forming apparatus from the information in the state information registration unit 203, an operation procedure for solving the error, and a part to be operated to solve the error Determine.

  The information transmission server 200 is connected to the communication unit 304 of the smartphone 300 via a network, receives an image transmitted from the smartphone 300 by the image transmission / reception unit 210, and receives an operation procedure request by the operation procedure request reception unit 205.

  At this time, the data transmitted from the smartphone also includes unique information (such as an IP address and a serial number of the image forming apparatus) that can identify the image forming apparatus acquired by the smartphone.

  When the image transmission / reception unit 210 of the information transmission server 200 receives an image, the image processing unit 211 acquires information about a part to be operated from the operation procedure / operation part determination unit 204, and the image sent from the smartphone 300. Detect the matching part.

  At this time, identification information for specifying the image forming apparatus is sent together with the image data transmitted by the smartphone 300, and from this information, the model name of the image forming apparatus 100 and the presence / absence of optional installation can be known, and the operation differs for each model. Information on the part to be acquired can be acquired. The image processing unit 211 can obtain information on the image forming apparatus that matches the image from the plurality of image forming apparatuses 100 on the network from the operation procedure / operation part determining unit 204, and should be operated using image processing. The part can be detected.

  When the operation procedure information request receiving unit 205 receives the operation procedure information request, the operation procedure / operation part determination unit 204 determines error information of the image forming apparatus from the information in the status information registration unit 209 and resolves the error. The operation procedure to be performed is determined, the necessary operation procedure information is extracted from the operation procedure / operation part information storage unit 209, and the operation procedure information is transmitted from the operation procedure information transmission unit 206 to the smartphone 300.

  Also at this time, a specific information that can be specified for the image forming apparatus 100 is sent together with the operation procedure request receiving unit 205, and from this information, the model name of the image forming apparatus and the presence / absence of optional installation can be known, and the operation procedure differs for each model. The operation procedure information transmitting unit 206 can transmit a model-specific operation procedure photographed by the smartphone 300 from among a plurality of operation procedures of the image forming apparatus on the network.

[Display example when an error occurs]
Next, the function of the operation display unit 107 when an error occurs in the image forming apparatus 100 shown in FIGS. 1 and 2 will be described with reference to FIG. FIG. 7 shows the operation display unit 107 of the image forming apparatus 100 when an error occurs.

  The operation display unit 107 includes a display unit 601 and input units 602 and 603. When a paper jam occurs, the image forming apparatus 100 displays an image as shown in FIG. 7 on the display unit 601 of the operation display 107, for example.

  At this time, the operation display 107 displays the product information display 604 on the display unit 601. The product information display 604 is displayed with a QR code, and describes information for specifying the image forming apparatus 100 such as an IP address of the image forming apparatus 100, a serial number, a model number, and the presence / absence of a peripheral device.

  The user reads this QR code by using a camera function that is an input means of the smartphone 300. Thereby, the smartphone 300 can recognize the image forming apparatus 100 to be photographed as a unique image forming apparatus 100.

  Although the product information display 604 is a QR code here, the IP address, serial number, presence / absence of a peripheral device, etc. may be displayed as long as the image forming apparatus 100 in operation can be identified. In this case, the smartphone 300 may directly input an IP address, a serial number, and the presence / absence of a peripheral device.

  In addition, the image forming apparatus 100 connected to the network is displayed in a list on the smartphone 300 together with the product name, IP address, and serial number, and the IP address and serial number displayed on the operation display unit are displayed. The image forming apparatus 100 may be specified by causing the user to confirm that the values match, or automatically performing a matching process, and automatically selecting or causing the user to select an image forming apparatus with the matching unique information.

  Even when there is no product information display, the image forming apparatus 100 may be specified by displaying a list of the image forming apparatuses 100 connected to the network on the smartphone 300 and allowing the user to select them.

  Further, when the smartphone 300 can identify the image forming apparatus 100 by reading the QR code once, the smartphone 300 stores the unique information of the image forming apparatus 100 that identifies the information, so that an error occurs. A configuration in which the QR code is not required to be read every time may be employed.

  Although not shown in FIG. 7, an indication of the shooting direction and position such as “Please shoot the right side of the image forming apparatus” is first displayed on the display unit 601 of the operation display unit 107 by the camera of the smartphone 300. May be.

[Operation procedure processing]
Next, an operation procedure process in the smartphone according to the embodiment will be described with reference to FIG. FIG. 8 is a flowchart showing operation procedure processing in the smartphone. Here, the operation procedure of the image forming apparatus 100 is displayed using the camera function of the input unit 302 of the smartphone 300. The smartphone 300 can identify the image forming apparatus 100 to be photographed by reading the QR code displayed on the operation display unit 107 of the image forming apparatus 100 in advance.

  First, when imaging of the image forming apparatus 100 is started with the camera of the input unit 302 of the smartphone 300 in S100 of FIG. 8, the smartphone 300 transmits an operation part information request to the information distribution server 200 (S101). At this time, the smartphone 300 has previously read from the QR code or the like, identification information (IP address, serial number, presence / absence information of peripheral devices, etc.) that can identify the image forming apparatus as unique information of the image forming apparatus 100 that is taking a picture. Are sending together.

  When receiving the operation part information request (S102), the information distribution server 200 determines the operation part information from the unique information of the image forming apparatus 100 and the state information of the image forming apparatus 100 (S103). When the determination of the operation part information ends, the information distribution server 200 transmits the operation part information to the smartphone 300 (S104).

  When the smartphone 300 acquires the operation part information (S105), the smartphone 300 searches the image of the image forming apparatus 100 photographed by the camera for a match with the operation part information. When the smartphone 300 detects a matching part from the operation part information and the image of the image forming apparatus 100 captured by the camera (S106), the smartphone 300 displays the operation part of the image forming apparatus 100 displayed on the operation display unit 303 of the smartphone 300. A frame display is performed (S107).

  As a result, even if there are a plurality of image forming apparatuses 100 on the network, the user can surely know the part to be operated that is suitable for the specified state of the image forming apparatus 100.

  In the smartphone 300, when a user selects a specific operation part by touching an image of the operation part displayed in a frame with the input unit in the operation display unit 303 of the smartphone 300 (S <b> 108), an operation procedure distribution request is issued. The information is transmitted from the smartphone 300 to the information distribution server 200 (S109).

  When receiving the operation procedure distribution request from the smartphone 300 (S110), the information distribution server 200 determines the operation procedure from the unique information of the image forming apparatus 100, the state information of the image forming apparatus 100, and the operation part information (S111). When the determination of the operation procedure ends, the information distribution server 200 transmits desired operation procedure information to the smartphone 300 (S112).

  The smartphone 300 acquires operation procedure information from the information distribution server 200 (S113), and displays the acquired operation procedure information on the operation display unit 303 of the smartphone 300 (S114). The smartphone 300 can also display the acquired operation procedure information on the operation display unit 107 of the image forming apparatus 100.

  Thereby, the user can perform an operation for canceling the error while viewing the operation procedure information. If the user wants to acquire more detailed operation procedure information, the user can further request operation procedure information (S115).

  In addition, in the part selection in S108, when the user does not select a part displayed in a frame within a predetermined period, the smartphone 300 continues photographing, continues to acquire operation part information, and displays a state in which the frame is displayed. maintain. For example, when the user operates the part (opens the cover or the like) without looking at the operation procedure of the part displayed in the frame, the image forming apparatus 100 causes the information distribution server 200 to update the state information (the cover is empty). Information) is transmitted, so that the information distribution server 200 also changes the determination result of the operation part due to the change of the state information. In this case, the smartphone 300 acquires new operation part information and displays a frame of the new operation part, that is, the part of the next procedure (see FIG. 10).

  With this method, the user can check the parts to be operated for canceling errors in the image forming apparatus 100 for each operation procedure, one by one, in response to errors such as paper jams or out of toner. You can operate while watching the procedure.

  Moreover, the display which does not need to see the operation procedure can be skipped by not selecting in S108. When one operation is completed, the frame display moves to the next part, so there is no need for the user to operate and skip the operation procedure, and the operation procedure display that the user does not need to see can be skipped without being aware of it. it can.

  As described above, according to the embodiment, as an example of desired designation display on the operation part of the image forming apparatus 100 determined by the operation procedure / operation part determination unit 204 in the image input by the smartphone 300 on the smartphone 300 side. Can be displayed on the display means.

[Modification of operation procedure processing]
Next, a modified example of the operation procedure process in the smartphone according to the embodiment will be described with reference to FIG. FIG. 9 is a flowchart illustrating a modified example of the operation procedure display process according to an embodiment. In FIG. 9, the operation procedure of the image forming apparatus 100 is displayed using the camera function of the input unit 302 of the smartphone 300.

  The difference from the operation procedure process shown in FIG. 8 is that the operation part is detected on the information distribution server side in this modification.

  As described above, the smartphone 300 can identify the image forming apparatus 100 to be photographed by reading the QR code displayed on the operation display unit 107 of the image forming apparatus 100 in advance.

  In S200 of FIG. 9, when imaging of the image forming apparatus 100 is started by the camera of the input unit 302 of the smartphone 300, the smartphone 300 transfers the image to the information distribution server 200 (S201).

  At this time, the smartphone 300 transmits together with the unique information (IP address, serial number, presence / absence information of peripheral devices, etc.) of the image forming apparatus that has been read, read in advance from a QR code or the like.

  The information distribution server 200 receives an image from the smartphone 300 (S202), and determines and acquires operation site information from the received unique information of the image forming apparatus 100 and the state information of the image forming apparatus 100 (S203). Then, the operation part information is detected by comparing the image of the image forming apparatus 100 with the operation part information (S204). When the operation part is detected, the information distribution server 200 displays a frame on the operation part (S205), and transfers the frame-displayed image to the smartphone 300 (S206).

  The smartphone 300 receives and displays an image in which the operation part is displayed as a frame from the information distribution server 200 (S207). As a result, even if there are a plurality of image forming apparatuses 100 on the network, the user can surely know the part to be operated that is suitable for the specified state of the image forming apparatus 100.

  When the user selects a specific operation part by touching an image of the operation part displayed in a frame with the input means in the operation display unit 303 of the smartphone 300 (S208), the smartphone 300 receives a distribution request for the operation procedure. It transmits to the distribution server 200 (S209).

  When receiving the operation procedure distribution request from the smartphone 300 (S210), the information distribution server 200 determines the operation procedure from the unique information of the image forming apparatus 100, the state information of the image forming apparatus 100, and the operation part information (S211). When the determination of the operation procedure ends, the information distribution server 200 transmits the operation procedure information to the smartphone 300 (S212).

  The smartphone 300 acquires operation procedure information from the information distribution server 200 (S213), and displays the acquired operation procedure information on the operation display unit 303 of the smartphone 300 (S214). The user can perform an operation while viewing the operation procedure information. If the user wants to obtain more detailed operation procedure information, the user can further request operation procedure information (S215).

  Further, in the part selection in S208, when the user does not select the part displayed in the frame within the predetermined period, the imaging is continued, the operation part information is continuously acquired, and the state where the frame is displayed is maintained. For example, when the user operates the operation part (opens the cover, etc.) without looking at the operation procedure of the operation part displayed in the frame, the image forming apparatus displays new status information (information that the cover is empty) on the information distribution server. ) Is transmitted, the information distribution server 200 also changes the determination result of the operation part due to the change of the state information, and the smartphone 300 acquires new operation part information, so the new operation part, that is, the part of the next procedure Is displayed (see FIG. 10).

  With this method, the user can check the parts to be operated for canceling errors in the image forming apparatus 100 for each operation procedure, one by one, in response to errors such as paper jams or out of toner. Recovery operation can be performed while watching the procedure.

  In addition, it is possible to skip the display of items that do not need to see the operation procedure, and when one operation is completed, the frame display moves to the next part. It is not necessary, and the operation procedure display that the user does not need to see without being aware of it can be skipped. Note that the frame display of the part indicates that the part is a selection target for guidance display of the operation procedure.

[Example of frame display during shooting]
The configuration and operation of each device according to an embodiment have been described above with reference to FIGS. FIG. 10 is a diagram in which a part to be operated when the image forming apparatus 100 is photographed with the smartphone 300 is displayed in a frame. The smartphone 300 is connected to the information distribution server 200 and the image forming apparatus 100 via a network, and by photographing the image forming apparatus 100, an operation site corresponding to the state (state information) of the image forming apparatus 100 is illustrated. A frame can be displayed on the display screen as shown in FIG.

  In FIG. 10, an example of the frame display is described. However, when a desired designation display is attached to the operation part of the image forming apparatus 100 and displayed on the display unit, the target part can be seen by looking at the operation display unit 303 of the smartphone 300. As long as this is the case, any display method may be used regardless of the display method, such as displaying a round frame, hatching display or blinking display, or displaying an arrow. For example, assuming that the imaging diagram 310 shown on the left is the operation procedure 1 and the imaging diagram 311 shown on the right is the operation procedure 2, when the user images the front at the start of imaging, the operation site is imaged. There is no frame display. In that case, the user can shoot until the frame display W1 appears on the operation display unit 303 of the smartphone 300 by shooting the image forming apparatus 100 in different directions, such as from the top or from the left or right, until the frame display is displayed. The site to be operated in the operation procedure 1 can be found. Then, when the user touches the area displayed in the frame with a finger or a touch pen, the smartphone 300 can acquire the operation procedure from the information distribution server 200 and display it.

  Further, for example, when the radiograph 310 is the procedure 1 and the radiograph 311 is the procedure 2, if the operation is continued without selecting the portion indicated by the frame W1 in the radiograph 310, the video is the radiograph 311. Then, the parts of the procedure 2 are displayed as frames W2 and W3. Thereby, the user can skip the display of the operation procedure 1 without being conscious. Further, even if the operation procedure of the image forming apparatus 100 proceeds, the operation parts W2 and W3 suitable for the state of the image forming apparatus 100 can be displayed in a frame.

  The operation procedure / operation part determination unit 204 repeatedly determines the operation part of the image forming apparatus 100, and the control unit 250 determines the image forming apparatus 100 in the image according to the determination result by the operation procedure / operation part determination unit 204. Reattach the frame display to the operation part. As a result, the operation site with the frame display can be changed according to the change in the state of the image forming apparatus 100.

  As a result, even if the state of the image forming apparatus 100 changes due to the cancellation of the abnormality by the user, it is possible to appropriately display the operation sites that are candidates for guidance.

  Further, by including information on paper jam and information on consumables used in the image forming apparatus 100 in the status information of the image forming apparatus 100, an appropriate operation part of the image forming apparatus 100 is specified, and the operation part is identified. Display a frame. Thus, the user can easily resolve the abnormality in a short time by selecting one of the frame displays and acquiring the operation procedure of the operation part displayed in the frame from the information distribution server 200.

[Hierarchical structure of operation procedure data]
Next, a hierarchical structure of data indicating an operation procedure will be described with reference to FIG. FIG. 11 is a data structure diagram of operation procedure information stored in the operation procedure / operation part storage unit 205 included in the information distribution server 200 and the operation procedure management unit 305 included in the smartphone 300.

  The operation procedure information 701 includes a plurality of work operation procedures 702. The work operation procedure 702 is information for displaying the operation procedure, and is data such as an image, a moving image, and sound. The operation procedure information 701 is classified into a plurality of hierarchies, and a lower level work operation procedure 702 is displayed each time the progress of work performed by the user proceeds.

  In addition, work operation procedures connected by arrows represent operation procedure information that is related to each other. When the work displayed by the operation procedure of the hierarchy 1 progresses, the operation procedure and the relevance are next displayed. It is possible to display the operation procedure of level 2 with When there is a relationship with a plurality of operation procedure information in the lower layer, which work operation procedure 702 is displayed next differs depending on the type of work. The configuration of the operation procedure in each operation will be described with reference to FIG.

  The work operation procedure information becomes more detailed guidance information in units of parts as the level advances. In the example of FIG. 11, the description is for layers 1 to 4, but the number of layers is not limited to four.

  The function of the operation procedure management unit 305 included in the smartphone 300 may be provided in the image forming apparatus 100 and the operation procedure information 701 may be stored in the image forming apparatus 100. Therefore, the work operation procedure information can be stored by at least one of the image forming apparatus 100, the smartphone 300, and the information distribution server 200. The storage area to be stored may be an internal storage area of at least one of the image forming apparatus 100, the smartphone 300, and the information distribution server 200, or may be a storage area of another device connected via a network. Good.

[Internal data structure of operation procedure]
Next, the internal data structure of the work operation procedure will be described with reference to FIG. The work operation procedure 702 includes an outline operation procedure 703 and one or more detailed operation procedures 704. The outline operation procedure 703 is operation procedure information for representing an outline of the operation procedure. The outline operation procedure 703 is a simpler operation procedure than the detailed operation procedure 704, and mainly represents rough information of the procedure. The outline operation procedure 703 is information preferable for displaying a user who is used to work as a target.

  The detailed operation procedure 704 is operation procedure information for representing details of the operation procedure. The detailed operation procedure 704 is information for explaining the operation procedure with respect to the same work content as the overview operation procedure 703. However, the detailed operation procedure 704 mainly represents detailed information of the procedure, and is displayed for a user who is not familiar with the operation. This is preferable information. Three detailed operation procedures 704 are provided here, but the number is not limited to this, and a plurality of detailed operation procedures 704 may be provided to explain the details of the procedure described in the work operation procedure 702.

[Data structure of operation procedure for each work type]
Next, the data structure of the operation procedure for each work type will be described with reference to FIG.
FIG. 13 is a diagram illustrating a data structure in which operation procedures are hierarchized for each work type.

  The work type 801 is classified for each type of abnormality such as an identifier for each work content, for example, an error code. FIG. 13 shows the arrangement of work operation procedures 702 displayed at each level for each work type, and each work operation procedure 702 can be used to display operation procedures for a plurality of work types.

  When receiving the operation procedure distribution request, the operation procedure / operation part determination unit 204 of the information distribution server 200 refers to the work type and hierarchy, and transmits the target work operation procedure 702 as operation procedure information to be transmitted. .

  The number of hierarchies and hierarchy transition conditions differ depending on the work type. As the work type, the state of the image forming apparatus 100 transmitted from the image forming apparatus 100 is received by the communication unit 202 of the information distribution server 200, and the operation procedure / operation part determination unit 204 that has received the condition satisfies the transition condition. If it is determined, the process moves to another hierarchy. An example of the transition condition is shown in FIG.

  That is, the hierarchy indicates the degree of work progress of the user, and has a structure in which operation procedure information to be displayed is switched according to the work progress. Further, the user can arbitrarily display an operation procedure of another hierarchy.

[Example of hierarchy transition conditions for each work type]
FIG. 14 is a diagram showing the hierarchy transition condition for each work type. For each work type, information detected by the detection unit 106 of the image forming apparatus 100 when the user's work progresses is set in advance in the operation procedure / operation part determination unit 204 of the information distribution server 200. The operation procedure / operation part determination unit 204 of the information distribution server 200 shifts the hierarchy of the operation procedure to another hierarchy according to the conditions shown in FIG.

[Example of management status of operation procedure]
FIG. 15 shows an example of a work operation procedure held by the operation procedure / operation part recording unit 205 of the information distribution server 200 and the operation procedure management unit 305 of the smartphone 300.

  A table 705 is a work operation procedure for each work type held by the operation procedure / operation part recording unit 205. “Outline” in the table 705 is an abbreviation for the outline operation procedure 703, and “Detail” is an abbreviation for the detailed operation procedure 704.

  “Hold” in the table 705 indicates that the corresponding operation procedure is held, and “-” (hyphen) indicates that it is not held. The operation procedure / operation part recording unit 205 holds an outline operation procedure 703 and a detailed operation procedure 704 in all work types and levels.

  On the other hand, a table 706 is a work operation procedure for each work type held by the operation procedure management unit 305. The symbols in Table 706 are the same as in Table 705. The operation procedure management unit 305 holds only some work operation procedures. Further, for each work type, there are two types of holding states: a holding state in which no work operation procedure is held, a general operation procedure 703 for all layers, and a detailed operation procedure 704 for some or all layers. It becomes.

  As described above, the work operation procedure information is information such as an image, a moving image, and sound, and the capacity of the recording medium is required to hold all information of all work types. FIG. 15 shows an example of a work operation procedure held by the operation procedure management unit 305 of the smartphone 300 by a holding method in consideration of the recording capacity of the mobile terminal.

  Whether the work operation procedure is held or not is determined by the work record holding unit 305, details of which will be described later. In FIG. 15, the operation procedure management unit 305 of the smartphone 300 is described. However, instead of the smartphone 300 or together with the smartphone 300, the operation procedure management unit may be provided in the image forming apparatus 100.

[Smartphone operation]
Next, the operation centering on the smartphone 300 will be described with reference to FIG. 16 showing the operation procedure request process according to the embodiment. FIG. 16 is a flowchart showing details of the operation from the operation procedure request to the end shown in S109 of FIG. 8 and from the operation procedure request to the end shown in S209 of FIG.

  When this flow is used, the user can first see the display of the outline operation procedure 703 during the first work, and if necessary, obtain the detailed operation procedure 704 from the information distribution server 200 and see the detailed operation procedure 704. Can do.

  When the user performs the second and subsequent operations, if the display frequency of the detailed operation procedure 704 is high in the previous operation procedure display, the operation procedure management unit 305 of the smartphone 300 is not acquired from the information distribution server 200. The detailed operation procedure 704 held in is automatically displayed.

  Further, when the display frequency of the detailed operation procedure 704 is low at the time of displaying the operation procedure up to the previous time, the outline operation procedure 703 is displayed. If necessary, the detailed operation procedure 704 is acquired from the information distribution server 200. Thus, the detailed operation procedure can be displayed. Further, the user can select to discard the detailed operation procedure 704 so that the detailed operation procedure 704 is not displayed at the same time of the next work. The above can be performed for each level of the operation procedure information 701.

  The display of these operation procedures can be arbitrarily terminated by the user. The management of the display frequency of the detailed operation procedure will be described later. The detailed operation of this flow will be described below.

  When the operation procedure request S109 of FIG. 8 is started (S300), the smartphone 300 determines the work type and operation procedure information to be displayed. In step S105 in FIG. 8 and step S207 in FIG. 9, the smartphone 300 acquires work type information from the information distribution server 200. In addition, the smartphone 300 acquires information that can determine the hierarchy of the operation procedure information in steps S109 and S207 (S301).

  Next, the smartphone 300 adds up the total display count of the operation procedure for each work type managed by the work record holding unit 306 (S302). This number is used in the work record management in S323. It is determined whether or not the outline operation procedure 703 in the determined work type is held in the operation procedure management unit 305 of the smartphone 300 (S303). If not, the outline operation procedure 703 is transmitted to the outline operation procedure 703. A request is made to the distribution server 200 (S304), an outline operation procedure 703 is acquired, and held in the operation procedure management unit 305 (S309). According to this flow, the summary operation procedure 703 is requested and acquired only when the first operation procedure display (of the user who operates the smartphone 300) of the smartphone 300 is displayed.

The information distribution server 200 receives the distribution request of the outline operation procedure 703 (S305), reads out the corresponding operation procedure information held in the operation procedure / operation part storage unit 205 (S306), and stores the corresponding operation procedure information in the smartphone 300. Send to. (S307)
When the outline operation procedure 703 is held (YES in S303), this means that the operation procedure of the same work was previously displayed. At this time, the work record holding unit 306 of the smartphone 300 checks whether the display frequency of the detailed operation procedure 704 is low, that is, whether the user has completed the operation without displaying the detailed operation procedure (S308). ). The display frequency of the detailed operation procedure 704 is managed by the work record holding unit 306 and is sequentially updated by work record management (S323).

  When the display frequency of the detailed operation procedure is low, or when the outline operation procedure 703 is acquired (in the case of the first operation procedure display), the overview operation procedure is displayed on the operation display unit 303 (S310), and the operation procedure display is displayed by the user. It is confirmed whether or not there is a re-request (S322). The presence / absence of the re-request is confirmed by, for example, whether or not the user has selected a message for prompting the end of the guidance display, or whether or not the button has been pressed.

  If it is selected not to make a re-request, the smartphone 300 performs work record management (S323) and ends the operation procedure display. Details of work record management will be described later.

  When it is not selected that the re-request is not performed, the control unit 301 of the smartphone 300 determines whether or not the detailed operation procedure 704 has been displayed (S311). (S322) A loop state is entered.

  If not displayed, the control unit 301 confirms whether or not acquisition of a detailed operation procedure has been selected (S312). If not selected, the control unit 301 confirms whether or not a re-request is present (S322), and enters a loop state. The presence / absence of selection of acquisition of the detailed operation procedure is confirmed, for example, by whether or not a message for determining whether or not to acquire detailed operation information is selected by the user or a button is pressed.

  When acquisition of the detailed operation procedure is selected, the smartphone 300 requests the information distribution server 200 for the detailed operation procedure 704 (S313), acquires the detailed operation procedure 703, and holds it in the operation procedure management unit 305 (S317). ).

  The information distribution server 200 receives the request for the detailed operation procedure 704 (S314), reads out the corresponding operation procedure information held in the operation procedure / operation part storage unit 205 (S315), and transmits it to the smartphone 300 ( S316).

  When the update frequency of the detailed procedure is high, or when the detailed operation procedure is acquired, the detailed operation procedure 704 held in the operation procedure management unit 305 of the smartphone 300 is displayed by the operation display unit 303 (S318). It is confirmed whether or not discarding has been selected by the user (S319). Whether or not to discard the detailed operation procedure is checked, for example, by whether or not a message for determining whether or not to discard the detailed operation information is selected by the user or a button is pressed.

  When discarding the detailed operation procedure is not selected, the display count of the detailed operation procedure is added by one (S320), and whether or not there is a re-request is confirmed (S322). When the discard of the detailed operation procedure is selected, the number of display of the detailed operation procedure is set to 0 (S321), and the presence / absence of a re-request is confirmed (S322). The display count of the detailed operation procedure is used for managing the display frequency of the detailed operation procedure, and is used in the work record management (S323).

  As described above, the operation procedure display is repeatedly performed a plurality of times, so that only the necessary operation procedure according to the user's work level is displayed.

  Further, the transmission unit of the information distribution server 200 transmits operation procedure information that is not stored in the storage area of the smartphone 300 or the image forming apparatus 100 as at least a part of the operation procedure information for canceling the abnormality. Can do.

  In the present flow, the embodiment using the smartphone 300 has been described, but this includes replacing the smartphone 300 with the image forming apparatus 100 by providing the image forming apparatus 100 with the operation procedure management unit 305, or a work record holding unit of the smartphone 300. Obviously, it can also be arranged with 306.

[Work Record Management]
Next, management of work records executed by the work record holding unit 306 of the smartphone 300 will be described with reference to FIG. FIG. 17 shows a flow of work record management.

  The work record holding unit 306 starts the work record management process at the end of the display of the operation procedure information (S400), confirms and sets the display frequency of the detailed operation procedure 704, and the details recorded in the operation procedure management unit 305. The operation procedure 704 is deleted.

  The work record holding unit 306 determines the work type of the current operation procedure display and the hierarchy of the displayed work operation procedure 702 (S401), and acquires the display count of the detailed operation procedure 704 stored in the work record holding unit 306. Similarly, the total display count of the work type stored in the work record holding unit 306 is referred to (S402), and it is determined whether the display frequency of the detailed operation procedure 704 is 80% or more (S403).

  When the display frequency is 80% or more, the work record holding unit 306 sets the display frequency of the detailed operation procedure of the current hierarchy in the current work to be high (S406), and ends the work record management. On the other hand, when the display frequency is less than 80%, the work record holding unit 306 deletes the detailed operation procedure of the current hierarchy in the current work from the work record holding unit 306 (S404), and the display frequency of the detailed operation procedure is low. The setting is made (S405), and the work record management is terminated.

  In this flow, the threshold value for setting the display frequency is set to 80%, but this is merely an example, and can be made variable depending on the user or service. Moreover, it can be made variable according to the memory capacity value of the smartphone 300. Moreover, although this embodiment demonstrated embodiment using the smart phone 300, this is replaced with the image forming apparatus 100 by providing the image forming apparatus 100 with a work record holding unit, or arranged together with the work record holding unit 306 of the smartphone 300. Obviously, it is also possible.

  From the above, as shown in FIG. 14, it is possible to manage the retention and non-retention of operation procedure information for each work type hierarchy, and to retain only the minimum necessary information in the operation procedure management unit 305. Become.

[Example of work record]
FIG. 18 is a diagram illustrating an example of a work record result recorded in the work record holding unit 306 of the smartphone 300. The result of the work record is recorded for each work type. The total number of displays in the table represents the total number of displays for each work type, the number represents the number of displays of the detailed operation procedure 704 in each layer, and the frequency represents the level of display frequency of the detailed operation procedure 704. In the work type “0000”, the total number of times of display is 10, the number of times of display at levels 1, 2, 3, 4 is 10, 8, 0, 2, and the frequency of display at levels 1, 2, 3, 4 is high. , High, low, low.

  As described above, according to the present embodiment, for each user and each error type, the user side acquires the operation procedure of the part to be operated from the information distribution server 200 until the error is canceled from the time of the work occurrence. Or a record of whether or not it has been acquired is stored in the smartphone 300 as a “display count”. These work records may be held in a desired storage area not only by the smartphone 300 but also by the image forming apparatus 100 and the information distribution server 200. Here, the desired storage area is not limited to the internal storage area provided in each of the smartphone 300, the image forming apparatus 100, and the information distribution server 200, but an external apparatus connected to these apparatuses via a network. It may be a storage area.

  The operation procedure with a high reference frequency of the user is displayed in detail on the operation display unit of the smartphone 300 or the image forming apparatus 100, and the operation procedure with a low reference frequency is displayed in detail unless the user side obtains it from the information distribution server 200. The operation procedure is displayed so that only the summary is displayed without displaying on the means.

[Example of operation procedure display on smartphone]
FIG. 19 is a conceptual diagram when an operation procedure is displayed on the smartphone 300. An operation procedure 800 illustrated on the left side is a conceptual diagram when the outline operation procedure 703 is displayed, and a rough work procedure is displayed on the operation display unit 303. Further, when the user touches a portion described as the end of the operation procedure display as indicated by the display portion 801, the display can be terminated and a request for the next procedure display portion can be requested. When the display location 801 detects that the user has touched the portion of the display location 801 upon confirming the presence / absence of the re-request of the flow shown in FIG. 16 (S322), it can be determined that there is no re-request. .

  A display location 802 is a display for selecting whether or not the detailed operation procedure 704 is acquired. When the user touches the display location 802, the detailed operation procedure can be displayed on the operation display unit 303.

  The display location 802 corresponds to whether or not the detailed operation procedure of the flow illustrated in FIG. 16 is selected (S312). When the user touches the display location 802, the detailed operation procedure 704 is acquired from the information distribution server 200.

  An operation procedure 803 illustrated on the right side is a conceptual diagram when the detailed operation procedure 704 is displayed, and a more detailed work procedure is displayed on the operation display unit 303. When there are a plurality of detailed operation procedures 704 in the work operation procedure, another detailed operation procedure can be referred to by touching a location as shown in the display location 804 by the user. Further, when the user touches the display location 805, it can be selected that the next detailed operation display is not performed. This corresponds to the presence / absence of detailed operation procedure discarding (S319) in FIG. Note that the operation procedures shown in the left and right diagrams of FIG. 19 may be displayed on the operation display unit 107 of the image forming apparatus 100.

[Operation procedure update process]
Next, the operation procedure update process will be described with reference to FIG. FIG. 20 is a flow describing the processing when the detailed operation procedure 704 is updated on the information distribution server 200.

  If the smartphone 300 has already acquired the detailed operation procedure 704, information such as the previous acquisition date and time is received from the smartphone 300. If the information has been updated since the acquisition of the detailed operation procedure 704, the information is replaced. To the smartphone 300. In FIG. 20, the following procedure is added to the flow shown in FIG.

  When it is determined that the update frequency of the detailed operation procedure is high (S308), the smartphone 300 transmits the date and time information obtained for the detailed operation procedure 704 in the current hierarchy of the current work to the information distribution server 200 (S324).

  The information distribution server 200 receives the acquisition date / time information of the detailed operation procedure (S325), and determines whether or not the detailed operation procedure is the latest (S326). The determination can also be made based on whether or not the acquisition date and time information is before the update date and time of the detailed operation procedure in the server.

  If it is the latest, the smartphone 300 performs processing according to the display of the detailed operation procedure (S318) and the subsequent processing flow. If the information distribution server 200 is not up-to-date, it is assumed that a normal detailed operation procedure request has been received (S314), the operation procedure determination (S315), and the operation procedure transmission (S316) are performed. The transmitted detailed operation procedure is acquired (S317), and the detailed operation procedure 704 is updated to the latest information.

  As described above, the detailed operation procedure information can be kept up-to-date.

[effect]
As described above, according to the display system 1 according to the above-described embodiment, the state information of the image forming apparatus 100 is acquired using the imaging function of the smartphone 300, and the information distribution server 200 includes the image captured by the smartphone 300. Send. The information distribution server 200 determines a specific operation part of the image forming apparatus 100 with respect to the transmitted image. The information distribution server 200 or the smartphone 300 adds a frame display to the determined specific operation part and displays the frame on the display screen of the smartphone 300.

  According to this, since the unique information is acquired from the display screen of the image forming apparatus 100 using the imaging function of the smartphone 300, the image forming apparatus 100 can be easily identified. There is no need to attach QR codes to parts.

  Further, according to the display system 1 according to the above-described embodiment, a specific image forming apparatus 100 can be specified from among a plurality of image forming apparatuses 100 connected to the network based on identification information (unique information) of the image forming apparatus 100. For this reason, it is possible to determine an operation part suitable for the situation of the specified image forming apparatus 100 and attach a frame display to the operation part.

  Further, according to the display system 1 according to the embodiment, it is detected whether the operation part of the image forming apparatus 100 determined by the operation procedure / operation part determination unit 204 is displayed in the input image. If so, the image processing for displaying the operation site of the image forming apparatus 100 in the image in a frame is repeated. As a result, with the change over time of the resolution of the problem of the image forming apparatus 100, it is possible to display a frame in accordance with the situation at that time for the operation part of the image forming apparatus 100 displayed on the display screen of the smartphone 300.

  Further, the operation procedure information transmission unit 206 transmits the operation procedure of the image forming apparatus 100 with respect to the state of the image forming apparatus 100 to the smartphone 300 when a frame display in the input image is selected by the user or automatically. . When any one of the frame displays displayed in the input image is selected, the control unit 301 of the smartphone 300 displays the operation procedure of the operation part with the selected frame display on the operation display unit 303 of the smartphone 300. To display. Thus, for example, when an abnormality such as a paper set or a printing jam occurs in the image forming apparatus 100, a desired operation procedure can be displayed on the display screen, and the user can easily cancel the abnormality.

  Note that the status information of the image forming apparatus 100 may include information related to peripheral devices of the image forming apparatus 100. In this case, the operation procedure / operation part determination unit 204 can determine the operation part of the image forming apparatus 100 based on the status information of the image forming apparatus 100 and information on peripheral devices of the image forming apparatus 100. According to this, since the operation part is determined in consideration of the information on the peripheral device, the operation part that matches the state of the image forming apparatus 100 including the peripheral device is appropriately identified, and the operation part is determined. A frame display can be attached.

  The preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, but the technical scope of the present invention is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field of the present invention can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it belongs to the technical scope of the present invention.

  For example, instead of the image forming apparatus 100, the smartphone 300 may transmit the status information of the image forming apparatus 100 to the information distribution server 200.

  In the above embodiment, the operation part of the image forming apparatus 100 is specified on the information distribution server 200 side, and the image processing related to the frame display of the specific operation part in the photographed image is performed on the information distribution server 200 (S204 in FIG. 9). To S206) or the smartphone 300 (S106 to S108 in FIG. 8). However, the image processing related to the frame display may be processed at any time by either or both of the information distribution server 200 and the smartphone 300. As a result, the processing speed can be increased. The frame display image processing can also be performed by the image forming apparatus.

  Moreover, each part which implement | achieves each function of the electronic device which concerns on this invention, a terminal device, and an information delivery apparatus may be implement | achieved by the software which consists of a program group which performs each function. Each unit that realizes each function of the electronic device, the terminal device, and the information distribution device according to the present invention may be realized by hardware as a semiconductor device such as an LSI (Large Scale Integration) chip including the above functional blocks, It may be realized using both software and hardware.

  Such a program for executing each function of each device may be stored in a storage means such as a ROM or HDD provided in the computer from the beginning, or a CD-ROM or flexible disk as a recording medium, A program recorded in a nonvolatile recording medium (memory) such as SRAM, EEPROM, or memory card and recorded in the memory is installed in the computer and executed by the CPU, or the program is read from the memory and executed by the CPU. As a result, the above-described procedures may be executed. Furthermore, it is also possible to download the program from an external device that is connected to the network and has a recording medium that records the program, or from an external device that stores the program in the storage means, and execute the above-described procedures.

DESCRIPTION OF SYMBOLS 1 Display system 100 Image forming apparatus 101 Control part 106 Detection part 107 Operation display part 108 Communication part 108a Reception part 108b Transmission part 109,200 Information delivery server 201 Communication part 202 Status information reception part 203 Status information registration part 204 Operation procedure / operation Part determination unit 211 Image processing unit 250 Control unit 300 Smartphone 301 Control unit 302 Input unit 303 Operation display unit 304 Communication unit 304a Reception unit 304b Transmission unit 305 Operation procedure management unit 306 Work record holding unit 702 Work operation procedure 703 Outline operation procedure 704 Detailed operation procedure 801 Work type

Japanese Patent No. 4362578

Claims (12)

A display system in which an electronic device, a terminal device, and an information distribution device are connected via a network,
The electronic device is
A transmission unit that transmits state information indicating the state of the electronic device;
The information distribution apparatus includes:
A receiving unit for receiving state information transmitted from the electronic device;
A determination unit for determining an operation part of the electronic device based on the state information of the electronic device received by the reception unit;
With
The terminal device
An input unit for inputting an image by photographing the electronic device;
An operation display unit on the terminal device side for displaying the input image,
At least one of the information distribution device and the terminal device is:
A control unit is provided that adds a desired designation display to the operation part of the electronic device determined by the determination unit in the input image and displays the operation display unit on the terminal device side. Display system. The electronic device includes an operation display unit on the electronic device side that displays identification information of the electronic device,
The input unit of the terminal device inputs identification information of the electronic device by photographing the operation display unit on the electronic device side,
The receiving unit of the information distribution device receives the input identification information of the electronic device,
The determination unit of the information distribution device determines an operation part of the electronic device based on the status information of the electronic device and the identification information of the electronic device received by the receiving unit. Display system described. A display system in which an electronic device and a terminal device are connected via a network,
The electronic device is
A determination unit for determining an operation part of the electronic device based on state information indicating a state of the electronic device;
The terminal device
An input unit for inputting an image by photographing the electronic device;
An operation display unit on the terminal device side for displaying the input image,
At least one of the electronic device and the terminal device is:
A control unit is provided that adds a desired designation display to the operation part of the electronic device determined by the determination unit in the input image and displays the operation display unit on the terminal device side. Display system. A plurality of the electronic devices are connected to the terminal device;
The status information of each electronic device includes identification information of each electronic device,
The said determination part determines an operation site | part with respect to a specific electronic device among these several electronic devices based on the status information of the said electronic device, and the identification information of the said electronic device. The display system according to any one of the above. The state information of the electronic device includes information related to peripheral devices of the electronic device,
The said determination part determines the operation site | part of the said electronic device based on the status information of the said electronic device, and the information regarding the peripheral device of the said electronic device, It is characterized by the above-mentioned. Display system. The determination unit repeatedly determines an operation part of the electronic device according to a change in the state of the electronic device,
The control unit of at least one of the information distribution device and the terminal device changes the designation display displayed on the operation display unit on the terminal device side according to the determination result. Display system described. The information distribution apparatus includes:
A transmission unit for transmitting an operation procedure of the electronic device to the state of the electronic device to the terminal device;
The control unit of the terminal device
When any of the designation displays displayed on the operation display unit on the terminal device side is selected, the operation procedure of the operation part to which the selected designation display is attached is displayed on the operation display unit on the terminal device side. The display system according to any one of claims 1 to 6. The transmission unit of the information distribution device includes:
8. The display system according to claim 7, wherein, when any one of the designation displays is selected, an operation procedure of the electronic device with respect to a state of the electronic device is transmitted to the terminal device. The control unit of at least one of the information distribution device and the terminal device,
It is detected whether the operation part of the electronic device determined by the determination unit is displayed in the input image, and when it is detected, the designated display is attached to the operation part of the electronic device in the image The display system according to any one of claims 1 to 8, wherein: The electronic device is an image forming apparatus,
10. The display system according to claim 1, wherein the status information of the electronic device includes information on a paper jam and information on a consumable used in the image forming apparatus. A process of transmitting status information indicating the status of the electronic device;
Processing for receiving status information transmitted from the electronic device;
Based on the received status information of the electronic device, a process of determining an operation part of the electronic device;
Processing to input an image by photographing the electronic device;
Processing for displaying the input image on the operation display unit on the terminal device side;
The program which makes a computer perform the process which attaches a desired designation | designated display to the operation part of the determined said electronic device in the said input image, and displays it on the operation display part by the side of the said terminal device. An information distribution device connected to an electronic device and a terminal device via a network,
A receiving unit for receiving state information indicating the state of the electronic device from the electronic device;
A determination unit for determining an operation part of the electronic device based on the state information of the electronic device received by the reception unit;
A desired designation display is attached to the operation part of the electronic device determined by the determination unit in the image of the electronic device photographed by the terminal device and displayed on the operation display unit on the terminal device side of the terminal device An information distribution apparatus comprising: a control unit that causes