JP7404952B2 - Communication terminal, information provision system, information provision method and program - Google Patents

Description

The present invention relates to a communication terminal, an information providing system, an information providing method, and a program.

In recent years, smart glasses that create augmented reality (AR) and virtual reality (VR) heads that create augmented reality (AR) by superimposing images on real scenery on a display device have become popular. Glass-type wearable terminals such as head mount displays (hereinafter referred to as HMDs) have come into use. This glasses-type wearable terminal can be used in a variety of situations, including support for equipment maintenance.

For example, as an example of displaying support information, when a mark such as a barcode provided on the substrate processing apparatus 10 undergoing maintenance is recognized, a manual associated with the mark may be displayed on the worker's HMD 30. A display control device 40 is disclosed (see Patent Document 1).

However, in the conventional method, although procedure information corresponding to the equipment to be maintained is displayed, when replacing or using a used item used for a given equipment, the used item is used for multiple models. In this case, it is assumed that the installation location of the used items and the procedural information related to their use differ depending on the model. In such a case, a problem arises in that appropriate procedure information cannot be provided for the used item to be replaced.

In order to solve the above-mentioned problem, the invention according to claim 1 includes a photographing means for photographing specific usage type information for identifying the type of a specific usage product, and a photographing means for photographing specific usage type information for identifying the type of a specific usage product, and a determination unit that determines, based on the information, whether there is a single or multiple type of onboard equipment that can mount the specific item; and if there is only one type of onboard equipment that can mount the specific item, Corresponding to usage type information, display procedure information indicating the procedure to be used for the applicable onboard equipment, and if there are multiple types of onboard equipment that can mount the specific usage item, display the procedure information for the multiple types of onboard equipment. and a display control means for displaying on-board device information indicating on the display means, and when there are multiple types of on-board devices that can mount the specific item, the photographing means selects one of the plurality of types of on-board devices. , photographing specific on-board device type information for identifying the type of the specific on-board device, and the display control means corresponding to the photographed specific usage type information and the specific on-board device type information. , the communication terminal is characterized in that procedure information indicating a procedure for using the specific used item for the specific installed equipment is displayed on the display means.

According to the present invention, when replacing or using used items used in multiple models, even if the installation position and usage procedure information of the target used items differ depending on the model, appropriate This has the effect of being able to provide procedural information.

1 is a diagram showing an example of the configuration of an information providing system according to the present embodiment. It is a diagram showing an example of the hardware configuration of a communication terminal. It is a diagram showing an example of the hardware configuration of a procedure information management device. FIG. 2 is a diagram showing an example of the hardware configuration of the installed equipment. 1 is a diagram showing an example of each functional block of the information providing system according to the present embodiment. (A) is a conceptual diagram showing a used item identification table, and (B) is a conceptual diagram showing a procedure information correspondence table. FIG. 3 is a sequence diagram illustrating an example of a procedure information display process according to the present embodiment. 7 is a flowchart illustrating an example of procedure information specifying processing according to the present embodiment. FIG. 3 is a diagram showing an example of screen display contents displayed on a communication terminal. FIG. 3 is a diagram showing an example of screen display contents displayed on a communication terminal.

Hereinafter, an overall outline of an embodiment of the present invention will be described using the drawings. This embodiment discloses an information providing system using smart glasses, which are glasses-type wearable terminals used to utilize AR. That is, the present embodiment discloses an invention related to a system that provides procedure information to a user using a used item identification table and a procedure information management table received from the procedure information management device 3.

[System overview]
FIG. 1 is a diagram showing an example of the configuration of an information providing system according to the present embodiment. The information providing system shown in FIG. 1 interconnects a communication terminal 2, a procedure information management device 3, a used item 5, and at least one onboard device 7 via a network 4 such as a LAN (Local Area Network). It is formed by connecting to.

The communication terminal 2 is a glasses-type wearable terminal used to utilize AR, and communicates with the procedure information management device 3 via the network 4. This communication terminal 2 is, for example, smart glasses. Note that the communication terminal 2 may be an HMD type wearable terminal that provides VR. Furthermore, the communication terminal 2 is not limited to a wearable terminal, and may be a mobile terminal such as a smartphone or a PC (Personal Computer).

The procedure information management device 3 is an example of a procedure information management device that can communicate with the communication terminal 2 via a network 4 such as the Internet. The procedure information management device 3 stores and manages data such as a used item identification table and a procedure information correspondence table used in the communication terminal 2. Details of the used item identification table and the procedure information correspondence table will be described later. Note that the network 4 described above may be configured as either a wired LAN or a wireless LAN. That is, the communication terminal 2 and the procedure information management device 3 may be connected via a cable such as a wired LAN.

<About terms>
The used items according to the present embodiment refer to various consumable items that are expected to be used up or consumed within a predetermined period of time, such as toner cartridges, staplers, printing paper, and the like. Furthermore, used items refer to various replacement items that need to be replaced due to failure or damage. Furthermore, the used items include optional equipment installed to provide a predetermined function. In other words, "used items" is a general term for items including these consumable items, replacement items, and additional items.

[Hardware configuration]
Next, the hardware configurations of the communication terminal 2, procedure information management device 3, and on-board equipment 7 of this embodiment will be explained in detail using FIGS. 2 to 4.

<Hardware configuration of communication terminal>
FIG. 2 is a diagram showing an example of the hardware configuration of a communication terminal. As shown in FIG. 2, the communication terminal 2 includes a CPU 201, a ROM 202, a RAM 203, an EEPROM 204, a CMOS sensor 205, an image sensor I/F 206, an acceleration/direction sensor 207, a media I/F 209, and a GPS receiving section 211. ing.

Among these, the CPU 201 controls the operation of the communication terminal 2 as a whole. The ROM 202 stores programs used to drive the CPU 201. RAM 203 is used as a work area for CPU 201. The EEPROM 204 reads or writes various data such as programs executed by the communication terminal 2 under the control of the CPU 201 . A CMOS (Complementary Metal Oxide Semiconductor) sensor 205 is a type of built-in imaging means that photographs a subject (such as a used item) and obtains image data under the control of the CPU 201 . Note that instead of a CMOS sensor, an imaging means such as a CCD (Charge Coupled Device) sensor may be used. The image sensor I/F 206 is a circuit that controls driving of the CMOS sensor 205. The acceleration/direction sensor 207 is a variety of sensors such as an electronic magnetic compass, a gyro compass, and an acceleration sensor that detect geomagnetism. Note that the acceleration/direction sensor 207 may also include an illuminance sensor. A media I/F 209 controls reading or writing (storage) of data to a medium 208 such as a flash memory. The GPS receiving unit 211 receives GPS signals from GPS satellites.

The communication terminal 2 also includes a long-distance communication circuit 212, a CMOS sensor 213, an image sensor I/F 214, a microphone 215, a speaker 216, a sound input/output I/F 217, a display 218, an external device connection I/F (Interface) 219, It includes a short-range communication circuit 220, an antenna 220a of the short-range communication circuit 220, and a touch panel 221.

Among these, the long distance communication circuit 212 is a circuit that communicates with other devices via the network 4. The CMOS sensor 213 is a type of built-in imaging means that photographs a subject and obtains image data under the control of the CPU 201. Note that the CMOS sensor 213 may be used in common with the CMOS sensor 205 described above. The image sensor I/F 214 is a circuit that controls driving of the CMOS sensor 213. Microphone 215 is a built-in circuit that converts sound into electrical signals. The speaker 216 is a built-in circuit that converts electrical signals into physical vibrations to produce sounds such as music and voice. The sound input/output I/F 217 is a circuit that processes input/output of sound signals between the microphone 215 and the speaker 216 under the control of the CPU 201 . The display 218 is a type of display means such as a liquid crystal or organic EL (Electro Luminescence) that displays an image of a subject, various icons, and the like. The external device connection I/F 219 is an interface for connecting various external devices. The near field communication circuit 220 is a communication circuit such as NFC (Near Field Communication) or Bluetooth (registered trademark). The touch panel 221 is a type of input means by which the user operates the communication terminal 2 by, for example, pressing the display 218. The communication terminal 2 also includes a bus line 210. The bus line 210 is an address bus, a data bus, etc. for electrically connecting each component such as the CPU 201 shown in FIG. 2.

Note that the communication terminal 2 may be, for example, smart glasses or a head-mounted display as a wearable terminal, a smartphone, a portable terminal, or a PC.

<Hardware configuration of procedure information management device>
FIG. 3 is a diagram showing an example of the hardware configuration of the procedure information management device. As shown in FIG. 3, the procedure information management device 3 includes a CPU 301, ROM 302, RAM 303, HD (Hard Disk) 304, HD controller 305, media 306, media interface (I/F) 307, display 308, and network. It includes an interface (I/F) 309, a keyboard 311, a mouse 312, a DVD (or BD: Blu-Ray Disc) 313, a DVD-RW drive 314, and a bus line 310.

Among these, the CPU 301 controls the entire operation of the procedure information management device 3. The ROM 302 stores programs used to drive the CPU 301, such as IPL. Further, the ROM 302 may store data constituting programs other than the various programs stored in the HD 304. The CPU 301 may perform control with the communication terminal 2 by executing various programs stored in the ROM 302. RAM 303 is used as a work area for CPU 301. Further, the RAM 303 has a function as a work area in which various programs stored in storage units such as the ROM 302 and the HD 304 are downloaded, and various processes are executed by the CPU 301. The HD 304 stores various data such as programs. The HD controller 305 controls reading and writing of various data to the HD 304 under the control of the CPU 301 . The media I/F 307 controls reading or writing (storage) of data to the media 306 such as a flash memory. The display 308 displays various information such as a cursor, menu, window, characters, or images.

The network I/F 309 is an interface for data communication using the network 4. The keyboard 311 is a type of input means that includes a plurality of keys for inputting characters, numbers, various instructions, and the like. The mouse 312 is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like. Note that the mouse 312 is an example of a pointing device. A CD-RW drive 314 controls reading and writing of various data to a DVD-RW (Digital Versatile-Disc-ReWritable) 313, which is an example of a removable recording medium. Further, the procedure information management device 3 includes a bus line 310. The bus line 310 is an address bus, a data bus, etc. for electrically connecting each component such as the CPU 301 shown in FIG. 3.

Note that the procedure information management device 3 may be a procedure information management device, a PC, or the like having a server function.

<Hardware configuration of installed equipment>
FIG. 4 is a diagram showing an example of the hardware configuration of the installed equipment. An MFP (Multi Function Peripheral) is given as an example of the on-board device 7, and the MFP includes a controller 600, a short-range wireless communication circuit 620, an engine control section 630, an operation panel 640, and a network I/F 650.

Among these, the controller 600 controls, for example, input from the operation panel 640. The controller 600 also includes a CPU 601, a system memory (MEM-P) 602, a north bridge (NB) 603, a south bridge (SB) 604, and an ASIC (Application Specific Integrated Circuit) as a control unit that performs overall control of the onboard equipment 7. 606, a local memory (MEM-C) 607 as a storage unit, an HDD controller 608, and an HDD 609 as a storage unit. Further, the NB 603 and the ASIC 606 are connected through an AGP (Accelerated Graphics Port) bus 621. NB603 is a bridge circuit for connecting the CPU601, MEM-P602, SB604, and ASIC606. The NB 603 includes a memory controller that controls reading and writing to and from the MEM-P 602, a PCI (Peripheral Component Interconnect) master, and an AGP target. The MEM-P602 includes a ROM 602a, which is a memory for storing programs and data that realizes each function of the controller 600, and a RAM 602b, which is used as a memory for storing programs and data, a storage memory when scanning a document, and a drawing memory when printing the memory. Be prepared. Note that the programs stored in the RAM 602b are files in an installable or executable format, and are provided by being recorded on a computer-readable recording medium such as a CD-ROM, CD-R, or DVD. may be configured. SB604 is a bridge circuit for connecting NB603, PCI devices, and peripheral devices. The ASIC 606 is an IC (Integrated Circuit) for image processing that includes hardware elements for image processing. Its role is a bridge circuit that connects the AGP bus 621, PCI bus 622, HDD controller 608, and MEM-C 607, respectively.

The ASIC 606 also has a PCI target and an AGP master, an arbiter (ARB) that arbitrates the operation and timing of other devices connected to the ASIC 606, a memory controller that controls the MEM-C 607, and a DMAC (Direct Memory Access Controller) that controls DMA. ), a PCI unit that transfers data between a scanner unit 631 and a printer unit 632 via a PCI bus 622. Note that the ASIC 606 may be connected to a USB (Universal Serial Bus) interface and an IEEE 1394 (Institute of Electrical and Electronics Engineers 1394) interface. MEM-C607 is a local memory used as a copy image buffer and code buffer. The HDD 609 is a storage for storing image data, font data used when printing a manuscript, forms, and the like. The HDD controller 608 controls data reading or writing to the HDD 609 under the control of the CPU 601. The AGP bus 621 is a bus interface for a graphics accelerator card proposed to speed up graphics processing. AGP bus 621 allows high-throughput direct access to MEM-P 602 to speed up graphics accelerator cards. The short-range wireless communication circuit 620 is a circuit for performing short-range wireless communication, and includes a short-range wireless communication circuit antenna 620a. The near field communication circuit 620 is, for example, a wireless communication circuit such as NFC (Near Field Communication) or Bluetooth (registered trademark).

The engine control section 630 includes a scanner section 631 and a printer section 632. The scanner section 631 and the printer section 632 include image processing sections such as error diffusion and gamma conversion. The operation panel 640 as a part of the operation section 11 can be mounted on or connected to the mounted device 7, and includes a panel display section 640a and a panel operation section 640b. In this embodiment, a state in which the device can be connected to the on-board device 7 is shown as an example. The panel display section 640a includes a touch panel or the like that displays current setting values, a selection screen, etc., and receives input from an operator. The panel operation unit 640b also includes a numeric keypad for accepting input of printing-related attribute information (also referred to as various conditions) such as document size, file format, color/monochrome, number of copies, etc., a start key for accepting copy start instructions, and the like. .

Network I/F 650 is an interface for data communication using a communication network. Near field wireless communication circuit 620 and network I/F 650 are electrically connected to ASIC 606 via PCI bus 622. Further, the MFP as an example of the mounted device 7 can switch and select a document box function, a copy function, a printer function, and a facsimile function using an application switching key displayed on the panel display section 640a or provided in the panel operation section 640b. becomes possible. That is, the mounted device 7 is in the document box mode when the document box function is selected, the copy mode when the copy function is selected, the printer mode when the printer function is selected, and the facsimile mode when the facsimile function is selected.

In addition to the above-mentioned MFP, the mounted devices 7 include any type of device that is equipped with the various used items described above, a projector equipped with a lamp, etc., an inkjet printer that uses ink, etc., and various batteries. It may be a device equipped with

[Functional configuration]
<Functional configuration of information provision system>
Next, the functional configuration of the information providing system will be explained. FIG. 5 is a diagram illustrating an example of functional blocks of each device making up the information providing system. In the information providing system, as shown in FIG. 1, a communication terminal 2 and a procedure information management device 3 are connected via a network 4. Thereby, the communication terminal 2 performs data communication, such as audio data, image data, and text data, with the procedure information management device 3.

<Functional configuration of communication terminal>
As shown in FIG. 5, the communication terminal 2 includes a transmitting/receiving section 21, a receiving section 22, an imaging section 23, a display control section 24, a determining section 25, an image processing section 26, a communication section 28, and a storage/reading processing section. It has 29. The functions of each of these parts are realized when any of the components shown in FIG. or a means of functioning. Note that, in addition to the image processing program described above, the communication terminal 2 may store other processing programs in a storage unit such as the ROM 202.

Furthermore, the communication terminal 2 has a storage unit 2000 constructed by a ROM 202 and an EEPROM 204 shown in FIG.

By executing the image processing program, the CPU 201 determines the usage type ID 6, which is given to the used item 5 by pasting, printing, or stamping, etc., which will be described later, and the usage type ID 6, which is given to the mounted device 7 by pasting, printing, stamping, etc. This enables processing including photographing processing for the installed model ID 8, and processing for displaying various images and text on the display 218 of the communication terminal 2. In addition, the CPU 201 compares the photographed used product type ID 6 and installed model type ID 8 with the table data acquired (received) from the procedure information management device 3, and selects the procedure information related to the replacement and use of the used product 5. Executes various processes.

<Functional configuration of communication terminal>
Next, each functional configuration of the communication terminal 2 will be explained. Note that the following functional configurations mainly describe functional configurations that a smartphone has, but can also be commonly used for communication terminals. The transmitting/receiving unit 21 of the communication terminal 2 is mainly realized by the processing of the CPU 301 on the long distance communication circuit 212, and is capable of transmitting and receiving various data (or information) with other devices via a communication network such as the Internet. conduct.

The reception unit 22 is mainly realized by the processing of the CPU 201 on the touch panel 221, and receives various selections or inputs from the user. This is realized by the processing of the CPU 201 on the CMOS 213 via F214, and photographs the subject etc. to obtain photographed image data.

The display control unit 24 is mainly realized by the processing of the CPU 201, and causes the display 218 to display various images.

The judgment unit 25 is mainly realized by the processing of the CPU 201, and performs various judgments. The details of the judgment made by the judgment unit 25 will be described later.

The image processing unit 26 processes the photographed image data of the subject photographed by the imaging unit 23.

The communication unit 28 is mainly realized by the processing of the CPU 201 for the short-range communication circuit 220, and performs data communication with the transmitting/receiving unit 31 and the communication unit 38 of the procedure information management device 3. In the case of wired communication, the communication unit 28 supplies power or communicates image data, etc. to the procedure information management device 3 via the communication cable by processing the CPU 201 on the external device connection I/F 219. conduct.

The storage/read processing unit 39 is mainly realized by the processing of the CPU 201, and stores various data (or information) in the storage unit 2000 and reads various data (or information) from the storage unit 2000.

In the present embodiment, the transmitting/receiving section 21, receiving section 22, imaging section 23, display controlling section 24, determining section 25, image processing section 26, communication section 28, and storage/reading processing section 29 may be realized by software. . In addition, the transmitting/receiving unit 21, the receiving unit 22, the imaging unit 23, the display control unit 24, the determining unit 25, the image processing unit 26, the communication unit 28, and the storage/reading processing unit 29 execute part of the processing for other programs. Alternatively, the process may be executed indirectly using another program. Further, the transmitting/receiving section 21, the receiving section 22, the imaging section 23, the display control section 24, the determining section 25, the image processing section 26, the communication section 28, and the storage/reading processing section 29 are partially or entirely integrated into an IC (Integrated Circuit). ), etc. may be realized by hardware.

<Functional configuration of procedure information management device>
The procedure information management device 3 includes a transmitting/receiving section 31 , a receiving section 32 , a display control section 34 , a determining section 35 , a providing section 36 , a communication section 38 , and a storage/reading processing section 39 . The functions of each of these parts are realized when any of the components shown in FIG. or a means of functioning.

Further, the procedure information management device 3 has a storage unit 3000 constructed by a ROM 302 and an HD 304 shown in FIG.

<Each functional configuration of the procedure information management device>
Next, each functional configuration of the procedure information management device 3 will be explained. The transmitting/receiving unit 31 is realized by commands from the CPU 301 and the network I/F 309 shown in FIG. 3, and transmits and receives various data (or information) to and from other terminals, devices, or systems via the network 4.

The receiving unit 32 is mainly realized by commands from the CPU 301 shown in FIG. 3, as well as a keyboard 311 and a mouse 312, and receives various inputs from the user.

The display control unit 34 is realized by instructions from the CPU 301 shown in FIG. 3, and causes the display 308 to display an image. For example, the display control unit 34 downloads a Web APP (Web Application) that includes at least HTML (HyperText Markup Language), CSS (Cascading Style Sheets), JAVA SCRIPT (registered trademark), etc., and displays various images generated by the Web APP. The data is displayed on display 308. The display control unit 34 causes the display 308 to display image data generated by HTML5, which includes data in the XML (Extensible Markup Language), JSON (JavaScript Object Notation), or SOAP (Simple Object Access Protocol) format, for example.

The determining unit 35 is realized by instructions from the CPU 301 shown in FIG. The selection and execution of information to be provided to the communication terminal 2 is determined by referring to the information.

The communication unit 38 is realized by instructions from the CPU 301 shown in FIG. 3, is mainly realized by processing of the CPU 301 for the network I/F 309, and performs data communication with the transmission/reception unit 21 and the communication unit 28 of the communication terminal 2. .

The storage/read processing unit 39 is executed by the commands from the CPU 301 and the HDD controller 305 shown in FIG. Perform processing.

In the procedure information management device 3 described above, part or all of the communication control section 351 to storage/read processing section 356 may be realized by hardware such as an IC (Integrated Circuit).

Furthermore, in the above example, the communication control unit 351 to the storage/read processing unit 356 are realized by software, but some or all of them may be realized by hardware such as an IC (Integrated Circuit). The things that can be done are the same as those of the other programs mentioned above.

(Used item specification table)
FIG. 6(A) is a conceptual diagram showing a used item identification table. In the storage unit 3000, a used item management DB 3001 is constructed, which includes a used item identification table as shown in FIG. 6(A). In this used item identification table, the ``used item name,'' ``used item identification ID,'' and ``used item type,'' which make up the ``used item information,'' are managed in association with each ``image information (image characteristics).'' ing.

Among these, image information (image characteristics) is a QR code (registered trademark, omitted hereinafter) given to the toner cartridge, which is an example of the product 5, by pasting, printing, or engraving, a stapler needle, or printing. This is information including characters pasted or printed on the paper box. In addition to the above-mentioned QR code and characters, the image information may also be a barcode, a specific mark, or a symbol. Furthermore, the image information may be the shape, color, or pattern of the item 5 itself. Furthermore, the image information may give characteristics to the box in which the used item 5 is packed.

The used item name is a symbol or the like representing a word indicating the characteristics of the used item 5, such as "TC-C" given to the used item 5 such as a toner cartridge.

The used product type ID (used product type ID6) is type identification information (hereinafter simply referred to as identification information) for identifying the type of the used product 5 represented by "QR-ID1" etc., and is used type information. This is an example. If the usage type ID given to the usage item 5 by pasting, printing, or engraving is a QR code or barcode, the information embedded in the QR code or barcode photographed by the communication terminal 2. The decoded information is given as the usage type ID. Note that the usage type ID may be text information (character information) such as specific characters and symbols in addition to code information represented by an image code such as a QR code or a bar code. Further, the used product type ID represents, for example, identification information given to used products with the same model number but different serial numbers.

The type of used item 5 is information indicating what kind of item the used item 5 is, and is given with color information added, such as "toner cartridge (cyan)", for example.

(Procedure information correspondence table)
FIG. 6(B) is a conceptual diagram showing a procedure information correspondence table. In the storage unit 3000, a procedure information management DB 3002 is constructed, which is composed of a procedure information management table as shown in FIG. 6(B). In this procedure information correspondence table, for each of the above-mentioned "used item information (used item name and used type ID)", the ``model name'', ``model ID'', and ``model icon'' that constitute the ``model information'', and , "procedure information number" and "product type information" that constitute "procedure information and product type information" are managed in association with each other. In other words, the procedure information correspondence table includes a usage type ID, which is an example of usage type information, a model name, an installed model type ID, and a model icon, which are examples of installed model type information for identifying the type of the installed device 7. This is management information that is managed by associating it with other information.

The model name is information indicating the model of the onboard equipment 7, etc., and is given as information such as "model A" and "model B", for example.

The installed device type ID (installed device type ID8) is type identification information (hereinafter simply referred to as identification information) for identifying the type of the installed device 7 represented by "M-IDA" etc., and is installed device type information. This is an example. Among the model-specific IDs, if the target given to the onboard device 7 by pasting, printing, or engraving is a QR code or barcode, the information embedded in the QR code or barcode photographed by the communication terminal 2 is The decoded information is given as the installed model type ID. Note that the installed model type ID may be text information (character information) such as specific characters and symbols in addition to code information represented by an image code such as a QR code or a bar code. Further, the usage type ID represents, for example, identification information given to mounted devices with the same model number but different serial numbers.

The model icon is a thumbnail image of the model associated with the above-mentioned model name and model information. Note that the thumbnail images of each model are stored and managed in the storage unit 3000, and the file name of the thumbnail image may be given as the model icon instead of the thumbnail image in this procedure information correspondence table.

The procedure information number is information given to each device model and product that uses the product, and indicates the procedure for replacing, using, etc. the product, and is managed by the name of the manual such as user manual, operation manual, etc. It is given with a number. Note that the above-mentioned manual includes images, videos, and audio information.

The used item type information is given the same information as the types of used items that constitute the used item identification table.

<Functional configuration of MFP>
The CPU 601 of the onboard device 7 stores information in a storage device such as the HDD 609 based on various execution commands such as print commands and file output commands sent from a PC or a procedure information management device connected to the onboard device 7 via the network 4. The stored print execution program is loaded into the RAM 602b and executed. By executing this print execution program, the CPU 601 configures each function or functioning means, including, for example, a communication control unit, a command reception unit, a determination unit, a command execution unit, a notification unit, and a storage/read processing unit. . However, in this embodiment, since the onboard device 7 has no functional connection with the communication terminal 2 and the procedure information management device 3, which are the main subjects of the invention, a detailed explanation of the functional configuration of the onboard device 7 will be omitted. Note that each of the above-mentioned functional units may be partially or entirely realized by hardware such as an IC (Integrated Circuit).

[Processing or operation of embodiment]
Hereinafter, the processing and operation of this embodiment will be explained using the drawings. <Processing sequence>
Here, using FIGS. 7 to 10, a user who wears or owns the communication terminal 2 takes a picture of the usage type ID 6 given to the used item 5 by pasting, printing, stamping, etc. However, a process for displaying a replacement manual or the like related to the photographed used item 5 on the display 218 will be explained. Note that a toner cartridge is illustrated as an example of the used item 5, and an MFP is illustrated as an example of a device mounted with the toner cartridge.

FIG. 7 is a sequence diagram showing an example of the procedure information display process according to the present embodiment. First, the communication terminal 2 starts a predetermined communication protocol for establishing mutual communication with the procedure information management device 3. The start of this communication protocol is performed between the communication unit 28 of the communication terminal 2 and the communication unit 38 of the procedure information management device 3, but since it is a process that can be executed with a general communication protocol, a detailed explanation will be given. Omitted.

After the communication unit 28 establishes communication between the communication terminal 2 and the procedure information management device 3, the transmitting and receiving unit 21 of the smart glasses transmits the used item management table and procedure information managed in the storage unit 3000 of the procedure information management device 3. The correspondence table and all procedure information (manuals corresponding to procedure information 1 to 9) are downloaded (received) (step S101). On the other hand, in step S101, the transmitting/receiving unit 21 may acquire some or all of the procedure information.

Next, the imaging unit 23 of the communication terminal 2 photographs an area including the QR code attached, printed, or engraved on the toner cartridge, which is an example of the used item 5, in the user's field of vision through the user's operation. (Step S102). Note that the display control unit 27 may display on the display 218 that downloading of the procedure information has been completed before the user photographs the toner cartridge. By doing so, the user can know the appropriate shooting timing.

Next, the determining unit 25 collaborates with the image processing unit 26 to identify, from the photographed QR code, the used product name, used type ID, etc. of the toner cartridge to which the QR code is affixed, printed, or engraved (step S103). As this specific method, the determination unit 25 uses the QR code of the used product identification table downloaded in step S101 as a search key to identify the used product name, used product type ID, and used product type defined in the used product information. . Here, the determination unit 25 may decode the QR code to obtain the product name and specification product identification ID. Further, in addition to the photographed QR code, the determination unit 25 searches the used product identification table using the name and unique number included in the photographed image of the toner cartridge main body as a search key, and identifies the used product. You can also do it. At this time, the determination unit 25 may acquire the product name and specification product identification ID by recognizing characters included in the photographed image and converting the text into text. Note that the transmitting/receiving unit 21 may request the procedure information management device 3 to identify the used item by transmitting image data indicating the photographed image to the procedure information management device 3. In this case, the communication terminal 2 acquires the identification result specified by the procedure information management device 3. Furthermore, the transmitter/receiver 21 may request other servers to decode the QR code or recognize characters. In this case, the communication terminal 2 acquires the used product name and specification product identification ID from the server.

Subsequently, the determining unit 25 determines whether or not procedure information such as replacement for the toner cartridge can be specified based on the used product name and used type ID of the identified toner cartridge (step S104). The procedure information specifying process in step S104 will be described in detail below using FIG. 8.

<Flowchart>
FIG. 8 is a flowchart illustrating an example of the procedure information specifying process according to the present embodiment.

First, the determining unit 25 uses the used product information (used product name and used type ID) of the specified used product 5 (toner cartridge) as a search key to search the downloaded procedure information correspondence table, thereby determining the corresponding model information. (Model name, installed model ID, and model icon) are read (step S1201).

Subsequently, the determining unit 25 determines whether the type of equipment on which the identified used item 5 is mounted is singular (step S1202). In other words, the determination unit 25 determines whether the model information (model name, installed model ID, and model icon) of the installed device 7 corresponding to the type of the used item 5 read in step S1201 uniquely corresponds to the type of the used item 5 read out in step S1201. . Specifically, the determination unit 25 determines, for example, whether the QR code affixed to the toner cartridge and the model name of the MFP, as well as the QR code affixed to the MFP and the model icon, etc., uniquely correspond. to judge. That is, the determining unit 25 determines whether or not the used product information obtained from the QR code or the like uniquely corresponds to the model information or the procedure information based on the procedure information correspondence table. Here, if the identified used item corresponds to only a specific model (single model), the determination unit 25 determines that the procedure information corresponding to the identified used item 5 can be specified. On the other hand, if a plurality of items of used item information correspond to each other (that is, if the used item does not correspond to only a specific model (single item)), the determining unit 25 determines that the procedure information cannot be specified.

If it is determined that the specified used item 5 is used only in a specific (single) on-board device (step S1202; YES), that is, if the on-board device 7 on which the specified used item 5 is mounted is specified, the judgment is made. The unit 25 causes the display control unit 24 to execute the process of step S105, which will be described later in FIG. 7, and exits from this flow.

On the other hand, if it is determined that there are multiple types of installed devices in which the specified used item 5 is installed (step S1202; NO), the determination unit 25 determines the used item information (used item name) of the specified used item 5 (toner cartridge). and usage type ID), the plurality of model information (model name, installed model type ID, and model icon) are read out (step S1203).

Next, the display control unit 24 causes the display 218 to display a thumbnail image indicated by the model name and model icon in each model information from each of the plurality of model information (model name, installed model ID, and model icon). (Step S1204). Details will be explained with reference to FIG.

<Display example on display>
FIG. 9 is a diagram showing an example of screen display contents displayed on the communication terminal. Note that FIG. 9 is a schematic diagram of eyeglass-type smart glasses that are an example of the communication terminal 2. As shown in FIG. 9, the display control unit 24 displays the type of toner cartridge and the thumbnail image photographed in step S102 in the area 251 of the display 218 of the communication terminal 2. Further, the display control unit 24 displays a message in the area 252 indicating that there are multiple types of on-board equipment 7 on which the used item 5 identified in step S1202 is mounted, and that the on-board equipment cannot be identified. In the example of FIG. 9, content that does not allow identification of the onboard device 7 is displayed. For example, "The model equipped with the applicable replacement product cannot be identified. It is necessary to identify the compatible model." Further, the display control unit 24 causes the display 218 to display, in the area 253, a thumbnail image indicated by the model name and model icon in each model information of the mounted device 7 in which the photographed used item is mounted. In the procedure information correspondence table, the model names corresponding to the used product name "TC-C" are "model A,""modelB," and "model C." Therefore, the display control unit 24 first displays, for example, "The corresponding models are model A, model B, and model C " in area 252 on the display 218. Further, the display control unit 24 displays, in the area 253, information regarding candidates for a plurality of mounted devices 7 on which the photographed used item 5 is mounted. Specifically, for example, the display control unit 24 displays thumbnail images of “model A,” “model B,” and “model C,” and displays each usage type ID (each QR code) on each thumbnail image. Contents (for example, characters and symbols such as "Here", "→", and "○ mark") indicating the location where each type of identification information (obtained from the code) is displayed, printed, or engraved are displayed.

Note that the dark gray portion shown in FIG. 9 is a unit that includes a built-in microphone, speaker, etc., including the image sensor (CMOS) of the smart glasses. Furthermore, the part indicated by a circle in the dark gray part has a built-in lens for photographing the subject. This configuration also applies to an example of screen display content shown in FIG. 10, which will be described later.

When the screen shown in FIG. 9 is displayed by the display control unit 24 in step S1204, the image capturing unit 23 displays the QR code pasted, printed, or engraved on other mounted devices 7 by the user's operation after viewing the screen shown in FIG. Take a photo of the code, etc. Therefore, the image processing unit 26 analyzes the photographed QR code and passes the installed model type ID, which is one of the model information of the installed device 7, to the determination unit 25. The determining unit 25 determines whether or not the identified used item 5 and the newly photographed model information of the mounted device 7 uniquely correspond to each other. In other words, the determining unit 25 determines whether the type of the mounted device 7 on which the specified used item 5 is mounted can be specified (step S1205). Here, the determination unit 25 searches the procedure information correspondence table for the installed device indicated by the QR code obtained in step S1204 using the usage type ID6 as a search key, and determines whether it is possible to specify the procedure information number. Decide whether or not. As a result, the determining unit 25 determines that the combination of the photographed used product 5 and the mounted device 7 has been determined if the procedure information number corresponding to the used product type ID6 and the installed device type ID8 is narrowed down to one. , the process moves to step S105 in FIG. 7 and exits from this flow.

On the other hand, if the procedure information number corresponding to the usage type ID6 and the installed device type ID8 is not narrowed down to one (step S1205; NO), the determination unit 25 obtains the model information of yet another installed device 7. Wait until.

<Display example on display>
FIG. 10 is a diagram showing an example of screen display contents displayed on a communication terminal. As shown in FIG. 10, the display control unit 24 displays the type of toner cartridge and the thumbnail image photographed in step S102 in the area 251 of the display 218 of the communication terminal 2. In addition, the display control unit 24 displays a message in the area 252 indicating that the mounted devices on which the used item 5 identified in step S1202 is mounted have been narrowed down and the mounted devices have been identified. In the example of FIG. 10, the contents of the onboard equipment identified are displayed. For example, "A model equipped with the applicable replacement item has been found. The replacement procedure for the applicable replacement item will now be displayed." Further, the display control unit 24 displays, in the area 253, for example, a thumbnail image of the model A in which the used item 5 is installed and the title of the user manual of the model A. Further, the display control unit 24 displays the entire image of model A in the area 254. Note that the display examples shown in FIGS. 9 and 10 are merely examples, and the display content and layout are not limited to these.

Returning to FIG. 7, the display control unit 24 displays the procedure information specified in step S104 on the display 218 (step S105). Specifically, the display control unit 24 displays, on the display 218, the procedure information (manual) corresponding to the QR code printed on the used item 5 photographed by the imaging unit 23 and the QR code printed on the mounted device 7, for example. to be displayed. That is, the display control unit 24 displays the procedure information corresponding to the acquired used product information and model information.

Furthermore, the processes of steps S1202 to S1204 are repeated until the loaded device 7 on which the used item 5 is loaded is specified. However, if the on-board equipment 7 is still not identified even after repeating the processes from steps S1202 to S1204 described above, and the procedure information of the used item 5 cannot be identified, the determination unit 25 controls the display control unit 24 to A message indicating that the mounted device 7 cannot be identified may be displayed.

In this case, the determination unit 25 controls the communication unit 28 to control the procedure information management device 3 to download other procedure information different from the procedure information downloaded in step S101 to the communication terminal 2. It's okay. In this case, the procedure information management device 3 may have a function of receiving the usage type ID 6 of the used item 5 and the installed model ID 8 of the installed device 7 photographed by the imaging unit 23 of the communication terminal 2 . At this time, the display control unit 24 may display a message on the display 218 indicating that another procedure information is being downloaded.

Note that the determining unit 25 controls the communication unit 28 to download the procedure information executed in step S101 to the procedure information management device 3 even if it is executed after identifying the used item 5 in step S103. good. In this case, compared to the process of downloading all the procedure information, only the procedure information narrowed down to the procedure information related to the specified used item 5 is downloaded, so the memory of the communication terminal 2 can be saved, and the communication terminal 2 and procedure information can be managed. It is also possible to expect savings in communication costs and data amount associated with communication with the device 3. More specifically, after acquiring the used item information in step S103, the transmitting/receiving unit 21 transmits the acquired used item information to the procedure information management device 3. The determining unit 35 of the procedure information management device 3 determines whether the procedure information can be uniquely identified based on the used product information received from the communication terminal 2, and if the procedure information can be uniquely identified, the determination unit 35 determines whether the procedure information can be uniquely identified. Only the procedure information can be downloaded to the communication terminal 2. This eliminates the need to download unnecessary procedure information to the communication terminal 2. If the procedure information cannot be uniquely identified based on the used product information received from the communication terminal 2, the determining unit 35 downloads all the procedure information corresponding to the used product information received from the communication terminal 2 to the communication terminal 2. You may do so. This allows the communication terminal 2 to download procedure information that may be needed in advance while the user is taking an image of the QR code or the like of the onboard device 7, so that the procedure information can be displayed immediately after identifying the model information. It can be performed.

Further, the determination unit 25 may control the communication unit 28 to download the procedure information executed in step S101 to the procedure information management device 3 after specifying the procedure information in step S104. . In this case, compared to the process of downloading all the procedure information or the procedure information related to the used product 5, only one procedure information related to the specified used product 5 and the specified installed equipment 7 is downloaded, so the memory of the communication terminal 2 is Further savings can be expected, as well as further savings in communication costs and data amount related to communication between the communication terminal 2 and the procedure information management device 3. More specifically, after acquiring the used item information in step S103, the transmitting/receiving unit 21 transmits the acquired used item information to the procedure information management device 3. If the procedure information cannot be uniquely identified based on the used item information received from the communication terminal 2, the determination unit 35 of the procedure information management device 3 transmits the model information without transmitting the procedure information to the communication terminal 2. request. In this case, the imaging unit 23 of the communication terminal 2 further acquires model information by photographing the QR code of the installed device, and transmits and receives the acquired model information and used item information acquired in advance to the procedure information management device. 21. The transmitting/receiving unit 31 of the procedure information management device 3 transmits the specified piece of procedure information to the communication terminal 2 based on the used product information and model information received from the communication terminal 2.

Furthermore, when the procedure information includes used product information, the determining unit 25 may specify the procedure information including the acquired used product information and model information.

[Main effects of the embodiment]
As explained above, the communication terminal 2 in the information providing system according to the present embodiment photographs the usage type ID 6 for identifying the type of the used item 5 (S102), and From the usage type ID 6 for identifying the type and the installed model ID 8 for identifying the type of the specific installed equipment 7 on which the used item 5 is mounted, the procedure information related to the replacement and use of the specific used item 5 ( manual) is displayed on the display 218 of the communication terminal 2 (S105). As a result, even if there are multiple types of models on which the used item 5 is mounted, it is possible to provide the user with appropriate procedure information to be used in a specific mounted device 7 on which the used item 5 is mounted.

In addition, if there are multiple types of onboard equipment 7 that use the used item 5, model icons representing the multiple types of onboard equipment 7 are displayed on the display 218 (S1203), and a specific one of the multiple types of onboard equipment 7 is displayed. The mounted device type ID 8 for identifying the type of the mounted device 7 is photographed (S1204), and the specific mounted device 7 on which the used item 5 is mounted is specified (S1202). Thereby, the information providing system can repeatedly provide information to the user until appropriate procedure information is determined.

Each function of the above embodiments can be realized by one or more processing circuits. Here, "processing circuit" refers to a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, or an ASIC (Application Circuit) designed to execute each function explained above. Specific Integrated Circuit), DSP (digital signal processor), FPGA (field programmable gate array), and conventional circuit modules.

Although the present embodiment has been described above based on each embodiment, the present invention is not limited to the requirements shown in the above embodiments. These points can be changed without detracting from the gist of the present invention, and can be determined appropriately depending on the application thereof.

2 Communication terminal 3 Procedure information management device 4 Network 5 Used items 6 Used type ID (an example of used type information)
7 Installed equipment 8 Installed model type ID (an example of installed model type information)

Japanese Patent Application Publication No. 2014-164482

Claims (10)

a photographing means for photographing specific usage type information for identifying the type of the specific usage item;
a determination unit that determines whether there is a single type or a plurality of types of equipment on which the specific used product can be mounted, based on the photographed specific used product type information;
If there is only one onboard device that can mount the specific usage item, display procedure information that corresponds to the specific usage type information and indicate the procedure to be used for the onboard device, and If there are multiple types of onboard equipment on which the product can be mounted, display control means for displaying on-board model information representing the plurality of types of onboard equipment on the display means;
has
If there are multiple types of equipment that can be loaded with the above-mentioned specific items,
The photographing means photographs specific onboard device type information for identifying the type of a specific onboard device among the plurality of types of onboard devices;
The display control means corresponds to the photographed specific usage type information and the specific installed equipment type information, and a procedure indicating a procedure for using the specific used item for the specific installed equipment. A communication terminal characterized in that information is displayed on the display means. The display control means displays used items that are managed by associating predetermined usage type information for identifying the type of the predetermined used items and predetermined installed equipment type information for identifying the type of the predetermined mounted equipment. 2. The communication terminal according to claim 1, wherein, in the management information, the procedure information corresponding to the specific usage type information and the specific installed model type information is displayed on the display means. The photographing means photographs a specific loaded device among the plurality of types of loaded devices capable of mounting the specific used item displayed by the display control unit based on the used item management information,
The display control means displays on the display means specific installed model type information for identifying the type of the specific used equipment photographed by the photographing means and the procedure information corresponding to the used type information. The communication terminal according to claim 2 , characterized in that: The communication terminal according to any one of claims 1 to 3,
A communication terminal comprising receiving means for receiving information including the procedure information from a providing device that stores and manages the information. Any one of claims 1 to 4, wherein the display control means displays, as the procedure information, a manual for the specific device to use to replace or use the specific item. The communication terminal according to item 1. The usage type information is given in a form that includes pasting, printing, or marking on the used item, and the installed model type information is given in a form that includes pasting, printing, or marking on the installed equipment . The communication terminal according to any one of claims 1 to 5. 7. The communication terminal according to claim 1, wherein the usage type information and the installed model type information are information including a barcode and a two-dimensional barcode , respectively. A communication terminal according to any one of claims 1 to 7,
a procedure information management device that manages procedure information displayed by the communication terminal;
An information provision system having
The communication terminal is
a photographing means for photographing specific usage type information for identifying the type of the specific usage item;
a determination unit that determines whether there is a single type or a plurality of types of equipment on which the specific used product can be mounted, based on the photographed specific used product type information;
If there is only one onboard device that can mount the specific usage item, display procedure information that corresponds to the specific usage type information and indicate the procedure to be used for the onboard device, and If there are multiple types of onboard equipment on which the product can be mounted, display control means for displaying on-board model information representing the plurality of types of onboard equipment on the display means;
has
If there are multiple types of equipment that can be loaded with the above-mentioned specific items,
The photographing means photographs specific installed device type information for identifying a specific type of device used among the plurality of types of devices used,
The display control means corresponds to the photographed specific usage type information and the specific installed model type information, and displays the above-mentioned procedure for using the specific usage item for the specific usage equipment. An information providing system characterized by displaying procedure information on the display means. An information provision method performed by a communication terminal capable of photographing a predetermined item used by a predetermined device, the method comprising:
a photographing step of photographing specific usage type information for identifying the type of the specific usage item;
a determination step of determining whether there is a single type or multiple types of equipment on which the specific used product can be mounted, based on the photographed specific used product type information;
If there is only one onboard device that can mount the specific usage item, display procedure information that corresponds to the specific usage type information and indicate the procedure to be used for the onboard device, and If there are multiple types of onboard devices that can carry the product, a display control step of displaying on-board device type information representing the plurality of types of onboard devices on a display means;
has
If there are multiple types of equipment that can be loaded with the above-mentioned specific items,
The photographing step includes a process of photographing specific installed device type information for identifying a specific type of used device among the plurality of types of installed devices;
The display control step corresponds to the photographed specific usage type information and the specific installed equipment type information, and is a procedure for indicating a procedure for using the specific installed item for the specific used equipment. An information providing method comprising: displaying information on the display means. A program that causes a computer to execute the information providing method according to claim 9.