JP7149092B2 - Information processing system, information processing method, server, and program - Google Patents

Description

The present invention relates to an information processing system and an information processing method.

2. Description of the Related Art In recent years, there have been known printers that are communicably connected to a server on a network and configured to receive various services from the server. For example, Japanese Patent Application Laid-Open No. 2002-200001 describes a technique in which, when an error occurs in a printer as an information processing device, the printer notifies the server of the information about the error and downloads software for resolving the error from the server. is disclosed.

Japanese Patent Application Laid-Open No. 2004-240588

By the way, consumables for information processing equipment include not only those whose quality is guaranteed by the information processing equipment manufacturer (so-called genuine products), but also consumables whose quality is not guaranteed by the information processing equipment manufacturer. in circulation. Therefore, it is preferable for manufacturers of information processing devices to motivate users to purchase genuine products.

Accordingly, it is an object of one aspect of the present invention to provide a convenient service for users who acquire consumables whose quality is guaranteed by the manufacturer of the information processing apparatus.

An aspect of the present invention is an information processing system including a wireless communication terminal and a server capable of communicating with the wireless communication terminal, wherein the wireless communication terminal is a consumable item for an information processing apparatus, or A pasting member that is affixed to a packaging material used for packaging a product and displays predetermined information, an imaging unit that captures an image of the information processing device , and an augmented reality image provided by the server, and an image processing unit that superimposes an image of the information processing device obtained by the imaging unit on a display unit and displays the predetermined information obtained by the imaging unit of the wireless communication terminal. and an authentication processing unit that authenticates based on at least a part of the wireless communication terminal, based on the characteristic points of the information processing device obtained by the imaging unit of the wireless communication terminal when the authentication is successful. and an image specifying unit that specifies the augmented reality image to be provided.

According to one aspect of the present invention, it is possible to provide convenient services to users who acquire consumables whose quality is guaranteed by the manufacturer of the information processing apparatus.

It is a figure which shows an example of the consumables in the information processing system of embodiment. It is a figure showing a schematic structure of an information processing system of an embodiment. 1 is a block diagram showing the system configuration of an information processing system according to an embodiment; FIG. It is a figure which shows the data structural example of a consumables database. It is a figure which shows the data structural example of the database for AR. It is a sequence chart executed in the information processing system of the embodiment. It is a figure which shows the transition example of the screen displayed in the user terminal of embodiment. It is a figure which shows the usage example of a user terminal in the information processing system of embodiment. 1 is a perspective view of a state in which the inside of a printer according to an embodiment is exposed; FIG. It is a figure which shows the transition example of the screen displayed in the user terminal of embodiment. FIG. 11 is a diagram showing an example of transition of screens displayed on the user terminal in a modified example of the embodiment;

An information processing system 1 according to an embodiment of the present invention will be described below. In the following description, a printer is taken as an example of the information processing device.
In the information processing system 1 of the present embodiment, a sticker is attached as an example of a sticking member to a printer consumable whose quality is guaranteed by the printer manufacturer (hereinafter referred to as "genuine consumable"). The seal serves to ensure that the consumable to be attached is a genuine consumable, and also serves as an information medium for providing services to users of the genuine consumable. ing. The services provided to the user are AR (Augmented Reality) content provided via a network and effective information regarding a printer as an information processing device.
In the following, roll paper (hereinafter referred to as “roll paper” as appropriate) in which a label is rolled is taken as an example of a genuine consumable for a printer, but it is not limited to this. The genuine consumables may be any members as long as they are consumables for the printer, such as ink ribbons, platen rollers, thermal heads, and the like.

(1) Overall Configuration of Information Processing System 1 of Embodiment Hereinafter, the configuration of the information processing system 1 of the present embodiment will be described with reference to FIGS. 1 and 2. FIG. FIG. 1 is a diagram showing an example of roll paper 2 as a genuine consumable in an information processing system 1 of this embodiment. FIG. 2 is a diagram showing a schematic configuration of the information processing system 1 of this embodiment.

In the information processing system 1 of the present embodiment, the user of the printer 5, which will be described later, is provided with the roll paper 2, which is a genuine consumable, from the manufacturer of the printer 5. FIG. For example, the user of the printer 5 places an online order for the roll paper 2 with the manufacturer of the printer 5, and the manufacturer of the printer 5 ships the roll paper 2 to the user. At this time, as shown in FIG. 1, the roll paper 2 is packaged in an exterior bag 2a (an example of packaging material) and shipped with a seal 3 attached to the exterior bag 2a. Although FIG. 1 shows an example in which the seal 3 is affixed to the exterior bag 2a, the present invention is not limited to this, and the seal 3 is affixed directly to the roll paper 2, or attached to a management label of the roll paper 2. may be affixed.

In the following description, the state in which the seal 3 is attached to the roll paper 2 or the state in which the seal 3 is attached to the exterior bag 2a of the roll paper 2 as shown in FIG. is affixed to the roll paper 2."

As shown in FIG. 1, the sticker 3 has a label 31 and a security code 32 printed thereon. The sign 31 and security code 32 are examples of predetermined information.
Indicia 31 are distinctive characters, symbols, marks, indicia, logos, etc. created by the manufacturer of printer 5 . A mark 31 is provided on the seal 3 for the purpose of confirming that the seal 3 is a genuine seal by performing authentication on the server 6 side based on the characteristic points of the mark 31 .
The security code 32 is information for authenticating the user who purchased the roll paper 2 on the server 6 side.

As shown in FIG. 2 , the information processing system 1 of this embodiment includes a user terminal 4 (an example of a wireless communication terminal), a printer 5 and a server 6 . The user terminal 4, printer 5, and server 6 are connectable via a network NW.
The user terminal 4 is a mobile terminal used by the user of the printer 5, such as a smart phone or a tablet terminal. As shown in FIG. 2, the user terminal 4 is also used for the purpose of taking an image of the sticker 3. FIG.
The printer 5 is a printer for loading (setting) the roll paper 2 contained in the exterior bag 2a to which the seal 3 is attached.
The server 6 is a network server provided to provide various services to users of the printer 5 . In this embodiment, the server 6 has functions such as managing genuine consumables, authenticating the label 31 of the sticker 3 and the security code 32, and providing information to the user terminal 4, for example.

(2) Configuration of Each Unit of Information Processing System 1 of Embodiment Next, configurations of the user terminal 4, the printer 5, and the server 6 of the information processing system 1 of the present embodiment will be described with reference to FIG. FIG. 3 is a block diagram showing the system configuration of the information processing system 1 of this embodiment.

As shown in FIG. 3, the user terminal 4 includes, for example, a control unit 41, a storage 42, an operation input unit 43, a display unit 44, an audio input/output unit 45, an imaging unit 46, and a wireless communication unit 47.
The control unit 41 includes a microcomputer and memory (RAM (Random Access Memory), ROM (Read Only Memory)), and controls the operation of the user terminal 4 .
A microcomputer of the control unit 41 executes a web browser and an AR (augmented reality) application. The AR application is software that superimposes AR data (image data) on the image captured by the imaging unit 46 and displays the image. The control unit 41 is an example of an image processing unit.
The storage 42 is a storage device such as RAM and flash ROM. The storage 42 stores various application programs including web browsers and AR applications.

The operation input unit 43 is at least one of operation buttons provided on the housing of the user terminal 4 and touch input buttons provided on the touch panel input screen of the display unit 44 .
The display unit 44 includes, for example, a display panel such as an LCD (Liquid Crystal Display) and a drive circuit for displaying an image on the display panel. The display unit 44 functions as a finder when the imaging unit 46 operates.
The voice input/output unit 45 is voice input/output means including a microphone and a speaker.
The imaging unit 46 includes an imaging device such as a CCD (charged coupled device), CMOS image sensor, or the like, and captures an image of a subject. The control unit 41 temporarily records the captured image in the control unit 41 or records it in the storage 42 in accordance with an operation input to the operation input unit 43 .
The wireless communication unit 47 is an interface for communicating with the server 6 and other web servers via the network NW. In this embodiment, the wireless communication unit 47 transmits the image data of the sticker 3, the security code of the sticker 3, and the image data of the printer 5 to the server 6, and receives AR data and the like from the server 6. FIG.

As shown in FIG. 3, the printer 5 includes a control unit 51, a storage 52, an operation input unit 53, a display unit 54, and a wireless communication unit 55, for example. Note that the printer 5 may have a wired communication unit instead of the wireless communication unit 55 . In FIG. 3, printing-related components of the printer 5 are omitted.
The control unit 51 includes a microcomputer and memory (RAM, ROM) and controls the operation of the printer 5 . The microcomputer reads and executes the firmware stored in the ROM when the printer 5 is activated. Functions implemented by executing the firmware include generating print data to be supplied to a head driving section (not shown).

The storage 52 is a storage device such as memory (RAM, ROM). The storage 52 stores, for example, data received from the server 6 (for example, data for maintenance).
The operation input unit 53 is at least one of operation buttons provided on the housing of the printer 5 and touch input buttons provided on the touch panel input screen.
The display unit 54 includes, for example, a display panel such as an LCD, and a drive circuit for displaying an image on the display panel.
The wireless communication unit 55 communicates with the server 6 via the network NW to transmit and receive data.

The server 6 is a network server managed by the manufacturer of the printer 5, and includes, for example, a control section 61, storage 62, and communication section 63, as shown in FIG.
The control unit 61 includes a microcomputer and memory (RAM, ROM) and controls operations of the server 6 . The microcomputer reads and executes a service program stored in the ROM when the server 6 is started. Various services are provided to the user of the printer 5 by executing the service program.

The control unit 61 performs authentication processing based on the image data of the sticker 3 and the security code received from the user terminal 4 . Based on the image of the printer 5 received from the user terminal 4, the control unit 61 also performs a process of specifying AR data (to be described later) corresponding to the printer code of the printer 5, the unique shape of the printer 5, and the like.
The control unit 61 is an example of an authentication processing unit and an image specifying unit.

The storage 62 is a storage device such as HDD or SSD. The storage 62 stores security information for authentication, a consumables database and an AR database. The storage 62 also stores image data of the authenticity mark of the sticker 3 .

FIG. 4 shows an example of the data structure of the consumables database. As shown in FIG. 4, in the consumables database, each record consists of a 'user ID' field, a 'consumables code' field, and a 'security code' field. be.
The user ID is identification information that identifies the user who purchased the consumable. The consumables code is identification information (for example, label layout, ribbon type, product number, model, etc.) for specifying the type of consumables. The security code is written on a sticker attached to the consumable and is a code for authenticating the genuine consumable.
Each record in the consumables database is recorded when the consumables are shipped to the printer 5 user. That is, before shipping the roll paper 2 of FIG. 1 to the user, the manufacturer of the printer 5, as shown in FIG. (for example, "LR014") and the security code 32 printed on the seal 3 is recorded in the consumables database.

FIG. 5 shows an example of the data structure of the AR database. As shown in FIG. 5, the AR database is a database in which each record consists of data in a "printer code" field, a "printer part" field, a "feature point data" field, and an "AR data" field. .
The printer code is identification information (for example, product number, model, etc.) for specifying the type of printer.
The part of the printer indicates, for example, a characteristic part of the printer (a part having a unique shape of the printer).
The feature point data is data for authenticating the printer of the corresponding printer code, and is, for example, image data of the shape of the characteristic part of the printer (the shape unique to the printer). In the example of FIG. 5, feature point data and AR data are associated with each part of the printer. Note that FIG. 5 shows an example in which feature point data and AR data are associated one-to-one for each part of the printer, but this is not the only option. A plurality of corresponding AR data may be associated with each other. Examples of characteristic portions are the roll paper mounting portion, the ink ribbon mounting portion, etc., which are characteristic portions of the printer.

The AR data is image data for explaining, for example, how to operate the above-described characteristic portions of the printer of the corresponding printer code (for example, roll paper attachment portion, ink ribbon attachment portion), etc. / or character data or the like. The AR data is superimposed on the actual image of this characteristic site and used. The AR data preferably includes reference point data for superimposing on the actual image. For example, as shown in FIG. 5, feature point data and AR data are associated with each part of the printer, such as AR data corresponding to the roll paper attachment portion and AR data corresponding to the ink ribbon attachment portion. ing. For example, the AR data corresponding to the roll paper attachment part is superimposed on the image of the actual roll paper attachment part of the printer in which the inside of the printer is exposed in order to attach the roll paper to the roll paper attachment part of the printer. data.

The communication unit 63 communicates with the printer 5 via, for example, the network NW to transmit and receive data. In this embodiment, the communication unit 63 receives the image data of the sticker 3, the security code of the sticker 3, and the image data of the shape of the characteristic part of the printer 5 from the user terminal 4, and sends the AR to the user terminal 4. data for use, etc.

(3) Operation of the information processing system 1 of the embodiment Next, refer to FIGS. and explain.
FIG. 6 is a sequence chart executed in the information processing system 1 of this embodiment. FIG. 7 is a diagram showing a transition example of screens displayed on the user terminal 4 of this embodiment. FIG. 8 is a diagram showing a usage example of a user terminal in the information processing system 1 of this embodiment. FIG. 9 is a perspective view showing the interior of the printer 5 of this embodiment exposed. FIG. 10 is a diagram showing a transition example of screens displayed on the user terminal 4 of this embodiment.

The flowchart in FIG. 6 shows the processing after the roll paper 2 is delivered to the user of the printer 5. As described above, before the roll paper 2, which is a genuine consumable, ), a record corresponding to the roll paper 2 to be shipped is stored in advance in the consumables database in the storage 62 of the server 6 by the manufacturer of the printer 5 .

When the roll paper 2 is delivered to the user of the printer 5, the control unit 41 of the user terminal 4 detects the sticker attached to the roll paper 2 via the imaging unit 46 in response to the user's operation of instructing the user terminal 4 to take an image. 3 is acquired (step S10) and transmitted to the server 6 (step S12).
The control unit 61 of the server 6 that has received the image data of the sticker 3 extracts the feature points of the image of the sign 31 included in the image data, and compares the extracted feature points with the authentic sign stored in the storage 62 in advance. A matching process (an example of authentication process) with the feature points of the image No. 31 is performed.

As a result of the matching process, if it is determined that the sticker included in the image data transmitted in step S12 is not an authentic sticker (step S14: NO), the control unit 61 of the server 6 does not respond to the user terminal 4. do not do. As a result of the matching, when it is determined that the sticker included in the image data transmitted in step S12 is an authentic sticker (step S14: YES), the control unit 61 of the server 6 sends a URL (Uniform Resource) to the user terminal 4. Locator) information is returned (step S16). This URL information is information for accessing a web page provided by the manufacturer of the printer 5 to provide various services related to consumables.

The web browser of the user terminal 4 displays the web page based on the URL information received in step S16 (step S18). A screen G1 in FIG. 7 is an example of the screen of the web page displayed in step S18. The screen G1 is a screen for receiving an operational input of the security code 32 of the sticker 3. FIG.
When the user of the printer 5 on the screen G1 inputs the security code 32 displayed on the sticker 3 using the operation input unit 43, the control unit 41 of the user terminal 4 transmits the input security code 32 to the server 6 ( step S22).

The control unit 61 of the server 6 performs authentication processing based on the security code 32 received in step S22 (step S24). If the security code 32 received in step S22 does not match any security code recorded in the consumables database in the storage 62 (step S24: NO), the control unit 61 determines that authentication has failed. No response.
On the other hand, if the security code 32 received in step S22 matches the security code recorded in any record of the consumables database in the storage 62 (step S24: YES), the control unit 61 authenticates When it is judged as successful, the information for displaying the menu is transmitted (step S26). As described above, a security code is recorded in each record of the consumables database before the consumables are shipped to the user. It is possible to confirm whether or not the user is an authorized user who has purchased the genuine consumable.

The web browser of the user terminal 4 displays the web page illustrated on the screen G2 of FIG. 7 (step S28). This web page is a menu screen with multiple options.
An example of the menu displayed on the screen G2 consists of a group of buttons displaying "manual", "movie", "support", "order", and "matching confirmation". These button groups are provided to provide services related to consumables (roll paper in this embodiment) corresponding to the security code entered on the screen G1.

A “manual” button is a button for displaying an instruction manual related to the printer 5 and/or the roll paper 2 .
The "moving image" button is a button for displaying an image for augmented reality, and will be described later.
A "support" button is a button for guiding the call center.
The "order" button is a button for re-ordering the same roll paper as the roll paper attached with the seal used for authentication (that is, roll paper 2 in the present embodiment).
The “confirm matching” button is a button for providing information on other consumables such as ink ribbons that are matched with the roll paper 2 . It should be noted that "matching with the roll paper 2" means that the manufacturer of the printer 5 has confirmed that the quality such as color development, printing, stability (scratch resistance, durability) is OK. means that

Here, it is assumed that the user operates the "moving image" button on the screen G2 (step S30).
Upon recognizing that the “moving image” button has been operated, the control unit 41 of the user terminal 4 activates the AR software and operates the imaging unit 46 . As a result, images picked up by the imaging unit 46 are sequentially displayed on the display unit 44, as shown in the screen G3 of FIG. 7 (step S32). That is, the display section 44 functions as a finder.
As shown in the screen G4 of FIG. 8, the user is guided by the AR software so that an image of a unique shape obtained for each type of printer 5 in step S32 is included. For example, it is configured such that an instruction is given by display or voice to capture an image including the above-mentioned unique shape.
Examples of shapes unique to the type of printer 5 are shown in FIG. As shown in FIG. 9, when the inside of the printer 5 is exposed, the shape of the roll paper mounting portion 501 or the shape of the ink ribbon mounting portion 502 differs depending on the type of printer. is an example of a shape specific to . Note that the roll paper attachment portion 501 and the ink ribbon attachment portion 502 are merely examples of shapes specific to the printer 5, and are not intended to be limited to the portions illustrated in FIG.

The AR software of the user terminal 4 transmits the image data of the printer 5 acquired in step S32 to the server 6 (step S34).
The server 6 identifies the type of the printer 5 based on the image data of the printer 5 transmitted in step S34. Specifically, the control unit 61 of the server 6 collates (matches) the image data of the shape unique to the type of the printer 5 among the received image data of the printer 5 with the feature point data of each record of the AR database. processing) to specify the printer code of the printer 5 and the characteristic parts included in the image data of the printer 5 .
As a method of extracting feature points, a guide may be provided on the display unit 44 of the user terminal 4 as will be described later, or guidance may be given by voice.

The control unit 61 selects AR data corresponding to a specific portion of the printer 5 by performing matching processing based on the received image data, and transmits the selected AR data to the user terminal 4 .

Upon receiving the AR data, the AR software of the user terminal 4 superimposes the virtual image of the AR data on the actual image of the printer 5 captured by the imaging unit 46, thereby obtaining a real image and a virtual image. Augmented reality display (AR display) is performed by synthesizing (step S40).

An example of AR display is shown in FIG. Screens G5 to G7 in FIG. 10 are a series of images that are displayed in order, and are animations that guide the user of the printer 5 on how to install the roll paper. This animation may be repeatedly displayed.
In the screens G5 to G7 of FIG. 10, no roll paper is attached to the printer 5, which is the actual image captured by the imaging unit 46. Then, the AR image Iar, which is a virtual image of the virtual roll paper, is superimposed and displayed.
The AR image Iar preferably includes a character string Tar that describes how to attach the roll paper. By performing AR display as shown in FIG. 10, the user of the printer 5 can simultaneously see both the real image of the printer 5 and the virtual image displayed by AR based on the real image of the real object. , there is an advantage that the mounting method of the roll paper is much easier to understand than the conventional simple moving image display of the mounting method.

As described above, in the information processing system 1 of the present embodiment, the user terminal 4 of a user who has purchased a genuine consumable (roll paper in the example of the present embodiment) is given a It is configured to be able to display an augmented reality image related to genuine consumables through the medium of the sticker 3 .
Further, according to the information processing system 1 of the present embodiment, the user is provided with substantial information (see screen G2 in FIG. 7) such as a manual, support, order, and matching information for further user convenience. can do. In other words, the information processing system 1 of this embodiment also functions as a system that supports the operation of the printer 5 .
Therefore, users can be strongly motivated to acquire genuine consumables.

In the above-described embodiment, in order to specify the AR data corresponding to the printer 5 on the server 6 side, the type of the printer 5 is specified from the user terminal 4 to the server 6. A case of transmitting an image of a characteristic point such as the roll paper attachment portion 501 or the ink ribbon attachment portion 502 has been described. At this time, in order to assist the user in easily obtaining an image of the roll paper attachment portion 501 or the ink ribbon attachment portion 502, the display portion 54 functioning as a viewfinder displays the roll paper attachment portion 501 and/or the ink ribbon. A line corresponding to the contour of the attachment portion 502, a point prompting the focus position, a cross grid line, or the like may be displayed.

For example, as shown in the screen G8 of FIG. 11, when the user performs an operation to acquire an image of the roll paper attachment portion 501 or the ink ribbon attachment portion 502 through the user terminal 4, the roll paper attachment portion 501 and the ink ribbon attachment portion 502 are configured to display linear marks mk1 and mk2 respectively corresponding to the contours of . As shown in the screen G9, the user moves the user terminal 4 to align the roll paper mounting portion 501 with the mark mk1, for example, and performs an operation to acquire the image of the printer 5. FIG. This makes it easier to focus the imaging unit 46 on the roll paper mounting unit 501, so that image data suitable for selecting AR data can be transmitted to the server 6 more reliably.

Also, instead of the image of the part specifying the type of printer 5, an image of a marker unique to the type of printer 5 may be transmitted. Such a marker may be a marker displayed on the printer 5 in advance, or may be a sticker-like marker affixed to the printer 5 after the printer 5 is manufactured. In this case, the AR database of the server 6 associates the printer code with the feature point data of the marker.

Although the embodiments of the information processing system of the present invention have been described above, the present invention is not limited to the above embodiments. Also, the above embodiments can be modified and modified in various ways without departing from the gist of the present invention. For example, the technical matters described in any of the above embodiments can be applied in combination with other embodiments as appropriate.

For example, in steps S12 and S34 in the flowchart of FIG. is not. Alternatively, the user terminal 4 may extract feature points from the image data, and transmit the extracted feature point data (not limited to the image, but may be feature amount data) to the server 6. .

DESCRIPTION OF SYMBOLS 1... Information processing system 2... Roll paper 2a... Outer bag 3... Seal 31... Mark 32... Security code 4... User terminal 41... Control part 42... Storage 43... Operation input part 44... Display part 45... Voice input/output part 46 Imaging unit 47 Wireless communication unit 5 Printer 501 Roll paper attachment unit 502 Ink ribbon attachment unit 51 Control unit 52 Storage 53 Operation input unit 54 Display unit 55 Wireless communication unit 6 Server 61 Control Part 62... Storage 63... Communication part Tar... Character string Iar... Image for AR G1 to G9... Screen NW... Network mk1, mk2... Mark

Claims (10)

a wireless communication terminal;
a server communicable with the wireless communication terminal;
An information processing system comprising
The wireless communication terminal is
An attachment member that is attached to consumables of an information processing device or a packaging material used for packaging the consumables and displays predetermined information, and an imaging unit that captures an image of the information processing device;
an image processing unit that superimposes an augmented reality image provided by the server on the image of the information processing device obtained by the imaging unit and displays the image on a display unit;
The server is
an authentication processing unit that performs authentication based on at least part of the predetermined information obtained by the imaging unit of the wireless communication terminal;
an image identification unit that identifies the augmented reality image to be provided to the wireless communication terminal based on the feature points of the information processing device obtained by the imaging unit of the wireless communication terminal when the authentication is successful; has a
Information processing system. The imaging unit of the wireless communication terminal captures an image of a unique shape obtained for each type of the information processing device as a characteristic point of the information processing device,
The image identification unit of the server identifies a type of the information processing device based on a unique shape of the information processing device, and identifies an augmented reality image corresponding to the type.
The information processing system according to claim 1. The display unit functions as a finder and displays a line corresponding to the contour of the shape when the image capturing unit captures an image of the information processing device.
The information processing system according to claim 2. The information processing device includes a marker unique to each type of the information processing device,
the image capturing unit of the wireless communication terminal captures an image of the information processing device including the marker;
The image identification unit of the server identifies a type of the information processing device based on the image of the marker, and identifies an augmented reality image corresponding to the type.
The information processing system according to claim 1. The wireless communication terminal comprises a web browser,
the server transmits URL (Uniform Resource Locator) information to the wireless communication terminal when authentication based on at least part of the predetermined information is successful;
The web browser of the wireless communication terminal displays a web page for transmitting code information to the server on the display unit of the wireless communication terminal based on the URL.
The information processing system according to any one of claims 1 to 4. When authentication based on the code information by the server is successful, the web browser of the wireless communication terminal can select any one of a plurality of options for receiving provision of information related to the information processing device. view the page,
The information processing system according to claim 5. An information processing method between a wireless communication terminal having an imaging unit and a server capable of communicating with the wireless communication terminal,
The information processing method includes:
The imaging unit of the wireless communication terminal captures an image of the consumables of the information processing device or the pasting member on which predetermined information is displayed on the packaging material used for packaging the consumables, and the information processing device,
the server performs authentication based on at least part of the predetermined information obtained by the imaging unit of the wireless communication terminal;
When the authentication is successful, the server identifies an augmented reality image based on the feature points of the information processing device obtained by the imaging unit of the wireless communication terminal, and transmits the augmented reality image to the wireless communication device. provide to the terminal,
The wireless communication terminal displays the augmented reality image provided by the server in such a manner that it is superimposed on the image of the information processing device obtained by the imaging unit.
Information processing methods. A server communicable with a wireless communication terminal,
Acquiring from the wireless communication terminal the image of the information processing device and the consumables of the information processing device, or the pasted member that is attached to the packaging material used for packaging the consumables and on which predetermined information is displayed. an image acquisition unit that
an authentication processing unit that performs authentication based on at least part of the predetermined information obtained by the image acquisition unit ;
an image identification unit that identifies an augmented reality image to be provided to the wireless communication terminal based on the feature points of the information processing device obtained by the image acquisition unit when the authentication is successful;
a providing unit that provides the wireless communication terminal with the augmented reality image specified by the image specifying unit so as to be superimposed on the image of the information processing device and displayed;
A server with An information processing method performed by a server capable of communicating with a wireless communication terminal,
Acquiring from the wireless communication terminal the image of the information processing device and the consumables of the information processing device, or the pasted member that is attached to the packaging material used for packaging the consumables and on which predetermined information is displayed. death,
perform authentication based on at least part of the predetermined information obtained from the wireless communication terminal ;
identifying an augmented reality image to be provided to the wireless communication terminal based on the feature points of the information processing device obtained from the wireless communication terminal when the authentication is successful;
providing the specified augmented reality image to the wireless communication terminal so as to be superimposed on the image of the information processing device and displayed;
Information processing methods. in a computer in a server capable of communicating with a wireless communication terminal,
Acquiring from the wireless communication terminal the image of the information processing device and the consumables of the information processing device, or the pasted member that is attached to the packaging material used for packaging the consumables and on which predetermined information is displayed. let
Authenticate based on at least part of the predetermined information obtained from the wireless communication terminal ;
specifying an augmented reality image to be provided to the wireless communication terminal based on the feature points of the information processing device obtained from the wireless communication terminal when the authentication is successful ;
A program for causing the wireless communication terminal to provide the specified augmented reality image so as to be superimposed on the image of the information processing device and displayed.

Images