JP2018092228A - Information processing terminal, control method of information processing terminal and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a mechanism capable of performing display with high visibility for a user, by changing display of character data or image data corresponding to a two-dimensional code, depending on whether an information processing terminal for reading the two-dimensional code is used as a portable terminal, or used as a head mount display.SOLUTION: A control method comprises the steps of: determining whether an information processing device having imaging means is used as a portable terminal or a head mount display; displaying character data or image data corresponding to a two-dimensional code in a list, when used as the portable terminal; and displaying image data in which the character string data or the image data corresponding to the plurality of two-dimensional codes is overlapped on the plurality of two-dimensional codes of image data obtained by photographing the paper medium by the imaging means, respectively, when used as the head mount display.SELECTED DRAWING: Figure 4

Description

  The present invention relates to an information processing terminal, a control method for the information processing terminal, and a program, and in particular, depending on whether an information processing terminal that reads a two-dimensional code is used as a mobile terminal or a head-mounted display, The present invention relates to a technique for providing a mechanism capable of performing display with high visibility for a user by changing display of corresponding character data or image data.

  Although paperless printing is progressing through digitization of printed materials, there is still a great demand for paper media due to its high visibility. However, when confidential information is described in a printed document on a paper medium, the loss of the printed document may lead to information leakage. Further, there is a problem that it is desired to avoid leakage of confidential information even if a printed document on a paper medium is lost.

  Therefore, in Patent Document 1, confidential information in a print document is encrypted including authentication information and printed as a paper medium. A technique is described in which the printed document is photographed by a terminal such as a smartphone and read and the authentication information is input, whereby the decrypted document can be viewed on the terminal.

JP 2012-212210 A

  In Patent Document 1, when an encrypted document is viewed through a camera-equipped terminal such as a smartphone, the decrypted document can be confirmed only when viewed through the terminal. However, if the display on the terminal side is a terminal such as a smartphone, the screen area is limited and the visibility is low.

  Moreover, it is necessary to always hold it in the hand, which is a burden on the user because it is used like a magnifying glass.

  On the other hand, in the case of a terminal of the type generally worn on the head called HMD, by creating an augmented reality called AR, the display area is not limited, and a virtual world can be created in a natural state close to the human visual field. Can be produced. If it is such a terminal, the screen area is not limited like the above smartphone, and the decrypted document can be confirmed without the action of holding it in the hand, so the display method according to the type of terminal Was demanded.

  The present invention changes the display of character data or image data corresponding to the two-dimensional code depending on whether the information processing terminal that reads the two-dimensional code is used as a portable terminal or a head-mounted display. It is an object to provide a mechanism capable of performing display with high visibility.

  The present invention is an information processing terminal having photographing means, which is a paper medium on which characters or images are printed, and is processed and processed so that at least a part of the characters or the images cannot be recognized. Further, a reading unit that reads the two-dimensional code from the paper medium on which the two-dimensional code is printed on the character or the image using the photographing unit, and a character corresponding to the two-dimensional code read by the reading unit Display means for displaying data or image data, and determination means for determining whether the information processing terminal is used as a portable terminal or a head-mounted display. The display means is portable by the determination means. When it is determined to be used as a terminal, a list of character data or image data corresponding to a plurality of the two-dimensional codes is displayed. When it is determined to be used as a head-mounted display, a plurality of pieces of image data obtained by photographing the paper medium by the photographing unit using the character data or image data corresponding to the plurality of two-dimensional codes. The superimposed image data is displayed on the two-dimensional code.

  The present invention is also a method of controlling an information processing terminal having a photographing unit, wherein the reading unit of the information processing terminal is a paper medium on which characters or images are printed, and at least one of the characters or the images. A reading step of reading the two-dimensional code by using the photographing unit from a paper medium in which a plurality of two-dimensional codes are printed on the processed character or image. The display unit of the information processing terminal displays character data or image data corresponding to the two-dimensional code read by the reading step, and the determination unit of the information processing terminal is portable by the information processing terminal. A determination step for determining whether the information processing terminal is used as a terminal or a head-mounted display. If it is determined that it is used as a portable terminal, a list of character data or image data corresponding to a plurality of the two-dimensional codes is displayed, and if it is determined that it is used as a head mounted display, a plurality of Displaying image data obtained by superimposing the character data or image data corresponding to the two-dimensional code on a plurality of the two-dimensional codes of image data obtained by photographing the paper medium by the photographing unit. It is characterized by.

  In addition, the present invention is a program that can be read and executed by an information processing terminal having a photographing unit, and the information processing terminal is a paper medium on which characters or images are printed, and at least a part of the characters or the images Reading means for reading the two-dimensional code using the photographing means, from a paper medium in which a plurality of two-dimensional codes are printed on the processed character or image, Display means for displaying character data or image data corresponding to the two-dimensional code read by the reading means, and determination means for determining whether the information processing terminal is used as a portable terminal or a head mounted display And when the determination means determines that the display means is used as a portable terminal, a plurality of the display means Character data or image data corresponding to the dimension code is displayed in a list, and when it is determined that the data is used as a head mounted display, the character data or image data corresponding to a plurality of the two-dimensional codes is stored in the photographing unit. The image data superimposed on each of the plurality of two-dimensional codes of the image data obtained by photographing the paper medium is displayed.

  According to the present invention, depending on whether an information processing terminal that reads a two-dimensional code is used as a portable terminal or a head-mounted display, by changing the display of character data or image data corresponding to the two-dimensional code, A display with high visibility for the user can be performed.

1 is a system configuration diagram illustrating an example of a configuration of a print management system of the present invention. It is a block diagram which shows the hardware constitutions of the information processing apparatus applicable to the information processing terminal 110 and the authentication server 130 shown in FIG. It is a block diagram which shows an example of the hardware constitutions of the controller unit of the information processing terminal 110 shown in FIG. 1, and the authentication server 130. It is a figure which shows an example of the flowchart which shows an example of the display of the decoding document using the camera function according to the kind of terminal in this invention. It is a figure which shows an example of a user authentication screen. It is a figure which shows an example of the screen which hold | maintained the wearable camera over the encryption document. It is a figure which shows an example of the screen which held the smart phone over the encryption document. It is a figure which shows an example of the screen of the smart phone which displayed the decoding list.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a system configuration diagram showing an example of the system of the present invention.

  The system according to the embodiment of the present invention is configured by connecting an information processing terminal 110 and an authentication server 130 on a LAN 120.

  The LAN 120 is a local area network and indicates a network in a company or a home, but is not limited to this, and may be a public line or a Wi-Fi network.

The information processing terminal 110 is an information processing device used by a user, and can be applied to a terminal such as an HMD or a smartphone, and acquires a decrypted document or a decrypted list from the authentication server 130. It is a device.
Note that encryption in the present invention means that the display of character data and image data is not visually recognized by the user. For example, it means a masked state. Decoding in the present invention means that the user can visually recognize the display of character data and image data that are masked and cannot be visually recognized by the user.

  In this embodiment, as an example of the information processing terminal 110 used by the user, for example, a wearable camera or a smartphone is used. However, the present invention is not limited to this, and can be configured by various information processing apparatuses.

  The authentication server 130 is a server that authenticates whether the user who possesses the information processing terminal 110 is a user who can decrypt and view the encrypted document.

  Next, a hardware configuration applicable to the information processing terminal 110 and the authentication server 130 illustrated in FIG. 1 will be described with reference to FIG.

  FIG. 2 is a block diagram illustrating a hardware configuration of an information processing apparatus applicable to the information processing terminal 110 and the authentication server 130 illustrated in FIG. Since each apparatus has the same configuration, the description will be made using the same reference numerals.

  The CPU 201 comprehensively controls each device and controller connected to the system bus 204.

  In the ROM 202 or the external memory 212, a BIOS (Basic Input / Output System), an operating system program (hereinafter referred to as OS), which is a control program of the CPU 201, or a function executed by a server or each client, which will be described later Various programs are stored.

  The RAM 203 functions as a main memory, work area, and the like for the CPU 201.

  The CPU 201 implements various operations by loading a program necessary for execution of processing into the RAM 203 and executing the program.

  An input controller (input C) 205 controls input from the keyboard / touch panel 209 and the camera (image reading unit).

  A video controller (VC) 206 controls display on a display terminal (display) 211.

  The display may be a CRT display or a liquid crystal display.

  The memory controller (MC) 207 is a hard disk (HD) or floppy (registered trademark) disk (registered trademark) that stores a boot program, browser software, various applications, font data, user files, editing files, various data, and the like. Controls access to an external memory 212 such as a CompactFlash (registered trademark) memory connected to the (FD) or PCMCIA card slot via an adapter.

  A communication I / F controller (communication I / FC) 208 is connected to and communicates with an external device via the network LAN 103120, and executes communication control processing in the network. For example, Internet communication using TCP / IP is possible.

  Note that the CPU 201 enables display on the display 211 by executing outline font rasterization processing on a display information area in the RAM 203, for example.

  In addition, the CPU 201 enables a user instruction with a mouse cursor (not shown) on the display 211.

  A program for realizing the present invention is recorded in the external memory 212 and is executed by the CPU 201 by being loaded into the RAM 203 as necessary.

  Further, various data and various tables used by the program according to the present invention are stored in the external memory 212, and detailed description thereof will be described later.

  FIG. 3 is a diagram illustrating an example of a block diagram illustrating functions or hardware included in the information processing terminal 110 and the authentication server 130.

  The information processing terminal 110 includes an encrypted document decryption system communication control unit 304, a display device 305, and an input device 306.

  The encrypted document decryption system communication control unit 304 corresponds to the CPU 201 in FIG. 2, the display device 305 corresponds to the display 211 in FIG. 2, and the input device 306 includes the keyboard / touch panel 209 in FIG. Reading unit) 210.

  The display device 305 is an application example of display means for displaying character data or image data corresponding to the two-dimensional code read by the reading means.

  The authentication server 130 includes an authentication information storage unit 301, a document information storage unit 302, and a communication control unit 303.

  The document information storage unit 302 stores the decrypted document. Further, the authentication information storage unit 301 stores information on a combination of a user ID and password that permits user authentication.

  The communication control unit 303 corresponds to the CPU 201 in FIG. 2, and the authentication information storage unit 301 and the document information storage unit 302 correspond to the external memory 212 in FIG.

  Hereinafter, an example of processing of the decrypted document display system using the camera function corresponding to the type of terminal according to the present invention will be described with reference to the flowchart of FIG.

  In step S401, first, the information processing terminal 110 displays a user authentication screen illustrated in FIG. 5 on the display device 305 of the information processing terminal 110 in order to acquire information for authentication from the user.

  FIG. 5 is a diagram illustrating an example of a user authentication screen 501 (user authentication dialog) displayed on the display device 305 of the information processing terminal 110.

  On the user authentication screen 501 in FIG. 5, a user ID input field 502, a password input field 503, and an OK button 504 are displayed.

  When the information processing terminal 110 accepts input of a user ID and password by the user and accepts pressing of an OK button 504, the information processing terminal 110 transmits the input user ID and password to the authentication server 130 to request a user authentication. Is performed (step S402).

  Next, when the authentication server 130 receives the user ID and password from the information processing terminal 110 (step S403), the received user ID and password combination is stored in the authentication information storage unit 301 of the authentication server 130. It is determined whether the set of ID and password matches, and user authentication processing (user authentication means) is executed (step S404).

  Then, if the user authentication is successful, the authentication server 130 (authentication information storage unit 301) transmits authentication result information to the information processing terminal 110 (step S405).

  In step S <b> 406, the information processing terminal 110 receives authentication result information from the authentication server 130.

  In step S407, when it is determined that the “authentication result information” acquired in step S406 is “authentication success” (step S407: YES), the information processing terminal 110 proceeds to step S408.

  On the other hand, if it is determined that the “authentication result information” acquired in S406 is unsuccessful (not “authentication successful”) (step S407: NO), the information processing terminal 110 ends the process.

  In step S <b> 408, the information processing terminal 110 acquires document information from a printed paper medium document that has been encrypted using the camera function of the information processing terminal 110. Step S408 is a paper medium on which a character or an image is printed, and is processed so that at least a part of the character or the image becomes unrecognizable, and is two-dimensionally formed on the processed character or the image. This is an application example of reading means for reading the two-dimensional code from a paper medium on which a plurality of codes are printed using the photographing means.

  Here, in step S408, an example of a screen (FIG. 7) for reading a print document encrypted by the input device 306 of the information processing terminal 110 will be described.

  FIG. 7 is an example of a process for reading a print document encrypted by the input device 306 of the information processing terminal 110 in step S408.

  The QR code (registered trademark) printed on the print document 701 is read using the camera function of the smartphone 702 (corresponding to the information processing apparatus 110). In the print document 701, the ciphertext 602 is ciphertext [1] (described as “1” in a circle in the drawing) (ciphertext 1) and ciphertext [2] (“2” in a circle in the drawing). ), Ciphertext [3] (shown as “3” in a circle in the drawing), and ciphertext [4] (described as “4” in a circle in the drawing) (encrypted image 1) Figure to show. Then, a diagram in which a QR code (registered trademark) and an AR marker are printed on each of ciphertext [1], ciphertext [2], ciphertext [3], and ciphertext [4] is shown.

  In step S409, if it is determined that “encrypted document information exists” in the document information acquired in step S408 (step S409: YES), the information processing terminal 110 shifts the processing to step S410.

  On the other hand, when it is determined that the encrypted document information does not exist in the document information acquired in step S408 (step S409: NO), the information processing terminal 110 ends the process.

  In step S410, the information processing terminal 110 decrypts the encryption information of the document information acquired in step S408.

  Steps S409 to S410 will be specifically described. As an example of a method for printing encrypted information on a print document, a QR code (registered trademark) can be used. When a QR code (registered trademark) exists in a printed document, it can be determined that “exists” in determining whether the above-described encrypted document information exists, and encryption is performed based on the QR code (registered trademark). The decryption information can be decoded.

  If there are a plurality of QR codes (registered trademark) in the print document, each QR code (registered trademark) photographed in the camera is sequentially decoded. If it is desired to decrypt all encrypted information at once, a plurality of encrypted information (decrypted information display position, document information before encryption) may be included in one QR code (registered trademark). good. With this method, it is possible to decrypt a plurality of encrypted information at a time without photographing a plurality of QR codes (registered trademark) in a printed document.

  In step S411, the information processing terminal 110 acquires a display format determination method for displaying the document information decrypted in step S410.

  In step S412, the information processing terminal 110 determines that the determination method of the display format acquired in step S411 is “determination based on whether or not the information processing terminal is held” (step S412: YES). The process proceeds to step S413. On the other hand, if the information processing terminal 110 determines that the determination method of the display format acquired in S411 is not “determination based on whether or not the information processing terminal is held” (step S412: NO), the information processing terminal 110 performs the process. The process proceeds to step S416. Whether to determine whether or not to hold the information processing terminal is received from the user in advance on a setting screen or the like. Alternatively, the information of the acceleration sensor may be acquired in step S413 without performing the process of step S412, and if it is not held in the hand, the process may be determined based on the type of terminal in step S416.

  In step S413, the information processing terminal 110 acquires information on the acceleration sensor of the information processing terminal 110 in order to determine whether or not the user has the information processing terminal 110 in hand.

  In step S414, the information processing terminal 110 is in a state of movement that can be detected by the acceleration sensor from the information of the acceleration sensor acquired in step S413, and any one of inclination, impact, vibration, and the like is a predetermined value or more. If it is determined that there is a change and “holds the terminal in hand” (step S414: YES), the process proceeds to step S415. On the other hand, if it is determined that the display format determination method acquired in S413 does not hold the terminal (step S414: NO), the information processing terminal 110 shifts the processing to step S419.

  In step S415, the information processing terminal 110 displays the decrypted information in a list format (FIG. 8) on the display device 305 of the information processing terminal 110, and ends the process.

  Here, FIG. 8 will be described.

  8, all QR codes (registered trademark) are read by the input device 306 of the information processing terminal 110 in step S408, and the decoded information is displayed on the display device 305 of the information processing terminal 110 in step S415. FIG. The encrypted information read from the print document 701 in FIG. 7 is decrypted on the smartphone 801 and displayed in a list format. Specifically, when each QR code (registered trademark) is read, the ciphertext 1, the ciphertext 2, the ciphertext 3, and the cipher image 1 are decrypted and displayed.

  In step S416, when the information processing terminal 110 determines that the determination method of the display format acquired in step S411 is “determination based on terminal type” (step S416: YES), the processing proceeds to step S417. On the other hand, if it is determined that the determination method of the display format acquired in step S411 is not “determination based on terminal type” (step S416: NO), the information processing terminal 110 ends the process. Whether the determination is based on the type of terminal accepts the setting from the user in advance on the setting screen or the like.

  The reason why the process of step S417 is performed is that, for example, when a smartphone is attached to the HMD and used, it is necessary to determine the type of terminal. That is, it is a process for determining that the smartphone is an HMD when the smartphone is used on the HMD.

  In step S417, the information processing terminal 110 is a “terminal type information (the information processing terminal is used as an HMD) of the information processing terminal 110 in order to determine whether the terminal is an HMD (head mounted display) type terminal. Information indicating whether the terminal is in the form of being used in hand.

  In step S418, if the information processing terminal 110 determines that “the terminal is an HMD” from the terminal type information acquired in step S417 (step S417: YES), the processing proceeds to step S419. On the other hand, if the information processing terminal 110 determines that the terminal is not an HMD from the terminal type information acquired in step S417 (step S417: NO), the information processing terminal 110 proceeds to step S415. Step S418 is an application example of determination means for determining whether the information processing terminal is used as a portable terminal or a head mounted display.

  In step S419, the information processing terminal 110 displays the decoded information on the display device 305 of the information processing terminal 110 so as to be superimposed on the shooting information as augmented reality called AR (hereinafter referred to as AR). As an example of an AR implementation method, for example, as disclosed in JP-A-2006-71705, an AR marker is printed on a print document at the same location as the QR code (registered trademark) of encrypted information, and the AR marker is set to the AR code. There is a method of displaying decoded information as a display reference position in an overlapping manner. The AR marker may be printed separately from the QR code (registered trademark), or the QR code (registered trademark) may be used as the AR marker. After displaying the AR, the process is terminated.

  In step S415 and step S419, the display means displays a list of character data or image data corresponding to a plurality of the two-dimensional codes when it is determined that the display means is used as a portable terminal. When it is determined to be used as a mount display, the character string data or image data corresponding to a plurality of the two-dimensional codes is used as a plurality of pieces of image data obtained by photographing the paper medium by the photographing unit. This is an application example in which image data superimposed on the two-dimensional code is displayed.

  Next, an example of display of a decrypted document using a camera function corresponding to the type of terminal in the present invention will be described with reference to FIG.

  FIG. 6 is an example of reading a print document encrypted with the input device 306 of the information processing terminal 110 in step S408 and displaying the decrypted information on the display device 305 of the information processing terminal 110 in step S419. .

A print document 601 is a print document in which a QR code (registered trademark) of encryption information and an AR marker are printed.
The ciphertext 602 of the encrypted print document 601 read by the camera function of the HMD 603 is read, and the shooting information and the decrypted information are superimposed on the HMD 603 and displayed (print document 604). In this embodiment, the QR code (registered trademark) is read when displayed on the display device 305 of the smartphone, and the AR marker is read when displayed on the display device 305 of the HMD 603.

  In the print document 601, the ciphertext 602 is ciphertext [1] (described as “1” in a circle in the drawing) (ciphertext 1) and ciphertext [2] (“2” in a circle in the drawing). ), Ciphertext [3] (shown as “3” in a circle in the drawing), and ciphertext [4] (described as “4” in a circle in the drawing) (encrypted image 1) Figure to show. Then, a diagram in which a QR code (registered trademark) and an AR marker are printed on each of ciphertext [1], ciphertext [2], ciphertext [3], and ciphertext [4] is shown.

  In the print document 604, a diagram is shown in which the ciphertext B displays the captured information and the decrypted information in an overlapping manner.

  As described above, according to the present invention, the display of character data or image data corresponding to the two-dimensional code is changed depending on whether the information processing terminal that reads the two-dimensional code by the user is used as a portable terminal or a head-mounted display. Thus, it is possible to provide a mechanism capable of performing display with high visibility for the user.

  Although the embodiment of the present invention has been described above, the present invention can take an embodiment as a system, apparatus, method, program, recording medium, or the like. Specifically, the present invention may be applied to a system composed of a plurality of devices, or may be applied to an apparatus composed of a single device.

  The program according to the present invention is a program that allows a computer to execute the processing method of each flowchart, and the storage medium of the present invention stores a program that allows the computer to execute the processing method of each flowchart. The program in the present invention may be a program for each processing method of each device.

  As described above, a recording medium that records a program that implements the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU or MPU) of the system or apparatus stores the program stored in the recording medium. It goes without saying that the object of the present invention can also be achieved by reading and executing.

  In this case, the program itself read from the recording medium realizes the novel function of the present invention, and the recording medium recording the program constitutes the present invention.

  As a recording medium for supplying the program, for example, a flexible disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, DVD-ROM, magnetic tape, nonvolatile memory card, ROM, EEPROM, silicon A disk or the like can be used.

  Further, by executing the program read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) operating on the computer based on an instruction of the program is actually It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the processing and the processing is included.

  Furthermore, after the program read from the recording medium is written to the memory provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, the function expansion board is based on the instructions of the program code. It goes without saying that the case where the CPU or the like provided in the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

  The present invention may be applied to a system constituted by a plurality of devices or an apparatus constituted by a single device. Needless to say, the present invention can be applied to a case where the present invention is achieved by supplying a program to a system or apparatus. In this case, by reading a recording medium storing a program for achieving the present invention into the system or apparatus, the system or apparatus can enjoy the effects of the present invention.

  Furthermore, by downloading and reading a program for achieving the present invention from a server, database, etc. on a network using a communication program, the system or apparatus can enjoy the effects of the present invention. In addition, all the structures which combined each embodiment mentioned above and its modification are also included in this invention.

110 Information processing terminal 120 LAN
130 Authentication server

Claims (5)

An information processing terminal having photographing means,
A paper medium on which characters or images are printed, wherein at least part of the characters or the images are processed so that they cannot be recognized, and a plurality of two-dimensional codes are printed on the processed characters or images Reading means for reading the two-dimensional code from the paper medium using the photographing means;
Display means for displaying character data or image data corresponding to the two-dimensional code read by the reading means;
Determination means for determining whether the information processing terminal is used as a portable terminal or a head-mounted display,
The display means displays a list of character data or image data corresponding to a plurality of the two-dimensional codes when it is determined by the determination means to be used as a portable terminal, and is determined to be used as a head mounted display. In such a case, the character data or the image data corresponding to the plurality of two-dimensional codes are respectively superimposed on the plurality of two-dimensional codes of image data obtained by photographing the paper medium by the photographing unit. An information processing terminal characterized by displaying combined image data.   The determination unit determines that the information processing terminal is used as a portable terminal when the information processing terminal is held in a user's hand, and uses the information processing terminal as a head mounted display when the information processing terminal is not held in the user's hand. The information processing terminal according to claim 1, wherein it is determined that the information processing is performed.   If the value detected by the acceleration sensor included in the information processing terminal is greater than a predetermined value, the determination unit determines that the value is held in the hand, and if the value is smaller than the predetermined value, the determination unit determines that the value is not held in the hand. The information processing terminal according to claim 1, wherein the information processing terminal is determined. A method for controlling an information processing terminal having a photographing means,
The reading means of the information processing terminal is a paper medium on which a character or an image is printed, and is processed so that at least a part of the character or the image cannot be recognized, and the processed character or the image A reading step of reading the two-dimensional code from a paper medium having a plurality of two-dimensional codes printed thereon using the photographing means;
A display step in which the display means of the information processing terminal displays character data or image data corresponding to the two-dimensional code read by the reading step;
A determination step of determining whether the information processing terminal is used as a mobile terminal or a head-mounted display;
The display step of the information processing terminal displays a list of character data or image data corresponding to a plurality of the two-dimensional codes when the determination step determines that the information processing terminal is used as a portable terminal, and a head mounted display When it is determined that the character data or image data corresponding to a plurality of the two-dimensional codes is used, a plurality of the two-dimensional images of the image data obtained by photographing the paper medium by the photographing unit. A control method characterized by displaying image data superimposed on each code. There is a program that can be read and executed by an information processing terminal having a photographing means,
The information processing terminal
A paper medium on which characters or images are printed, wherein at least part of the characters or the images are processed so that they cannot be recognized, and a plurality of two-dimensional codes are printed on the processed characters or images Reading means for reading the two-dimensional code from the paper medium using the photographing means;
Display means for displaying character data or image data corresponding to the two-dimensional code read by the reading means;
Functioning as a determination means for determining whether the information processing terminal is used as a portable terminal or a head-mounted display;
The display means displays a list of character data or image data corresponding to a plurality of the two-dimensional codes when it is determined by the determination means to be used as a portable terminal, and is determined to be used as a head mounted display. In such a case, the character data or the image data corresponding to the plurality of two-dimensional codes are respectively superimposed on the plurality of two-dimensional codes of image data obtained by photographing the paper medium by the photographing unit. A program characterized by displaying combined image data.

Images