JP7247725B2 - Form processing device and mobile terminal device - Google Patents

Description

The present invention relates to a form processing device and a mobile terminal device.

Conventionally, it has an input unit for entering information into various entry fields of an electronic form (for example, an electronic version of a tax return) displayed on the display screen of an electronic device, and a printing unit for printing the electronic form. A form processing apparatus is known (see, for example, Patent Document 1). This form processing apparatus includes a detection unit that detects an electronic form in which there is a defect (error) in the input contents of an entry field, and a printing part that, when printing the electronic form, prints the entry field with a deficiency as a blank. In addition, a print control unit for printing an instruction sheet for instructing handwritten countermeasures for the deficiencies is further provided.

JP 2018-032231 A

In the conventional form processing apparatus disclosed in Patent Literature 1, when printing an electronic form, an instruction sheet for instructing how to deal with defects is printed on a separate sheet of paper, which increases the amount of paper used. There is

As a countermeasure to this problem, it is conceivable to print an instruction to deal with the inadequacies in the margin of the form or the like. However, since there are restrictions on the number of characters and the size of characters that can be written in the margins, etc., there is a possibility that the user will not be able to accurately grasp the contents of the correction. In addition, a form on which such a response instruction is printed lacks credibility and may not be accepted by the institution to which it is submitted. Therefore, the user needs to discard the form on which the response instruction is written and create a new form, resulting in an increase in the number of paper sheets used.

The present invention has been made in view of such a point, and its object is to efficiently correct the contents of the defects without wasting paper when there are defects in the contents of the entry fields of an electronic form. To provide a form processing device and a mobile terminal device that can be recognized by a user.

A form processing apparatus according to the present invention controls a deficiency detection unit that detects a deficiency in the contents of an entry field of an electronic form, a printing unit that prints out the electronic form on paper, and the printing unit. and a print control unit.

Then, when the defect detection unit detects a defect, the print control unit blanks the entry field in which the defect detection unit detects a defect when the printing unit prints the form on paper. A code image including specific information capable of identifying the content of the defect is attached to a predetermined portion of the form, and the printing unit executes printing.

The mobile terminal device according to the present invention is configured to be able to read the information of the code image printed on the paper by the printing unit of the form processing device.

The mobile terminal device includes a housing, a display unit provided on the front surface of the housing, an imaging camera provided on the rear surface of the housing, and an image captured by the imaging camera in real time. a code image detection unit for obtaining an image captured by the imaging camera and detecting whether or not the code image exists in the obtained image; and the code image detection unit. when the code image is detected by reading the specific information contained in the code image, creating an input auxiliary image including the read specific information or an entry example based on the specific information, and and an AR control unit that performs AR control for displaying an augmented reality space on the display unit by synthesizing the image with the real space displayed on the display unit.

According to the present invention, there is provided a form processing device and a mobile terminal device that can efficiently make a user recognize the contents of the incompleteness without wasting paper when there is a deficiency in the contents of the entry fields of an electronic form. to do.

FIG. 1 is an overall configuration diagram showing a form processing system including an MFP (an example of a form processing apparatus) according to this embodiment. FIG. 2 is a schematic configuration diagram of the MFP. FIG. 3 is a schematic configuration diagram of a mobile terminal. FIG. 4 is a flow chart showing an example of defect detection control executed by the controller of the MFP. FIG. 5 is a diagram showing an example of a mode selection screen displayed on the touch panel of the MFP. FIG. 6 is a diagram showing an example of a selection screen on which the user can select the type of form to be checked. FIG. 7 is a diagram showing an example of an entry on a user registration card. FIG. 8 is an explanatory diagram for explaining the contents of entry condition data when the form is a registration card. FIG. 9 is a diagram showing an example of a form printed together with a code image in the form check mode. FIG. 10 is a flowchart illustrating an example of defect content acquisition control by a mobile terminal. FIG. 11 is a schematic diagram showing an example of an augmented reality space displayed on the touch panel of the mobile terminal by AR control. FIG. 12 is a view corresponding to FIG. 11 showing a modification of the first embodiment. FIG. 13 is a view corresponding to FIG. 4 showing the second embodiment. FIG. 14 is a view corresponding to FIG. 7 showing another entry example of the user registration card.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in detail based on the drawings. In addition, the present invention is not limited to the following embodiments.

[overall structure]
FIG. 1 is a schematic diagram showing a form processing system 1 including an MFP 10, which is an example of a form processing apparatus according to this embodiment. This form processing system 1 includes a mobile terminal 20 and a form management server 30 in addition to the MFP 10 . The MFP 10 and the form management server 30 are connected via a network (such as the Internet) 40 so as to be able to transmit information.
The MFP 10 generates scan data of the form 100 handwritten by the user and determines whether or not the contents of the entry fields of the form 100 are defective. When the MFP 10 determines that the contents of the entry fields of the form 100 are incomplete, the MFP 10 blanks the entry fields with the inadequacies and attaches a code image G containing the incomplete information to the blanks to complete the form. Perform 100 prints. By reading the code image G attached to the printed form 100 with the mobile terminal 20, the user can recognize the content of the deficiency. The form management server 30 saves and manages the scan data of the form transmitted from the MFP 10.

[Configuration of MFP]
A specific configuration of the MFP 10 will be described with reference to FIG. This MFP 10 includes a touch panel 11 , a printing section 12 , a scanning section 13 , a hard disk 14 , a network interface 15 and a controller 16 . These are interconnected via a bus line (not shown).

The touch panel 11 displays operation items and various types of information for the MFP 10 and accepts user operations. The touch panel 11 is configured by, for example, a liquid crystal panel. A user can give various instructions to MFP 10 by operating touch panel 11 with a finger. The printing unit 12 prints an image on paper using an inkjet method or an electrophotographic method. The scanning unit 13 has an image reading sensor such as a CCD or a CIS, and scans a document (in this embodiment, a completed form 100) to generate image data (hereinafter referred to as scan data). The scanning unit 13 stores the generated scan data in the hard disk 14 or the like.

The hard disk 14 stores scan data and print data received from the outside. The hard disk 14 also pre-stores entry condition data used for defect detection control of the form 100, which will be described later.

The controller 16 consists of a microcomputer having a CPU, ROM, RAM and the like. The controller 16 receives a user's operation from the touch panel 11 and selectively switches the operation mode of the MFP 10 between the normal mode and the form processing mode.
In the normal mode, one function selected by the user from four tabs (not shown) of scanner function, print function, facsimile function and copy function displayed on the touch panel 11 can be selected and executed.
In the form processing mode, as will be described later, the MFP 10 functions as a detection device for detecting defects in the form 100 , and electronic data of the form 100 corrected by the user is transmitted to the form management server 30 . The controller 16 executes defect detection control of the form 100 in this form processing mode. Details of defect detection control by the controller 16 will be described later.

[Mobile device configuration]
Next, a specific configuration of the mobile terminal 20 will be described with reference to FIG. The mobile terminal 20 is, for example, a mobile phone (for example, a smart phone), a PDA, a notebook PC, a tablet PC, or the like.

The mobile terminal 20 includes a touch panel (display unit) 21 , a communication unit 22 , an imaging camera 23 and a hard disk 24 . These are interconnected via a bus line (not shown).

The touch panel 21 is a liquid crystal touch panel that displays operation items and various types of information for the mobile terminal 20 and receives user operations. The touch panel 21 is provided on the front surface of the housing of the mobile terminal 20 .
A user can give various instructions to the mobile terminal 20 by operating the touch panel 21 with a finger.

The communication unit 22 connects the mobile terminal 20 to the network 40 by wireless communication via an access point.
The image capturing camera 23 is provided on the back side of the housing of the mobile terminal 20, and is capable of capturing an image of the external situation using the camera function. The imaging camera 23 has a field of view on the rear side in the normal direction of the touch panel 11 . The imaging camera 23 is configured by, for example, a CCD camera, a CMOS sensor, or the like.

The hard disk 24 stores image data and the like captured by the imaging camera 23 . Various applications are stored in the hard disk 24 . In this embodiment, as an example of this application, a code analysis application 24a that decodes the code image G in the captured image and extracts information is stored.

The controller 25 consists of a microphone and a computer having a CPU, ROM and RAM. The controller 25 controls various operations of the mobile terminal 20 . The controller 25 displays an image captured by the imaging camera 23 on the touch panel 21 in real time.
The controller 25 then functions as a display control unit.

When the controller 25 determines that the image captured by the imaging camera 23 contains the code image G, the controller 25 activates the code analysis application 24a. The controller 25 cooperates with the code analysis application 24a to decode the code image G and obtain specific information that can identify the details of the incompleteness in the entry field. By displaying the acquired specific information on the touch panel 21, the controller 25 assists the user in correcting and writing in the entry fields.

[Defect detection control of forms by MFP]
Next, details of defect detection control of the form 100 executed by the controller 16 of the MFP 10 will be described with reference to FIG.

At step SA101, it is determined whether or not the user has selected the form check mode as the operation mode of the MFP10. This determination is made based on whether the user has selected the form check mode selection button 51 or the normal use mode selection button 52 on the mode selection screen 50 (see FIG. 5) displayed on the touch panel 11. . If the determination in step SA101 is NO (the user selects the normal use mode), the process returns. If the determination is YES (the user selects the form check mode), the process proceeds to step SA102.

At step SA102, the touch panel 11 displays a selection screen 60 (see FIG. 6) for the user to select the type of the form 100 to be checked.
FIG. 6 shows an example of this selection screen 60. As shown in FIG. In this example, the first button 61 for selecting the user registration card 70, the second button 62 for selecting the tax return form to be submitted to the tax office, and the moving-out notification for the local government are selected as the form 100 to be checked. A third button 63 for selection is displayed so as to be selectable. Also, at the top of the selection screen 60, a message prompting the user to scan the form 100 after selecting the type of the form 100 is displayed.
The user registration card 70 is, for example, an application form distributed by the manufacturer to collect customer information. A final tax return is a document used when filing an income report to the tax office. A moving-out notification is a document that must be submitted to the municipality before moving out when moving out due to moving or the like.
The user registration card 70, tax return office, and moving-out notification are examples of the form 100 to be checked by the form processing system 1, and the form 100 is not limited to these. FIG. 7 is a schematic diagram showing an entry example of the user registration card 70. As shown in FIG. The user registration card 70 has an address entry field 71, a name entry field 72, a phone number entry field 73, and a date of birth entry field 74. FIG.

Returning to FIG. 4, at step SA103, based on the selection signal from the touch panel 11, the type of form selected by the user at step SA102 is read.

At step SA104, it is determined whether or not the user has completed scanning of the form 100 by the scanning unit 13. If the determination is NO, the process returns, and if the determination is YES, the process proceeds to step SA105.

In step SA105, the scanning unit 13 performs image processing (for example, OCR processing) on the scan data (electronic form) generated by scanning the form 100, so that the input contents of each entry column of the form 100 are converted into characters. Get it as information.

At step SA106, entry condition data corresponding to the type of form 100 read at step SA103 is read from hard disk 24 of MFP10.
The hard disk 24 stores entry condition data for each type of form 100 (in this embodiment, for each of three types: the user registration card 70, the tax return form, and the notification of moving out). FIG. 8 shows entry condition data for the user registration card 70 as an example. The entry condition data is composed of four columns of item numbers, entry column names, printing positions of code images G, which will be described later, and entry conditions. In this entry condition data, for example, for the entry field of "name", two points are predetermined as entry conditions: (1) inserting a space between the name and the name; and (2) inserting a furigana. I understand.

At Step SA107, the entry contents of each entry column of the form 100 obtained at Step SA105 are compared with the entry condition data corresponding to the type of the form 100 called at Step SA106, so that any deficiencies in each entry column are detected. It is determined (detected) whether or not there is any (that is, whether or not there is anything that violates the content of the entry condition data). When this determination is NO, the process returns, and when the determination is YES, the process proceeds to step SA108. The controller 16 functions as a defect detector by executing the process of step SA107.

At step SA108, the entry fields determined to be inadequate in step SA107 are blanked, and a code image G is created based on the details of the inadequacies. The code image G contains illumination information that proves that the code image was printed by the printing unit 12 of the MFP 10 in addition to specific information that can specify the content of the defect. In this embodiment, as an example of the code image G, a QR code (registered trademark) is adopted. In this step SA108, the form 100 is printed by the printing unit 12 with the created code image G attached to the corner of the entry column where the defect is detected. The controller 16 then functions as the print control section of the present invention. FIG. 9 is a diagram showing a printed result of the form 100 when the form 100 is the user registration card 70 and a defect is detected in the entry field 73 for the telephone number. According to this figure, it can be seen that the code image G is printed in the lower left corner of the telephone number entry field 73 .
After completing the printing process in step SA108, the process returns.

[Details of acquisition control of deficiencies by mobile devices]
Next, with reference to FIG. 10, details of defect content acquisition control based on the code image G in the mobile terminal 20 will be described. The processing of steps SA201 to SA207 below is executed by the controller 25 of the mobile terminal 20. FIG.

In step SA201, it is determined whether or not imaging processing is being performed by the imaging camera 23 of the mobile terminal 20. If the determination is NO, the process returns, and if the determination is YES, the process proceeds to step SA202. The controller 25 functions as a code image detection unit by executing the process of step SA201.

At step SA202, it is determined whether or not the code image G exists in the image captured by the imaging camera 23. If the determination is NO, the process returns, and if the determination is YES, the process proceeds to step SA203.

At step SA203, the code analysis application 24a stored in the hard disk 24 is activated. Then, the description information of the code image G is obtained by decoding the code image G detected in step SA202 using the code analysis application 24a.

At step SA204, certification information created by the MFP 10 (information certifying that the code image G was printed in the form check mode of the MFP 10) is included in the description information of the code image G acquired at step SA203. ) is included. If this determination is NO, the process returns, while if the determination is YES, the process proceeds to step SA205.

At step SA205, specific information for identifying defects in the form 100 is extracted from the description information of the code image G acquired at step SA203.

At step SA206, it is determined whether or not a human hand is present in the image captured by the imaging camera 23 acquired at step SA201. This determination can be made based on an image processing technique such as pattern matching. If this determination is NO, the process proceeds to step SA208, and if YES, the process proceeds to step SA207.

At step SA207, an input auxiliary image H including the specific information extracted at step SA205 is created. By arranging and synthesizing the input auxiliary image H so as not to overlap the human hand with respect to the real space in the captured image, the touch panel 11 is caused to display the augmented reality space (see FIG. 11). Return later.

In step SA208, which is followed when the determination in step SA206 is NO, the input auxiliary image is arranged at a predetermined position (for example, near the lower side of the center of the screen) regardless of the position of the person's hand. Similarly, display the augmented reality space on the touch panel 11, and then return. Here, augmented reality is generally called AR (abbreviation of augmented reality), and the control of steps SA206 and SA207 corresponds to the AR control of the present invention.

FIG. 11 is an example of the augmented reality space displayed on the touch panel 11 by the process of step SA207. In this example, as an example of the input auxiliary image H, a balloon image that describes specific information that can identify the content of the deficiency is generated. Note that the input auxiliary image H is not limited to the balloon image, and may be an image in which an entry example of a number starting from the area code is entered in the entry column 73 as shown in FIG. 12, for example.

[Effect]
As described above, in the present embodiment, when the controller 16 of the MFP 10 detects an error in the entry field of the scan data (electronic form) of the form 100 read by the scanning unit 13 (determination in step SA107 is YES), when the form 100 is printed on paper by the printing unit 12, the entry column in which the deficiency is detected is blanked, and a code image containing specific information that can identify the content of the deficiency. It is configured to attach G to a predetermined portion of the form 100 and execute printing.
According to this configuration, the user can easily recognize the contents of the deficiencies in the entry fields of the form 100 by reading the contents of the code image G with the mobile terminal 20 or the like. Then, in this embodiment, as shown in FIG. 9, the entry column (telephone number entry column 73 in the example of FIG. 9) in which a defect is detected is printed blank, so correct information must be entered in this blank. Thus, the form 100 can be completed without wasting paper. Therefore, the number of sheets to be used can be saved. In addition, by converting the defective content into the code image G, it is possible to make the user recognize the defective content more efficiently than when describing the defective content in a document or printing it on a separate sheet of paper. . Therefore, the number of sheets used can be further reduced.

Further, in the present embodiment, the controller 16 forms the code image G near the inside of the outer edge of the entry field where the defect exists (see FIG. 9, for example).
According to this, the code image G becomes an obstacle when the user fills in the correct contents by handwriting in the entry field (the telephone number entry field 73 in the example of FIG. 9) that was printed as a blank due to the presence of a defect. never It should be noted that the code image G may be printed in the vicinity of the outer edge of the defective entry field. According to this, it is possible to reliably prevent the code image G from becoming an obstacle when the user re-enters the correct contents in the entry column.

Further, according to this embodiment, the code image G is a QR code image. The QR code can store multilingual data such as alphabets, kanji, hiragana, and katakana as well as numbers. Therefore, by using the QR code image as the code image G, it is possible to allow the user to accurately recognize the content of the inadequacies not by the error number or the like but by the text.

Further, in this embodiment, when the code image G is detected, the controller 25 of the mobile terminal 20 synthesizes the input auxiliary image H with the real space displayed on the touch panel 21 of the mobile terminal 20, and (steps SA207 and SA208).
According to this, the user, while looking at the augmented reality space displayed on the touch panel 21 of the mobile terminal 20 as shown in FIG. can be filled in with correct information. Therefore, correction entry by the user can be easily performed.

Further, in the present embodiment, the controller 25 of the mobile terminal 20 acquires an image captured by the imaging camera 23, determines whether an image of a human hand exists in the acquired captured image, and determines whether the image of the hand exists. If it is determined to exist (if the determination in step SA206 is NO), the input auxiliary image (balloon image H, entry example image I, etc.) is combined with the physical space so as not to overlap the hand image. is configured as follows.
According to this configuration, it is possible to prevent the input auxiliary image H from overlapping the hand of the user who fills in the entry field. Therefore, the input auxiliary image H can be arranged at a position where it is always easy to see.

Further, in this embodiment, the code image G includes certification information that certifies that the code image G was printed by the printing unit 12 of the MFP 10 . The controller 25 of the mobile terminal 20 determines whether or not the information of the code image G includes the certification information, and if it determines that the certification information is not included (the determination in step SA204 is NO ), the AR control is not executed.
According to this configuration, when the controller 25 detects the code image G that has nothing to do with the entry fields of the form 100, the AR control is executed unnecessarily and the user misunderstands it as a failure. can be prevented.

<<Embodiment 2>>
FIG. 13 is a view corresponding to FIG. 10 showing the second embodiment. In this embodiment, the content of the defect content acquisition control based on the code image G in the mobile terminal 20 is different from that in the first embodiment.

In FIG. 13, the processing of steps SB101 to SB107 is the same as the processing of steps SA101 to SA107 of the first embodiment, so detailed description thereof will be omitted.

At Step SB108, correction candidates for the content of the entry column determined to be incomplete at Step SB107 are estimated and listed. AI technology (artificial intelligence), for example, may be used for estimating correction candidates. The controller 16 functions as an estimation unit by executing the process of step SB108.

In step SB109, it is determined whether or not the number of correction candidates listed in step SB108 is plural. If the determination is NO, the process proceeds to step SB111, and if the determination is YES, the process proceeds to step SB110. .

In step SB110, as in step SA108 of the first embodiment, the entry field in which the deficiency is detected is blanked, and the content of the deficiency is converted into a code image G, attached to the corner of the entry field, and printed. 12 is executed.

In step SB111, which is followed when the determination in step SB109 is NO, one correction candidate listed in step SB108 is automatically entered into the entry column determined to be incomplete, and the printing unit 12 executes printing. Return later.

[Effect]
The effects of this embodiment will be described with reference to FIG. FIG. 14 is an example of an entry example of the user registration card 70 before checking by the MFP 10. As shown in FIG.

In this example, the name entry field 72 is defective in that the furigana is left blank, and the date of birth entry field 74 is defective in that it is written in the era name instead of the Western calendar. There is

Consider the processing after step SB108 when the controller 16 executes defect detection control for the scan data of the user registration card 70. FIG.

First, in the name entry field 72, the controller 16 presumably lists the kana of "Tomoko Yamada" as "Tomoko Yamada" and "Satoko Yamada" as correction candidates in the process of step SB108. In this case, since the number of correction candidates is two, the controller 16 determines YES in the next step SB109 and proceeds to step SB110. As a result, the form 100 is printed by the printing unit 12 with the incomplete entry fields 72 left blank.

On the other hand, in the date of birth entry field 74, the controller 16 corrects "September 6, 1974" as a correction candidate for "September 6, 1974" written in the era name in the process of step SB108. Enumerate presumably as candidates. In this case, the number of correction candidates is only this one, so the controller 16 determines NO in the next step SB109, proceeds to step SB111, and sets September 6, 1974, which is the correction candidate, as the date of birth. The entry field 74 is automatically entered.

[Effect]
As described above, according to the second embodiment, even if there is a defect in the contents of the entry field of the form 100, if the correction candidate for this defect is uniquely determined by the controller 16, this correction candidate is automatically entered in the entry field and confirmed. According to this, it is possible to quickly correct any inadequacies in the entry fields.

<<Other embodiments>>
In the above embodiment, a QR code is used as an example of the code image G, but the code image G is not limited to this. Code image G may be, for example, a barcode image.

In the above embodiment, the electronic form is scan data, but it is not limited to this. The electronic form may be created, for example, by keyboard entry into an electronic format of the form stored in a PC or the like.

Further, the specific information for specifying the deficiency in the entry column of the form 100 may be URL information indicating the location of information describing the content of the deficiency. Even if a QR code image is adopted as the code image G, the amount of information is limited, but if the incomplete information is stored on a server on the Internet, such limitation of the amount of information can be almost eliminated. can.

INDUSTRIAL APPLICABILITY As described above, the present invention is useful for form processing devices and mobile terminal devices.

G: Code image H: Input auxiliary image 10: MFP (form processing device)
12: printing unit 16: controller (display control unit, print control unit, code image detection unit, estimation unit)
20: Mobile terminal 21: Touch panel (display unit)
23: imaging camera 24: hard disk 24a: code analysis application 25: controller (AR control unit)
70: User registration card (form)
71: Address entry field (entry field)
72: Name entry field (entry field)
73: Telephone number entry field (entry field)
74: Date of birth entry field (entry field)
100: Form

Claims (8)

A form comprising a defect detection unit for detecting defects in the contents of entry fields of an electronic form, a printing unit for printing out the electronic form on paper, and a print control unit for controlling the printing unit. A processing device,
When the defect detection unit detects a defect, the print control unit blanks the entry field in which the defect detection unit detects a defect when the printing unit prints the form on a sheet of paper. a code image including specific information capable of specifying the content of the form, attached to a predetermined portion of the form, and the printing unit executes printing. The form processing device according to claim 1,
The form processing apparatus, wherein the predetermined location is located near the inner side or the outer side of the outer edge of the entry column of the form. The form processing device according to claim 1 or 2,
Further comprising an estimation unit for estimating and listing correction candidates for the deficiency based on the content of the entry field when the deficiency detection unit detects a deficiency in the content of the entry field,
Even if the defect detection unit detects the defect, the print control unit causes the printing unit to print the form if there is only one correction candidate for the defect listed by the estimation unit. At this time, without executing the printing of the code image, the one correction candidate is entered in the entry field in which the deficiency is detected by the deficiency detection unit, and the printing is executed. processing equipment. In the form processing device according to any one of claims 1 to 3,
The form processing device, wherein the specific information is URL information indicating the location of the information about the deficiency. In the form processing device according to any one of claims 1 to 4,
The form processing device, wherein the code image is a QR code image. A mobile terminal device capable of reading information of the code image printed on the paper by the printing unit of the form processing device according to any one of claims 1 to 5,
a housing;
a display unit provided on the front surface of the housing;
an imaging camera provided on the rear surface of the housing and having a field of view on the rear side in the normal direction of the display unit;
a display control unit for displaying an image captured by the imaging camera on the display unit in real time;
a code image detection unit that acquires an image captured by the imaging camera and detects whether or not the code image exists in the acquired captured image;
When the code image is detected by the code image detection unit, the specific information included in the code image is read, and an input auxiliary image including the read specific information or an entry example based on the specific information is created. and an AR control unit that performs AR control for displaying an augmented reality space on the display unit by synthesizing the input auxiliary image with the real space displayed on the display unit. In the mobile terminal device according to claim 6,
When executing the AR control, the AR control unit determines whether an image of a person's hand exists in the image captured by the imaging camera, and if it determines that the image of the hand exists, the input A mobile terminal device configured to synthesize an auxiliary image in the real space so as not to overlap the hand image. In the mobile terminal device according to claim 6 or 7,
The code image includes certification information that certifies that it was printed by the printing unit of the form processing device,
When the code image detection unit detects a code image, the AR control unit determines whether or not the code image information includes the certification information, and determines whether the certification information is included. A mobile terminal device configured not to execute the AR control when it is determined that the mobile terminal device does not exist.

Images