WO2018116422A1

WO2018116422A1 - Information processing device

Info

Publication number: WO2018116422A1
Application number: PCT/JP2016/088185
Authority: WO
Inventors: 順平大木
Original assignee: サン電子株式会社
Priority date: 2016-12-21
Filing date: 2016-12-21
Publication date: 2018-06-28

Abstract

This information processing device is provided with an image forming unit, an input unit, a notification unit, and a control unit. The control unit is provided with: an image acquisition unit which acquires image data representing an image that is formed by the image forming unit and that represents a document that includes first character information; an extraction unit which, by performing character recognition processing on the image represented by the acquired image data, extracts first character data representing the first character information of the document in the image; an input data acquisition unit which acquires second character data representing second character information inputted to the input unit; and a notification control unit which causes the notification unit to perform a notification operation in a specific case in which the first character information represented by the first character data and the second character information represented by the second character data do not match.

Description

Information processing device

The technology disclosed in this specification relates to an information processing apparatus that executes processing of character information.

For example, Japanese Unexamined Patent Application Publication No. 2007-108807 (hereinafter referred to as Patent Document 1) discloses a system including a delivery terminal carried by a delivery person and a Web server that can communicate with the delivery terminal. When the delivery person inputs the recipient identification information to the delivery terminal when the recipient is absent, the delivery terminal transmits the inputted recipient identification information to the Web server. The Web server uses the recipient identification information to identify the recipient's e-mail address registered in the Web server, and transmits the absent contact information to the identified e-mail address.

When a delivery person delivers a specific package such as a credit card, it is necessary to comply with a specific law related to the specific package. The delivery clerk asks the recipient to present his / her ID in accordance with certain laws, performs identity verification to confirm that the recipient is the person who should receive the package, and is confirmed to be the principal In some cases, deliver a specific package to the recipient. At that time, the person in charge of delivery records the character information described in the identification card presented by the recipient.

In such a situation, it is assumed that the delivery terminal and Web server of Patent Document 1 are used. In this case, when the person in charge of delivery inputs the character information described in the identification card of the recipient to the delivery terminal, the delivery terminal transmits character data representing the entered character information to the Web server. The Web server stores the received character data. However, there is a possibility that the person in charge of delivery erroneously inputs the character information described in the identification card to the delivery terminal. In the technique of Patent Document 1, a situation in which a delivery person erroneously inputs character information is not considered.

This specification discloses a technique that can appropriately notify the user that the input character information does not match the character information described in the document.

The information processing apparatus disclosed in this specification includes an image forming unit, an input unit, a notification unit, and a control unit. The control unit is an image formed by the image forming unit, and is represented by an image acquisition unit that acquires image data indicating an image representing a document in which the first character information is described, and the acquired image data. By performing character recognition processing on the image, an extraction unit that extracts first character data representing first character information described in a document in the image, and a second input to the input unit An input data acquisition unit that acquires second character data representing character information; first character information represented by first character data; second character information represented by second character data; A notification control unit that causes the notification unit to perform a notification operation in a specific case where the two do not match.

According to the information processing apparatus described above, the first character information represented by the first character data extracted from the image by the character recognition process and the second character information input to the input unit do not match In this case, the notification operation is executed. By performing the notification operation, the user of the information processing apparatus can know that the second character information does not match the first character information. Therefore, the information processing apparatus can appropriately notify the user that the input character information does not match the character information described in the document.

Here, the “image forming unit” includes a camera, a scanner, and the like. The “input unit” includes a keyboard, a touch panel, and the like. The “notification unit” includes a display, a speaker, and the like, and the “notification operation” includes an operation for displaying a warning screen on the display, an operation for outputting a warning sound from the speaker, and the like. The above-mentioned “document” includes a driver's license, a membership card, an identification card such as a passport, various tickets, etc., and the “first character information” is a unique number written on the identification card, ticket, etc. including. The “information processing apparatus” may be a system including a terminal device and a server capable of communicating with the terminal device, or may be a single terminal device. The “information processing apparatus” is not limited to an apparatus used in a situation where a specific package is delivered, and is an apparatus used in a situation where a document such as an identification card or a ticket is presented from a third party. Also good.

The control unit further selects the second character data when the first character information represented by the first character data matches the second character information represented by the second character data. You may provide the memory | storage control part memorize | stored in a memory | storage device.

Here, the “storage device” is a device such as a semiconductor memory or a hard disk drive. The device may be provided in the terminal device, or may be connected to the terminal device via a network (for example, a LAN (abbreviation of Local Area Network), the Internet, etc.). The “storage device” may be either a volatile storage device or a nonvolatile storage device. According to said structure, when 1st character information and 2nd character information correspond, 2nd character data can be memorize | stored in a memory | storage device.

The information processing apparatus may include a terminal device and a server that can communicate with the terminal device. The terminal device includes an image forming unit, an input unit, a notification unit, and a terminal control unit, and the terminal control unit includes an image acquisition unit, an extraction unit, an input data acquisition unit, a notification control unit, The extraction unit further transmits the extracted first character data to the server, the input data acquisition unit further transmits the acquired second character data to the server, and the notification control unit In the specific case where the first character information and the second character information do not match and the notification instruction is received from the server, the notification unit may perform the notification operation. The server includes a server control unit, the server control unit receiving a first character data from the terminal device, a second receiving unit receiving the second character data from the terminal device, A determination unit that determines whether or not the first character information represented by the received first character data matches the second character information represented by the received second character data; A transmission unit that transmits a notification instruction to the terminal device when it is determined that the first character information and the second character information do not match in the unit.

Here, the “server” is communicably connected to the terminal device via a network (for example, LAN, Internet, etc.). According to said structure, a terminal device transmits the extracted 1st character data to a server. For this reason, the communication load between the terminal device and the server can be reduced as compared with other configurations in which the terminal device transmits image data to the server and causes the server to execute character recognition processing. In addition, the “server” may be configured by a single device or may be configured by a plurality of devices that can communicate with each other. Generally speaking, the server receives first character data from the terminal device, receives second character data from the terminal device, and first character information represented by the received first character data. And the second character information represented by the received second character data are determined to match, and it is determined that the first character information and the second character information do not match As long as the notification instruction can be transmitted to the terminal device, it may have an arbitrary configuration.

The terminal device further includes a frame that can be mounted on the user's head, and the image forming unit includes a camera that is mounted on the frame and can capture a range corresponding to the field of view of the user wearing the frame. Includes a display device mounted on the frame and disposed at a position facing at least one of the right eye and the left eye of the user wearing the frame, and the notification operation is performed on the display device with the first character information and the second character information. It may also include displaying notification information related to the fact that the character information does not match.

According to this configuration, if the user views the document with the terminal device mounted on the head (that is, enters the view range), the terminal device can acquire image data indicating an image representing the document.

Note that a control method, a computer program, and a computer-readable recording medium storing the computer program for realizing the information processing apparatus are also novel and useful.

1 shows a schematic diagram of an information processing system. 1 shows a configuration of an information processing system. The flowchart of the apparatus process which the control part of an image display apparatus performs is shown. The flowchart of the server process which the control part of a server performs is shown. A case A1 where the character information does not match and a case A2 where the character information matches are shown.

(Example)
(Configuration of information processing system 2; FIGS. 1 and 2)
An information processing system 2 shown in FIG. 1 is a system for processing and managing various information input when a delivery person (that is, a user of the information processing system 2) D1 delivers a credit card to a customer C1. . The information processing system 2 includes an image display device 4, a keyboard 8, and a server 100. The image display device 4 and the server 100 can communicate with each other via the Internet 60. The image display device 4 and the keyboard 8 can communicate with each other by short-range wireless communication.

(Configuration of image display device 4; FIGS. 1 and 2)
The image display device 4 shown in FIG. 1 is a so-called head mounted display that is used by being attached to the head H1 of the delivery person D1. The image display device 4 includes a support 6,

display units

10 a and 10 b,

projection units

11 a and 11 b, a first camera 12, a second camera 14, and a control box 16.

The support 6 is a spectacle frame-shaped member. The delivery person D1 can wear the image display device 4 on the head by wearing the support 6 so as to wear glasses.

The

display units

10a and 10b are translucent display members, respectively. When the delivery person D1 wears the image display device 4 on the head, the display unit 10a is arranged at a position facing the right eye of the delivery person D1, and the display unit 10b is arranged at a position facing the left eye. Hereinafter, the left and

right display units

10a and 10b may be collectively referred to as the display unit 10. In the present embodiment, the delivery person D1 can visually recognize the surroundings through the display unit 10.

Projection units

11a and 11b are members that project images onto the

display units

10a and 10b. The

projection units

11a and 11b are provided on the side portions of the

display units

10a and 10b. Hereinafter, the left and

right projection units

11a and 11b may be collectively referred to as the projection unit 11. In the present embodiment, the projection unit 11 projects a predetermined object image on the display unit 10 in accordance with an instruction from the control unit 30. As a result, the delivery person D1 can see the real-world object as if the object image was synthesized at a predetermined position in the space or / and the real-world object that the delivery person D1 can visually recognize through the display unit 10. Or / and space and object images can be seen. Hereinafter, in this specification, when it is explained that the control unit 30 displays a desired screen on the display unit 10 by instructing the projection unit 11 to project an image, the operation of the projection unit 11 will be described. It may be omitted and simply expressed as “the control unit 30 causes the display unit 10 to display a desired image”.

The first camera 12 is a camera disposed in the support 6 at a position above the display unit 10a (that is, a position corresponding to the right eye of the delivery person D1). On the other hand, the 2nd camera 14 is a camera arrange | positioned among the support bodies 6 in the upper position of the display part 10b (namely, position corresponding to the left eye of the delivery person D1). The first camera 12 captures a range corresponding to the visual field range of the user's right eye. The second camera 14 captures a range corresponding to the visual field range of the user's left eye.

The control box 16 is attached to a part of the support 6. The control box 16 accommodates each element that controls the control system of the image display device 4. Specifically, as shown in FIG. 2, the control box 16 stores a network interface 20, a short-range communication interface 22, a control unit 30, and a memory 32. Hereinafter, the interface is described as “I / F”. In another example, the control box 16 may be provided separately from the support 6. In that case, each component (network I / F 20, control unit 30, memory 32) in the control box 16 and each component (projection unit 11, cameras 12, 14) provided on the support 6 are connected by cables or the like. As long as it is electrically connected. In addition, instead of the cable, each component (network I / F 20, control unit 30, memory 32) in the control box 16 and each component (projection unit 11, camera) provided in the support 6 are performed by wireless communication. 12, 14) may be communicable.

The network I / F 20 is an I / F for executing wireless communication with a device (for example, the server 100) on the Internet 60. The short-range communication I / F 22 is an I / F for performing short-range communication with an external device (for example, the keyboard 8) located around the image display device 4. The short-range communication is, for example, Bluetooth communication conforming to the Bluetooth (registered trademark of Bluetooth SIG) standard.

The control unit 30 executes various processes according to the main program 34 stored in the memory 32. Details of processing executed by the control unit 30 will be described in detail later. Further, as shown in FIG. 2, the control unit 30 includes a display unit 10, a projection unit 11, a first camera 12, a second camera 14, a network I / F 20, a near field communication I / F 22, and a memory 32. And the operation of each of these elements can be controlled.

The memory 32 stores a character recognition program 36 in addition to the main program 34. The character recognition program 36 is a program for executing a character recognition process (so-called OCR (abbreviation of Optical Character 画像 Recognition)) for images formed by the

cameras

12 and 14. The character recognition process is a process of analyzing an image, detecting a pattern of character information included in the image, and extracting the character information as character data (for example, a character code such as Unicode).

(Configuration of keyboard 8; FIGS. 1 and 2)
A keyboard 8 shown in FIG. 1 includes a plurality of keys for inputting instructions, character information, and the like to the image display device 4. In another example, the keyboard 8 may be a keyboard and a touch panel mounted on a portable terminal such as a tablet terminal or a smartphone. In another example, the keyboard 8 may be attached to the support 6 of the image display device 4.

(Configuration of server 100; FIGS. 1 and 2)
The server 100 shown in FIG. 1 is installed on the Internet 60 by the vendor of the image display device 4. The server 100 includes a control unit 130 and a memory 132. The control unit 130 executes various processes according to the program 134 stored in the memory 132. The memory 132 also has an area for storing various information generated in accordance with the processing of the control unit 130 (for example, server processing in FIG. 4 described later).

(Situation in which the information processing system 2 is used; FIG. 1)
Here, a situation where the information processing system 2 of the present embodiment is used will be described. When delivering the credit card (not shown), the delivery person D1 requests the customer C1 to present the identification card 50 in order to confirm that the customer C1 is the person who should receive the credit card. The delivery person D1 inputs the identification character information 54 described in the predetermined frame 52 of the presented identification card 50 to the keyboard 8. As a result, the image display device 4 transmits input character data representing input character information to the server 100 via the Internet 60.

On the other hand, when the delivery person D1 views the identification card 50 through the display unit 10 of the image display device 4, the

cameras

12 and 14 take the identification card 50. As a result, the image display device 4 acquires an image of the identification card 50 photographed by the

cameras

12 and 14. Next, the image display device 4 performs character recognition processing on the photographed image of the identification card 50 and extracts recognized character data representing the identification character information 54 described in the identification card 50. The image display device 4 transmits the recognized character data to the server 100 via the Internet 60.

The server 100 determines whether or not the input character data matches the recognized character data. If the input character data does not match the recognized character data, the server 100 transmits a warning instruction for displaying a warning screen on the display unit 10 of the image display device 4 to the image display device 4. Thereby, the delivery person D1 can know that the character information different from the identification character information 54 has been inputted to the keyboard 8 by looking at the warning screen. On the other hand, when the input character data matches the recognized character data, the server 100 stores the input character data.

(Device processing; FIG. 3)
With reference to FIG. 3, the content of the apparatus process which the control part 30 of the image display apparatus 4 performs is demonstrated. When the delivery person D1 attaches the image display device 4 to his / her head and turns on the power of the image display device 4, the control unit 30 starts the process of FIG.

In S10, the control unit 30 monitors whether a predetermined input start instruction is input to the keyboard 8 via the short-range communication I / F 22. The input start instruction is an instruction for starting input of character information. The delivery person D1 can input an input start instruction to the keyboard 8. When an input start instruction is input to the keyboard 8, the control unit 30 determines YES in S10 and proceeds to S12.

In S12, the control unit 30 causes the display unit 10 to display a predetermined character display screen. The character display screen is a screen for displaying character information input to the keyboard 8 (hereinafter referred to as “input character information”). The delivery person D1 inputs character information (that is, identification character information 54 described on the presented identification card 50) to the keyboard 8 while looking at the character display screen.

In S14, the control unit 30 acquires input character data representing input character information input from the keyboard 8 to the keyboard 8 via the short-range communication I / F 22.

In S16, the control unit 30 acquires image data indicating an image representing the identification card 50. In S 12 and S 14, the delivery person D 1 inputs character information while looking at the identification card 50 through the display unit 10. At that time, the

cameras

12 and 14 take an image of the identification card 50 existing in the field of view of the delivery person D1. Thereby, in S20, the control unit 30 acquires image data representing an image of the identification card 50 photographed by the

cameras

12 and 14.

In S18, the control unit 30 uses the character recognition program 36 to execute character recognition processing on the image represented by the acquired image data. Specifically, the control unit 30 detects a predetermined frame 52 arranged at a predetermined position according to a predetermined format of the identification card 50 from the image. The control unit 30 performs a character recognition process on the identification character information 54 in the predetermined frame 52. Thereby, the control unit 30 extracts recognized character data representing the identification character information 54 described in the identification card 50.

In S20, the control unit 30 transmits both the input character data acquired in S14 and the recognized character data acquired in S22 to the server 100 via the network I / F 20.

In S22, the control unit 30 determines whether or not a warning instruction is received from the server 100. The warning instruction is an instruction for causing the display unit 10 to display a warning screen indicating that the input character information represented by the input character data does not match the identification character information 54 represented by the recognized character data. The warning instruction is transmitted from the server 100 to the image display device 4 when the server 100 determines that the input character information represented by the input character data does not match the identification character information 54 represented by the recognized character data. . When receiving the warning instruction from the server 100, the control unit 30 determines YES in S22, and proceeds to S24. In S24, the control unit 30 causes the display unit 10 to display a predetermined warning screen according to the warning instruction. When S24 ends, the control unit 30 returns to the monitoring of S10.

On the other hand, when receiving an OK instruction from the server 100, the control unit 30 determines NO in S22, and proceeds to S26. The OK instruction is an instruction for causing the display unit 10 to display an OK screen indicating that the input character information represented by the input character data matches the identification character information 54 represented by the recognized character data. The OK instruction is transmitted from the server 100 to the image display device 4 when the server 100 determines that the input character information represented by the input character data matches the identification character information 54 represented by the recognized character data. In S 26, the control unit 30 displays a predetermined OK screen on the display unit 10 according to the OK instruction. When S26 ends, the control unit 30 returns to the monitoring of S10.

(Server processing; Fig. 4)
With reference to FIG. 4, server processing executed by the control unit 130 of the server 100 will be described. When the server 100 is turned on, the control unit 130 starts the process of FIG.

In S50, the control unit 130 monitors reception of input character data and recognized character data from the image display device 4. When the control unit 130 receives the input character data and the recognized character data from the image display device 4 within a predetermined period, the control unit 130 determines YES in S50 and proceeds to S52.

In S52, the control unit 130 compares the input character information represented by the input character data with the identification character information 54 represented by the recognized character data, and determines whether or not they match. If the control unit 130 determines that both match, the control unit 130 determines YES in S52 and proceeds to S54. On the other hand, when determining that the two do not match, the control unit 130 determines NO in S52 and proceeds to S58.

In S54, the control unit 130 stores the input character data representing the input character information in a predetermined storage area of the memory 32.

In subsequent S 56, the control unit 130 transmits a predetermined OK instruction to the image display device 4. As described above, the OK instruction is an instruction for displaying a predetermined OK screen on the display unit 10 of the image display device 4. When S56 ends, the control unit 130 returns to the monitoring of S50.

On the other hand, in S58, the control unit 130 transmits a predetermined warning instruction to the image display device 4. As described above, the warning instruction is an instruction for displaying a predetermined warning screen on the display unit 10 of the image display device 4. When S58 ends, the control unit 130 returns to the monitoring of S50.

The control unit 130 transmits the input character data stored in the predetermined storage area in S54 to the service server (not shown) of the credit card company at a predetermined timing. When the customer C1 orders a credit card, the customer C1 transmits the identification character information 54 of the identification card 50 to the credit card company. The credit card company registers the identification character information 54 transmitted from the customer C1 in the service server. When the service server receives character data representing character information that matches the registered identification character information 54, the service server notifies the credit card company that the delivered customer C1 is the person who ordered the credit card.

(Specific case: Fig. 5)
With reference to FIG. 5, specific cases A1 and A2 realized by the processes of FIGS. 3 and 4 will be described.

(Specific case A1 in which the character information does not match; FIG. 5)
Case A1 is a case where character information (that is, input character information and identification character information 54) does not match. In T100, the image display device 4 receives input instruction (YES in S10 in FIG. 3), and input character information different from the identification character information “123456789” of the identification card 50 via the keyboard 8. The input of “113456789” is accepted. In T102, the image display device 4 acquires input character data representing the input character information “113456789” from the keyboard 8 (S14).

At T110, the image display device 4 photographs the identification card 50. At T112, the image display device 4 acquires image data indicating an image representing the identification card 50 photographed by the cameras 12 and 14 (S16).

At T 114, the image display device 4 executes character recognition processing on the image represented by the acquired image data, and recognizes recognized character data representing the identification character information “123456789” described in the identification card 50. Extract (S18).

At T120, the image display device 4 transmits both the input character data acquired at T102 and the recognized character data extracted at T114 to the server 100 (S20).

At T130, the server 100 determines that the input character information “113456789” represented by the input character data does not match the identification character information “123456789” represented by the recognized character data (NO in S52 of FIG. 4). ). In subsequent T134, the server 100 transmits a warning instruction to the image display device 4 (S58).

At T140, the image display device 4 displays a warning screen on the display unit 10 in accordance with the warning instruction received from the server 100 (YES in S22 of FIG. 3) (S24). The delivery person D1 can know that the input character information (T100) input by the delivery person D1 does not match the identification character information 54 by looking at the warning screen displayed on the display unit 10.

(Specific case A2 in which character information matches; FIG. 5)
Case A2 is a case where character information (that is, input character information and identification character information 54) matches. In T200, the image display device 4 accepts the input start instruction (YES in S10 of FIG. 3), and the input character information “123456789” that is the same as the identification character information “123456789” of the identification card 50 is received via the keyboard 8. "123456789" is received. In T202, the image display device 4 acquires input character data representing the input character information “123456789” from the keyboard 8 (S14).

T210 to T220 are the same as T110 to T120. In T230, the server 100 determines that the input character information “123456789” represented by the input character data matches the identification character information “123456789” represented by the recognized character data (YES in S52 of FIG. 4). . In subsequent T232, the server 100 stores the input character data in a predetermined storage area of the memory 32 (S54). In T234, the server 100 transmits an OK instruction to the image display device 4 (S56).

At T240, the image display device 4 displays an OK screen on the display unit 10 in accordance with the OK instruction received from the server 100 (NO in S22 of FIG. 3) (S26). The delivery person D1 can know that the input character information (T200) input by the delivery person D1 matches the identification character information 54 by looking at the OK screen displayed on the display unit 10.

At T250, the server 100 transmits the input character data stored in the predetermined storage area of the memory 32 to the service server of the credit card company.

The configuration and operation of the image display device 4 according to the present embodiment have been described above. As described above, in the information processing system 2 of the present embodiment, the identification character information 54 represented by the recognized character data extracted from the image by the character recognition process does not match the input character information input to the keyboard 8. In this case (T130 in FIG. 5), a warning screen is displayed on the display unit 10 of the image display device 4 (T140). Accordingly, the delivery person D1 sees the warning screen and knows that the input character information (T100) input by the delivery person D1 on the keyboard 8 does not match the identification character information 54 described in the identification card 50. Can do.

In the present embodiment, the information processing system 2 stores the input character data representing the input character information in the memory 32 of the server 100 when the identification character information 54 matches the input character information (T230) (T232). . The information processing system 2 can store correct character data indicating the identification character information 54.

In this embodiment, the image display device 4 executes character recognition processing (S18 in FIG. 3), and transmits the recognized character data extracted by the character recognition processing to the server 100 (S20). Therefore, the image display device 4 and the server 100 are compared with other configurations in which the image display device transmits image data indicating an image captured by the camera to the server 100 and causes the server 100 to perform character recognition processing. The communication load during the period can be reduced.

In this embodiment, the image display device 4 is a head mounted display that can be mounted on the user's head. Therefore, if the delivery person D1 sees the identification card 50 with the image display device 4 attached (that is, enters the field of view), the image display device 4 acquires image data indicating an image representing the identification card 50. (S16 in FIG. 3).

(Correspondence)
The information processing system 2 is an example of an “information processing apparatus”. A combination of the image display device 4 and the keyboard 8 is an example of a “terminal device”. The

cameras

12 and 14, the keyboard 8, and the display unit 10 are examples of “image forming unit”, “input unit”, and “notification unit”, respectively. The identification card 50, the identification character information 54, and the recognized character data are examples of “document”, “first character information”, and “first character data”, respectively. The input character information and the input character data are examples of “second character information” and “second character data”, respectively. Displaying a warning screen on the display unit 10 (S24 in FIG. 3) is an example of “notification operation”. The memory 132 of the server 100 is an example of a “storage device”. The warning instruction in S40 of FIG. 3 is an example of “notification instruction”.

As mentioned above, although the Example was described in detail, these are only illustrations and do not limit a claim. The technology described in the claims includes various modifications and changes of the specific examples illustrated above. For example, the following modifications may be adopted.

(Modification 1) The server 100 may transmit the input character data to the service server of the credit card company without storing the input character data in the memory 132 in S54 of FIG. In the present modification, the “storage control unit” can be omitted.

(Modification 2) The information processing system 2 includes only the image display device and does not need to include the server 100. That is, in this modification, the image display device 4 may exhibit both functions of the image display device 4 and the server 100 of the above-described embodiment. In this case, the control unit 30 may execute the process of S52 of FIG. 4 instead of S20 of FIG. When determining that the input character information and the identification character information 54 match, the control unit 30 displays an OK screen on the display unit 10, and when determining that the input character information and the identification character information 54 do not match, the display unit 10 may display a warning screen. In the present modification, the image display device 4 is an example of an “information processing device”, and the “first reception unit”, “second reception unit”, “determination unit”, and “transmission unit” can be omitted. is there.

(Modification 3) In the apparatus processing of FIG. 3, the control unit 30 performs the processing of S10 to S14 (acquisition of input character data) after executing the processing of S16 and S18 (that is, acquisition of image data and recognized character data). ) May be executed. That is, T100 and T102 may be executed after executing T110 to T114 of FIG. Further, instead of transmitting the input character data and the recognized character data in S20, the control unit 30 may transmit the input character data after S14 and transmit the recognized character data after S18. That is, the control unit 30 may transmit the input character data and the recognized character data at different timings.

(Modification 4) The “terminal device” may be a mobile terminal such as a smartphone or a tablet terminal provided with a camera and a display device. In addition, the terminal device may include a scanner instead of the camera. In this case, the control unit of the terminal device may acquire image data of an image representing the identification card by causing the scanner to scan the identification card. In this case, the scanner is an example of an “image forming unit”.

(Modification 5) In the above embodiment, each of the image display devices 4 has a substantially glasses-like support frame, and can be worn on the user's head like wearing glasses. The image display device is not limited to this, and may have an arbitrary support frame such as a hat shape or a helmet shape as long as the image display device can be mounted on the user's head.

(Modification 6) The image display device 4 includes a first camera 12 and a second camera in eyewear (glasses, sunglasses, etc.) generally used for purposes such as vision correction and eye protection. 14 and the control box 16 may be attached. In that case, the lens portion of the eyewear may be used as the display unit.

(Modification 7) The display unit 10 of the image display device 4 may be a light-shielding display, and may block the user's field of view when the user wears the image display device. Since the display unit 10 is a light-shielding display, when the image display device 4 is turned on, the control unit 30 displays an image captured by the first camera 12 in a region facing the user's right eye. The image captured by the second camera 14 may be displayed in a region facing the user's left eye.

(Modification 8) In the above embodiment, the information processing system 2 has been described as being used in a situation where a credit card is delivered. The technology disclosed in the present specification can be used in other situations that require presentation of an identification card. For example, a situation where a government office issues a certificate to residents, a situation where a bank opens an account for an individual, and a situation where a parcel recipient cannot receive a parcel at the delivery company's window.

Further, the technical elements described in the present specification or drawings exhibit technical usefulness alone or in various combinations, and are not limited to the combinations described in the claims at the time of filing. In addition, the technology illustrated in the present specification or the drawings achieves a plurality of objects at the same time, and has technical utility by achieving one of the objects.

Claims

An image forming unit;
An input section;
A notification unit;
An information processing apparatus comprising a control unit,
The controller is
An image acquisition unit that acquires an image data that is an image formed by the image forming unit and that represents the image representing a document in which first character information is described;
First character data representing the first character information described in the document in the image is extracted by executing character recognition processing on the image represented by the acquired image data An extractor to perform,
An input data acquisition unit for acquiring second character data representing second character information input to the input unit;
In a specific case where the first character information represented by the first character data and the second character information represented by the second character data do not match, a notification operation is performed on the notification unit. A notification control unit to be executed,
Information processing device.
The control unit further includes the first character information represented by the first character data and the second character information represented by the second character data when the first character information matches the second character information. A storage control unit for storing the character data of 2 in the storage device;
The information processing apparatus according to claim 1.
The information processing device includes a terminal device and a server capable of communicating with the terminal device,
The terminal device includes the image forming unit, the input unit, the notification unit, and a terminal control unit,
The terminal control unit includes the image acquisition unit, the extraction unit, the input data acquisition unit, and the notification control unit,
The extraction unit further transmits the extracted first character data to the server,
The input data acquisition unit further transmits the acquired second character data to the server,
The notification control unit performs the notification operation on the notification unit in the specific case where the first character information and the second character information do not match and the notification instruction is received from the server. Let
The server includes a server control unit,
The server control unit
A first receiving unit for receiving the first character data from the terminal device;
A second receiving unit for receiving the second character data from the terminal device;
Judgment whether or not the first character information represented by the received first character data and the second character information represented by the received second character data match. And
A transmission unit that transmits the notification instruction to the terminal device when the determination unit determines that the first character information and the second character information do not match;
The information processing apparatus according to claim 1 or 2.
The terminal device further includes a frame that can be worn on a user's head,
The image forming unit includes a camera mounted on the frame and capable of photographing a range corresponding to the field of view of the user wearing the frame,
The notification unit includes a display device mounted on the frame and disposed at a position facing at least one of the right eye and the left eye of the user wearing the frame,
The notification operation includes causing the display device to display notification information related to the fact that the first character information and the second character information do not match.
The information processing apparatus according to claim 3.