JP7318325B2 - Information processing device and program - Google Patents

Description

The present invention relates to an information processing device and program.

In recent years, as online non-face-to-face transactions, various transactions such as opening an account at a financial institution and applying for a card loan have been performed. In identity verification procedures for such non-face-to-face transactions, for example, the customer sends an image or copy of an identity verification medium such as a driver's license or individual number card to the financial institution, and after completing the procedure, the financial institution sends the customer a postal item. It was completed by sending and confirming the delivery of the mail. However, the customer could not initiate the transaction until the mail was received, which was sometimes inconvenient for the customer.

In this regard, on November 30, 2018, the Act on Prevention of Transfer of Criminal Proceeds was amended. The revised Act on Prevention of Transfer of Criminal Proceeds aims to complete online identity verification procedures for online non-face-to-face transactions. In addition, characteristics of identification media, such as the thickness of the identification media, were also subject to verification.

Patent Documents 1 to 6 below, for example, are known as patent documents related to the above matter. Patent Literature 1 discloses a technique of capturing an image of a driver's license with a smartphone and opening an account using the image of the driver's license. Patent Documents 2 and 3 disclose techniques for inputting a known object model in advance and identifying the size of the known object from the resulting two-dimensional image captured by a camera. Further, Patent Document 4 discloses a technique for measuring the position of an object to be photographed based on a moving image obtained by imaging when the object moves relative to a camera. Further, Patent Documents 5 and 6 disclose techniques for measuring the actual thickness of a card-like medium.

JP 2018-32367 A JP-A-2002-288638 JP-A-2010-8352 JP 2008-89314 A JP-A-04-013909 JP-A-09-297822

However, in online non-face-to-face transactions, no method has been established for accurately determining whether or not the thickness of the personal identification medium is normal.

Therefore, the present invention has been made in view of the above problems, and an object of the present invention is to provide a new and improved information processing method capable of improving the accuracy of determination of the thickness of an identity verification medium. It is to provide an apparatus and a program.

In order to solve the above problems, according to an aspect of the present invention, a plurality of frame data including a video of an identity verification medium is included, and between the plurality of frame data,The personal identification medium in each frame data rotatesAn acquisition unit that acquires video data, an analysis unit that analyzes the thickness of the personal identification medium using the video data, and whether the thickness of the personal identification medium satisfies a predetermined condition based on the analysis result of the analysis unit and a judgment unit for judging whether or not,The analysis unit identifies frame data including a side image of the personal identification medium from the plurality of frame data as target frame data, and identifies the personal identification medium in the video of the personal identification medium included in the target frame data. The thickness is extracted as an analysis result, the analysis unit measures the length of each of the plurality of frame data in the direction intersecting the rotation axis of the personal identification medium, and the measured length is the minimum value. as the target frame data,An information processing device is provided.In order to solve the above problems, according to another aspect of the present invention, a plurality of frame data including a video of an identity verification medium is included, and the identity verification in each frame data is performed between the plurality of frame data. an acquisition unit that acquires moving image data in which a medium rotates; an analyzing unit that analyzes the thickness of the identity verification medium using the moving image data; a judgment unit for judging whether or not a condition is satisfied, wherein the analysis unit analyzes the size of the identity verification medium using the moving image data, and the predetermined condition is the identity obtained by the analysis. Including that the thickness of the confirmation medium is within an allowable range according to the size of the personal identification medium obtained by the analysis, the analysis unit determines the front or back side of the personal identification medium from among the plurality of frame data. is specified as reference frame data, and the size of the personal identification medium in the image of the personal identification medium included in the reference frame data is extracted as an analysis result of the size; Information processing, wherein the length of each of a plurality of frame data in a direction intersecting the rotational axis of the personal identification medium is measured, and the frame data having the maximum measured length is specified as the reference frame data. An apparatus is provided. In order to solve the above problems, according to another aspect of the present invention, a plurality of frame data including video of an identity verification medium is included, and the direction of the identity verification medium is changed between the plurality of frame data. An acquisition unit that acquires video data, an analysis unit that analyzes the thickness of the personal identification medium using the video data, and whether the thickness of the personal identification medium satisfies a predetermined condition based on the analysis result of the analysis unit a determining unit that determines whether The size of the identity verification medium is analyzed, and the predetermined condition includes that the thickness of the identity verification medium obtained by the analysis is within an allowable range according to the size of the identity verification medium obtained by the analysis. , an information processing apparatus is provided.

The allowable range may be a range specified by applying the relationship between the known thickness of the identity verification medium and the known size of the identity verification medium to the size of the identity verification medium obtained by analysis. good.

The direction of the image of the identity verification medium may be changed from the image of one of the front surface and the back surface of the identity verification medium to the image of the other surface or the back surface of the identity verification medium in the moving image data. In addition, the size of the personal identification medium described above may be the length in the vertical direction and/or the length in the horizontal direction of the personal identification medium.

In order to solve the above problems, according to another aspect of the present invention, a computer includes a plurality of frame data including an image of an identity verification medium, and between the plurality of frame data, an acquisition unit that acquires moving image data in which the identity verification medium rotates ; an analysis unit that analyzes the thickness of the identity verification medium using the animation data; and the thickness of the identity verification medium based on the analysis results of the analysis unit a determination unit that determines whether or not satisfies a predetermined condition, wherein the analysis unit identifies frame data including a side image of the personal identification medium from the plurality of frame data as target frame data, The thickness of the identity verification medium in the image of the identity verification medium included in the target frame data is extracted as an analysis result, and the analysis unit extracts the thickness of the identity verification medium in the image of the identity verification medium included in the target frame data, and extracts the thickness of the identity verification medium for each of the plurality of frame data. A program is provided for functioning as an information processing apparatus that measures the length in the direction in which the measured length is the minimum value and specifies the frame data having the minimum measured length as the target frame data.

Also, in order to solve the above problems, according to another aspect of the present invention,a computer comprising a plurality of frame data including a video of an identity verification medium, an acquisition unit configured to acquire moving image data in which the identity verification medium in each frame data rotates between the plurality of frame data; an analysis unit that analyzes the thickness of the personal identification medium using the The analysis unit analyzes the size of the identity verification medium using the moving image data, and the predetermined condition is that the thickness of the identity verification medium obtained by the analysis is the size of the identity verification medium obtained by the analysis. The analysis unit specifies frame data including an image of the front or back of the personal identification medium from among the plurality of frame data as reference frame data, and the reference frame extracting the size of the personal identification medium in the image of the personal identification medium included in the data as an analysis result of the size;
The analysis unit measures a length of each of the plurality of frame data in a direction intersecting the rotation axis of the personal identification medium, and selects the frame data having the maximum measured length as the reference frame data. A program is provided for functioning as an information processing device specified as.

In order to solve the above problems, according to another aspect of the present invention, a computer includes a plurality of frame data including an image of an identity verification medium, and between the plurality of frame data, the identity verification medium an acquisition unit that acquires moving image data that changes direction; an analysis unit that analyzes the thickness of the identity verification medium using the motion image data; a determination unit that determines whether or not the conditions are satisfied, the acquisition unit further acquires still image data including an image of the front or back surface of the personal identification medium, and the analysis unit stores the still image data to analyze the size of the identity verification medium, and the predetermined condition is that the thickness of the identity verification medium obtained by the analysis is within an allowable range according to the size of the identity verification medium obtained by the analysis. A program is provided for functioning as an information processing apparatus, including:

According to the present invention described above, it is possible to improve the determination accuracy of the thickness of the personal identification medium.

1 is an explanatory diagram showing an information processing system according to one embodiment of the present invention; FIG. 1 is an explanatory diagram showing the configuration of a customer terminal 10 according to one embodiment of the present invention; FIG. FIG. 10 is an explanatory diagram showing a specific example of a guidance screen for guiding the video capture of a driver's license; FIG. 10 is an explanatory diagram showing a specific example of a guidance screen for guiding the video capture of a driver's license; FIG. 4 is an explanatory diagram showing a specific example of video data of a driver's license; FIG. 4 is an explanatory diagram showing a specific example of video data of a driver's license; 2 is an explanatory diagram showing the configuration of a WebAP server 20; FIG. 3 is an explanatory diagram showing the configuration of an analysis server 30 according to one embodiment of the present invention; FIG. FIG. 10 is an explanatory diagram showing an analysis example of the thickness of a driver's license; FIG. 4 is an explanatory diagram showing the operation of the information processing system according to one embodiment of the present invention; 4 is a flow chart showing the operation of the analysis server 30; FIG. 12 is an explanatory diagram related to the fifth modified example; FIG. 21 is an explanatory diagram showing the configuration of a customer terminal 10-2 according to a seventh modified example; 3 is a block diagram showing the hardware configuration of an analysis server 30; FIG.

Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. In the present specification and drawings, constituent elements having substantially the same functional configuration are denoted by the same reference numerals, thereby omitting redundant description.

In addition, in this specification and drawings, a plurality of components having substantially the same functional configuration may be distinguished by attaching different alphabets after the same reference numerals. However, when there is no particular need to distinguish between a plurality of constituent elements having substantially the same functional configuration, only the same reference numerals are given to each of the plurality of constituent elements.

<Overview of information processing system>
One embodiment of the present invention relates to an information processing system including a server of a company that verifies the identity of customers. Businesses that verify the identity of customers include financial institutions, finance leasing companies, credit card companies, real estate brokers, jewelers and precious metals dealers, mail receiving service providers, telephone reception agencies, and telephone forwarding service providers. There are various companies such as An outline of an information processing system for verifying the identity of a customer in such a trader will be described below.

FIG. 1 is an explanatory diagram showing an information processing system according to one embodiment of the present invention. As shown in FIG. 1, the information processing system according to one embodiment of the present invention has a customer terminal 10, a WebAP server 20, an analysis server 30, and an operator terminal 40. The WebAP server 20 and the analysis server 30 are arranged, for example, in a data center owned by the vendor as shown in FIG.

(Customer terminal 10)
A customer terminal 10 and a WebAP server 20 are connected via a network 12 . Network 12 is a wired or wireless transmission path for information transmitted from devices connected to network 12 . For example, the network 12 may include a public line network such as the Internet, a telephone line network, a satellite communication network, various LANs (Local Area Networks) including Ethernet (registered trademark), WANs (Wide Area Networks), and the like. The network 12 may also include a dedicated line network such as IP-VPN (Internet Protocol-Virtual Private Network).

The customer terminal 10 is an information processing device used by a customer to apply for the provision of services or products to a company. The customer terminal 10 displays a screen for inputting application information and a guide screen for guiding an image of the personal identification medium. The application information includes, for example, personal information such as the customer's name and address. The personal identification medium may be, for example, a card-like medium such as a driver's license, an individual number card and an insurance card, or a booklet-like medium such as a passport. The customer terminal 10 transmits to the WebAP server 20 the application information input by the customer on the input screen and image data of the personal identification medium imaged by the customer along the guidance screen. The customer terminal 10 may display the input screen and the guidance screen based on the application application installed in the customer terminal 10, or display the input screen and the guidance screen provided as a Web screen from the WebAP server 20. may be displayed.

Regarding the transmission of image data, the Act on Prevention of Transfer of Criminal Proceeds revised on November 30, 2018 requires the thickness of the identity verification medium in addition to the name, address, date of birth and face photo written on the identity verification medium. The characteristics of personal identification media such as As a method for confirming the thickness of the identity verification medium, the customer takes an image of the identity verification medium from a direction that includes the front and side images of the identity verification medium, and the still image data obtained is sent to the vendor. A method of confirming the thickness of the personal identification medium from the image of the side surface of the personal identification medium included in the still image data is conceivable. However, depending on the direction in which the customer takes an image of the personal identification medium, the sides of the personal identification medium may not be captured sufficiently, making it difficult to check the thickness of the personal identification medium.

From the above point of view, the customer terminal 10 according to one embodiment of the present invention transmits to the WebAP server 20 video data in which the identity verification medium changes direction between a plurality of frame data as image data of the identity verification medium. With this configuration, it is possible to analyze the thickness of the identity verification medium using frame data that sufficiently includes the image of the side of the identity verification medium, and as a result, it is possible to determine whether the thickness of the identity verification medium is normal or not. can be improved. The analysis of the thickness of the personal identification medium and the like will be described later in detail as functions of the analysis server 30 .

The customer terminal 10 may be a smart phone or a PC (Personal Computer) as shown in FIG. 1, or may be another information processing device. Other information processing devices include portable information processing devices such as mobile phones, PHS (Personal Handyphone Systems), portable music players, portable video processing devices and portable game devices, and home video processing devices. (DVD recorders, video decks, etc.), PDAs (Personal Digital Assistants), home game machines, home electric appliances, and other information processing devices.

(WebAP server 20)
The WebAP server 20 receives the application information and the video data of the personal identification medium from the customer terminal 10 . The WebAP server 20 determines whether or not to accept the application from the customer based on the determination result obtained by the analysis server 30 regarding the video data of the personal identification medium and the visual confirmation result by the operator using the operator terminal 40 . The WebAP server 20 transmits to the customer terminal 10 the result of the decision as to whether or not the request can be accepted. The customer terminal 10 can reacquire and retransmit the moving image data of the personal identification medium when the determination result indicates that acceptance is not possible.

(analysis server 30)
The analysis server 30 receives the video data of the identity verification medium from the WebAP server 20, analyzes the thickness of the identity verification medium using the video data, and determines whether the thickness of the identity verification medium satisfies a predetermined condition. It is an information processing device that The analysis server 30 transmits the determination result regarding the thickness of the personal identification medium to the WebAP server 20 . Note that the analysis server 30 may perform OCR (Optical Character Recognition) recognition of the moving image data of the personal identification medium, and transmit the result of the OCR recognition to the WebAP server 20 together.

(Operator terminal 40)
The operator terminal 40 is an information processing device used by the operator to visually confirm the thickness of the personal identification medium. The operator terminal 40 receives, for example, the video data of the personal identification medium from the WebAP server 20, displays the video data, and transmits to the WebAP server 20 the result of visual confirmation input by the operator regarding the thickness of the personal identification medium. Alternatively, the operator terminal 40 receives the analysis results and judgment results from the analysis server 30 from the WebAP server 20, displays the analysis results and judgment results, and visually confirms these results input by the operator via the WebAP server 20. may be sent to Although FIG. 1 shows a configuration in which the operator terminal 40 accesses the WebAP server 20 from outside the data center, the operator terminal 40 may also be arranged inside the data center. A configuration in which the operator terminal 40 does not exist and the result is automatically returned to the customer terminal 10 is also conceivable.

The outline of the information processing system according to one embodiment of the present invention has been described above. Next, configurations of the customer terminal 10, the WebAP server 20, and the analysis server 30 included in the information processing system will be described in detail one by one.

<Configuration of customer terminal 10>
FIG. 2 is an explanatory diagram showing the configuration of the customer terminal 10 according to one embodiment of the present invention. As shown in FIG. 2, the customer terminal 10 according to one embodiment of the present invention includes an operation unit 110, a display unit 120, an imaging unit 130, a communication unit 140, and a control unit 150.

(Operation unit 110)
The operation unit 110 is a component for the customer to input information and instructions to the customer terminal 10 . In one embodiment of the present invention, the customer inputs the application information by operating the operation unit 110 . Such an operation unit 110 includes a keyboard, mouse, buttons, and the like. Further, although FIG. 2 shows the operation unit 110 and the display unit 120 separately, the operation unit 110 may be a touch panel laminated on the display unit 120 .

(Display unit 120)
The display unit 120 is configured to display various screens. In one embodiment of the present invention, the display unit 120 displays, under the control of the control unit 150, a screen for inputting application information, a guide screen for guiding video capture of the personal identification medium, and the like. The guidance screen guides the user to pick up an image of the personal identification medium so that the imaged surface changes from one of the front surface and the back surface of the personal identification medium to the other of the front surface and the back surface of the personal identification medium. A specific example of such a guidance screen will be described below with reference to FIGS. 3 and 4. FIG. In the following, for convenience of explanation, an example in which the personal identification medium is a driver's license will be mainly explained.

FIG. 3 and FIG. 4 are explanatory diagrams showing specific examples of guidance screens that guide the user to capture a moving image of a driver's license. As shown in FIG. 3, the guidance screen includes the message ``Put the driver's license on the desk and start shooting video from directly above'' and a front image 52 of the surface of the driver's license (sample). Subsequently, as shown in FIG. 4, the guidance screen displays the message "Turn over your driver's license like this when you start capturing the video." It changes to an animation image 54 that is flipped around the axis of rotation.

(Imaging unit 130)
The imaging unit 130 converts the image of the subject condensed by the lens into image data, which is an electrical signal. In one embodiment of the present invention, the imaging unit 130 captures an image of the driver's license and acquires video data of the driver's license. The video data of the driver's license obtained by imaging along the guide screen described above includes frame data including the image of the front side of the driver's license, frame data including the image of the side of the driver's license, and frame data including the image of the back of the driver's license. Contains data. Note that the imaging unit 130 may be a CMOS imaging device, an LBCAST imaging device, or a CCD (Charge Coupled Device). A specific example of the video data of the driver's license obtained by the imaging unit 130 will be described below with reference to FIGS. 5 and 6. FIG.

5 and 6 are explanatory diagrams showing specific examples of video data of a driver's license. As shown in FIG. 5, the license image 60 included in the moving image data changes from the front image of the front surface to the image including the front surface and the side surface, and further changes to the front image of the side surface. Thereafter, as shown in FIG. 6, the license image 60 changes to an image including the side and back sides, and further changes to a front image of the back side.

(Communication unit 140)
The communication unit 140 is configured to communicate with the WebAP server 20 via the network 12 . In one embodiment of the present invention, the communication unit 140 transmits the customer's application information, the video data of the driver's license, etc. to the WebAP server 20 under the control of the control unit 150 . Further, the communication unit 140 may receive a web screen corresponding to the application information input screen and a web screen corresponding to the guidance screen from the web AP server 20 .

(control unit 150)
The control unit 150 controls overall operations of the customer terminal 10 . For example, the control unit 150 causes the display unit 120 to display the application information input screen and the guidance screen, and causes the communication unit 140 to transmit the application information and video data of the driver's license to the WebAP server 20 .

<Configuration of WebAP server 20>
The configuration of the customer terminal 10 according to one embodiment of the present invention has been described above. Next, the configuration of the WebAP server 20 according to one embodiment of the present invention will be described with reference to FIG.

FIG. 7 is an explanatory diagram showing the configuration of the WebAP server 20. As shown in FIG. As shown in FIG. 7 , the WebAP server 20 includes a communication section 240 and a control section 250 .

(Communication unit 240)
The communication unit 240 is configured to communicate with other devices such as the customer terminal 10 , the analysis server 30 and the operator terminal 40 . For example, the communication unit 240 receives the customer's application information and video data of the driver's license from the customer terminal 10 via the network 12 . In addition, the communication unit 240 transmits video data of the driver's license to the analysis server 30 and the operator terminal 40 under the control of the control unit 250 , receives the determination result regarding the thickness of the driver's license from the analysis server 30 , and receives the driver's license from the operator terminal 40 . Receive a visual confirmation of the thickness of the certificate.

(control unit 250)
The control unit 250 controls overall operations of the WebAP server 20 . For example, the control unit 250 controls communication between the communication unit 240 and other devices. In addition, the control unit 250 has the function of the acceptability determination unit 252 as shown in FIG.

The acceptability determination unit 252 determines whether or not to accept an application from a customer. For example, the acceptability determination unit 252 checks whether the personal information included in the application information and the personal information obtained as the OCR recognition result of the video data of the driver's license match or disagree. It is determined that the application cannot be accepted. In addition, when the result of the judgment regarding the thickness of the license received from the analysis server 30 indicates an abnormality, or when the result of the visual confirmation regarding the thickness of the license received from the operator terminal 40 indicates an abnormality, it is also possible to determine whether or not acceptance is possible. Department 252 determines that the application cannot be accepted. On the other hand, the personal information included in the application information and the personal information obtained as the result of OCR recognition of the video data of the driver's license match, and the determination result regarding the driver's license thickness received from the analysis server 30 indicates normal, and the operator terminal If the result of visual confirmation regarding the thickness of the license received from 40 indicates that the thickness is normal, the acceptability determination unit 252 can determine that the application can be accepted.

The control unit 250 causes the communication unit 240 to transmit the determination result of the acceptability determination unit 252 to the customer terminal 10 .

<Configuration of analysis server 30>
Next, with reference to FIG. 8, the configuration of the analysis server 30 according to one embodiment of the present invention will be described.

FIG. 8 is an explanatory diagram showing the configuration of the analysis server 30 according to one embodiment of the present invention. As shown in FIG. 8 , the analysis server 30 has a communication section 340 and a control section 350 .

(Communication unit 340)
The communication unit 340 is configured to communicate with the WebAP server 20 . The communication unit 340 functions, for example, as an acquisition unit that acquires video data of a driver's license by receiving it from the WebAP server 20 . In addition, the communication unit 340 transmits to the WebAP server 20 the result of the OCR recognition of the video data of the driver's license and the determination result regarding the thickness of the driver's license.

(control unit 350)
The control unit 350 controls overall operations of the analysis server 30 . In particular, the control unit 350 according to one embodiment of the present invention has functions of an analysis unit 352 and a condition determination unit 354 .

- Analysis unit 352
The analysis unit 352 analyzes the thickness of the driver's license using the video data of the driver's license. Specifically, the analysis unit 352 identifies the frame data including the image of the side of the driver's license from the plurality of frame data constituting the video data as the target frame data, and the image of the driver's license included in the target frame data. Extract the thickness of the license as an analysis result. Here, it is more desirable for the analysis unit 352 to specify the frame data including the front image of the side of the driver's license as the target frame data. For this reason, when the image of the driver's license rotates between a plurality of frame data, the analysis unit 352 extracts the image of the driver's license from each of the plurality of frame data by detecting four sides or the like. It is also possible to measure the length of the test image in the direction intersecting the axis of rotation, and specify the frame data having the minimum measured length as the target frame data. A specific example of such thickness analysis will be described below with reference to FIG.

FIG. 9 is an explanatory diagram showing an analysis example of the thickness of a driver's license. In the example shown in FIG. 9, the image 60 of the driver's license is rotated around the axis of rotation along the horizontal direction of the driver's license. At this time, the analysis unit 352 determines the vertical length A (for example, the number of pixels ) is measured. As shown in FIG. 9, the length A has a maximum value Amax for the front image on the front surface and a minimum value Amin for the front image on the side surface. For this reason, the analysis unit 352 identifies frame data including a side front image whose length A is the minimum value Amin as target frame data. Then, the analysis unit 352 extracts the minimum value Amin of the length A as the analysis result of the thickness of the license.

Also, the analysis unit 352 analyzes the size of the driver's license using the moving image data of the driver's license. The size of the license may be the longitudinal length and/or the lateral length of the license. The analysis unit 352 identifies, as reference frame data, frame data including images of the front side or the back side of the driver's license from a plurality of frame data constituting the moving image data, and identifies the driver's license in the driver's license image included in the reference frame data. Extract the size of as the analysis result. Here, it is more desirable for the analysis unit 352 to specify the frame data including the front image of the front side or the back side of the driver's license as the reference frame data. Therefore, when the license image is rotated between a plurality of frame data, the analysis unit 352 determines the length of each of the plurality of frame data in the direction intersecting the rotation axis of the license image. It may be measured as described above, and the frame data having the maximum measured length may be specified as the reference frame data.

Referring to FIG. 9 again, the analysis unit 352 identifies, as reference frame data, frame data in which the length A of the license image 60 in the vertical direction is the maximum value Amax. Then, the analysis unit 352 extracts the vertical length Amax and the horizontal length W of the license image 60 included in the reference frame data as the analysis result of the size of the license in the license image 60 .

-Condition decision unit 354
The condition determination unit 354 determines whether or not the thickness of the driver's license satisfies a predetermined condition based on the analysis result of the analysis unit 352 . The predetermined condition includes, for example, that the thickness of the license obtained by analysis is within an allowable range according to the size of the license obtained by analysis. The tolerance range may be a range specified by applying the relationship between known license thickness and known license size to the analyzed license size.

Specifically, when the ratio of the known license thickness to the known license lateral length is "1:100" and the lateral length obtained by analysis is W, the above allowable The range may be "(1-b1)W/100 to (1+b2)W/100". "b1" and "b2" are ratios (eg, 0.1, etc.) that define the width of the acceptable range.

In the above example, the thickness of the license and the length in the horizontal direction of the license are focused. The relationship between the thickness, the vertical length of the license, and the horizontal length of the license may be determined.

<Operation of information processing system>
The configuration of the information processing system according to one embodiment of the present invention has been described above. Next, operations of the information processing system according to the embodiment of the present invention will be summarized with reference to FIGS. 10 and 11. FIG. In the following explanation, emphasis is placed on the explanation of the processing related to the moving image data, and the explanation of the processing concerning the application information is omitted.

FIG. 10 is an explanatory diagram showing the operation of the information processing system according to one embodiment of the present invention. As shown in FIG. 10, in the identity verification process, first, the imaging unit 130 of the customer terminal 10 captures a moving image of the customer's face and acquires moving image data of the customer's face (S404). At this time, the control unit 150 causes the display unit 120 to display an operation instruction to the customer, such as "blink," "look right," or "look up." This operation instruction to the customer may be variable for each personal identification process. The moving image data of the customer's face is displayed, for example, on the operator terminal 40 together with the content of the action instruction displayed to the customer, and the operator of the operator terminal 40 can confirm that the content of the operation instruction matches the action of the customer in the moving image data. You can check if there is With this configuration, even if a third party has video data of another customer's face obtained by past imaging, if the action instructed in the identity verification process is different from the action in the video data, the customer Since the confirmation process can end in failure, it is possible to improve the accuracy of the personal identification process.

After that, the control unit 150 of the customer terminal 10 causes the display unit 120 to display a guidance screen or the like for guiding the user to capture a moving image of the personal identification medium (S408). Then, according to the guide screen, the customer uses the imaging unit 130 to take a moving image of the personal identification medium, and acquires the moving image data of the personal identification medium (S412). Subsequently, the communication unit 140 of the customer terminal 10 transmits the moving image data of the customer's face and the moving image data of the personal identification medium to the WebAP server 20 (S416).

When the WebAP server 20 receives the moving image data of the customer's face and the moving image data of the personal identification medium from the customer terminal 10, the WebAP server 20 transmits the moving image data of the personal identification medium to the analysis server 30 (S420).

Then, the analysis unit 352 of the analysis server 30 analyzes the thickness of the identity verification medium using the video data of the identity verification medium (S428), and the condition determination unit 354 of the analysis server 30, based on the analysis result of the analysis unit 352, It is determined whether or not the thickness of the personal identification medium satisfies a predetermined condition (S432), and the communication unit 340 of the analysis server 30 transmits the determination result to the WebAP server 20 (S436).

Subsequently, the WebAP server 20 transmits the determination result received from the analysis server 30, the moving image data of the customer's face, and the moving image data of the personal identification medium to the operator terminal 40 (S440). Then, the operator of the operator terminal 40 visually confirms the determination result obtained by the analysis server 30, the moving image data of the customer's face, and the moving image data of the personal identification medium, and inputs the result of the visual confirmation into the operator terminal 40 (S444). ), the operator terminal 40 transmits the visual confirmation result to the WebAP server 20 (S448).

The acceptability determination unit 252 of the WebAP server 20 determines whether or not to accept the application from the customer based on the visual confirmation result received from the operator terminal 40 and the determination result received from the analysis server 30 (S452). Then, the communication unit 240 of the WebAP server 20 transmits the determination result of acceptance or rejection to the customer terminal 10 (S456).

If the determination result received from the WebAP server 20 indicates that reception is not possible (S460/No), the customer terminal 10 repeats the processing from S404. On the other hand, if the determination result received from the WebAP server 20 indicates acceptance (S460/Yes), the personal identification process ends (S464).

Here, with reference to FIG. 11, the detailed flow of the processing of the analysis server 30 shown in S428 and S432 of FIG. 10 will be organized. The processing of S428 shown in FIG. 10 corresponds to the processing of S510 to S540 described below, and the processing of S432 shown in FIG. 10 corresponds to the processing of S550 to S570 described below.

FIG. 11 is a flow chart showing the operation of the analysis server 30. As shown in FIG. As shown in FIG. 11, the analysis unit 352 of the analysis server 30 measures the length A of one side of the image of the personal identification medium in each frame data constituting the moving image data (S510). On the one hand, the length on the other hand is, for example, the length in the direction intersecting with the rotational axis of the image of the personal identification medium.

Then, the analysis unit 352 identifies the frame data whose length A is the maximum value Amax as the reference frame data (S520), and analyzes the size of the identity verification medium in the image of the identity verification medium included in the reference frame data. (S530). Furthermore, the analysis unit 352 extracts the minimum value of the length A as the thickness of the personal identification medium (S540).

After that, the condition determination unit 354 specifies the allowable thickness range by applying the relationship between the known thickness of the personal identification medium and the known size of the personal identification medium to the extracted size (S550). Then, the condition determination unit 354 determines whether the thickness extracted by the analysis unit 352 is within the allowable range (S560). After that, the communication unit 340 transmits the determination result of the condition determination unit 354 to the WebAP server 20 (S570).

<Effect>
According to one embodiment of the present invention described above, various effects can be obtained. For example, in one embodiment of the present invention, moving image data is used in which the identification medium rotates so that the imaging target changes from one of the front and back sides of the identification medium to the other of the front and back sides of the identification medium. With this configuration, it is possible to analyze the thickness of the identity verification medium by using the frame data that sufficiently includes the image of the side of the identity verification medium among the plurality of frame data constituting the moving image data. It is possible to improve the accuracy of determining whether the thickness of the medium is normal.

In addition, by using the above video data, it is guaranteed that the image on the front of the identity verification medium, the image on the back of the identity verification medium, and the image on the side of the identity verification medium are all related to the same identity verification medium. It becomes possible.

<Modification>
An embodiment of the present invention has been described above. Several variations of one embodiment of the present invention are described below. It should be noted that each modified example described below may be applied singly to one embodiment of the present invention described above, or may be applied in combination to one embodiment of the present invention. Further, each modification may be applied instead of the configuration described in the embodiment of the present invention, or may be additionally applied to the configuration described in the embodiment of the present invention.

(First modification)
In the above, an example was described in which the axis of rotation of the driver's license in capturing the video data was the horizontal direction of the driver's license, but the axis of rotation is not limited to such an example. For example, the rotation axis or rotation axis of the driver's license in capturing the moving image data may be the vertical direction of the driver's license or the diagonal direction of the driver's license. In the above example, the front side of the driver's license, the side of the driver's license, and the back of the driver's license are mainly imaged in this order. may be done.

(Second modification)
In the above, an example in which the driver's license is moved when the image of the driver's license is captured by the customer terminal 10 has been described. good. For example, the license may be imaged by the customer moving the customer terminal 10 around the license while the license is fixed.

(Third modification)
In the above example, the target frame data and the reference frame data are specified based on the vertical length A of the license in each frame data. is not limited to For example, the analysis unit 352 calculates the area of the image of the driver's license in each frame data, identifies the frame data with the smallest area as the target frame data including the front image of the side of the driver's license, The frame data may be specified as reference frame data containing a frontal image of the surface of the license. Alternatively, the analysis unit 352 may create a 3D model of the driver's license image in each frame data, and specify the target frame data and the reference frame data based on the posture (orientation) of the 3D model.

(Fourth modification)
An example in which the customer terminal 10 transmits the moving image data of the driver's license has been described above. The customer terminal 10 may transmit still image data obtained by imaging the front side or the back side of the driver's license from the front in addition to the moving image data of the driver's license. In this case, the analysis unit 352 of the analysis server 30 treats the still image data as reference frame data and analyzes the vertical or horizontal length of the driver's license. Since it is considered that the still image data includes a front image of the front or back of the driver's license more reliably, by treating the still image data as reference frame data, the length of the driver's license in the vertical or horizontal direction can be estimated. It is possible to improve the analysis accuracy of the directional length.

(Fifth Modification)
In the above description, as a predetermined condition regarding the thickness of the license, the thickness of the license obtained by the analysis by the analysis unit 352 is the length in the vertical direction or the length in the horizontal direction of the license obtained by analyzing the reference frame data. However, the predetermined condition is not limited to this. For example, when the rotation axis of the license is in the horizontal direction of the license, the length of the license in the target frame data in the rotation axis direction is considered to be equal to the horizontal length of the license. Therefore, the predetermined condition may be that the thickness of the license obtained by analysis by the analysis unit 352 is within an allowable range according to the length of the license in the target frame data in the direction of the rotation axis. . A specific example will be described with reference to FIG.

FIG. 12 is an explanatory diagram related to the fifth modification. In the example shown in FIG. 12, the analysis unit 352 extracts the horizontal length W of the license in the target frame data. If the thickness Amin of the driver's license image in the target frame data is within the allowable range corresponding to the horizontal length W of the driver's license image in the target frame data, the condition determination unit 354 determines the thickness of the driver's license. may be determined to be satisfied.

With such a configuration, it is possible to further improve the accuracy of determining the thickness of the driver's license. More specifically, the distance between the driver's license and the imaging unit when the reference frame data was captured may differ from the distance between the driver's license and the imaging unit when the target frame data was captured. Therefore, the horizontal length W of the license image in the reference frame data and the horizontal length W of the license image in the target frame data may also differ. That is, the reference frame data and the target frame data may have different scales of the license image with respect to the actual license. Therefore, by using the thickness Amin and the horizontal length W of the license image in the same target frame data, it is possible to obtain a more accurate determination result.

(Sixth modification)
Although an example in which the WebAP server 20 and the analysis server 30 are separate servers has been described above, the functions of the WebAP server 20 and the analysis server 30 may be implemented in the same server. Also, the function of the analysis unit 352 of the analysis server 30 , the function of the condition determination unit 354 , or both of these functions may be implemented in the customer terminal 10 . For example, the customer terminal 10 may analyze the thickness of the driver's license using video data of the driver's license, and transmit to the WebAP server 20 the determination result as to whether the thickness of the driver's license satisfies a predetermined condition.

(Seventh Modification)
In relation to the sixth modification, the customer terminal 10 may identify target frame data from the video data of the driver's license and transmit the target frame data to the WebAP server 20 . In this case, the analysis server 30 extracts the thickness of the license from the target frame data and determines whether the thickness of the license satisfies a predetermined condition. Hereinafter, the customer terminal 10 according to the seventh modification will be referred to as a customer terminal 10-2, and the configuration of the customer terminal 10-2 will be described.

FIG. 13 is an explanatory diagram showing the configuration of the customer terminal 10-2 according to the seventh modification. As shown in FIG. 13, the customer terminal 10-2 according to the seventh modification includes an operation unit 110, a display unit 120, an imaging unit 130, a communication unit 140, and a control unit 150-2. . The functions of the operation unit 110, the display unit 120, the imaging unit 130, etc. are the same as those described with reference to FIG. 2, so detailed description thereof will be omitted here.

The control unit 150-2 controls overall operations of the customer terminal 10-2. In particular, control unit 150-2 according to the seventh modification has the function of analysis unit 154, as shown in FIG.

The analysis unit 154 identifies the frame data including the image of the side of the driver's license as the target frame data from the plurality of frame data constituting the moving image data. For example, as described with reference to FIG. 9, the analysis unit 154 measures the length of each of the plurality of frame data in the direction intersecting the rotation axis of the license image, and measures the measured length may be specified as the target frame data. Also, the analysis unit 154 may specify the frame data having the maximum measured length as the reference frame data.

The communication unit 140 transmits the target frame data and the reference frame data identified by the analysis unit 154 to the WebAP server 20 .

According to such a configuration, the object of communication is still image data instead of moving image data, so communication traffic can be suppressed.

(Eighth modification)
In the above, an example has been described in which acceptance of an application from a customer is determined through conditional determination in the analysis server 30 and visual confirmation in the operator terminal 40 . However, the timing of visual confirmation at the operator terminal 40 is not limited to the timing described above. For example, the WebAP server 20 may determine whether or not the application can be accepted based on the determination result of the analysis server 30, and after the determination result is determined to be acceptable, the operator terminal 40 may be visually checked.

<Hardware configuration>
An embodiment and modifications of the present invention have been described above. Information processing such as the analysis of the thickness of the driver's license and determination of the conditions described above are realized by cooperation between software and the hardware of the analysis server 30 described below.

FIG. 14 is a block diagram showing the hardware configuration of the analysis server 30. As shown in FIG. The analysis server 30 includes a CPU (Central Processing Unit) 301 , a ROM (Read Only Memory) 302 , a RAM (Random Access Memory) 303 and a host bus 304 . The analysis server 30 also includes a bridge 305, an external bus 306, an interface 307, an input device 308, a display device 309, an audio output device 310, a storage device (HDD) 311, a drive 312, and a network interface. 315.

The CPU 301 functions as an arithmetic processing device and a control device, and controls overall operations within the analysis server 30 according to various programs. Alternatively, the CPU 301 may be a microprocessor. The ROM 302 stores programs, calculation parameters, and the like used by the CPU 301 . The RAM 303 temporarily stores programs used in the execution of the CPU 301, parameters that change as appropriate during the execution, and the like. These are interconnected by a host bus 304 comprising a CPU bus or the like. Functions such as the analysis unit 352 and the condition determination unit 354 described above can be realized by the cooperation of the CPU 301, the ROM 302, the RAM 303, and the software.

The host bus 304 is connected via a bridge 305 to an external bus 306 such as a PCI (Peripheral Component Interconnect/Interface) bus. It should be noted that the host bus 304, bridge 305 and external bus 306 do not necessarily have to be configured separately, and these functions may be implemented in one bus.

The input device 308 includes input means for the user to input information, such as a mouse, keyboard, touch panel, button, microphone, sensor, switch, and lever. It consists of a control circuit and the like. By operating the input device 308, the user of the analysis server 30 can input various data to the analysis server 30 and instruct processing operations.

The display device 309 includes, for example, a CRT (Cathode Ray Tube) display device, a liquid crystal display (LCD) device, a projector device, an OLED (Organic Light Emitting Diode) device and a lamp. Also, the audio output device 310 includes audio output devices such as speakers and headphones.

The storage device 311 is a data storage device configured as an example of a storage unit of the analysis server 30 according to this embodiment. The storage device 311 may include a storage medium, a recording device that records data on the storage medium, a reading device that reads data from the storage medium, a deletion device that deletes data recorded on the storage medium, and the like. The storage device 311 is configured by, for example, a HDD (Hard Disk Drive), an SSD (Solid Storage Drive), or a memory having equivalent functions. The storage device 311 drives storage and stores programs executed by the CPU 301 and various data.

The drive 312 is a reader/writer for storage media, and is built in or externally attached to the analysis server 30 . The drive 312 reads out information recorded in the attached removable storage medium 24 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and outputs it to the RAM 303 or the storage device 311 . Drive 312 can also write information to removable storage medium 24 .

The network interface 315 is, for example, a communication interface configured with a communication device or the like for connecting to the network 12 . Also, the network interface 315 may be a wireless LAN (Local Area Network) compatible communication device or a wired communication device that performs wired communication.

Since substantially the same hardware configuration as described above can be applied to the customer terminal 10, the WebAP server 20 and the operator terminal 40, the hardware configuration of the customer terminal 10, the WebAP server 20 and the operator terminal 40 is shown here. detailed description is omitted.

<Supplement>
Although the preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, the present invention is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field to which the present invention belongs can conceive of various modifications or modifications within the scope of the technical idea described in the claims. It is understood that these also naturally belong to the technical scope of the present invention.

For example, each step in the processing of the information processing system of this specification does not necessarily have to be processed in chronological order according to the order described as a sequence diagram or flowchart. For example, each step in the processing of the information processing system may be processed in an order different from the order described as the flow chart, or may be processed in parallel.

In addition, hardware such as the CPU, ROM, and RAM built into the customer terminal 10, the WebAP server 20, and the analysis server 30 exhibits functions equivalent to those of each configuration of the customer terminal 10, the WebAP server 20, and the analysis server 30 described above. A computer program can also be written to do so. A storage medium storing the computer program is also provided.

10 customer terminal 110 operation unit 120 display unit 130 imaging unit 140 communication unit 150 control unit 154 analysis unit 20 WebAP server 240 communication unit 250 control unit 252 acceptability determination unit 30 analysis server 340 communication unit 350 control unit 352 analysis unit 354 condition determination Part 40 operator terminal

Claims (9)

an acquisition unit that includes a plurality of frame data including video of an identity verification medium, and acquires moving image data in which the identity verification medium in each frame data rotates between the plurality of frame data;
an analysis unit that analyzes the thickness of the personal identification medium using the video data;
a determination unit that determines whether the thickness of the personal identification medium satisfies a predetermined condition based on the analysis result of the analysis unit;
with
The analysis unit identifies frame data including a side image of the personal identification medium from the plurality of frame data as target frame data, and identifies the personal identification medium in the video of the personal identification medium included in the target frame data. Extract the thickness as an analysis result,
The analysis unit measures a length of each of the plurality of frame data in a direction intersecting the rotation axis of the personal identification medium,
An information processing apparatus that specifies frame data having a minimum measured length as the target frame data . an acquisition unit that includes a plurality of frame data including video of an identity verification medium, and acquires moving image data in which the identity verification medium in each frame data rotates between the plurality of frame data;
an analysis unit that analyzes the thickness of the personal identification medium using the video data;
a determination unit that determines whether the thickness of the personal identification medium satisfies a predetermined condition based on the analysis result of the analysis unit;
with
The analysis unit analyzes the size of the personal identification medium using the video data,
The predetermined condition includes that the thickness of the identity verification medium obtained by analysis is within an allowable range according to the size of the identity verification medium obtained by analysis,
The analysis unit identifies frame data including an image of the front or back of the personal identification medium from among the plurality of frame data as reference frame data, and identifies the image of the personal identification medium included in the reference frame data. Extracting the size of the personal identification medium as the analysis result of the size,
The analysis unit measures a length of each of the plurality of frame data in a direction intersecting the rotational axis of the personal identification medium,
An information processing device that specifies frame data having the maximum measured length as the reference frame data . an acquisition unit that acquires video data including a plurality of frame data including video of an identity verification medium, wherein the identity verification medium changes direction between the plurality of frame data;
an analysis unit that analyzes the thickness of the personal identification medium using the video data;
a determination unit that determines whether the thickness of the personal identification medium satisfies a predetermined condition based on the analysis result of the analysis unit;
with
The acquisition unit further acquires still image data including an image of the front side or the back side of the personal identification medium,
The analysis unit analyzes the size of the personal identification medium using the still image data,
The information processing apparatus, wherein the predetermined condition includes that the thickness of the personal identification medium obtained by the analysis is within an allowable range according to the size of the personal identification medium obtained by the analysis. The allowable range is a range specified by applying a relationship between a known thickness of a personal identification medium and a known size of the personal identification medium to the size of the personal identification medium obtained by analysis. Item 3. The information processing apparatus according to item 2 . Claims 1 to 4 , wherein the image of the identity verification medium changes direction from the image of one of the front surface and the back surface of the identity verification medium to the image of the other surface or the back surface of the identity verification medium in the moving image data. The information processing device according to any one of . The information processing apparatus according to any one of claims 2 to 4 , wherein the size of said personal identification medium is the length in the vertical direction and/or the length in the horizontal direction of said personal identification medium. the computer,
an acquisition unit that includes a plurality of frame data including video of an identity verification medium, and acquires moving image data in which the identity verification medium in each frame data rotates between the plurality of frame data;
an analysis unit that analyzes the thickness of the personal identification medium using the video data;
a determination unit that determines whether the thickness of the personal identification medium satisfies a predetermined condition based on the analysis result of the analysis unit;
with
The analysis unit identifies frame data including a side image of the personal identification medium from the plurality of frame data as target frame data, and identifies the personal identification medium in the video of the personal identification medium included in the target frame data. Extract the thickness as an analysis result,
The analysis unit measures a length of each of the plurality of frame data in a direction intersecting the rotation axis of the personal identification medium,
A program for functioning as an information processing device that identifies frame data having a minimum measured length as the target frame data . the computer,
an acquisition unit that includes a plurality of frame data including video of an identity verification medium, and acquires moving image data in which the identity verification medium in each frame data rotates between the plurality of frame data;
an analysis unit that analyzes the thickness of the personal identification medium using the video data;
a determination unit that determines whether the thickness of the personal identification medium satisfies a predetermined condition based on the analysis result of the analysis unit;
with
The analysis unit analyzes the size of the personal identification medium using the video data,
The predetermined condition includes that the thickness of the identity verification medium obtained by analysis is within an allowable range according to the size of the identity verification medium obtained by analysis,
The analysis unit identifies frame data including an image of the front or back of the personal identification medium from among the plurality of frame data as reference frame data, and identifies the image of the personal identification medium included in the reference frame data. Extracting the size of the personal identification medium as the analysis result of the size,
The analysis unit measures a length of each of the plurality of frame data in a direction intersecting the rotation axis of the personal identification medium,
A program for functioning as an information processing device that specifies frame data having the maximum measured length as the reference frame data. the computer,
an acquisition unit that acquires video data including a plurality of frame data including video of an identity verification medium, wherein the identity verification medium changes direction between the plurality of frame data;
an analysis unit that analyzes the thickness of the personal identification medium using the video data;
a determination unit that determines whether the thickness of the personal identification medium satisfies a predetermined condition based on the analysis result of the analysis unit;
with
The acquisition unit further acquires still image data including an image of the front side or the back side of the personal identification medium,
The analysis unit analyzes the size of the personal identification medium using the still image data,
The predetermined conditions for functioning as an information processing device include that the thickness of the personal identification medium obtained by analysis is within an allowable range according to the size of the personal identification medium obtained by analysis. ,program.

Images