JP2020201693A - Information processor and program - Google Patents

Abstract

To improve the accuracy in determining the thickness of an identity verification medium.SOLUTION: An information processor includes: an acquisition unit including a plurality of frame data including an image of an identity verification medium and configured to acquire moving image data in which the identity verification medium changes the orientation thereof among the plurality of frame data; an analysis unit configured to analyze the thickness of the identity verification medium using the moving image data; and a determination unit configured to determine, based on an analysis result by the analysis unit, whether the thickness of the identity verification medium satisfies a predetermined condition.SELECTED DRAWING: Figure 8

Description

The present invention relates to an information processing device and a program.

In recent years, as non-face-to-face transactions online, various transactions such as opening an account at a financial institution and applying for a card loan have been carried out. In such a non-face-to-face transaction, the customer sends an image or a copy of an identity verification medium such as a driver's license or an individual number card to a financial institution, and after the procedure is completed, the financial institution sends mail to the customer. It was sent and completed when the delivery of the mail was confirmed. However, the customer could not start the transaction until he received the mail, which sometimes made the customer feel inconvenient.

In this regard, the Act on Prevention of Transfer of Criminal Proceeds was amended on November 30, 2018. The revised Act on Prevention of Transfer of Criminal Proceeds aims to complete the identity verification procedure in online non-face-to-face transactions online, and includes the name, address, date of birth, and face photo written on the identity verification medium. In addition, the characteristics of the identity verification medium, such as the thickness of the identity verification medium, were also subject to verification.

As patent documents related to the above-mentioned matters, for example, the following patent documents 1 to 6 are known. Patent Document 1 discloses a technique of capturing a driver's license with a smartphone and opening an account using the image of the driver's license. Patent Document 2 and Patent Document 3 disclose a technique for identifying the size of a known object from a two-dimensional image obtained by inputting a known object model in advance and capturing the image with a camera. Further, Patent Document 4 discloses a technique for measuring the position of an object to be imaged based on a moving image obtained by imaging when the subject moves relative to the camera. Further, Patent Documents 5 and 6 disclose techniques for measuring the actual thickness of a card-shaped medium.

JP-A-2018-32367 JP-A-2002-288638 Japanese Unexamined Patent Publication No. 2010-8352 Japanese Unexamined Patent Publication No. 2008-89314 Japanese Unexamined Patent Publication No. 04-013909 Japanese Unexamined Patent Publication No. 09-297822

However, in non-face-to-face transactions online, a method for accurately determining whether or not the thickness of the identity verification medium is normal has not been established.

Therefore, the present invention has been made in view of the above problems, and an object of the present invention is new and improved information processing capable of improving the accuracy of determining the thickness of the identity verification medium. To provide equipment and programs.

In order to solve the above problem, according to a certain viewpoint of the present invention, moving image data including a plurality of frame data including an image of an identity verification medium and the direction of the identity verification medium is changed between the plurality of frame data. Based on the acquisition unit to be acquired, the analysis unit that analyzes the thickness of the identity verification medium using the moving image data, and the analysis result by the analysis unit, whether or not the thickness of the identity verification medium satisfies a predetermined condition is determined. An information processing device including a determination unit for determining is provided.

The analysis unit identifies the frame data including the image of the side surface of the identity verification medium from the plurality of frame data as the target frame data, and of the identity verification medium in the image of the identity verification medium included in the target frame data. The thickness may be extracted as an analysis result.

The image of the identity verification medium rotates between the plurality of frame data, and the analysis unit determines the length of each of the plurality of frame data in a direction intersecting the rotation axis of the image of the identity verification medium. And the frame data whose measured length is the minimum value may be specified as the target frame data.

The analysis unit analyzes the size of the identity verification medium using the moving image data, and the predetermined condition is that the thickness of the identity verification medium obtained by the analysis is the thickness of the identity verification medium obtained by the analysis. It may include being within the permissible range according to the size.

The analysis unit identifies the frame data including the front or back image of the identity verification medium from the plurality of frame data as reference frame data, and the analysis unit in the image of the identity verification medium included in the reference frame data. The size of the identity verification medium may be extracted as the analysis result of the size.

The image of the identity verification medium rotates between the plurality of frame data, and the analysis unit determines the length of each of the plurality of frame data in a direction intersecting the rotation axis of the image of the identity verification medium. The frame data having the maximum measured length may be specified as the reference frame data.

The permissible range is a range specified by applying the relationship between the thickness of the known identity verification medium and the size of the known identity verification medium to the size of the identity verification medium obtained by analysis. Good.

The acquisition unit further acquires still image data including images of the front surface or the back surface of the identity verification medium, and the analysis unit analyzes the size of the identity verification medium using the still image data and determines the predetermined size. The condition may include that the thickness of the identity verification medium obtained by the analysis is within an allowable range according to the size of the identity verification medium obtained by the analysis.

The image of the identity verification medium may be changed in direction from one image of the front surface or the back surface of the identity verification medium to the other image of the front surface or the back surface of the identity verification medium in the moving image data. The size of the above-mentioned identity verification medium may be the vertical length and / or the horizontal length of the identity verification medium.

Further, in order to solve the above problems, according to another viewpoint of the present invention, the computer includes a plurality of frame data including an image of the identity verification medium, and the identity verification medium is placed among the plurality of frame data. Based on the acquisition unit that acquires the moving image data that changes direction, the analysis unit that analyzes the thickness of the identity verification medium using the moving image data, and the analysis result by the analysis unit, the thickness of the identity verification medium is a predetermined condition. A program is provided to function as a judgment unit for determining whether or not the condition is satisfied.

Further, in order to solve the above problem, according to another viewpoint of the present invention, the identity verification medium includes a plurality of frame data including an image of the identity verification medium, and the identity verification medium changes direction between the plurality of frame data. An acquisition unit that acquires video data, an analysis unit that analyzes the video data and identifies frame data including an image of a side surface of the identity verification medium, and a transmission unit that transmits the frame data specified by the analysis unit. And, an information processing apparatus is provided.

Further, in order to solve the above problem, according to another viewpoint of the present invention, the computer includes a plurality of frame data including the image of the identity verification medium, and the identity verification medium is among the plurality of frame data. An acquisition unit that acquires moving image data whose orientation changes, an analysis unit that analyzes the moving image data and specifies frame data including an image of a side surface of the identity verification medium, and a frame data specified by the analysis unit. A program is provided to function as a transmitter to transmit.

According to the present invention described above, it is possible to improve the accuracy of determining the thickness of the identity verification medium.

It is explanatory drawing which shows the information processing system by one Embodiment of this invention. It is explanatory drawing which shows the structure of the customer terminal 10 by one Embodiment of this invention. It is explanatory drawing which shows the specific example of the guidance screen which guides the moving image imaging of a driver's license. It is explanatory drawing which shows the specific example of the guidance screen which guides the moving image imaging of a driver's license. It is explanatory drawing which shows the specific example of the moving image data of a driver's license. It is explanatory drawing which shows the specific example of the moving image data of a driver's license. It is explanatory drawing which shows the structure of the WebAP server 20. It is explanatory drawing which shows the structure of the analysis server 30 by one Embodiment of this invention. It is explanatory drawing which shows the analysis example of the thickness of a driver's license. It is explanatory drawing which shows the operation of the information processing system by one Embodiment of this invention. It is a flowchart which shows the operation of the analysis server 30. It is explanatory drawing which concerns on 5th modification. It is explanatory drawing which shows the structure of the customer terminal 10-2 by 7th modification. It is a block diagram which showed the hardware configuration of the analysis server 30.

Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. In the present specification and the drawings, components having substantially the same functional configuration are designated by the same reference numerals, so that duplicate description will be omitted.

Further, in the present specification and the drawings, a plurality of components having substantially the same functional configuration may be distinguished by adding different alphabets after the same reference numerals. However, when it is not necessary to particularly distinguish each of the plurality of components having substantially the same functional configuration, only the same reference numerals are given to each of the plurality of components.

<Overview of information processing system>
One embodiment of the present invention relates to an information processing system including a server of a trader who confirms the identity of a customer. Businesses that verify the identity of customers include financial institutions, finance leasing companies, credit card companies, residential land and building traders, jewelry and precious metal dealers, mail receiving service companies, telephone reception agents, and telephone transfer service companies. There are various vendors such as. The outline of the information processing system for verifying the identity of the customer in such a company will be described below.

FIG. 1 is an explanatory diagram showing an information processing system according to an embodiment of the present invention. As shown in FIG. 1, the information processing system according to the embodiment of the present invention includes a customer terminal 10, a WebAP server 20, an analysis server 30, and an operator terminal 40. The WebAP server 20 and the analysis server 30 are arranged in a data center owned by a trader, for example, as shown in FIG.

(Customer terminal 10)
The customer terminal 10 and the WebAP server 20 are connected to each other via the network 12. The network 12 is a wired or wireless transmission path for information transmitted from a device connected to the network 12. For example, the network 12 may include a public network such as the Internet, a telephone line network, a satellite communication network, various LANs (Local Area Network) including Ethernet (registered trademark), and a WAN (Wide Area Network). Further, the network 12 may include a dedicated network such as IP-VPN (Internet Protocol-Virtual Private Network).

The customer terminal 10 is an information processing device used by a customer to apply for a service or a product to a trader. The customer terminal 10 displays an input screen for application information and a guidance screen for guiding the imaging of the identity verification medium. The application information includes personal information such as, for example, the customer's name and address. The identity verification medium may be, for example, a card-like medium such as a driver's license, an individual number card, or a health insurance card, or a booklet-like medium such as a passport. The customer terminal 10 transmits the application information input by the customer to the input screen and the imaged data of the identity verification medium imaged by the customer along the guidance screen to the WebAP server 20. The customer terminal 10 may display the above input screen and guidance screen based on the application application installed in the customer terminal 10, or display the input screen and guidance screen provided as a Web screen by the WebAP server 20. It may be displayed.

Regarding the transmission of imaging data, under the Act on Prevention of Transfer of Criminal Proceeds revised on November 30, 2018, the thickness of the identity verification medium is added to the name, address, date of birth, and face photograph written on the identity verification medium. The characteristics of identity verification media such as are also subject to verification. As a method for confirming the thickness of the identity verification medium, the customer images the identity verification medium from a direction in which the front image and the side image of the identity verification medium are included, and the obtained still image data is sent to the vendor. It is conceivable that the data is transmitted and the vendor confirms the thickness of the identity verification medium from the image on the side of the identity verification medium included in the still image data. However, depending on the direction in which the customer images the identity verification medium, the side surface of the identity verification medium may not be sufficiently captured, and it may be difficult to confirm the thickness of the identity verification medium.

From the above viewpoint, the customer terminal 10 according to the embodiment of the present invention transmits the moving image data in which the identity verification medium changes direction between a plurality of frame data to the WebAP server 20 as the imaging data of the identity verification medium. With this configuration, it is possible to analyze the thickness of the identity verification medium using frame data that sufficiently includes the image of the side surface of the identity verification medium, and as a result, the accuracy of determining whether or not the thickness of the identity verification medium is normal. Can be improved. The analysis of the thickness of the identity verification medium will be described in detail later as a function of the analysis server 30.

The customer terminal 10 may be a smartphone or a PC (Personal Computer) as shown in FIG. 1, or may be another information processing device. Other information processing devices include mobile phones, personal digital assistant systems (PHS), portable music playback devices, portable video processing devices such as portable video processing devices or portable game devices, and home video processing devices. Information processing devices such as (DVD recorders, video decks, etc.), PDAs (Personal Digital Assistants), home-use game devices, and home appliance devices can be mentioned.

(WebAP server 20)
The WebAP server 20 receives application information and video data of an identity verification medium from the customer terminal 10. The WebAP server 20 determines whether or not to accept the application from the customer based on the determination result obtained by the analysis server 30 regarding the moving image data of the identity verification medium and the visual confirmation result by the operator using the operator terminal 40. The WebAP server 20 transmits the determination result of acceptance / rejection to the customer terminal 10. The customer terminal 10 can reacquire and retransmit the moving image data of the identity verification medium when the determination result indicates that the reception is not possible.

(Analysis server 30)
The analysis server 30 receives the video data of the identity verification medium from the WebAP server 20, analyzes the thickness of the identity verification medium using the video data, and determines whether or not the thickness of the identity verification medium satisfies a predetermined condition. It is an information processing device. The analysis server 30 transmits the determination result regarding the thickness of the identity verification medium to the WebAP server 20. The analysis server 30 may recognize the moving image data of the identity verification medium by OCR (Optical character recognition), and may also transmit the result of the OCR recognition to the WebAP server 20.

(Operator terminal 40)
The operator terminal 40 is an information processing device used by the operator to visually confirm the thickness of the identity verification medium. For example, the operator terminal 40 receives the video data of the identity verification medium from the WebAP server 20, displays the video data, and transmits the visual confirmation result input by the operator regarding the thickness of the identity verification medium to the WebAP server 20. Alternatively, the operator terminal 40 receives the analysis result and the judgment result by the analysis server 30 from the WebAP server 20, displays the analysis result and the judgment result, and visually confirms the result input by the operator regarding these results to the WebAP server 20. May be sent to. Although FIG. 1 shows a configuration in which the operator terminal 40 accesses the WebAP server 20 from outside the data center, the operator terminal 40 may also be arranged in the data center. Further, it is also conceivable that the operator terminal 40 does not exist and the result is automatically returned to the customer terminal 10.

The outline of the information processing system according to the embodiment of the present invention has been described above. Subsequently, the configurations of the customer terminal 10, the WebAP server 20, and the analysis server 30 included in the information processing system will be sequentially described in detail.

<Structure of customer terminal 10>
FIG. 2 is an explanatory diagram showing a configuration of a customer terminal 10 according to an embodiment of the present invention. As shown in FIG. 2, the customer terminal 10 according to the embodiment of the present invention includes an operation unit 110, a display unit 120, an imaging unit 130, a communication unit 140, and a control unit 150.

(Operation unit 110)
The operation unit 110 is configured for the customer to input information and instructions to the customer terminal 10. In one embodiment of the present invention, application information is input by the customer operating the operation unit 110. Examples of such an operation unit 110 include a keyboard, a mouse, and buttons. Further, although the operation unit 110 and the display unit 120 are shown separately in FIG. 2, the operation unit 110 may be a touch panel laminated on the display unit 120.

(Display unit 120)
The display unit 120 is configured to display various screens. In one embodiment of the present invention, the display unit 120 displays an input screen for application information, a guidance screen for inducing video imaging of the identity verification medium, and the like in accordance with control from the control unit 150. The guidance screen guides the image of the identity verification medium from one of the front surface or the back surface of the identity verification medium so that the image to be imaged changes to the other side of the front surface or the back surface of the identity verification medium. Hereinafter, a specific example of such a guidance screen will be described with reference to FIGS. 3 and 4. In the following, for convenience of explanation, an example in which the identity verification medium is a driver's license will be mainly described.

3 and 4 are explanatory views showing a specific example of a guidance screen for guiding a moving image of a driver's license. As shown in FIG. 3, the guidance screen includes the message "Start imaging the video from directly above the driver's license at the desk" and the front view 52 of the surface of the driver's license (sample). Then, as shown in Fig. 4, the guidance screen shows the message "Once you start imaging the video, turn the license over like this." And the license (sample) shows the driver's license in the horizontal direction. It changes to an animation image 54 that is turned inside out on the axis of rotation.

(Imaging unit 130)
The image pickup unit 130 converts the image of the subject focused by the lens into image data which is an electric signal. In one embodiment of the present invention, the imaging unit 130 images the driver's license and acquires moving image data of the driver's license. The video data of the driver's license obtained by imaging along the guidance screen described above includes frame data including the image of the front side of the license, frame data including the image of the side of the license, and a frame including the image of the back side of the license. Includes data. The image pickup unit 130 may be a CMOS image pickup device, an LBCAST image pickup device, or a CCD (Charge Coupled Device). Hereinafter, a specific example of the moving image data of the driver's license obtained by the imaging unit 130 will be described with reference to FIGS. 5 and 6.

5 and 6 are explanatory views showing a specific example of the moving image data of the driver's license. As shown in FIG. 5, the image 60 of the driver's license included in the moving image data changes from the front image of the front surface to the image including the front surface and the side surface, and further changes to the front image of the side surface. After that, the image 60 of the driver's license changes to an image including the side surface and the back surface, and further changes to a front image on the back surface, as shown in FIG.

(Communication unit 140)
The communication unit 140 is configured to communicate with the WebAP server 20 via the network 12. In one embodiment of the present invention, the communication unit 140 transmits the customer application information, the video data of the driver's license, and the like to the WebAP server 20 under the control of the control unit 150. Further, the communication unit 140 may receive the Web screen corresponding to the application information input screen and the Web screen corresponding to the guidance screen from the WebAP server 20.

(Control unit 150)
The control unit 150 controls the overall operation of the customer terminal 10. For example, the control unit 150 causes the display unit 120 to display the application information input screen and the guidance screen on the display unit 120, and causes the communication unit 140 to transmit the application information, the video data of the driver's license, and the like to the WebAP server 20.

<Configuration of WebAP server 20>
The configuration of the customer terminal 10 according to the embodiment of the present invention has been described above. Subsequently, with reference to FIG. 7, the configuration of the WebAP server 20 according to the embodiment of the present invention will be described.

FIG. 7 is an explanatory diagram showing the configuration of the WebAP server 20. As shown in FIG. 7, the WebAP server 20 includes a communication unit 240 and a control unit 250.

(Communication unit 240)
The communication unit 240 is configured to communicate with other devices such as the customer terminal 10, the analysis server 30, and the operator terminal 40. For example, the communication unit 240 receives the customer application information, the video data of the driver's license, and the like from the customer terminal 10 via the network 12. Further, the communication unit 240 transmits the moving image data of the license to the analysis server 30 and the operator terminal 40 according to the control by the control unit 250, receives the determination result regarding the thickness of the license from the analysis server 30, and licenses from the operator terminal 40. Receive the visual confirmation result regarding the thickness of the certificate.

(Control unit 250)
The control unit 250 controls the overall operation of the WebAP server 20. For example, the control unit 250 controls communication between the communication unit 240 and another device. Further, as shown in FIG. 7, the control unit 250 has a function of the acceptance / rejection determination unit 252.

The acceptance / rejection determination unit 252 determines whether or not to accept the application from the customer. For example, the acceptance / rejection determination unit 252 confirms the match / mismatch between the personal information included in the application information and the personal information obtained as the OCR recognition result of the video data of the driver's license, and when both personal information do not match. It is judged that the application cannot be accepted. In addition, when the judgment result regarding the thickness of the license received from the analysis server 30 shows an abnormality, or when the visual confirmation result regarding the thickness of the license received from the operator terminal 40 shows an abnormality, the acceptance / rejection judgment is made. Department 252 determines that the application cannot be accepted. On the other hand, the personal information included in the application information and the personal information obtained as the OCR recognition result of the video data of the license match, and the judgment result regarding the thickness of the license received from the analysis server 30 shows normal, and the operator terminal. If the visual confirmation result regarding the thickness of the license received from 40 is normal, the acceptance / rejection determination unit 252 may determine that the application can be accepted.

The control unit 250 causes the communication unit 240 to transmit the determination result by the acceptance / rejection determination unit 252 to the customer terminal 10.

<Configuration of analysis server 30>
Subsequently, the configuration of the analysis server 30 according to the embodiment of the present invention will be described with reference to FIG.

FIG. 8 is an explanatory diagram showing a configuration of an analysis server 30 according to an embodiment of the present invention. As shown in FIG. 8, the analysis server 30 includes a communication unit 340 and a control unit 350.

(Communication unit 340)
The communication unit 340 is configured to communicate with the WebAP server 20. The communication unit 340 functions as, for example, an acquisition unit that acquires the moving image data of the driver's license by receiving it from the WebAP server 20. In addition, the communication unit 340 transmits the result of OCR recognition of the video data of the driver's license and the result of determination regarding the thickness of the driver's license to the WebAP server 20.

(Control unit 350)
The control unit 350 controls the overall operation of the analysis server 30. In particular, the control unit 350 according to the embodiment of the present invention has the functions of the analysis unit 352 and the condition determination unit 354.

-Analysis unit 352
The analysis unit 352 analyzes the thickness of the driver's license using the moving image data of the driver's license. Specifically, the analysis unit 352 identifies the frame data including the image on the side of the license from the plurality of frame data constituting the moving image data as the target frame data, and in the image of the license included in the target frame data. Extract the thickness of the license as the analysis result. Here, it is more desirable that the analysis unit 352 specifies the frame data including the front image of the side surface of the driver's license as the target frame data. Therefore, when the image of the license is rotated between a plurality of frame data, the analysis unit 352 cuts out the image of the license by detecting four sides of each of the plurality of frame data, and then licenses the license. The length in the direction intersecting the rotation axis of the image of the testimony may be measured, and the frame data in which the measured length is the minimum value may be specified as the target frame data. Hereinafter, a specific example of such thickness analysis will be described with reference to FIG.

FIG. 9 is an explanatory diagram showing an analysis example of the thickness of the driver's license. In the example shown in FIG. 9, the image 60 of the driver's license is rotated around a rotation axis along the lateral direction of the driver's license. At this time, the analysis unit 352 sets the length A in the vertical direction of the license image as the length in the direction intersecting the rotation axis (horizontal axis) of the license image (for example, the number of pixels). ) Is measured. As shown in FIG. 9, the length A has a maximum value of Amax in the front image of the front surface and a minimum value of Amin in the front image of the side surface. Therefore, the analysis unit 352 specifies the frame data including the front image of the side surface whose length A is the minimum value Amin as the target frame data. Then, the analysis unit 352 extracts the minimum value Amin of the length A as the analysis result of the thickness of the license.

In addition, the analysis unit 352 analyzes the size of the driver's license using the moving image data of the driver's license. The size of the license may be the vertical length and / or the horizontal length of the license. The analysis unit 352 identifies the frame data including the front or back image of the license as the reference frame data from the plurality of frame data constituting the moving image data, and the license in the image of the license included in the reference frame data. The size of is extracted as the analysis result. Here, it is more desirable that the analysis unit 352 specifies the frame data including the front image of the front surface or the back surface of the driver's license as the reference frame data. Therefore, when the image of the license is rotated between a plurality of frame data, the analysis unit 352 determines the length of each of the plurality of frame data in the direction intersecting the rotation axis of the image of the license. The frame data measured as described above and having the maximum measured length may be specified as reference frame data.

Referring to FIG. 9 again, the analysis unit 352 specifies the frame data in which the length A of the image 60 of the driver's license in the vertical direction has the maximum value Amax as the reference frame data. Then, the analysis unit 352 extracts the vertical length Amax and the horizontal length W of the license image 60 included in the reference frame data as the analysis result of the license size in the license image 60.

-Condition judgment unit 354
The condition determination unit 354 determines whether or not the thickness of the license satisfies a predetermined condition based on the analysis result by the analysis unit 352. The predetermined condition includes, for example, that the thickness of the license obtained by the analysis is within the permissible range according to the size of the license obtained by the analysis. The permissible range may be the range specified by applying the relationship between the known license thickness and the known license size to the size of the license obtained by analysis.

Specifically, when the ratio of the thickness of the known license to the lateral length of the known license is "1: 100" and the lateral length obtained by the analysis is W, the above tolerance The range may be "(1-b1) W / 100 to (1 + b2) W / 100". “B1” and “b2” are ratios (for example, 0.1, etc.) that define the width of the allowable range.

In the above, an example focusing on the thickness of the license and the horizontal length of the license has been described, but the relationship between the thickness of the license and the vertical length of the license may be determined, and the driver's license may be judged. The relationship between the thickness, the vertical length of the license, and the horizontal length of the license may be determined.

<Operation of information processing system>
The configuration of the information processing system according to the embodiment of the present invention has been described above. Subsequently, the operation of the information processing system according to the embodiment of the present invention will be arranged with reference to FIGS. 10 and 11. In the following description, the explanation of the process related to the moving image data will be emphasized, and the explanation of the process related to the application information will be omitted.

FIG. 10 is an explanatory diagram showing the operation of the information processing system according to the embodiment of the present invention. As shown in FIG. 10, in the identity verification process, first, the imaging unit 130 of the customer terminal 10 captures the customer's face as a moving image and acquires the moving image data of the customer's face (S404). At this time, the control unit 150 causes the display unit 120 to display an operation instruction to the customer, such as "blink", "turn right", or "turn up". The operation instruction to the customer may be variable for each identity verification process. The video data of the customer's face is displayed on the operator terminal 40 together with the content of the operation instruction displayed to the customer, for example, and the operator of the operator terminal 40 matches the content of the operation instruction with the customer's operation in the video data. You may check whether or not. With this configuration, even if a third party has video data of the face of another customer obtained by past imaging, if the operation instructed in the identity verification process is different from the operation in the video data, the person himself / herself. Since the confirmation process can be terminated in failure, it is possible to improve the accuracy of the identity verification process.

After that, the control unit 150 of the customer terminal 10 causes the display unit 120 to display a guidance screen or the like that guides the image pickup of the identity verification medium (S408). Then, the customer images the identity verification medium as a moving image using the imaging unit 130 according to the guidance screen, and acquires the moving image data of the identity verification medium (S412). Subsequently, the communication unit 140 of the customer terminal 10 transmits the video data of the customer's face and the video data of the identity verification medium to the WebAP server 20 (S416).

When the WebAP server 20 receives the video data of the customer's face and the video data of the identity verification medium from the customer terminal 10, the WebAP server 20 transmits the video data of the identity verification medium to the analysis server 30 (S420).

Then, the analysis unit 352 of the analysis server 30 analyzes the thickness of the identity verification medium using the moving image data of the identity verification medium (S428), and the condition determination unit 354 of the analysis server 30 based on the analysis result by the analysis unit 352. It is determined whether or not the thickness of the identity verification medium satisfies a predetermined condition (S432), and the communication unit 340 of the analysis server 30 transmits the determination result to the WebAP server 20 (S436).

Subsequently, the WebAP server 20 transmits the determination result received from the analysis server 30, the video data of the customer's face and the video data of the identity verification medium to the operator terminal 40 (S440). Then, the operator of the operator terminal 40 visually confirms the determination result obtained by the analysis server 30, the video data of the customer's face and the video data of the identity verification medium, and inputs the visual confirmation result to the operator terminal 40 (S444). ), The operator terminal 40 transmits the visual confirmation result to the WebAP server 20 (S448).

The acceptance / rejection determination unit 252 of the WebAP server 20 determines whether or not to accept the application from the customer based on the visual confirmation result received from the operator terminal 40, the determination result received from the analysis server 30, and the like (S452). Then, the communication unit 240 of the WebAP server 20 transmits the determination result of acceptance / rejection to the customer terminal 10 (S456).

When the determination result received from the WebAP server 20 indicates that the reception is not possible (S460 / No), the customer terminal 10 repeats the process from S404. On the other hand, when the determination result received from the WebAP server 20 indicates acceptance is possible (S460 / Yes), the identity verification process ends (S464).

Here, with reference to FIG. 11, the detailed flow of processing of the analysis server 30 shown in S428 and S432 of FIG. 10 is organized. The process of S428 shown in FIG. 10 corresponds to the process of S510 to S540 described below, and the process of S432 shown in FIG. 10 corresponds to the process of S550 to S570 described below.

FIG. 11 is a flowchart showing the operation of the analysis server 30. As shown in FIG. 11, the analysis unit 352 of the analysis server 30 measures the length A of the image of the identity verification medium in each frame data constituting the moving image data (S510). On the other hand, the length in the improvement is, for example, the length in the direction intersecting the rotation axis of the image of the identity verification medium.

Then, the analysis unit 352 specifies the frame data having the maximum length A having the maximum value Amax as the reference frame data (S520), and analyzes the size of the identity verification medium in the video of the identity verification medium included in the reference frame data. Is extracted as (S530). Further, the analysis unit 352 extracts the minimum value of the length A as the thickness of the identity verification medium (S540).

After that, the condition determination unit 354 specifies the allowable range of the thickness by applying the relationship between the thickness of the known identity verification medium and the size of the known identity verification medium to the extracted size (S550). Then, the condition determination unit 354 determines whether or not the thickness extracted by the analysis unit 352 is included in the allowable range (S560). After that, the communication unit 340 transmits the determination result of the condition determination unit 354 to the WebAP server 20 (S570).

<Effect>
According to one embodiment of the present invention described above, various effects can be obtained. For example, in one embodiment of the present invention, moving image data is used in which the identity verification medium rotates so that the imaging target changes from one of the front surface or the back surface of the identity verification medium to the other of the front surface or the back surface of the identity verification medium. With this configuration, it is possible to analyze the thickness of the identity verification medium by using the frame data that sufficiently includes the image of the side surface of the identity verification medium among the plurality of frame data constituting the moving image data, and as a result, the identity verification is performed. It is possible to improve the accuracy of determining whether or not the thickness of the medium is normal.

In addition, by using the above video data, it is ensured that the image on the front surface of the identity verification medium, the image on the back surface of the identity verification medium, and the image on the side surface of the identity verification medium are all related to the same identity verification medium. It will be possible.

<Modification example>
The embodiment of the present invention has been described above. Hereinafter, some modifications of the embodiment of the present invention will be described. In addition, each modification described below may be applied alone to one embodiment of the present invention described above, or may be applied in combination to one embodiment of the present invention. Further, each modification may be applied in place of the configuration described in one embodiment of the present invention, or may be additionally applied to the configuration described in one embodiment of the present invention.

(First modification)
In the above, an example in which the rotation axis of the driver's license in the imaging of moving image data is the lateral direction of the driver's license has been described, but the rotation axis is not limited to such an example. For example, the rotation axis or rotation axis of the driver's license in capturing moving image data may be the vertical direction of the driver's license or the diagonal direction of the driver's license. In addition, in the above, the example in which the image is mainly taken in the order of the front side of the license, the side of the license, and the back side of the license has been described. It may be done.

(Second modification)
In the above, an example in which the driver's license is moved when the driver's license is imaged by the customer terminal 10 has been described. Good. For example, the driver's license may be imaged by moving the customer terminal 10 around the driver's license while the driver's license is fixed.

(Third variant)
In the above, an example of specifying the target frame data and the reference frame data based on the length A of the license in the vertical direction of each frame data has been described, but the method of specifying the target frame data and the reference frame data is such an example. Not limited to. For example, the analysis unit 352 calculates the area of the image of the driver's license in each frame data, specifies the frame data having the smallest area as the target frame data including the front image of the side surface of the license, and has the largest area. The frame data may be specified as reference frame data including the front image of the surface of the license. Alternatively, the analysis unit 352 may create a three-dimensional model of the image of the license in each frame data, and specify the target frame data and the reference frame data based on the posture (orientation) of the three-dimensional model.

(Fourth modification)
In the above, an example in which the customer terminal 10 transmits the moving image data of the driver's license has been described. In addition to the moving image data of the driver's license, the customer terminal 10 may transmit the still image data obtained by photographing the front surface or the back surface of the driver's license from the front. In this case, the analysis unit 352 of the analysis server 30 treats the still image data as reference frame data and analyzes the vertical length or the horizontal length of the license. Since it is considered that the still image data includes the front image of the front surface or the back surface of the license more reliably, by treating the still image data as reference frame data, the vertical length or width of the license can be obtained. It is possible to improve the analysis accuracy of the directional length.

(Fifth variant)
In the above, as a predetermined condition regarding the thickness of the license, the thickness of the license obtained by the analysis of the analysis unit 352 is the vertical length or the horizontal length of the license obtained by analyzing the reference frame data. Although it has been explained that it is within the permissible range according to the above, the predetermined conditions are not limited to this. For example, when the rotation axis of the license is the lateral direction of the license, the length of the license in the rotation axis direction in the target frame data is considered to be equal to the lateral length of the license. Therefore, the predetermined condition may be that the thickness of the license obtained by the analysis of the analysis unit 352 is within the permissible range according to the length of the license in the rotation axis direction in the target frame data. .. A specific example will be described with reference to FIG.

FIG. 12 is an explanatory diagram related to the fifth modification. In the example shown in FIG. 12, the analysis unit 352 extracts the lateral length W of the driver's license in the target frame data. Then, the condition determination unit 354 determines the thickness of the driver's license when the thickness Amin of the image of the driver's license in the target frame data is within the permissible range corresponding to the lateral length W of the image of the driver's license in the target frame data. It may be determined that the predetermined conditions relating to the above are satisfied.

According to such a configuration, it is possible to further improve the accuracy of determining the thickness of the license. More specifically, the distance between the license and the imaging unit when the reference frame data is imaged may be different from the distance between the license and the imaging unit when the target frame data is imaged. Therefore, the horizontal length W of the driver's license image in the reference frame data and the horizontal length W of the driver's license image in the target frame data may also be different. That is, the scale of the image of the license with respect to the actual license may differ between the reference frame data and the target frame data. Therefore, it is possible to obtain a more accurate judgment result by using the thickness Amin and the lateral length W of the image of the driver's license in the same target frame data for the judgment.

(Sixth variant)
In the above, the example in which the WebAP server 20 and the analysis server 30 are separate servers has been described, but the above-mentioned functions of the WebAP server 20 and the analysis server 30 may be implemented in the same server. Further, the function of the analysis unit 352, the function of the condition determination unit 354, or both of these functions of the analysis server 30 may be implemented in the customer terminal 10. For example, the customer terminal 10 may analyze the thickness of the driver's license using the moving image data of the driver's license, and transmit the determination result of whether or not the thickness of the driver's license satisfies a predetermined condition to the WebAP server 20.

(7th variant)
In connection with the sixth modification, the customer terminal 10 may specify the target frame data from the moving image data of the license and transmit the target frame data to the WebAP server 20. In this case, the analysis server 30 extracts the thickness of the license from the target frame data and determines whether or not the thickness of the license satisfies a predetermined condition. Hereinafter, the customer terminal 10 according to the seventh modification will be referred to as a customer terminal 10-2, and the configuration of the customer terminal 10-2 will be described.

FIG. 13 is an explanatory diagram showing the configuration of the customer terminal 10-2 according to the seventh modification. As shown in FIG. 13, the customer terminal 10-2 according to the seventh modification includes an operation unit 110, a display unit 120, an imaging unit 130, a communication unit 140, and a control unit 150-2. .. Since the functions of the operation unit 110, the display unit 120, the image pickup unit 130, and the like are as described with reference to FIG. 2, detailed description thereof will be omitted here.

The control unit 150-2 controls the overall operation of the customer terminal 10-2. In particular, the control unit 150-2 according to the seventh modification has the function of the analysis unit 154 as shown in FIG.

The analysis unit 154 identifies the frame data including the video on the side of the license from the plurality of frame data constituting the moving image data as the target frame data. For example, as described with reference to FIG. 9, the analysis unit 154 measures the length of each of the plurality of frame data in the direction intersecting the rotation axis of the image of the license, and the measured length is measured. The frame data having the minimum value may be specified as the target frame data. Further, the analysis unit 154 may specify the frame data having the maximum measured length as the reference frame data.

The communication unit 140 transmits the target frame data and the reference frame data specified by the analysis unit 154 to the WebAP server 20.

According to such a configuration, since the communication target is not moving image data but still image data, it is possible to suppress communication traffic.

(8th variant)
In the above, an example in which the acceptance of an application from a customer is determined after the condition determination on the analysis server 30 and the visual confirmation on the operator terminal 40 has been described. However, the timing of visual confirmation on the operator terminal 40 is not limited to the above-mentioned timing. For example, the WebAP server 20 may determine whether or not to accept the application based on the determination result by the analysis server 30, and after the determination result is determined to be acceptable, the operator terminal 40 may visually confirm the application.

<Hardware configuration>
An embodiment and a modification of the present invention have been described above. Information processing such as the above-mentioned analysis of the thickness of the license and the determination of conditions is realized by the cooperation between the software and the hardware of the analysis server 30 described below.

FIG. 14 is a block diagram showing the hardware configuration of the analysis server 30. The analysis server 30 includes a CPU (Central Processing Unit) 301, a ROM (Read Only Memory) 302, a RAM (Random Access Memory) 303, and a host bus 304. The analysis server 30 includes a bridge 305, an external bus 306, an interface 307, an input device 308, a display device 309, an audio output device 310, a storage device (HDD) 311 and a drive 312, and a network interface. It is equipped with 315.

The CPU 301 functions as an arithmetic processing unit and a control device, and controls the overall operation in the analysis server 30 according to various programs. Further, the CPU 301 may be a microprocessor. The ROM 302 stores programs, calculation parameters, and the like used by the CPU 301. The RAM 303 temporarily stores a program used in the execution of the CPU 301, parameters that change appropriately in the execution, and the like. These are connected to each other by a host bus 304 composed of a CPU bus or the like. By the collaboration between the CPU 301, ROM 302 and RAM 303 and the software, the functions of the analysis unit 352 and the condition determination unit 354 described above can be realized.

The host bus 304 is connected to an external bus 306 such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 305. It is not always necessary to separately configure the host bus 304, the bridge 305, and the external bus 306, and these functions may be implemented in one bus.

The input device 308 includes input means for the user to input information such as a mouse, a keyboard, a touch panel, a button, a microphone, a sensor, a switch, and a lever, and an input that generates an input signal based on the input by the user and outputs the input signal to the CPU 301. It is composed of a control circuit and the like. By operating the input device 308, the user of the analysis server 30 can input various data to the analysis server 30 and instruct the processing operation.

The display device 309 includes, for example, a display device such as a CRT (Cathode Ray Tube) display device, a liquid crystal display (LCD) device, a projector device, an OLED (Organic Light Emitting Mode) device, and a lamp. Further, the audio output device 310 includes an audio output device such as a speaker and headphones.

The storage device 311 is a data storage device configured as an example of the storage unit of the analysis server 30 according to the present embodiment. The storage device 311 may include a storage medium, a recording device for recording data on the storage medium, a reading device for reading data from the storage medium, a deleting device for deleting the data recorded on the storage medium, and the like. The storage device 311 is composed of, for example, an HDD (Hard Disk Drive) or an SSD (Solid Stage Drive), or a memory having an equivalent function. The storage device 311 drives the storage and stores programs and various data executed by the CPU 301.

The drive 312 is a storage medium reader / writer, and is built in or externally attached to the analysis server 30. The drive 312 reads the information recorded on the removable storage medium 24 such as the mounted magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and outputs the information to the RAM 303 or the storage device 311. The drive 312 can also write information to the removable storage medium 24.

The network interface 315 is, for example, a communication interface composed of a communication device or the like for connecting to the network 12. Further, the network interface 315 may be a wireless LAN (Local Area Network) compatible communication device or a wire communication device that performs wired communication.

Since a configuration substantially the same as the above-mentioned hardware configuration can be applied to the customer terminal 10, the WebAP server 20, and the operator terminal 40, the hardware configuration of the customer terminal 10, the WebAP server 20, and the operator terminal 40 can be applied here. The detailed description in is omitted.

<Supplement>
Although the preferred embodiments of the present invention have been described in detail with reference to the accompanying drawings, the present invention is not limited to such examples. It is clear that a person having ordinary knowledge in the field of technology to which the present invention belongs can come up with various modifications or modifications within the scope of the technical ideas described in the claims. , These are also naturally understood to belong to the technical scope of the present invention.

For example, each step in the processing of the information processing system of the present specification does not necessarily have to be processed in chronological order in the order described as a sequence diagram or a flowchart. For example, each step in the processing of the information processing stem may be processed in an order different from the order described in the flowchart, or may be processed in parallel.

In addition, the hardware such as the CPU, ROM, and RAM built into the customer terminal 10, the WebAP server 20, and the analysis server 30 exerts the same functions as the configurations of the customer terminal 10, the WebAP server 20, and the analysis server 30 described above. You can also create a computer program to make it work. A storage medium for storing the computer program is also provided.

10 Customer terminal 110 Operation unit 120 Display unit 130 Imaging unit 140 Communication unit 150 Control unit 154 Analysis unit 20 WebAP server 240 Communication unit 250 Control unit 252 Acceptability judgment unit 30 Analysis server 340 Communication unit 350 Control unit 352 Analysis unit 354 Condition judgment Part 40 Operator terminal

Claims (13)

An acquisition unit that includes a plurality of frame data including an image of an identity verification medium and acquires moving image data in which the identity verification medium changes direction between the plurality of frame data.
An analysis unit that analyzes the thickness of the identity verification medium using the moving image data,
Based on the analysis result by the analysis unit, a determination unit that determines whether or not the thickness of the identity verification medium satisfies a predetermined condition, and a determination unit.
Information processing device equipped with. The analysis unit identifies frame data including an image of a side surface of the identity verification medium from the plurality of frame data as target frame data, and of the identity verification medium in the image of the identity verification medium included in the target frame data. The information processing apparatus according to claim 1, wherein the thickness is extracted as an analysis result. The image of the identity verification medium is rotated between the plurality of frame data,
The analysis unit measures the length of each of the plurality of frame data in the direction intersecting the rotation axis of the image of the identity verification medium.
The information processing apparatus according to claim 2, wherein the frame data having the minimum measured length is specified as the target frame data. The analysis unit analyzes the size of the identity verification medium using the moving image data, and then analyzes the size of the identity verification medium.
Any of claims 1 to 3, wherein the predetermined condition includes that the thickness of the identity verification medium obtained by analysis is within an allowable range according to the size of the identity verification medium obtained by analysis. The information processing device according to item 1. The analysis unit identifies the frame data including the front or back image of the identity verification medium from the plurality of frame data as reference frame data, and the analysis unit in the image of the identity verification medium included in the reference frame data. The information processing apparatus according to claim 4, wherein the size of the identity verification medium is extracted as an analysis result of the size. The image of the identity verification medium is rotated between the plurality of frame data,
The analysis unit measures the length of each of the plurality of frame data in the direction intersecting the rotation axis of the image of the identity verification medium.
The information processing apparatus according to claim 5, wherein the frame data having the maximum measured length is specified as the reference frame data. The allowable range is a range specified by applying the relationship between the thickness of the known identification medium and the size of the known identification medium to the size of the identification medium obtained by analysis. The information processing apparatus according to any one of items 4 to 6. The acquisition unit further acquires still image data including images of the front surface or the back surface of the identity verification medium.
The analysis unit analyzes the size of the identity verification medium using the still image data, and then analyzes the size of the identity verification medium.
Any of claims 1 to 3, wherein the predetermined condition includes that the thickness of the identity verification medium obtained by analysis is within an allowable range according to the size of the identity verification medium obtained by analysis. The information processing device according to item 1. The video of the identity verification medium changes the direction from one image of the front surface or the back surface of the identity verification medium to the other image of the front surface or the back surface of the identity verification medium in the moving image data, according to claims 1 to 8. The information processing apparatus according to any one of the above. The information processing apparatus according to any one of claims 4 to 8, wherein the size of the identity verification medium is the vertical length and / or the horizontal length of the identity verification medium. Computer,
An acquisition unit that includes a plurality of frame data including an image of an identity verification medium and acquires moving image data in which the identity verification medium changes direction between the plurality of frame data.
An analysis unit that analyzes the thickness of the identity verification medium using the moving image data,
Based on the analysis result by the analysis unit, a determination unit that determines whether or not the thickness of the identity verification medium satisfies a predetermined condition, and a determination unit.
A program to function as. An acquisition unit that includes a plurality of frame data including an image of an identity verification medium and acquires moving image data in which the identity verification medium changes direction between the plurality of frame data.
An analysis unit that analyzes the moving image data and identifies frame data including an image of a side surface of the identity verification medium.
A transmission unit that transmits the frame data specified by the analysis unit, and a transmission unit.
Information processing device equipped with. Computer,
An acquisition unit that includes a plurality of frame data including an image of an identity verification medium and acquires moving image data in which the identity verification medium changes direction between the plurality of frame data.
An analysis unit that analyzes the moving image data and identifies frame data including an image of a side surface of the identity verification medium.
A transmission unit that transmits the frame data specified by the analysis unit, and a transmission unit.
A program to function as.

Images