RU2565007C1 - Recognition of bank card identification data and device to this end - Google Patents

Abstract

FIELD: physics.

SUBSTANCE: claimed process comprises the steps that follow. Multiple images of bank card face and rear are produced and transmitted to computer. Bank card quadrangle fragment corresponding to first six figures of the card number is identified. Bank card serial number defined by said first six figures of the card number is used to select the bank card fragments with ID data required for identification from the data base of coordinates. Said coordinates are compared with the data required for bank card identification. ID data are identified on bank card quadrangle fragments. In case identification is impossible on some bank card quadrangle fragment the latter is selected from the other image from multiple images of bank card face and rear.

EFFECT: higher accuracy of identification.

20 cl, 3 dwg

Description

FIELD OF THE INVENTION

The group of inventions relates to methods and devices specifically designed for data recognition, in particular to methods and devices for recognizing identification data on a bank card, and can be used to automate the input of personal identification data on bank cards.

The prior art method.

A bank card has a lot of inscriptions printed on its front and back sides. There can be written the name of the bank that issued the card, the type of card, the name of the fields as “month and year”, as well as official information, for example: “The card is the property of the bank” and other information. For payment systems to work, they need to enter only identification information that corresponds to the card number, surname and name of the holder, indicates the validity of the card and the verification code CVV2 / CVC2 on the back of the bank card. In this case, the rest of the information needs to be weeded out, since its recognition leads to an extra load on the computing device.

Difficulties in recognition are that:

- identification information may be lost among the plurality of other information printed,

- may be poorly scanned,

- It can be embossed, that is, mechanically extruded on the front side of the plastic card, and also due to this it is very poorly recognized by optical methods.

To improve recognition of identification data on a bank card, methods of fragmentation were invented, that is, cropping areas on a bank card, on which the necessary information is located.

According to a first of its aspects, the present invention relates to a method for recognizing identification data on a bank card, wherein:

- receive at least one image of a credit card,

- transmit at least one image of a credit card to a computer device,

- perform color processing of the image of a credit card on a computer device,

- determine the angles and sides of a bank card,

- convert the image of the bank card to obtain the orthogonal projection of the bank card,

- according to the image parameters determine the type of bank card based on a database of types of bank cards,

- determine in accordance with the type of bank card the exact location of the quadrangular fragments on the bank card, within which it is necessary to conduct optical recognition of identification data,

- produce optical recognition of identification data on the quadrangular fragments of a bank card.

Such a method is described in US patent for the invention No. US 8837833 B1, published in 2014.

This method is the closest in technical essence and the achieved technical result and is selected for the prototype of the invention as a method.

The disadvantage of this prototype is its low accuracy of recognition of identification data on a bank card. This is due to the fact that:

- one image of a bank card often fails to recognize all the necessary fragments due to a blurred image, cropping, flare, glare, the difficulty of determining the edge of a bank card;

- this method does not take into account the fact that all bank cards not only differ in size, but also have the location of identification data in different parts of the bank card. If the card number is usually in the center of the front side, then the expiration date of the bank card, and especially the verification code CVV2 / CVC2 on the back of the bank card, can be located anywhere;

- this method does not take into account the fact that it is impossible to accurately determine the type of bank card from a certain aspect ratio of the bank card and, therefore, find out the correct location of the quadrangular fragments on the bank card, within which it is necessary to conduct optical recognition of identification data.

Disclosure of the invention as a method.

Based on this original observation, the present invention mainly aims to propose a method for recognizing identification data on a bank card, allowing at least to smooth out at least one of the above disadvantages, namely, to increase the accuracy of recognition of identification data on a bank card.

To achieve this goal, the method for recognizing identification data on a bank card is characterized essentially in that the method further includes the following steps:

- receive and transmit to the computer device a lot of different images of the front and back sides of a credit card,

- first of all, on the front side of the bank card, a quadrangular fragment of the bank card is recognized, corresponding to the first six digits of the bank card number, which uniquely correlate the bank card with a specific series of a bank card in a particular issuing bank,

- create in a computer device a database of coordinates of quadrangular fragments of a bank card with identification data necessary for recognition in each particular series of bank cards,

- based on the first six digits of the bank card number, a bank card series is selected from the database of coordinates of fragments of a bank card with identification data necessary for recognition, the specified coordinates of quadrangular fragments of a bank card with data necessary for recognition,

- identification data is recognized on the quadrangular fragments of the bank card, and if it is impossible to recognize on some quadrangular fragment of the bank card, the indicated fragment of the bank card is selected from another image from the set of different images of the front and back sides of the bank card

Thanks to these advantageous characteristics, it becomes possible to form and transfer to a computer device many different images of the front and back sides of a bank card, and this set can be a continuous video sequence. Also, among many different images of the front and back sides of a bank card, it is possible to change the image capture settings - turn the flash on and off, change modes from color to black and white, turn on and turn off various filters, and more. Thus, a large number of different images of the front and back sides of the bank card appear, and many different images of quadrangular fragments on the bank card, within which it is necessary to conduct optical recognition of identification data. All this eliminates possible recognition problems associated with the presence of a blurry image, cropping, flare, glare, difficulties in determining the edge of a bank card, for example, when the edges of a bank card merge with the background.

Recognition of the quadrangular fragment of a bank card corresponding to the first six digits of a bank card number that uniquely correlates a bank card with a specific series of a bank card in a particular issuing bank is possible using standard optical recognition methods, because the bank card number is always in the center and the coordinates of this The plot is known in advance.

The first six digits of the bank card number is the so-called BIN (or BIN in English). These numbers clearly allow you to identify the bank that issued the card. One bank of BINs can have many. These figures also make it possible to determine whether a card belongs to a particular international payment system. In the vast majority of cases, BIN also makes it possible to determine the series of cards issued as part of one bank program or product line. Such cards have the same style and design, similar service rates. It is important that within the same series, that is, bank cards having one BIN, the location of all identification data on the bank card is identical.

Thus, having an accumulated database of coordinates of quadrangular fragments of a bank card with identification data necessary for recognition in each particular series of bank cards, by the BIN number you can accurately know the coordinates of quadrangular fragments of a bank card with identification data necessary for recognition.

And, therefore, when recognizing identification data on a bank card, first of all, having determined that it belongs to a certain series (BIN), it becomes possible to minimize the recognition time and also to increase recognition accuracy due to the fact that the exact boundaries of those fragments become known which are the identification details of a bank card.

There is an embodiment of the invention in which a client device of a user having image acquisition means is used as a computer device.

Thanks to this advantageous characteristic, it becomes possible to recognize identification data on a bank card using a client device of a user, for example, using his mobile phone such as a smartphone.

In general, each client device can be any form of computing platform that connects to the network, such as a federated network and allows interaction with application programs. Typical examples of individual client devices include, but are not limited to, stationary and portable personal computers, “smart” cell phones (in English, a smartphone), lightweight clients, workstations, “dumb” terminals connected to the application server, and various their layout and configuration, that is, both physical devices for interacting in communication interaction systems, and virtual devices implemented on programmable computers yuternyh devices and having a software interface for communication functions.

There is also an embodiment of the invention in which a server is used as a computer device, which is connected via an interconnected network to a client device of a user having image acquisition means.

Thanks to this advantageous characteristic, it becomes possible to recognize identification data on a bank card using a remote server that has significantly greater computing power.

The combined network, as well as all connections between all modules and blocks, include various topologies, configurations, and layouts of the components of the interconnect, configured to interconnect corporate, global, and local area networks, and includes, without limitation, traditional wired, Wireless, satellite, optical and equivalent network technologies.

There is an advantageous embodiment of the invention in which, if it is not possible to recognize the identification data on a quadrangular fragment of a bank card, select the specified fragment of the bank card from another image from the set of different images of the front and back sides of the bank card, which is the best, and as the criterion for choosing the best for recognition Fragments of the image use the criterion for the best contrast and sharpness of the most complete fragment.

Due to this advantageous characteristic, it becomes possible in the case of a poor image of one of the fragments, for example, due to poor sharpness or contrast, or because there is a glare, or merges with the background, or a foreign object falls, or the user has blocked his finger, to make recognition differently fragment. Another fragment is selected for reasons of best suitability for recognition. This may be the maximum visibility of the fragment at the best contrast at the best sharpness.

There is another embodiment of the invention in which, if it is not possible to recognize the identification data on a certain quadrangular fragment of a bank card, they transmit audio or written messages to the user of the client device indicating the need for receiving and transmitting additional images.

Thanks to this advantageous feature, it becomes possible to receive new images of quadrangular fragments of a bank card into the device if it is unsuitable for recognizing old ones.

There is also an embodiment of the invention in which, in the case of impossibility of recognizing identification data on a certain quadrangular fragment of a bank card using a client device of a user, identification data is recognized using a server that is connected via an integrated network with a client device of the user in separate images and in the database available on the server coordinate data of fragments of a bank card with identification data necessary for recognition and.

Thanks to this advantageous characteristic, an opportunity arises in the case when a user could not recognize a certain fragment by means of his client device, for example, in some predetermined time, then the recognition process is transmitted via an integrated network to the server.

There is another embodiment of the invention in which, if it is not possible to recognize the identification data in a separate fragment by means of the server, the specified fragment is transmitted to the client device of the operator connected via the integrated network to the server and receives from the operator the correct version of the identification data, which is determined visually by the operator and entered manually.

Due to this advantageous characteristic, it becomes possible in the case when a user could not automatically recognize a certain fragment by means of the server, for example, for some predetermined other time, then the recognition process is transmitted via an integrated network to the operator’s client device, which is connected via an integrated network to the server. The operator visually evaluates the received unrecognized fragment and enters the correct version of the identification data.

There is a variant of the invention in which, when an operator recognizes a hard-to-detect fragment for each fragment, a database of hard-to-recognize fragments and the corresponding correct identification data corresponding to them is formed.

Thanks to this advantageous characteristic, it becomes possible to create a database of fragments that are difficult to recognize and the correct identification data corresponding to them to automate the server identification process in the future.

In addition, there is a variant of the invention in which, if it is not possible to recognize the identification data in a separate fragment by the server, additionally check the presence of such a fragment in the database of hard-to-recognize fragments located on the server, if there is such a fragment there, then select from the database hardly recognizable fragments the correct variant of identification data corresponding to the indicated fragment.

Due to this advantageous characteristic, it becomes possible to first contact the operator to check a hard-to-recognize fragment for the presence in the database of hard-to-recognize fragments, located on the server, of the corresponding variant of identification data. If such a fragment has already been checked by the operator, then the second time the server will automatically recognize it.

There is also a variant of the invention, in which, if it is not possible to recognize the identification data in a separate fragment, external libraries containing additional fonts and / or languages and / or symbols necessary for recognition are connected by means of the server.

Thanks to this advantageous feature, it becomes possible to recognize identification data on a bank card that contains rare fonts or languages that are not in the server database.

There is an embodiment of the invention in which, if it is impossible to determine the fragment necessary for recognition in the absence of a connection through the integrated network between the client device and the server, a user is asked to set the fragment boundaries on the image displayed on the display of the client device on which certain identification data is located.

Thanks to this advantageous characteristic, it becomes possible, if there is no connection to the integrated network and the impossibility of transferring data to the server, to still recognize data by asking the user himself to set the boundaries of the fragment for its recognition. For example, there were problems finding a fragment that contains data on the validity of a bank card. The user is invited to show on the image of the bank card the place where this data is.

There is a variant of the invention in which, if it is not possible to recognize the identification data in a separate fragment by the server means or in the absence of a connection through the integrated network between the client device and the server, an unrecognized fragment is transferred to the display of the user’s client device and the correct variant of identification data corresponding to this unrecognized fragment, by manually entering the correct data.

Thanks to this advantageous characteristic, it becomes possible, if there is no connection to the integrated network and the impossibility of transferring data to the server, to still recognize data by asking the user to specify the correct fragment recognition. For example, there were problems with recognizing a fragment that contains data on the validity of a bank card. The user is prompted to enter the expiration date of the bank card for the specified fragment with the validity of the bank card.

There is an embodiment of the invention in which the Moon criterion is used to verify the correctness of determining the bank card number, if it is not fulfilled, the process of identifying identification data on the bank card is started anew.

Thanks to this advantageous feature, it becomes possible to quickly check the correctness of determining the bank card number. And if an error is detected, it is necessary to start the recognition procedure again. The fact is that the last digit in the number of any bank card is the result of the sequence of the previous 15 digits, and you can always calculate it if you know the first 15 digits and the Hans Peter Moon criterion, which created the algorithm, which later went into the ISO international standard / IEC 7812-1, on the basis of which card numbers are built. Alternatively, it is possible in this way not to recognize the last digit of the bank card number. But this increases the risk of error.

There is an embodiment of the invention in which when receiving and transmitting to a computer device a plurality of different images of the front and back sides of a bank card, additionally, using the image acquisition means, the level of illumination, and / or the presence of glare on the card, and / or the color gamut, and / or proximity the background colors of the color scheme of the bank card, and / or the remoteness of the bank card from the camera, send audio or written messages to the user of the client device indicating the need for receiving and transferring giving additional images.

Thanks to this advantageous characteristic, it becomes possible to eliminate the systematic error of the lack of necessary data in the whole set of received bank card images. If the image processing methods cannot detect or identify a fragment, then it becomes possible to transmit to the user a message about the need for additional input of bank card images.

There is an embodiment of the invention in which identification data is recognized on quadrangular fragments of a bank card using methods that provide self-learning for the self-learning process.

Due to this advantageous characteristic, it is possible to recognize data using a combination of mathematical statistics methods and / or methods of artificial intelligence systems, including those based on neural networks, for example, a three-layer perceptron, as well as methods of frequency analysis of data on the differential value of map image pixels.

The set of essential features of the invention is not known from the prior art for methods of similar purpose, which allows us to conclude that the criterion of "novelty" for the invention in relation to the method.

The prior art device

Another side of the present invention relates to a device for recognizing identification data on a bank card, including means for receiving and inputting bank card images and connected to it computing means, including the following interconnected modules:

- a module for color processing the image of a bank card on a computer device,

- a module for determining the angles and sides of a bank card,

- a module for converting a bank card image to obtain an orthogonal projection of a bank card,

- a module for storing a database of bank card types,

- a module for determining the type of bank card based on a database of types of bank cards,

- module for optical recognition of identification data on quadrangular fragments of a bank card

Such a device is described in US patent for the invention No. US 8837833 B1, published in 2014

This device is the closest in technical essence and the achieved technical result and is selected as a prototype of the invention as a device.

The disadvantage of this prototype is its low accuracy of recognition of identification data on a bank card. This is due to the fact that:

- one image of a bank card often fails to recognize all the necessary fragments due to a blurred image, cropping, flare, glare, the difficulty of determining the edge of a bank card;

- this device, while functioning, does not take into account the fact that all bank cards not only differ in size, but also have identification data located in different parts of the bank card. If the card number is usually in the center of the front side, then the expiration date of the bank card, and especially the verification code CVV2 / CVC2 on the back of the bank card, can be located anywhere;

- this device during its operation does not take into account the fact that it is impossible to accurately determine the type of bank card from a certain aspect ratio of the bank card and, therefore, find out the correct location of the quadrangular fragments on the bank card, within which it is necessary to conduct optical recognition of identification data.

Disclosure of the invention as a device

The present invention, on the other hand, mainly aims to provide a device for recognizing identification data on a bank card, which allows at least smoothing out at least one of the above disadvantages, namely, to increase the accuracy of recognition of identification data on a bank card.

To achieve this goal, the device further includes the following modules connected to each other and connected to computing means:

- a module for storing a database of coordinates of quadrangular fragments of a bank card with identification data necessary for recognition in each particular series of bank cards,

- a module for determining, by the first six digits of the bank card number, a series of a bank card from a database of coordinates of bank card fragments with identification data necessary for recognition, the specified coordinates of quadrangular fragments of a bank card with identification data necessary for recognition.

Thanks to these advantageous characteristics, it is possible to generate and constantly replenish the database of coordinates of quadrangular fragments of a bank card with the identification data necessary for recognition in each particular series of bank cards. And when recognizing identification data on a bank card, first of all, having determined that it belongs to a certain series (BIN), minimize recognition time, and also increase recognition accuracy due to the fact that the exact boundaries of those fragments on which the identification data are located are known bank card.

There is also an embodiment of the invention in which the device further includes a module for storing a database of a plurality of bank card images.

Thanks to this advantageous feature, it becomes possible to have many fallback options for recognizing fragments if an unsuccessful attempt is made to recognize any of the fragments of a bank card that contains bank card identification information.

There is another embodiment of the invention in which the device is connected via an integrated network to another remote device for recognizing identification data on a bank card.

Due to this advantageous characteristic, it becomes possible to recognize the identification data of a bank card using not only one device, for example a user's mobile phone such as a smartphone, but also a remote server connected to the client device of the user via an integrated network.

There is an embodiment of the invention in which the device is connected via an interconnected network to the client device of the operator to be able to manually recognize difficult fragments.

Thanks to this advantageous feature, it becomes possible to recognize identification data on a bank card, even if no automated methods give a result. Having shown a fragment that is difficult for recognition on a bank card to an operator, one can not only recognize the missing data, but also form a database of hard to recognize fragments.

There is an embodiment of the invention in which the device further includes a module for storing a database of unrecognizable fragments connected to computing means.

Thanks to this advantageous characteristic, it becomes possible to minimize the need to contact the operator. It is possible to preliminarily check whether such a task of recognition was encountered earlier and, in case of finding an answer, rely on it.

The set of essential features of the present invention as a device is not known from the prior art for devices of a similar purpose, which allows us to conclude that the criterion of "novelty" for the invention as a device is met.

A brief description of the drawings.

Other distinctive features and advantages of this group of inventions clearly follow from the description below for illustration and not being restrictive, with reference to the accompanying drawings, in which:

- figure 1 depicts a functional diagram of a device for recognizing identification data on a bank card according to the invention,

- figure 2 depicts an example of fragments for recognition of identification data on a bank card according to the invention,

- figure 3 schematically depicts the steps of a method for recognizing identification data on a bank card according to the invention.

According to figure 1, the device 1 for recognizing identification data on a bank card includes a means 2 for receiving and inputting images of a bank card and connected to it computing means 3, including the following interconnected modules:

- module 31 color processing image of a bank card on a computer device,

- module 32 determine the angles and sides of a bank card,

- module 33 converting images of a bank card to obtain an orthogonal projection of a bank card,

- module 34 storing a database of types of bank cards,

- module 35 determining the type of bank card from a database of types of bank cards,

- module 36 of optical recognition of identification data on quadrangular fragments of a bank card.

The device further includes the following modules connected to each other and connected to computing means 3:

- module 4 for storing a database of coordinates of quadrangular fragments of a bank card with identification data necessary for recognition in each particular series of bank cards,

- module 5 for determining, by the first six digits of the bank card number, a series of a bank card from a database of coordinates of bank card fragments with identification data necessary for recognition, the specified coordinates of quadrangular fragments of a bank card with identification data necessary for recognition.

The device further includes a database storage unit 6 of a plurality of bank card images.

The device may be connected via an integrated network 7 to another remote device 8 for recognition of identification data on a bank card.

The device has a connection via an integrated network 7 to the client device 9 of the operator for the possibility of recognizing difficultly recognized fragments manually.

The device 1 and / or device 8 may further include a module 10 for storing a database of hard to recognize fragments connected to computing means 3.

The device 1 may be a client device of the user, and the device 8 is a remote server. A server (Eng. Server) is an electronic device that performs service functions at the request of a client, giving him access to certain resources. For the purposes of this description, a server is considered having a permanent connection to a federated network that can transmit data to the server from client devices. The server can process this data and transfer the processing result back to the client device.

Database storage modules are a module of a client device 1 or server 8, which stores the coordinates of fragments of a bank card with identification data necessary for recognition, of different series (with different BINs), which can be executed as a hard disk drive or as a flash drive memory (flash memory), which refers to semiconductors of electrically reprogrammable memory.

Modules 31-36, 4, 5, 6 of device 1 or server - these can be controllers, microprocessors, their departments, which can be executed in isolation, or can be combined into groups. Similarly, different databases can be stored in the same memory module.

As a means 2 of receiving and inputting bank card images, it is preferable to use the built-in camera of a mobile phone user of a smartphone type. But it can also be a separate device, for example, a digital camera or a scanner connected to device 1.

A fragment can be either a single digit or a group of digits. For example, in a bank card number, numbers are usually divided into groups of four. So in this case, a fragment can be a group of four digits, or a smaller group, up to one digit.

The device 1 and / or device 8 can additionally be connected to external libraries containing additional fonts and / or languages and / or characters necessary for recognition. The figures are not shown.

The figure 2 shows fragments that include the entire field: F1 - bank card numbers, F2 - last name and username, F3 - expiration date. Also, for the fragment F1, the coordinates of the quadrangular region are shown in the coordinates attached to the edge of the bank card.

The implementation of the invention

A device for recognizing identification data on a bank card works as follows. Here is the most comprehensive example of the invention, bearing in mind that this example does not limit the application of the invention.

According to figure 2:

Stage A1. A database of 4 coordinates of quadrangular fragments of a bank card with the identification data necessary for recognition in each particular series of bank cards is preliminarily created in a computer device. Also, a database of 10 difficultly recognized fragments and the corresponding correct identification data variants are preliminarily formed in a computer device.

Stage A2. The server 8 is used as a computer device, connected via an integrated network 7 to a client device 1 of a user having an image pickup device 2, as well as to a client device of an operator 9.

Stage A3. Many different images of the front and back sides of the bank card are received and transmitted to the computer device 1 using the image acquisition means 2. Moreover, this set can be a continuous video sequence. Also, among the many different images of the front and back sides of a bank card, image capture parameters are changed - turn the flash on and off, change modes from color to black and white, turn on and turn off various filters, and more. That is, they use all kinds of color and gamut algorithms, including interchanging the individual color channels in various combinations (green, red, blue, alpha) and converting the image to monochrome, and flash is also actively used, which is turned on at different angles of demonstrating a bank card to the image acquisition tool 2. The user moves the bank card in front of the image pickup means 2 up-down, left-right, and with the help of the image pickup 2 and possibly flash I’m certain shots where these or those fragments are best seen, including due to caused glare, which is especially important for options for recognizing embossed numbers.

Thus, a large number of different images of the front and back sides of the bank card and many different images of quadrangular fragments on the bank card appear, within which optical identification of the identification data is necessary. All this eliminates possible recognition problems associated with the presence of a blurry image, cropping, flare, glare, difficulties in determining the edge of a bank card, for example, when the edges of a bank card merge with the background.

Stage A4. Determine the angles and sides of a bank card. First of all, a frame is searched for an object containing four rounded corners and four faces. For this, as an option, they use DBASM technology, adapted for use on bank cards. DBASM is the name of the technology for searching for an active element or object by formulated criteria, and stands for Discriminative Bayesian Active Shape Models.

Stage A5. The image of the bank card is converted to obtain an orthogonal projection of the bank card, and color processing of the image of the bank card is performed on a computer device, for which they analyze the image with the aim of eliminating false positives, performed by using the MOSSE correlation filter to analyze the similarity of the substrate with a set of known substrates . MOSSE - stands for Minimum Output Sum of Squared Error.

Step A6. First of all, on the front side of the bank card, a quadrangular fragment of the bank card is recognized, corresponding to the first six digits of the bank card number, which uniquely correlate the bank card with a specific series of bank cards in a particular issuing bank.

Stage A7. Based on the first six digits of the bank card number, the bank card series selects from the database the coordinates of the bank card fragments with the identification data necessary for recognition, the specified coordinates of the quadrangular bank card fragments with the data necessary for recognition. That is, in accordance with the type of bank card, the exact location of the quadrangular fragments on the bank card is determined, within which it is necessary to conduct optical recognition of identification data.

Stage A8. Then, identification data is recognized on the quadrangular fragments of the bank card, for which the digits are searched using the Sobel operator and using the frequency filter first vertically (to determine the upper and lower digits borders), then horizontally to determine the boundaries of the "fours" of digits, which allow you to find the boundaries of each of the numbers and the boundaries of the missing fours. Data is recognized using a combination of mathematical statistics methods and / or methods of artificial intelligence systems, including those based on neural networks, for example, a three-layer perceptron, as well as methods of frequency analysis of data on the differential value of the image pixels of the maps.

Stage A9. If it is impossible to recognize on a quadrangular fragment of a bank card, select the specified fragment of the bank card from another image from the set of different images of the front and back sides of the bank card. For this, it is not the clearest image that is determined, but rather the individual fragments of the images that have turned out to be the clearest. In one image, one region is most pronounced, in another image - another. Images are sorted in order with respect to each fragment, i.e. they determine the place on the bank card, where there should be a number or a figure to be recognized, and quickly sort through all the images, where in this place the most contrasting lines and elements. And so on until the full recognition of the numbers or numbers in this place. As a criterion for choosing the best image fragment for recognition, you can use the criterion for the best contrast and sharpness of the most complete fragment.

Stage A10. If it is not possible to recognize the identification data on some quadrangular fragment of a bank card, they transmit audio or written messages to the user of the client device indicating the need for receiving and transmitting additional images.

Stage A11. If it is not possible to recognize identification data on a certain quadrangular fragment of a bank card using a client device of a user, identification data is recognized using a server 8, which is connected via an integrated network 7 with a client device 1 of a user from separate images and from the database of coordinates of fragments of a bank cards with identification data necessary for recognition.

Stage A12. If it is impossible to recognize the identification data in a separate fragment by means of the server 8, the specified fragment is transmitted to the client device of the operator 9, which is connected via the integrated network to the server, and the correct version of the identification data is received from the operator, which is determined visually by the operator and entered manually.

Stage A13. If it is impossible to recognize the identification data in a separate fragment by means of server 8, additionally check for the presence of such a fragment in the database 10 of difficult to recognize fragments located on server 8, if there is such a fragment there, then select the correct one from the database of 10 difficult to recognize fragments identity option. The database of 10 hard-to-recognize characters and combinations of characters does not apply to a specific series of bank cards, but to all bank cards in general. Images are subjected to a certain encoding, which allows us to identify similar features and combinations of lines in fragments with those that have already been recognized.

Stage A14. If it is impossible to recognize the identification data in a separate fragment by means of the server 8, external libraries are connected that contain additional fonts and / or languages and / or characters necessary for recognition.

Stage A15. If it is not possible to determine the fragment necessary for recognition in the absence of a connection through the integrated network between the client device and the server, a user is asked to set the fragment boundaries on the image displayed on the display of the client device on which certain identification data is located.

Stage A16. If it is impossible to recognize the identification data in a separate fragment by means of the server or in the absence of a connection through a connected network between the client device 1 and server 8, an unrecognized fragment is transferred to the display of the user’s client device and the correct version of the identification data corresponding to this unrecognized fragment is received from it manually entering the correct data.

Stage A17. To check the correctness of determining the bank card number, the Moon criterion is used, if it is not fulfilled, the identification process on the bank card is started again.

The sequence of steps is approximate and allows you to rearrange, decrease, add or perform some operations at the same time without losing the ability to provide recognition of identification data on a bank card. It is also possible to set various times during which the recognition process is transferred from one device (client - 1) to another (server - 8), then to the third (operator’s client device - 9) or to exclude some steps and use a limited version of the method or devices without losing the ability to provide recognition of identification data on a bank card. It is also possible to set various times during which the process.

Industrial applicability

The proposed method and device for the recognition of identification data on a bank card can be implemented by a specialist in practice and upon implementation provide for the implementation of the declared purpose, which allows us to conclude that the criterion of "industrial applicability" for the invention is met.

In accordance with the proposed invention made a prototype device for the recognition of identification data on a bank card.

Tests of the prototype device showed that it provides the ability to:

- accurate determination of the type of bank card;

- using the well-known coordinate database of quadrangular fragments of a bank card with identification data necessary for recognition in each particular series of bank cards, reduce the time needed to recognize the necessary identification data by eliminating the recognition of extra characters;

- multivariate recognition of identification data due to the possibility of automated and manual replacement of bad images, connecting additional features of manual recognition, both on the part of the operator and the user;

- check for correct recognition;

- create a self-learning system, which each time requires less and less time for recognition, including due to the accumulation of data in databases.

All this can significantly improve recognition accuracy and almost completely eliminate failures.

An additional useful technical result of the claimed invention is that it allows:

- Do not drive the user details of their bank cards manually on the websites of sellers;

- do not give bank cards into the hands of sellers' employees - you just need to point the mobile device’s camera on the front and back of the bank card, after which the device will instantly receive all the bank card details and it will be possible to write off funds to the seller automatically;

- exclude sellers from the settlement process, and, therefore, significantly increase the security of cashless payments.

Thus, in this invention the goal is achieved - improving the accuracy of recognition of identification data on a bank card. In addition, the above advantages show high efficiency of the proposed method and device.

Claims (20)

1. The method of recognition of identification data on a bank card, in which
- receive at least one image of a credit card,
- transmit at least one image of a credit card to a computer device,
- perform color processing of the image of a credit card on a computer device,
- determine the angles and sides of a bank card,
- convert the image of the bank card to obtain the orthogonal projection of the bank card,
- according to the image parameters determine the type of bank card based on a database of types of bank cards,
- determine in accordance with the type of bank card the exact location of the quadrangular fragments on the bank card, within which it is necessary to conduct optical recognition of identification data,
- produce optical recognition of identification data on the quadrangular fragments of a credit card,
characterized in that
Additionally, the method includes the following steps:
- receive and transmit to the computer device a lot of different images of the front and back sides of a credit card,
- first of all, on the front side of the bank card, a quadrangular fragment of the bank card is recognized, corresponding to the first six digits of the bank card number, which uniquely correlate the bank card with a specific series of a bank card in a particular issuing bank,
- create in a computer device a database of coordinates of quadrangular fragments of a bank card with identification data necessary for recognition in each particular series of bank cards,
- based on the first six digits of the bank card number, a bank card series is selected from the database of coordinates of fragments of a bank card with identification data necessary for recognition, the specified coordinates of quadrangular fragments of a bank card with data necessary for recognition,
- identification data is recognized on the quadrangular fragments of the bank card, and if it is impossible to recognize on some quadrangular fragment of the bank card, the indicated fragment of the bank card is selected from another image from the set of different images of the front and back sides of the bank card. 2. The method according to p. 1, characterized in that as a computer device using a client device of a user having a means of obtaining images. 3. The method according to p. 1, characterized in that as a computer device using a server connected via an integrated network to a client device of the user having the means of obtaining images. 4. The method according to p. 1, characterized in that if it is impossible to recognize the identification data on a certain quadrangular fragment of a bank card, select the specified fragment of the bank card from another image from the set of different images of the front and back sides of the bank card, which is the best, and as the criterion for choosing the best for recognizing a fragment of the image uses the criterion for the best contrast and sharpness of the most complete fragment. 5. The method according to claim 1, characterized in that if it is impossible to recognize the identification data on a certain quadrangular fragment of a bank card, they transmit audio or written messages to the user of the client device indicating the need for receiving and transmitting additional images. 6. The method according to p. 1, characterized in that if it is not possible to recognize the identification data on a certain quadrangular fragment of a bank card using a client device of the user, identification data is recognized using a server that is connected through an integrated network with the client device of the user in separate images and according to the database of coordinates of fragments of a bank card available on the server with identification data necessary for recognition. 7. The method according to p. 1, characterized in that if it is not possible to recognize the identification data in a separate fragment by means of the server, the specified fragment is transmitted to the client device of the operator connected via the integrated network to the server, and the correct version of the identification data is received from the operator, which is determined operator visually and manually entered. 8. The method according to p. 1, characterized in that when the operator recognizes a hard-to-detect fragment for each fragment, a database of hard-to-recognize fragments and the correct identification data corresponding to them are formed. 9. The method according to p. 1, characterized in that if it is impossible to recognize the identification data in a separate fragment by means of the server, they additionally check the presence of such a fragment in the database of hard-to-recognize fragments located on the server, if there is such a fragment there, then choose databases of hard-to-recognize fragments the correct variant of identification data corresponding to the indicated fragment. 10. The method according to p. 1, characterized in that if it is impossible to recognize the identification data in a separate fragment by the means of the server, external libraries containing additional fonts and / or languages and / or characters necessary for recognition are connected. 11. The method according to p. 1, characterized in that if it is impossible to determine the fragment necessary for recognition in the absence of a connection through the integrated network between the client device and the server, the user is asked to set the fragment boundaries on the image displayed on the display of the client device, on which certain credentials are found. 12. The method according to p. 1, characterized in that if it is impossible to recognize the identification data in a single fragment by the server or in the absence of a connection through a connected network between the client device and the server, an unrecognized fragment is transferred to the display of the client device of the user and receives the correct version from it identification data corresponding to this particular unrecognized fragment by manually entering the correct data. 13. The method according to p. 1, characterized in that the Moon criterion is used to check the correctness of determining the bank card number, if it is not fulfilled, the process of recognizing identification data on the bank card is started again. 14. The method according to claim 1, characterized in that upon receipt and transmission to the computer device of a plurality of different images of the front and back sides of the bank card, additionally, using the image acquisition means, the level of illumination, and / or the presence of glare on the card, and / or color the gamut, and / or proximity of the background color to the color gamut of the bank card, and / or the remoteness of the bank card from the camera, transmit audio or written messages to the user of the client device indicating the need for receiving and transmitting additional images. 15. The method according to p. 1, characterized in that the identification data is recognized on the quadrangular fragments of a bank card using methods that provide self-learning for the self-learning process. 16. A device for recognizing identification data on a bank card, including means for receiving and inputting bank card images and connected to it computing means, including the following interconnected modules:
- a module for color processing the image of a bank card on a computer device,
- a module for determining the angles and sides of a bank card,
- a module for converting a bank card image to obtain an orthogonal projection of a bank card,
- a module for storing a database of bank card types,
- a module for determining the type of bank card based on a database of types of bank cards,
- module optical recognition of identification data on quadrangular fragments of a bank card,
characterized in that the device further includes the following modules connected to each other and connected to computing means:
- a module for storing a database of coordinates of quadrangular fragments of a bank card with identification data necessary for recognition in each particular series of bank cards,
- a module for determining, by the first six digits of the bank card number, a series of a bank card from a database of coordinates of fragments of a bank card with identification data necessary for recognition, the specified coordinates of quadrangular fragments of a bank card with identification data necessary for recognition. 17. The device according to p. 16, characterized in that the device further includes a module for storing a database of a plurality of bank card images. 18. The device according to p. 16, characterized in that the device is connected via an integrated network to another remote device for recognizing identification data on a bank card. 19. The device according to p. 16, characterized in that the device is connected via an integrated network to the client device of the operator for the possibility of recognizing difficultly recognized fragments manually. 20. The device according to p. 16, characterized in that the device further includes a module for storing a database of unrecognizable fragments connected to the computing means.

Images