KR20190053414A - Method and server for providing payment service of bills - Google Patents

Abstract

Provided are a method for offering a bill payment service and a server apparatus performing the same. The method for offering the bill payment service, performed by the server apparatus operated by at least one processor, comprises the steps of: receiving a bill image, captured by a terminal, from the terminal; performing optical character recognition (OCR) for the bill image to extract bill information from the bill image; performing a natural process for the bill information to generate a bill information table with a specific format; transmitting a bill payment request, including the bill information table, to a payment process server; and receiving a bill payment process result from the payment process server and transmitting the result to the terminal. The present invention realizes the bill payment process only by operation of taking a picture of the bill to enhance user convenience.

Description

[0001] METHOD AND SERVER FOR PROVIDING PAYMENT SERVICE OF BILLS [0002]

The present invention relates to a bill delivery service providing method and a server apparatus for performing the method.

Due to the hardware development of mobile terminals such as mobile phones, mobile terminals equipped with multimedia functions and wireless internet functions are becoming a necessity of life. The mobile terminal is equipped with a high-performance camera so that it can easily acquire image information by shooting various subjects and has a technical basis for easily transmitting image information by the development of data transmission technology.

On the other hand, many kinds of taxes / bills must be paid on a monthly or specific period basis. It is common to visit a financial institution and pay it directly, or pay it through an Internet site or Internet banking site.

Therefore, when there are a plurality of bills, it is inconvenient to visit the financial institute directly each time the payment cycle comes, or to input necessary information by accessing the site.

SUMMARY OF THE INVENTION The present invention provides a method and system for reading a billscript image generated by a camera of a mobile terminal by using artificial intelligence technology and processing payment of the bills of bills read through an account designated by a customer in advance, And to provide the server device.

According to another aspect of the present invention, there is provided a method of providing a bill payment service performed by a server device operated by at least one processor, the method comprising: receiving an image of a bill taken by the terminal from a terminal; Performing optical character recognition (OCR) on an image, extracting billing information from the billing image, processing the billing information in a natural language to generate a billing information table in a specific format, Transmitting a bill payment request including a table to a payment processing server, and receiving a bill payment processing result from the payment processing server and transmitting the bill payment processing result to the terminal.

Before the step of receiving the billing image, collecting various types of billing images, and performing optical character recognition on the collected billing images, extracting character and pattern information.

Learning the extracted character and pattern information using artificial intelligence technology, and storing the learning information.

The step of extracting the bill information may extract character and pattern information from the bill image based on the learning information.

Wherein the step of generating the billing information table comprises the steps of: processing the character and pattern information in a natural language; confirming the billing classification identifier based on the natural-language processed information; And generating a bill information table.

The result of the bill payment processing may include a bill payment processing result of the account transfer method using the registered account.

According to another aspect of the present invention, there is provided a server apparatus including a communication unit connected to a terminal through a communication network to transmit and receive data, a memory for storing a program, and at least one processor for executing the program, Extracts character and pattern information by performing optical character recognition (OCR) on the received billboard image, processes the character and pattern information in a natural language to form bills of information in a specific format, And instructions for processing the payment of the bill based on the information.

The program may identify the corresponding billing classification identifier among a plurality of billing classification identifiers previously defined based on the natural language processed character and pattern information.

The program may include a command to generate the billing information table corresponding to the confirmed bill classification identifier of the natural language processed character and pattern information and process the bill payment using the bill information table.

The program may perform optical character recognition on a plurality of bill book images of different kinds, and may generate learning information by learning optical character recognition results.

And extracting the character and pattern information from the billboard image received from the terminal using the learning information.

The plurality of bill book images of the different kind may include bill statement details and other bill image images by the bill issuing agency.

According to the embodiment of the present invention, since the bill payment processing is performed by only the operation of photographing the bill, user convenience is increased.

In addition, there is an advantage that the security service provided by the financial institution can be used / paid as it is, by paying the bill through the interlocking with the stable banking program authenticated / distributed by the financial institution.

1 schematically shows a system configuration for providing bill payment service according to an embodiment of the present invention.
2 is a flowchart illustrating a series of processes for providing bill payment service according to an embodiment of the present invention.
FIG. 3 is a view illustrating an example of taking a bill according to an embodiment of the present invention.
4 is a diagram illustrating an example of a bill payment screen according to an embodiment of the present invention.
5 is a flowchart illustrating an operation of an image processing server according to an embodiment of the present invention.
6 is a hardware block diagram of a terminal according to an embodiment of the present invention.
7 is a hardware block diagram of a server apparatus according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when an element is referred to as " comprising ", it means that it can include other elements as well, without excluding other elements unless specifically stated otherwise.

Also, the terms of " part ", " ... module " in the description mean units for processing at least one function or operation, which may be implemented by hardware or software or a combination of hardware and software.

Hereinafter, a bill payment service providing method and a server apparatus for performing the bill payment service according to an embodiment of the present invention will be described with reference to the drawings.

FIG. 1 schematically shows a network configuration for providing a bill payment service according to an embodiment of the present invention. Referring to FIG.

Here, the bill includes bills such as national taxes, local taxes, penalties, electricity bills, and other bills such as apartment management fees.

In addition, the bill issuing organization may be an organization such as District Heating Corporation, Korea Electric Power Corporation, Water Resources Corporation, Newspaper Company, National Tax Service, National Police Agency, etc., or may be connected to government departments or affiliated institutions KFTC, and Jiro integrated management organization.

Referring to FIG. 1, a terminal 100 connects to a bill payment processing system 300 through a network 200. The terminal 100 is a mobile terminal having a camera and a data communication module, and includes, for example, a mobile phone, a PDA (Personal Digital Assistant), a smart phone, and the like.

The terminal 100 transmits a bills image generated by photographing the bill with a camera to the bill payment processing system 300 through the communication network 200.

The communication network 200 may be composed of various types of wireless networks such as a long term evolution (LTE) network, a mobile communication network such as a wideband code division multiple access (WCDMA) network, a Wi-Fi network, or a combination thereof.

The bill payment processing system 300 may be embodied as one physical server device or a plurality of physical server devices.

According to one embodiment, the bill payment processing system 300 may include a banking server 301, an image processing server 303 and a billing brokerage server 305.

The banking server 301 is a server for providing a mobile banking channel or a smartphone banking channel.

The banking server 301 operates a banking site connected to the mobile web or a banking application installed in the terminal 100.

The banking server 301 may provide a billing payment menu through a banking site or a banking application.

When the user selects the bill payment menu, the banking server 301 receives the billboard image photographed through the camera activated in the terminal 100, and transfers the billboard image to the image processing server 303.

The image processing server 303 learns different types of bill book images and generates learning information for each bill type. The image processing server 303 extracts character and pattern information from the billing image received from the banking server 301 based on the prior learning information. Here, the pattern information means the format or format of the bill.

The billing brokerage server 305 determines the bill classification identifier by performing a natural language processing (NLP) on the character and pattern information received from the image processing server 303. BOOK CLASSIFICATION IDENTIFIER means the bill type. For example, a bill classification identifier indicates whether the bill is an electric bill or an apartment bill.

The billing brokerage server 305 generates the billing information table according to the billing classification identifier. The bill transfer intermediary server 305 generates a bill payment request including the bill information table, transfers it to the payment processing server 400, and receives the bill payment processing result.

At this time, according to one embodiment, the payment processing server 400 may be an accounting server of the financial institution. When receiving the bill payment request, the payment processing server 400 fetches the bill payment amount from the account of the predetermined terminal 100 and deposits the bill into the account of the bill issuer. And returns the deposit processing result to the billing intermediation server 305.

According to another embodiment, the payment processing server 400 may be a card issuer server. The payment processing server 400 processes the bill payment using the card of the predetermined terminal 100 and returns the card payment result to the billing broker server 305 when the bill payment server 400 receives the bill payment request.

FIG. 2 is a flowchart illustrating a series of process steps for providing a bill payment service according to an embodiment of the present invention. FIG. 3 is a view illustrating an example of a bill according to an embodiment of the present invention, Fig.

Referring to FIG. 2, the terminal 100 is connected to the banking server 301 (S101). The terminal 100 selects the bill payment menu (S103), and activates the camera (S105).

As shown in FIG. 3, the terminal 100 shoots a bill to be paid (S107).

The terminal 100 transmits the at least one billing image generated through the photographing to the banking server 301 (S109).

Here, at least one bills image can be generated through a capture algorithm, and a detailed description will be omitted since there are various techniques disclosed in the capture algorithm.

The banking server 301 transmits at least one billboard image received from the terminal 100 to the image processing server 303 (S111).

The image processing server 303 performs optical character recognition (OCR) on at least one bills image received (S111) (S113), and extracts character and pattern information from at least one bills image (S115 ). Then, the extracted character and pattern information is transmitted to the billing intermediation server 305 (S117).

The billing broker server 305 performs natural language processing (NLP) (S119) on the character and pattern information received (S117), and configures the character and the pattern information as meaningful information. That is, the billing brokerage server 305 confirms the billing classification identifier corresponding to the character and the pattern information (S121), and generates the billing information table of the format matching the billing classification identifier (S121) S123). Here, the bill book information table can be generated in a form almost similar to or the same as that in which the information contained in the actual bill taken by the terminal 100 is configured.

The bill transfer intermediary server 305 transmits a bill payment request including the bill information table to the payment processing server 400 (S125).

The payment processing server 400 confirms the information necessary for paying the bill from the bill information table (S127). For example, information necessary for settlement such as information of the recipient and payment person, due date, amount of money, etc. is confirmed.

The payment processing server 400 transmits an authentication information request to the terminal 100 through the billing intermediation server 305 and the banking server 301 (S129, S131, and S133).

The terminal 100 outputs the authentication screen received (S133) (S135), and the authentication screen can be implemented as shown in FIG. That is, it is possible to output an authentication screen composed of authentication information, such as a PIN (Personal Identification Number) number entry item, necessary for payment of bill information and payment of a bill.

The terminal 100 transmits the authentication information received from the user (S137) to the payment processing server 400 through the banking server 301 and the billing intermediation server 305 (S139, S141 and S143).

The payment processing server 400 verifies the received authentication information validity (S143) (S145). If the verification of the authentication information is successful, the payment processing server 400 processes payment of the bill (S147). That is, the payment processing server 400 processes the bill payment process by the account transfer method, the card payment method, or the like (S147) on the basis of the previously registered billing person information, and then sends the bill payment processing result to the billing mediation server 305, (S149, S151, and S153) through the terminal 301 (S149, S151, and S153). The terminal 100 outputs a bill payment processing result screen (S155).

FIG. 5 is a flow chart showing the operation of the image processing server according to the embodiment of the present invention, and is an example in which steps S113 and S115 of FIG. 2 are specifically shown.

Referring to FIG. 5, the image processing server 303 collects various types of billing images photographed at different resolutions and frame per second (FPS) for each billing statement (S201).

The image processing server 303 performs OCR on each billing image collected (S201), and learns character and pattern information extracted from the billing image (S205) using artificial intelligence technology (S207) . The learning information accumulated through the learning (S207) is stored (S209).

Thereafter, the image processing server 303 performs OCR on the billing image received from the terminal 100 through the banking server 301 (S211), and based on the previously stored (S209) learning information, Information is recognized (S213).

In this manner, the pre-learned information is used as a reference value for extracting the bill character and the bill pattern information.

Meanwhile, FIG. 6 is a hardware block diagram of a terminal according to an embodiment of the present invention, and shows the hardware configuration of the terminal 100 described with reference to FIG. 1 to FIG.

6, the terminal 500 includes a communication unit 501, a memory 503, a camera 505, an input unit 507, a display unit 509, and at least one processor 511.

The communication unit 501 is connected to the communication network 200 to transmit and receive data. The memory 503 is configured to store a set of codes, which code is used to control the processor 511 to perform the operations of the invention described in Figures 1-3. This operation includes an operation of connecting to the banking server 301 to capture a billing image, transmitting the generated billing image, and receiving a billing processing result from the banking server 301. The memory 503 may include a read only memory (ROM), a random access memory (RAM), and a non-volatile random access memory (NVRAM).

The camera 505 receives an external image through photographing or the like.

The input unit 507 may be a variety of input devices such as a keypad, a touchpad, a touch screen, and an optical joystick.

The display unit 509 is a means for outputting the operation of the terminal 500 to the screen.

The processor 511 executes the code stored in the memory 503 to implement the configuration and method of the present invention described in Figs. Such a processor 511 may also be referred to as a controller, a microcontroller, a microprocessor, a microcomputer, or the like. In addition, the processor 511 may be implemented by hardware or firmware, software, or a combination thereof.

7 is a hardware block diagram of a server apparatus according to an embodiment of the present invention. The banking server 301, the image processing server 303, the billing brokerage server 305, and the payment processing server 305 described with reference to Figs. 1 to 5, (400).

7, the server apparatus 600 includes a communication unit 601, a memory 603, a storage device 605, and at least one processor 607. [

The communication unit 601 is connected to at least one processor 607 to transmit and receive data through the communication network 200. [ The memory 603 is coupled to at least one processor 607 and stores a set of codes that cause the configuration and / or method according to the embodiments described in FIGS. 1-3 to execute.

The storage device 605 stores data for executing the configuration and / or method according to the embodiments described in Figs. 1-5. The processor 607 executes the present invention in combination with hardware such as the memory 603, the storage device 605, and the like.

The embodiments of the present invention described above are not implemented only by the apparatus and method, but may be implemented through a program for realizing the function corresponding to the configuration of the embodiment of the present invention or a recording medium on which the program is recorded.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, It belongs to the scope of right.

Claims (12)

A bill payment service providing method performed by a server apparatus operated by at least one processor,
Receiving an image of the bill photographed by the terminal from the terminal;
Performing optical character recognition (OCR) on the bill image to extract bill bill information from the bill bill image;
Generating a billing information table in a specific format by processing the billing information in a natural language,
Transmitting a bill payment request including the bill information table to a payment processing server; and
Receiving the billing result from the billing server and transmitting the result to the terminal
The method comprising the steps of: The method of claim 1,
Prior to receiving the billing image,
Collecting various types of billboard images, and
Extracting character and pattern information by performing optical character recognition on the collected billboard images
A bill payment service providing method, 3. The method of claim 2,
Learning the extracted character and pattern information using artificial intelligence technology, and storing learning information
Further comprising the steps of: 4. The method of claim 3,
The step of extracting the bill information comprises:
And extracts character and pattern information from the bill image based on the learning information. 5. The method of claim 4,
Wherein the step of generating the billing information table comprises:
Processing the character and pattern information in a natural language,
Identifying the bill classification identifier based on the natural-language processed information, and
Generating the information processed in the natural language as a bill information table in a format according to the bill classification identifier
The method comprising the steps of: The method of claim 1,
As a result of the bill payment processing,
And a result of the account transfer method bill payment process using the previously registered account. A communication unit connected to the terminal through the communication network to transmit and receive data,
Memory to store the program, and
And at least one processor for executing the program,
The program includes:
Extracts character and pattern information by performing optical character recognition (OCR) on the billboard image received from the terminal, processes the character and pattern information in a natural language to form bills of information in a specific format,
And instructions for processing the bill payment based on the billing information in the specific format. 8. The method of claim 7,
The program includes:
Based on the character and pattern information processed in the natural language, the corresponding billing classification identifier from among a plurality of billing classification identifiers previously defined
Server device 9. The method of claim 8,
The program includes:
Generating the text and pattern information processed in the natural language as a bill information table according to the confirmed bill classification identifier,
And processing the bill payment using the billing information table. The method of claim 9,
The program includes:
Performing optical character recognition on a plurality of bill book images of different kinds, and generating learning information by learning optical character recognition results
Server device. 11. The method of claim 10,
And extracting the character and pattern information from the billing image received from the terminal using the learning information. 12. The method of claim 11,
Wherein the plurality of biller images of the different kinds include:
The billing statement and the billing authority include other billing images.

Images