KR20210004270A - A method for rasing nonprofit fund using scraping technology, and a system therefor - Google Patents

Abstract

The present invention relates to a method for settling nonprofit organization funds using a scraping technique and a system therefor and, more specifically, to a method for settling funds raised from a seller to a nonprofit organization by using a scraping technique which is a technique for extracting required data to process or provide the data, and a system therefor. According to a proper embodiment of the present invention, the system for settling nonprofit organization funds using a scraping technique comprises: a user agent which is positioned in a user PC, and has a work area and a scraping support area; and a scraping server which is linked to the user agent, and performs a role of data communication and data acquisition in accordance with a communication/security policy practically required for an external financial institution for a data request requested by the user agent (terminal).

Description

A method for rasing nonprofit fund using scraping technology, and a system therefor}

The present invention relates to a nonprofit fundraising settlement method and a system for the same using scraping technology, and more specifically, to settle the fundraising performed from a seller to a nonprofit organization using a scraping technology that extracts and processes or controls necessary data It relates to a method and a system for the same.

The scraping technology is a technology that extracts, processes, or provides necessary data. It is a technology that can collect and manage customer information scattered in various places such as financial companies, public institutions, and government websites.

It refers to a technology that collects and processes or provides customer information scattered in several places by accessing data systems such as financial institutions, public institutions, and government websites even if a customer provides his or her authentication information once. Scrap means scraping, and it is called scraping because it provides information that a user wants from a website or a database.

The scraping technology is used to manage personal assets and corporate funds by collecting financial information of customers scattered across various financial institutions, and is being actively used in all fields beyond Oda financial institutions. In particular, this technology is used as a core technology for fintech services that integrates and manages assets without entering a certificate password one by one.

When data scraping is activated, you do not have to go through the process of visiting financial institutions and public institutions to submit various documents, and through a specific application, collect and check deposits, savings, funds, and loans in various bank accounts, or subscribe to insurance companies, post offices, Saemaul Geumgo, etc. You can also view the insurance details and premiums that have been made.

On the other hand, in Korea, scraping companies have reviewed the direction of restricting the technology because they have a large amount of personal authentication information and then hacking can cause damage, but there was a backlash that it was an act that is going backwards. Accordingly, the government decided to allow scraping if the scraping companies do not directly store personal authentication information but store it in terminals.

In the conventional scraping method, a service server for scraping user information that may have to log in to a system of a predetermined financial institution receives log-in information from a client. In addition, the service server can scrape necessary user information after accessing the system of the target institution using the received information. To this end, the service server may generate an event to pretend to be a user for the target institution system.

In the scraping method, an abusing issue may occur in the target institution system due to various reasons, such as a problem that the service server generates a relatively large load on the target institution system, as well as the target institution system has an unwanted login gudxo. This has a problem of blocking access to the service server.

In addition, even if there is no or no abusing problem, there is a problem that the process of acquiring the public certificate or the psychological burden of the user is relatively large when the service server must acquire the public certificate and the public certificate password as login information. Accordingly, there is a problem that it is quite difficult to obtain a public certificate and a public certificate password from users.

Small and medium-sized non-profit organizations are complaining of difficulties in managing individual accounts for regular CMS withdrawals, repayments for the current month, or non-payment for the previous month. Difficulties in fundraising settlement and management are occurring due to various online/offline fundraising.

There is a need to connect with an O2O (Online to Offline) fundraising brokerage solution, and it is necessary to develop an integrated settlement management system capable of collecting deposit/withdrawal data for each distributed account according to the purpose of the fund and collecting big data that enables integrated management and monitoring.

Korean Patent Registration 10-046712 (Credit rating system and method through interface with Internet finance-related sites and related institutions)

The problem to be solved by the present invention is to provide a fundraising settlement management system and method to which scraping technology is applied.

Another object of the present invention is to provide a variety of CMS management, automatic donation receipt reporting, donation receipt statement issuance functions used by non-profit organizations through scraping technology, and donations that cannot be supported in existing CMS programs (regular payments through card payment, temporary donations) Fundraising classification and management function for fundraising can be provided, and fundraising settlement that can perform the function of checking and requesting regular payments, temporary donations, card sponsorships, etc. through the database of financial institutions (banks, card companies, VAN companies) applying scraping technology It is to provide a management system and method.

In addition, another object of the present invention is to provide a fundraising settlement method and system capable of automatically performing tasks related to donor information change request processing, donation receipt sending, etc. occurring during the issuance season of a donation receipt.

The objects of the present invention are not limited to the above-mentioned objects, and other objects that are not mentioned will be clearly understood by those of ordinary skill in the art from the following description.

The present invention, in order to achieve the above object, according to a preferred embodiment of the present invention, a non-profit fundraising settlement system using a scraping technology is located in a user PC, a user agent having a work area and a scraping support area; And a scraping server interworking with the user agent and performing a data communication and data acquisition role in accordance with a communication/security policy substantially requested from an external financial institution in response to a data request requested from the user agent (Agent, terminal). Include.

According to a preferred embodiment, the scraping area includes a version management module that performs a pre-processing task for updating and synchronizing programs, libraries, and certificates between a user PC and a scraping server and a file transmission/reception role, and user information and PC registered in the scraping server. The certificate distribution module performs synchronization by checking whether the registered user information or certificates are the same, checks the request data received from the business area, and requests the server for the data inquiry order (scheduling) according to the internal policy. It includes a task assignment management module.

According to a preferred embodiment, the scraping server is an authentication management module that performs a role of checking whether a program between the scraping server and the task assignment management module is authenticated when the user agent first requests information, and a task. User information transmitted from the allocation management module is transmitted to the scraping engine using API (Application Program Interface) calls or OLE (Object Linking and Embedding) protocols, and the result is transmitted from the task allocation management module to socket or SSL communication. A scraping operation module to transmit, and a scraping environment module that stops and reruns the process when a problem occurs due to abnormal execution or error in the scraping operation module, and performs user input for installing or updating programs necessary for scraping such as security modules. , It includes a scraping engine that inputs necessary information on the authentication page and uses it as a destination page, then enters the necessary information on the destination page, and then acquires information and performs tasks.

According to a more preferred embodiment, the scraping engine receives the scraping target information transmitted to the scraping task module, delivers it to the scheduler module, and performs the role of parsing, item extraction, and verification of the data set received from the downloader module. And, as a schedule buffer that receives the request received from the scraping engine, a scheduler module that delivers the request to the downloader module when the scraping engine is needed, and performs actions such as login and page movement to fetch target data, and targets It includes a downloader module that parses and retrieves the data after moving to the page.

As described above, the nonprofit fundraising settlement method according to the present invention is a system to settle the fundraising amount to a nonprofit organization by applying a scraping technique, and not only helps to perform the fundraising activity of a nonprofit organization easily and easily, but also scraping. Provides a variety of CMS management, automatic donation receipt reporting, donation receipt statement issuance functions used by non-profit organizations through technology, and functions to classify and manage donations for donations that cannot be supported by existing CMS programs (regular payments through card payment, temporary contributions) Can provide, and perform the function of checking and requesting regular payments, temporary donations, card sponsorships, etc. through the database of financial institutions (banks, card companies, VAN companies) applying scraping technology, and donor information generated during the season of issuing donation receipts. It has the advantage of being able to automatically perform tasks related to processing change requests and sending donation receipts. This has the advantage that management work efficiency, labor cost reduction, and settlement accuracy can be achieved.

1 is a schematic diagram of a fundraising settlement system for a non-profit organization using a scraping technique according to a preferred embodiment of the present invention.
Figure 2 is a schematic diagram of a SW development environment configuration and service basic architecture of a fundraising settlement system for a non-profit organization using scraping technology according to a preferred embodiment of the present invention.
3 is a block diagram of a fundraising settlement system for a non-profit organization using scraping technology according to a preferred embodiment of the present invention.

Advantages and features of the present invention, and a method of achieving them will become apparent with reference to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but will be implemented in various forms different from each other, and only these embodiments make the disclosure of the present invention complete, and common knowledge in the technical field to which the present invention belongs It is provided to completely inform the scope of the invention to those who have it, and the invention is only defined by the scope of the claims.

With reference to the accompanying drawings below will be described in detail for the implementation of the present invention. Regardless of the drawings, the same reference numerals refer to the same elements, and "and/or" includes each and all combinations of one or more of the mentioned items.

Although the first, second, and the like are used to describe various components, it goes without saying that these components are not limited by these terms. These terms are only used to distinguish one component from another component. Therefore, it goes without saying that the first component mentioned below may be the second component within the technical idea of the present invention.

The terms used in this specification are for describing exemplary embodiments, and are not intended to limit the present invention. In this specification, the singular form also includes the plural form unless specifically stated in the phrase. As used in the specification, “comprises” and/or “comprising” do not exclude the presence or addition of one or more other elements other than the mentioned elements.

Unless otherwise defined, all terms (including technical and scientific terms) used in the present specification may be used as meanings that can be commonly understood by those of ordinary skill in the art to which the present invention belongs. In addition, terms defined in a commonly used dictionary are not interpreted ideally or excessively unless explicitly defined specifically.

The present invention collects financial information on deposit and withdrawal accounts held/operated by non-profit organizations by applying scraping technology and processes regardless of payment methods (automatic transfer, mobile payment, phone payment, virtual account, deposit transfer, card, etc.) Is possible. In the case of regular card sponsorship, it is a method and system that solves the problem of manual comparison with sales details by depositing the total amount of the day by day, rather than making a deposit by case when depositing from a card company.

Most of the currently operated CMS management programs only provide information related to account transfer, but there is no function to support individual verification for changes in the payment method of sponsors (regular card payment). In particular, in the case of regular sponsorship in the card payment method, it is not delivered in the name of the depositor, but in an integrated deposit method for the payment case, so that the deposit details of the development sponsor must be compared again with the sales contents. Therefore, when it is recognized as an abnormal pending transaction of the card company, there was a problem that the payment confirmation was inconsistent, and each individual card company information had to be checked after logging in, and the member DB for temporary sponsors and potential sponsors only provided management for regular sponsors through CMS. It was difficult to manage and provide deposit and withdrawal information.

The method of fundraising for non-profit organizations applying the scraping technology of the present invention supports the operating environment for settlement/management of donations of small and medium-sized non-profit organizations. It is possible to solve the problem of inability to support for issuance of donation receipts related to in-kind payment, which requires a lot of time, especially in designated donation organizations.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. 1 is a flow chart schematically illustrating a data flow of a method for scraping user information of a financial institution according to a preferred embodiment of the present invention.

1 is a schematic diagram of a fundraising settlement system for a non-profit organization using a scraping technique according to a preferred embodiment of the present invention.

Referring to FIG. 1, the present invention is an integrated management system and method for calculating fundraising for non-profit organizations using scraping technology as a part of an information and communication software solution as a method for fundraising for a non-profit organization applying scraping technology.

As shown in Fig. 1, the non-profit fundraising settlement system using the scraping technology of the present invention includes a user agent, a fundraising support server, and a scraping server.

The user agent (terminal) is linked with functions such as CMS added to the settlement of donations, payment of regular card donations, management of regular sponsors, certificate management, and the scraping server. The user terminal performs on/offline settlement, campaign management, user (member) management, certificate management, and CMS management.

The fundraising support server has a function development and donation deposit and withdrawal management functions necessary in the areas of generating, managing, and reporting donation receipts, one of the main tasks of small and medium-sized non-profit organizations.

The scraping server is a place that requests financial information from multiple financial institutions registered based on user information and performs scraping. The scraping server provides a scraping engine, authentication management, scraping operation, and scraping environment.

2 is a schematic diagram of a configuration of a SW development environment and a basic service architecture of a fundraising settlement system for a non-profit organization using a scraping technique according to a preferred embodiment of the present invention.

Referring to Figure 2, the non-profit fundraising settlement system using the scraping technology of the present invention has an MSA (Micro Sevice Architecture) structure in consideration of future expandability. The basic architecture diagram of the scraping server and fundraising support server is the same.

Mybatis is used to develop SQL coding more conveniently, and Memory Cache is used to improve performance and manage memory efficiently. Also, Message Queue is used for asynchronous processing and delivery of event messages between services.

3 is a block diagram of a fundraising settlement system for a non-profit organization using scraping technology according to a preferred embodiment of the present invention.

3, a user agent (terminal) is physically located in a user PC, and is divided into a work area and a scraping support area, and the scraping area is composed of a version control module, a certificate distribution module, and a task assignment management module. .

The version control module performs a pre-processing task for updating and synchronizing programs, libraries, and certificates between the user PC and the scraping server, and a file transmission/reception role.

The certificate distribution module performs synchronization by checking whether the user information registered in the scraping server and the user information or certificate registered in the PC are the same.

The task assignment management module checks the requested data received from the business area and requests the server for a data inquiry order (scheduling) according to an internal policy.

The scraping server performs a data communication and data acquisition role in accordance with a communication/security policy substantially requested from an external financial institution in response to a data request from a user agent (agent, terminal).

The scraping server includes an authentication management module, a scraping operation module, a scraping environment module, and a scraping engine.

The authentication management module performs a role of checking whether a program that is mutually authenticated between the scraping server and the task assignment management module when the user agent first requests information.

The scraping task module transfers the user information transmitted from the task assignment management module to the scraping engine using an API (Application Program Interface) call or OLE (Object Linking and Embedding) protocol, and sends the result to the task. The allocation management module performs the role of transmitting through socket or SSL communication.

The scraping environment module stops and re-executes a process when a scraping operation module is abnormally executed or a problem occurs due to an error, and performs a user input for installing or updating a program necessary for a scraping operation such as a security module.

The scraping engine serves to input information necessary for an authentication page and use it as a target page, then input necessary information on the target page, and then acquire information and perform tasks.

The scraping engine includes a downloader module, a scheduler module, and a spider module.

The spider module receives the scraping target information delivered to the scraping task module, delivers it to the scheduler module, and performs the role of parsing, item extraction, and verification for the data set received from the downloader module.

The scheduler module is a schedule buffer that receives a request received from the scraping engine, and serves to transmit the request to the downloader module when the scraping engine is needed.

The downloader module performs actions such as log-in and page movement to fetch target data, and parses and fetches the data after moving to the target page.

The nonprofit fundraising settlement method using the scraping technology according to an embodiment of the present invention can be implemented in the form of computer program instructions and stored in a computer-readable recording medium, and the control program and the target program according to the embodiment of the present invention are also It may be stored in a computer-readable recording medium. The computer-readable recording medium includes all types of recording devices that store data that can be read by a computer system.

The program instructions recorded on the recording medium may be specially designed and configured for the present invention, or may be known and usable to those skilled in the software field.

Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magnetic optical media such as floppy disks, and ROM, RAM, and flash memory. Hardware devices specifically configured to store and execute the same program instructions are included. In addition, the computer-readable recording medium can be distributed over a computer system connected through a network to store and execute computer-readable codes in a distributed manner.

Examples of program instructions include not only machine language codes such as those produced by a compiler, but also devices that process information electronically using an interpreter or the like, for example, advanced undercodes that can be executed by a computer.

The above-described hardware device may be configured to operate as one or more software modules to perform the operation of the present invention.

Although the embodiments of the present invention have been described with reference to the above and the accompanying drawings, those of ordinary skill in the art to which the present invention pertains can implement the present invention in other specific forms without changing the technical spirit or essential features. You can understand that there is. Therefore, it is to be understood that the embodiments described above are illustrative and non-limiting in all respects.

Claims (4)

In the fundraising settlement system for nonprofit organizations using scraping technology,
A user agent located in a user PC and having a work area and a scraping support area; And
Includes; a scraping server interworking with the user agent and performing a data communication and data acquisition role in accordance with a communication/security policy substantially requested from an external financial institution in response to a data request requested by the user agent (Agent, terminal); Non-profit fundraising settlement system, characterized in that. The method of claim 1,
The scraping area is
A version control module that performs preprocessing and file transmission/reception roles for updating and synchronizing programs, libraries, and certificates between the user PC and the scraping server;
A certificate distribution module that performs synchronization by checking whether the user information registered on the scraping server and the user information or certificate registered on the PC are the same, and
A non-profit fundraising and settlement system comprising a task assignment management module that checks the requested data received from the business area and requests the server for a data inquiry order (scheduling) according to an internal policy. The method of claim 1,
The scraping server
An authentication management module that checks whether the scraping server and the task assignment management module are mutually authenticated when there is an initial request for information from the user agent;
The user information transmitted from the task assignment management module is transferred to the scraping engine using API (Application Program Interface) calls or OLE (Object Linking and Embedding) protocols, and the result is sent to the socket in the task assignment management module. Or a scraping operation module that is transmitted through SSL communication,
A scraping environment module that stops and re-runs the process when the scraping module is abnormally executed or a problem occurs due to an error, and performs user input for installing or updating programs necessary for scraping such as security modules, and processing;
A non-profit fundraising and settlement system comprising a scraping engine that inputs necessary information on the authentication page and uses it as a target page, then inputs the necessary information on the target page, and then acquires information and performs tasks. The method of claim 3,
The scraping engine
A spider module that receives the scraping target information delivered to the scraping task module and delivers it to the scheduler module, and performs the role of parsing, item extraction, and verification of the data set received from the downloader module, and
As a schedule buffer for receiving a request received from the scraping engine, a scheduler module that transmits the request to a downloader module when the scraping engine is needed,
A non-profit fundraising and settlement system comprising a downloader module that performs actions such as login and page movement to fetch target data, and parses and retrieves the data after moving to the target page.

Images