CN110188159B - Credit data access method, device, equipment and computer readable storage medium - Google Patents
Credit data access method, device, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN110188159B CN110188159B CN201910459669.XA CN201910459669A CN110188159B CN 110188159 B CN110188159 B CN 110188159B CN 201910459669 A CN201910459669 A CN 201910459669A CN 110188159 B CN110188159 B CN 110188159B
- Authority
- CN
- China
- Prior art keywords
- data
- verified
- data source
- target
- access
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/31—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/338—Presentation of query results
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/166—Editing, e.g. inserting or deleting
- G06F40/186—Templates
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/03—Credit; Loans; Processing thereof
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- Economics (AREA)
- Development Economics (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- Technology Law (AREA)
- General Business, Economics & Management (AREA)
- Software Systems (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Debugging And Monitoring (AREA)
- Storage Device Security (AREA)
Abstract
The invention discloses a credit investigation data access method, which comprises the following steps: when a credit investigation data access instruction is received, determining a target data source to be verified, and extracting data to be verified in the target data source according to a preset data reading rule; determining a data verification rule according to the data type of the target data source, and verifying the data to be verified according to preset test data and the data verification rule; acquiring a verification result of the data to be verified, and determining the accuracy of the data to be verified according to a standard result corresponding to the verification result and the preset test data; and if the accuracy is greater than a preset threshold, accessing the target data source into a corresponding online application. The invention realizes the on-line transmission and the on-line verification of the credit investigation data sources, realizes the rapid verification and access of a plurality of data sources, saves labor and improves the access efficiency of the credit investigation data.
Description
Technical Field
The present invention relates to the field of financial technology (Fintech), and in particular, to a credit data access method, apparatus, device, and computer readable storage medium.
Background
With the development of computer technology, more and more technologies (big data, distributed, blockchain, artificial intelligence, etc.) are applied in the financial field, and the traditional financial industry is gradually moving to financial technology (Fintech), and financial data is also growing in geometric scale, in large commercial silver behaviors, and in general, they need to access a large amount of credit data from a data source (commercial company, government agency, or other public organization related to providing credit data). The traditional credit investigation data access generally transmits data in an offline mode, then carries out credit investigation manually, and finally accesses the verified data into an online application. Therefore, the traditional credit sign data access method not only consumes labor, but also reduces the data access efficiency.
Disclosure of Invention
The invention mainly aims to provide a credit sign data access method, a credit sign data access device, credit sign data access equipment and a credit sign data access computer readable storage medium, and aims to solve the technical problems that traditional data access consumes manpower and is low in data access efficiency.
In order to achieve the above object, the present invention provides a credit investigation data access method, which includes the following steps:
When a credit investigation data access instruction is received, determining a target data source to be verified, and extracting data to be verified in the target data source according to a preset data reading rule;
determining a data verification rule according to the data type of the target data source, and verifying the data to be verified according to preset test data and the data verification rule;
acquiring a verification result of the data to be verified, and determining the accuracy of the data to be verified according to a standard result corresponding to the verification result and the preset test data;
if the accuracy is greater than a preset threshold, judging that the data to be verified passes verification, and accessing the target data source into a corresponding online application.
Optionally, when receiving the credit investigation data access instruction, determining a target data source to be verified, and extracting the data to be verified in the target data source according to a preset data reading rule specifically includes:
when a credit investigation data access instruction is received, determining a target data source to be verified, and acquiring an interface document corresponding to the target data source;
and determining target parameters corresponding to the target data source according to the interface document, and extracting data to be verified in the target data source according to the data type of the target data source and a target interface method corresponding to the target parameters.
Optionally, after the step of determining the target parameter corresponding to the target data source according to the interface document and extracting the data to be verified in the target data source according to the data type of the target data source and the target interface method corresponding to the target parameter, the method further includes:
judging whether the data format of the data to be verified is legal or not according to a preset parameter checking rule;
if the data format of the data to be verified is illegal, generating a reminding message of the illegal data format to be verified, and stopping verifying the data to be verified;
if the data format of the data to be verified is legal, executing the steps of: and determining a data verification rule according to the data type of the target data source, and verifying the data to be verified according to preset test data and the data verification rule.
Optionally, after the step of obtaining the verification result of the data to be verified and determining the accuracy of the data to be verified according to the standard result corresponding to the verification result and the preset test data, the method further includes:
comparing the verification result with a standard result corresponding to the preset test data to generate a comparison result;
And acquiring a preset report template corresponding to the data source, and filling the comparison result and the accuracy of the data to be verified into the preset report template according to a preset mapping relation to generate a data verification report.
Optionally, before the step of determining that the data to be verified passes verification and accessing the target data source to the corresponding online application if the accuracy is greater than the preset threshold, the method further includes:
acquiring each type of data source to be accessed through verification, and determining the access sequence of each type of data source in the data source to be accessed according to a preset access priority;
and sequentially adding each type of data source in the data sources to be accessed to a queuing queue according to the access sequence.
Optionally, if the accuracy is greater than a preset threshold, the step of determining that the data to be verified passes verification and accessing the target data source to the corresponding online application specifically includes:
if the accuracy is greater than a preset threshold, judging that the data to be verified passes verification, and adding the target data source to the queuing queue;
and if the data source with the access priority higher than that of the target data source does not exist in the queuing queue, accessing the target data source into the corresponding online application.
Optionally, after the step of determining that the data to be verified passes verification and accessing the target data source to the corresponding online application if the accuracy is greater than the preset threshold, the method further includes:
acquiring a routing parameter of a target access route accessed to the target data source, and judging whether the target data source is abnormal or not according to the routing parameter;
and if the target data source is abnormal, stopping accessing the target data source and accessing the similar data sources corresponding to the target data source.
Optionally, when receiving the credit investigation data access instruction, determining a target data source to be verified, and extracting the data to be verified in the target data source according to a preset data reading rule specifically includes:
when a credit investigation data access instruction is received, determining a target data source to be verified, acquiring an access request quantity of the target data source, and judging whether the access request quantity of the target data source is smaller than a preset threshold value;
if the access request quantity of the target data source is smaller than a preset threshold value, extracting data to be verified in the target data source according to a preset data reading rule;
If the access request quantity of the target data source is not smaller than a preset threshold value, generating and displaying a reminding message of overlarge access request quantity of the target data source, and adding the credit investigation data access instruction to a preset to-be-processed instruction queue.
In addition, in order to achieve the above object, the present invention also provides a credit information data access device, including:
the data extraction module is used for determining a target data source to be verified when a credit investigation data access instruction is received, and extracting data to be verified in the target data source according to a preset data reading rule;
the data verification module is used for determining a data verification rule according to the data type of the target data source and verifying the data to be verified according to preset test data and the data verification rule;
the accuracy calculation module is used for acquiring a verification result of the data to be verified and determining the accuracy of the data to be verified according to a standard result corresponding to the verification result and the preset test data;
and the data access module is used for judging that the data to be verified passes verification if the accuracy is greater than a preset threshold value, and accessing the target data source into the corresponding online application.
Optionally, the data extraction module specifically includes:
the document acquisition unit is used for determining a target data source to be verified when receiving a credit investigation data access instruction and acquiring an interface document corresponding to the target data source;
and the data extraction unit is used for determining target parameters corresponding to the target data source according to the interface document, and extracting data to be verified in the target data source according to the data type of the target data source and a target interface method corresponding to the target parameters.
Optionally, the data extraction module is further configured to:
judging whether the data format of the data to be verified is legal or not according to a preset parameter checking rule;
if the data format of the data to be verified is illegal, generating a reminding message of the illegal data format to be verified, and stopping verifying the data to be verified;
if the data format of the data to be verified is legal, executing the steps of: and determining a data verification rule according to the data type of the target data source, and verifying the data to be verified according to preset test data and the data verification rule.
Optionally, the credit investigation data access device further includes:
The result comparison module is used for comparing the verification result with a standard result corresponding to the preset test data to generate a comparison result;
and the report generation module is used for acquiring a preset report template corresponding to the data source, correspondingly filling the comparison result and the accuracy of the data to be verified into the preset report template according to a preset mapping relation, and generating a data verification report.
Optionally, the credit investigation data access device further includes:
the sequence determining module is used for acquiring each type of data source to be accessed through verification and determining the access sequence of each type of data source in the data source to be accessed according to the preset access priority;
and the data arrangement module is used for sequentially adding each type of data source in the data sources to be accessed to a queuing queue according to the access sequence.
Optionally, the data access module specifically includes:
the data queuing unit is used for judging that the data to be verified passes verification if the accuracy is greater than a preset threshold value, and adding the target data source to the queuing queue;
and the data access unit is used for accessing the target data source into the corresponding online application if the data source with the access priority higher than that of the target data source does not exist in the queuing queue.
Optionally, the data access module is further configured to:
acquiring a routing parameter of a target access route accessed to the target data source, and judging whether the target data source is abnormal or not according to the routing parameter;
and if the target data source is abnormal, stopping accessing the target data source and accessing the similar data sources corresponding to the target data source.
Optionally, the data extraction module specifically includes:
the request quantity judging unit is used for determining a target data source to be verified when receiving a credit investigation data access instruction, acquiring the access request quantity of the target data source and judging whether the access request quantity of the target data source is smaller than a preset threshold value or not;
the data extraction unit is used for extracting data to be verified in the target data source according to a preset data reading rule if the access request quantity of the target data source is smaller than a preset threshold value;
the instruction queuing unit is used for generating and displaying a reminding message of overlarge target data source access request quantity and adding the credit investigation data access instruction to a preset to-be-processed instruction queue if the target data source access request quantity is not smaller than a preset threshold value.
In addition, in order to achieve the above object, the present invention also provides a credit information data access device, including: the system comprises a memory, a processor and a credit information data access program which is stored in the memory and can run on the processor, wherein the credit information data access program realizes the steps of the credit information data access method when being executed by the processor.
In addition, in order to achieve the above object, the present invention also provides a computer-readable storage medium having stored thereon a credit data access program which, when executed by a processor, implements the steps of the credit data access method as described above.
When a credit investigation data access instruction is received, determining a target data source to be verified, and extracting data to be verified in the target data source according to a preset data reading rule; determining a data verification rule according to the data type of the target data source, and verifying the data to be verified according to preset test data and the data verification rule; acquiring a verification result of the data to be verified, and determining the accuracy of the data to be verified according to a standard result corresponding to the verification result and the preset test data; if the accuracy is greater than a preset threshold, judging that the data to be verified passes verification, and accessing the target data source into a corresponding online application. By the method, the on-line transmission and the on-line verification of the credit investigation data sources are realized, so that the rapid verification and access of a plurality of data sources are realized, the labor is saved, the access efficiency of the credit investigation data is improved, and the technical problems that the traditional data access consumes labor and the data access efficiency is low are solved.
Drawings
FIG. 1 is a schematic diagram of a device architecture of a hardware operating environment according to an embodiment of the present invention;
fig. 2 is a flowchart of a first embodiment of the credit investigation data access method of the present invention.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Referring to fig. 1, fig. 1 is a schematic device structure of a hardware running environment according to an embodiment of the present invention.
The credit investigation data access device of the embodiment of the invention can be a PC or a server device, and a Java virtual machine is operated on the credit investigation data access device.
As shown in fig. 1, the credit standing data access device may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. Wherein the communication bus 1002 is used to enable connected communication between these components. The user interface 1003 may include a Display, an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
It will be appreciated by those skilled in the art that the device structure shown in fig. 1 is not limiting of the device and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.
As shown in fig. 1, an operating system, a network communication module, a user interface module, and a credit data access program may be included in a memory 1005, which is a type of computer storage medium.
In the device shown in fig. 1, the network interface 1004 is mainly used for connecting to a background server, and performing data communication with the background server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the processor 1001 may be configured to call a credit data access program stored in the memory 1005 and perform operations in the credit data access method described below.
Based on the hardware structure, the embodiment of the credit investigation data access method is provided.
Referring to fig. 2, fig. 2 is a flow chart of a first embodiment of a credit data access method according to the present invention, the method includes:
step S10, when a credit investigation data access instruction is received, determining a target data source to be verified, and extracting data to be verified in the target data source according to a preset data reading rule;
The traditional credit investigation data is generally accessed by transmitting data sources offline, then manually verifying, and finally accessing the data sources which pass the manual verification into an online application. The data source refers to credit investigation data provided by commercial companies, government institutions or public organizations and the like. Typically, a financial institution such as a commercial bank needs access to a data source to obtain data. The traditional credit investigation data access method for offline transmission not only easily causes user information leakage, but also has the defects of labor consumption and low verification efficiency of manually verified data sources, thereby reducing the credit investigation data access efficiency. In order to solve the above-mentioned problems, the present embodiment provides a credit investigation data access method, which reads data in a target data source through a preset data reading rule, uses the data as data to be verified, verifies the data to be verified through a preset verification rule, and accesses the verified target data source to an online application, thereby realizing online transmission and online verification of credit investigation data, and improving access efficiency of the credit investigation data. Specifically, when a credit investigation data access instruction triggered by user operation is received, the credit investigation data access instruction may be triggered by a data query operation interface provided by a service personnel through a credit investigation data access program, and according to the credit investigation data access instruction, a current data source to be accessed is determined and used as a target data source to be verified. And extracting credit investigation data in the target data source according to a preset data reading rule. The preset data reading rule comprises an extraction interface method or a data extraction format and the like, namely, according to the data type of the target data source, the extraction interface method and/or the data extraction format to be called are determined, and the data to be verified are extracted from the target data source for verification. Therefore, service personnel can verify the data source to be accessed at any time according to the data query operation interface, intervention of operation and maintenance personnel is not needed, and data access efficiency is improved.
Further, the step S10 specifically includes:
when a credit investigation data access instruction is received, determining a target data source to be verified, acquiring an access request quantity of the target data source, and judging whether the access request quantity of the target data source is smaller than a preset threshold value;
if the access request quantity of the target data source is smaller than a preset threshold value, extracting data to be verified in the target data source according to a preset data reading rule;
if the access request quantity of the target data source is not smaller than a preset threshold value, generating and displaying a reminding message of overlarge access request quantity of the target data source, and adding the credit investigation data access instruction to a preset to-be-processed instruction queue.
In order to prevent the data source system from being abnormal due to excessive data source access requests, the request timeout is generated, the data access efficiency is reduced, and the request quantity of the target data source is controlled through the flow control module. In this embodiment, when a credit investigation data access instruction is received, a target data source is determined according to the instruction, and then an access request amount corresponding to the target data source is obtained, where the access request amount includes a request concurrency connection number (user concurrency amount) and/or a system throughput (Transaction Per Second, TPS). And comparing the user concurrency and/or the system throughput with the corresponding preset threshold value to judge whether the access request quantity is smaller than the preset threshold value. And packaging the corresponding flow control method codes according to the common flow control method, generating a flow control module, and configuring the request quantity values of different data sources according to preset flow control configuration values corresponding to the different data sources. If the access request quantity of the target data source is smaller than a preset threshold, namely the access request quantity is in the loadable range of the target data source, the credit investigation data access instruction can be processed in real time, and the access of the target data source is performed. And if the access request quantity of the target data source is not less than a preset threshold, namely the access request quantity exceeds the loadable range of the target data source, adding the credit investigation data access instruction to a preset to-be-processed instruction queue so as to process the credit investigation data access instruction when the request quantity of the target data source is less than the preset threshold, namely accessing the target data source. And simultaneously displaying a reminding message with overlarge target data source access request quantity so that a user can know the waiting reason.
Step S20, determining a data verification rule according to the data type of the target data source, and verifying the data to be verified according to preset test data and the data verification rule;
in this embodiment, according to the data type of the target data source, a wind control model corresponding to the data to be verified is determined, and according to the wind control model, a data verification rule corresponding to the target data source is determined, where the data verification rule includes parameters to be verified and verification conditions, such as whether a verification identity card number matches a name or a mobile phone number, or whether a verification name matches learning information, and the like. Obtaining preset test data corresponding to the data type, taking the data to be verified as a standard information base, judging whether corresponding verification parameters in the preset test data conform to the data verification rule, wherein the data verification rule is that whether the verification identity card number is matched with the name and the mobile phone number, obtaining verification parameters in the preset test data, such as the identity card number, the name and the mobile phone number, obtaining corresponding standard data in the data to be verified, including the standard identity card number and the standard mobile phone number corresponding to the name, and judging whether the verification parameters in the preset test data are matched according to the standard data in the data to be verified. Since the test result corresponding to the preset test data is known, the accuracy of the data to be verified can be verified according to the preset test data of the known test result.
Step S30, obtaining a verification result of the data to be verified, and determining the accuracy of the data to be verified according to a standard result corresponding to the verification result and the preset test data;
in this embodiment, the preset test data is verified according to the data to be verified and a data verification rule, and the verification result is obtained. And acquiring a known test result corresponding to the preset test data in advance, as a standard result, comparing the verification result with the standard result, and judging whether the verification result is correct or not, thereby determining the accuracy of the data to be verified. If the verification results corresponding to ten groups of preset test data are the same as the standard results, the accuracy of the data to be verified is 100%. In a specific embodiment, whether the data to be verified includes the preset test data may be further determined in advance, and if the data to be verified does not include the preset test data, the preset test data and the standard data may be directly determined to be not matched. Thus, not only the data accuracy of the target data source can be verified, but also the comprehensiveness of the target data source can be further verified.
And step S40, if the accuracy is greater than a preset threshold, judging that the data to be verified passes verification, and accessing the target data source into the corresponding online application.
In this embodiment, if it is determined that the accuracy of the target data source is greater than the preset threshold, that is, it is determined that the data to be verified passes verification, the verified target data source may be accessed to a corresponding online application, that is, related data in the target data source is obtained through an interface method in a preset data reading rule, that is, the target data source is accessed, so that a related user performs inquiry of credit investigation data.
When a credit investigation data access instruction is received, determining a target data source to be verified, and extracting data to be verified in the target data source according to a preset data reading rule; determining a data verification rule according to the data type of the target data source, and verifying the data to be verified according to preset test data and the data verification rule; acquiring a verification result of the data to be verified, and determining the accuracy of the data to be verified according to a standard result corresponding to the verification result and the preset test data; if the accuracy is greater than a preset threshold, judging that the data to be verified passes verification, and accessing the target data source into a corresponding online application. By the method, the on-line transmission and the on-line verification of the credit investigation data sources are realized, so that the rapid verification and access of a plurality of data sources are realized, the labor is saved, the access efficiency of the credit investigation data is improved, and the technical problems that the traditional data access consumes labor and the data access efficiency is low are solved.
Further, based on the first embodiment of the credit investigation data access method of the present invention, a second embodiment of the credit investigation data access method of the present invention is provided.
In this embodiment, step S10 specifically includes:
when a credit investigation data access instruction is received, determining a target data source to be verified, and acquiring an interface document corresponding to the target data source;
and determining target parameters corresponding to the target data source according to the interface document, and extracting data to be verified in the target data source according to the data type of the target data source and a target interface method corresponding to the target parameters.
In order to improve the data extraction efficiency, the common data extraction function class is packaged into various interface methods. In this embodiment, a typical data source manufacturer sets relevant parameter information of a data source through an interface document, such as a data type and a data parameter of the data source. When a credit investigation data access instruction is received, determining a target data source to be verified, acquiring an interface document of the target data source, determining a target interface method corresponding to the target data source in a pre-stored interface library according to target parameters and data types corresponding to the target data source in the interface document, and extracting data to be verified in the target data source through the target interface method. The interface methods provided by the data source generally comprise webservice (web service), http, https, sftp (secure file transfer protocol) and the like, and the interface methods are extracted and packaged into corresponding public modules. Some data sources may need to encrypt and decrypt parameters and results, and cryptographic modules include cryptographic, symmetric encryption 3DES or RSA asymmetric encryption, etc. In a specific embodiment, the data to be verified may be integrated according to a preset data format. Different data sources are prevented from corresponding to different data formats, conversion of the data formats is not needed to be carried out manually, and data access efficiency is improved.
Further, the credit investigation data access method further includes, after the step of determining the target parameter corresponding to the target data source according to the interface document and extracting the data to be verified in the target data source according to the data type of the target data source and the target interface method corresponding to the target parameter:
judging whether the data format of the data to be verified is legal or not according to a preset parameter checking rule;
if the data format of the data to be verified is illegal, generating a reminding message of the illegal data format to be verified, and stopping verifying the data to be verified;
if the data format of the data to be verified is legal, executing the steps of: and determining a data verification rule according to the data type of the target data source, and verifying the data to be verified according to preset test data and the data verification rule.
In this embodiment, in order to improve data verification efficiency, when data to be verified in the target data source is extracted, the data format of the data to be verified is verified first, for example, whether the extracted identification card number data, name data or mobile phone number data accords with the corresponding character type requirement (letters, chinese characters or numbers, etc.) and the character number requirement (18 bits, at least two Chinese characters or 11 bits, etc.). In this embodiment, the preset parameter checking rule adopts an annotation expression, and determines whether the data format of the data to be verified is legal according to the preset parameter checking rule, if there is illegal data, an illegal reminding message of the data to be verified is generated, and the verification of the data to be verified is stopped. In a specific embodiment, the reminding message may be generated and the verification of the data to be verified may be stopped when the illegal data to be verified reaches the preset data amount.
Further, based on the first embodiment of the credit investigation data access method of the present invention, a third embodiment of the credit investigation data access method of the present invention is provided.
In this embodiment, the credit information data access method further includes:
comparing the verification result with a standard result corresponding to the preset test data to generate a comparison result;
and acquiring a preset report template corresponding to the data source, and filling the comparison result and the accuracy of the data to be verified into the preset report template according to a preset mapping relation to generate a data verification report.
To facilitate user viewing of the data verification results, a data verification report is further generated for user viewing. In this embodiment, the verification result and the comparison result of the corresponding standard result are displayed, that is, the verification result and the standard result are displayed in a comparison manner. And then, according to a preset report template format in a data source preset interface document and a preset mapping relation between a data filling position and a data identifier, correspondingly filling the comparison result and the accuracy corresponding to the data to be verified into the preset report template, and generating a data verification report corresponding to the target data source, so that a user can conveniently check a verification result of the target data source. The preset report template comprises XML, HTML or JSON formats. In a specific embodiment, in order to facilitate the subsequent inquiry of the caller and the data analysis of the service personnel, the data verification report can be converted into a unified format, and the unified format is asynchronously stored in a data source or a large data platform for data backup.
Further, the credit sign data access method before step S40 further includes:
acquiring each type of data source to be accessed through verification, and determining the access sequence of each type of data source in the data source to be accessed according to a preset access priority;
and sequentially adding each type of data source in the data sources to be accessed to a queuing queue according to the access sequence.
If a plurality of data sources pass the verification, in order to prevent frequent access operation and cause operation blocking, the priority of the access data is preset, and the access queuing queue is set according to the priority. In this embodiment, each type of data source to be accessed through verification is obtained, a sequential access sequence corresponding to each type of data source to be accessed is determined according to a preset access priority, and each type of data source in the data sources to be accessed is sequentially added to a queuing queue according to the sequential access sequence, that is, the higher the priority is, the more front the corresponding type of data source in the queuing queue is, the more preferential access is performed.
The step S40 specifically includes: if the accuracy is greater than a preset threshold, judging that the data to be verified passes verification, and adding the target data source to the queuing queue;
And if the data source with the access priority higher than that of the target data source does not exist in the queuing queue, accessing the target data source into the corresponding online application.
In this embodiment, after determining that the accuracy of the target data source is greater than a preset threshold, that is, the data to be verified passes verification, the target data source is correspondingly added to a corresponding position in the queuing queue according to a priority corresponding to the target data source, when no type data source with a priority higher than that of the target data source exists in the queuing queue, the access of the target data source is performed, and if the type data source with a priority higher than that of the target data source exists, the type data source with a priority higher than that of the target data source is preferentially processed.
Further, the credit investigation data access method further comprises the following steps:
acquiring a routing parameter of a target access route accessed to the target data source, and judging whether the target data source is abnormal or not according to the routing parameter;
and if the target data source is abnormal, stopping accessing the target data source and accessing the similar data sources corresponding to the target data source.
In order to improve query efficiency of credit investigation data, the routing parameters corresponding to the accessed data sources are monitored, and the accessed data sources with abnormal parameters are replaced by other similar data sources in time. In this embodiment, a routing parameter corresponding to a target access route corresponding to a target data source, such as a proportion of successful data transmitted per minute or a data transmission rate, is obtained, and then whether the routing parameter reaches a standard transmission threshold is determined, so as to determine whether the target data source is abnormal. And stopping the access of the target data source when the abnormality of the target data source is detected, for example, suspending the target access route, and accessing the similar data source corresponding to the target data source, wherein the similar data source has the same data type as the target data source, and the routing parameters are normal. Therefore, access to abnormal data sources is prevented, and the query efficiency of credit investigation data is improved.
Further, in order to improve the credit investigation data query efficiency, the credit investigation data access method further includes:
when the related verification data corresponding to the target data source is obtained, the related verification data is stored in a data cache, when a data query instruction is received, whether query data corresponding to the data query instruction exist in the data cache is judged, and if the query data do not exist, the query data are obtained in the target data source. Therefore, the request processing amount of the target data source is reduced, and the data query efficiency is improved.
The invention also provides a credit investigation data access device. The credit investigation data access device comprises:
the data extraction module is used for determining a target data source to be verified when a credit investigation data access instruction is received, and extracting data to be verified in the target data source according to a preset data reading rule;
the data verification module is used for determining a data verification rule according to the data type of the target data source and verifying the data to be verified according to preset test data and the data verification rule;
the accuracy calculation module is used for acquiring a verification result of the data to be verified and determining the accuracy of the data to be verified according to a standard result corresponding to the verification result and the preset test data;
And the data access module is used for judging that the data to be verified passes verification if the accuracy is greater than a preset threshold value, and accessing the target data source into the corresponding online application.
Further, the data extraction module specifically includes:
the document acquisition unit is used for determining a target data source to be verified when receiving a credit investigation data access instruction and acquiring an interface document corresponding to the target data source;
and the data extraction unit is used for determining target parameters corresponding to the target data source according to the interface document, and extracting data to be verified in the target data source according to the data type of the target data source and a target interface method corresponding to the target parameters.
Further, the data extraction module is further configured to:
judging whether the data format of the data to be verified is legal or not according to a preset parameter checking rule;
if the data format of the data to be verified is illegal, generating a reminding message of the illegal data format to be verified, and stopping verifying the data to be verified;
if the data format of the data to be verified is legal, executing the steps of: and determining a data verification rule according to the data type of the target data source, and verifying the data to be verified according to preset test data and the data verification rule.
Further, the credit investigation data access device further comprises:
the result comparison module is used for comparing the verification result with a standard result corresponding to the preset test data to generate a comparison result;
and the report generation module is used for acquiring a preset report template corresponding to the data source, correspondingly filling the comparison result and the accuracy of the data to be verified into the preset report template according to a preset mapping relation, and generating a data verification report.
Further, the credit investigation data access device further comprises:
the sequence determining module is used for acquiring each type of data source to be accessed through verification and determining the access sequence of each type of data source in the data source to be accessed according to the preset access priority;
and the data arrangement module is used for sequentially adding each type of data source in the data sources to be accessed to a queuing queue according to the access sequence.
Further, the data access module specifically includes:
the data queuing unit is used for judging that the data to be verified passes verification if the accuracy is greater than a preset threshold value, and adding the target data source to the queuing queue;
And the data access unit is used for accessing the target data source into the corresponding online application if the data source with the access priority higher than that of the target data source does not exist in the queuing queue.
Further, the data access module is further configured to:
acquiring a routing parameter of a target access route accessed to the target data source, and judging whether the target data source is abnormal or not according to the routing parameter;
and if the target data source is abnormal, stopping accessing the target data source and accessing the similar data sources corresponding to the target data source.
Further, the data extraction module specifically includes:
the request quantity judging unit is used for determining a target data source to be verified when receiving a credit investigation data access instruction, acquiring the access request quantity of the target data source and judging whether the access request quantity of the target data source is smaller than a preset threshold value or not;
the data extraction unit is used for extracting data to be verified in the target data source according to a preset data reading rule if the access request quantity of the target data source is smaller than a preset threshold value;
the instruction queuing unit is used for generating and displaying a reminding message of overlarge target data source access request quantity and adding the credit investigation data access instruction to a preset to-be-processed instruction queue if the target data source access request quantity is not smaller than a preset threshold value.
The method executed by each program module may refer to each embodiment of the credit information data access method of the present invention, and will not be described herein.
The invention also provides a computer readable storage medium.
The computer readable storage medium of the present invention stores a credit investigation data access program which, when executed by a processor, implements the steps of the credit investigation data access method as described above.
The method implemented when the credit investigation data access program running on the processor is executed may refer to various embodiments of the credit investigation data access method of the present invention, and will not be described herein.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) as described above, comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The foregoing description is only of the preferred embodiments of the present invention, and is not intended to limit the scope of the invention, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.
Claims (16)
1. The credit information data access method is characterized by comprising the following steps of:
when a credit investigation data access instruction is received, determining a target data source to be verified, and extracting data to be verified in the target data source according to a preset data reading rule;
determining a data verification rule according to the data type of the target data source, and verifying the data to be verified according to preset test data and the data verification rule;
acquiring a verification result of the data to be verified, and determining the accuracy of the data to be verified according to a standard result corresponding to the verification result and the preset test data;
if the accuracy is greater than a preset threshold, judging that the data to be verified passes verification, and accessing the target data source into a corresponding online application;
when receiving a credit investigation data access instruction, determining a target data source to be verified, and extracting data to be verified in the target data source according to a preset data reading rule, wherein the step of extracting the data to be verified comprises the following steps:
when a credit investigation data access instruction is received, determining a target data source to be verified, and acquiring an interface document corresponding to the target data source;
And determining target parameters corresponding to the target data source according to the interface document, and extracting data to be verified in the target data source according to the data type of the target data source and a target interface method corresponding to the target parameters.
2. The credit data access method of claim 1, wherein after the step of determining the target parameter corresponding to the target data source according to the interface document and extracting the data to be verified in the target data source according to the data type of the target data source and the target interface method corresponding to the target parameter, the method further comprises:
judging whether the data format of the data to be verified is legal or not according to a preset parameter checking rule;
if the data format of the data to be verified is illegal, generating a reminding message of the illegal data format to be verified, and stopping verifying the data to be verified;
if the data format of the data to be verified is legal, executing the steps of: and determining a data verification rule according to the data type of the target data source, and verifying the data to be verified according to preset test data and the data verification rule.
3. The credit data access method of claim 1, wherein after the step of obtaining the verification result of the data to be verified and determining the accuracy of the data to be verified according to the standard result corresponding to the verification result and the preset test data, the method further comprises:
comparing the verification result with a standard result corresponding to the preset test data to generate a comparison result;
and acquiring a preset report template corresponding to the data source, and filling the comparison result and the accuracy of the data to be verified into the preset report template according to a preset mapping relation to generate a data verification report.
4. The credit data access method of claim 1, wherein the step of determining that the data to be verified is verified and accessing the target data source to the corresponding online application further comprises, if the accuracy is greater than a preset threshold:
acquiring each type of data source to be accessed through verification, and determining the access sequence of each type of data source in the data source to be accessed according to a preset access priority;
and sequentially adding each type of data source in the data sources to be accessed to a queuing queue according to the access sequence.
5. The method for accessing credit information data according to claim 4, wherein if the accuracy is greater than a preset threshold, the step of determining that the data to be verified is verified, and accessing the target data source to the corresponding online application specifically comprises:
if the accuracy is greater than a preset threshold, judging that the data to be verified passes verification, and adding the target data source to the queuing queue;
and if the data source with the access priority higher than that of the target data source does not exist in the queuing queue, accessing the target data source into the corresponding online application.
6. The credit data access method of claim 4, wherein after the step of determining that the data to be verified is verified and accessing the target data source to the corresponding online application if the accuracy is greater than a preset threshold, further comprising:
acquiring a routing parameter of a target access route accessed to the target data source, and judging whether the target data source is abnormal or not according to the routing parameter;
and if the target data source is abnormal, stopping accessing the target data source and accessing the similar data sources corresponding to the target data source.
7. The credit data access method according to any one of claims 1 to 6, wherein the step of determining a target data source to be verified and extracting data to be verified from the target data source according to a preset data reading rule when a credit data access instruction is received specifically includes:
when a credit investigation data access instruction is received, determining a target data source to be verified, acquiring an access request quantity of the target data source, and judging whether the access request quantity of the target data source is smaller than a preset threshold value;
if the access request quantity of the target data source is smaller than a preset threshold value, extracting data to be verified in the target data source according to a preset data reading rule;
if the access request quantity of the target data source is not smaller than a preset threshold value, generating and displaying a reminding message of overlarge access request quantity of the target data source, and adding the credit investigation data access instruction to a preset to-be-processed instruction queue.
8. A credit data access device, characterized in that the credit data access device comprises:
the data extraction module is used for determining a target data source to be verified when a credit investigation data access instruction is received, and extracting data to be verified in the target data source according to a preset data reading rule;
The data verification module is used for determining a data verification rule according to the data type of the target data source and verifying the data to be verified according to preset test data and the data verification rule;
the accuracy calculation module is used for acquiring a verification result of the data to be verified and determining the accuracy of the data to be verified according to a standard result corresponding to the verification result and the preset test data;
the data access module is used for judging that the data to be verified passes verification if the accuracy is greater than a preset threshold value, and accessing the target data source into a corresponding online application;
the data extraction module specifically comprises:
the document acquisition unit is used for determining a target data source to be verified when receiving a credit investigation data access instruction and acquiring an interface document corresponding to the target data source;
and the data extraction unit is used for determining target parameters corresponding to the target data source according to the interface document, and extracting data to be verified in the target data source according to the data type of the target data source and a target interface method corresponding to the target parameters.
9. The credit data access device of claim 8, wherein the data extraction module is further to:
Judging whether the data format of the data to be verified is legal or not according to a preset parameter checking rule;
if the data format of the data to be verified is illegal, generating a reminding message of the illegal data format to be verified, and stopping verifying the data to be verified;
if the data format of the data to be verified is legal, executing the steps of: and determining a data verification rule according to the data type of the target data source, and verifying the data to be verified according to preset test data and the data verification rule.
10. The credit data access device of claim 8, further comprising:
the result comparison module is used for comparing the verification result with a standard result corresponding to the preset test data to generate a comparison result;
and the report generation module is used for acquiring a preset report template corresponding to the data source, correspondingly filling the comparison result and the accuracy of the data to be verified into the preset report template according to a preset mapping relation, and generating a data verification report.
11. The credit data access device of claim 8, further comprising:
The sequence determining module is used for acquiring each type of data source to be accessed through verification and determining the access sequence of each type of data source in the data source to be accessed according to the preset access priority;
and the data arrangement module is used for sequentially adding each type of data source in the data sources to be accessed to a queuing queue according to the access sequence.
12. The credit data access device of claim 11, wherein the data access module specifically comprises:
the data queuing unit is used for judging that the data to be verified passes verification if the accuracy is greater than a preset threshold value, and adding the target data source to the queuing queue;
and the data access unit is used for accessing the target data source into the corresponding online application if the data source with the access priority higher than that of the target data source does not exist in the queuing queue.
13. The credit data access device of claim 11, wherein the data access module is further configured to:
acquiring a routing parameter of a target access route accessed to the target data source, and judging whether the target data source is abnormal or not according to the routing parameter;
And if the target data source is abnormal, stopping accessing the target data source and accessing the similar data sources corresponding to the target data source.
14. The credit data access device of claim 13, wherein the data extraction module specifically includes:
the request quantity judging unit is used for determining a target data source to be verified when receiving a credit investigation data access instruction, acquiring the access request quantity of the target data source and judging whether the access request quantity of the target data source is smaller than a preset threshold value or not;
the data extraction unit is used for extracting data to be verified in the target data source according to a preset data reading rule if the access request quantity of the target data source is smaller than a preset threshold value;
the instruction queuing unit is used for generating and displaying a reminding message of overlarge target data source access request quantity and adding the credit investigation data access instruction to a preset to-be-processed instruction queue if the target data source access request quantity is not smaller than a preset threshold value.
15. A credit data access device, the credit data access device comprising: a memory, a processor and a credit data access program stored on the memory and executable on the processor, which when executed by the processor, implements the steps of the credit data access method of any of claims 1 to 7.
16. A computer readable storage medium, characterized in that the computer readable storage medium has stored thereon a credit data access program, which, when executed by a processor, implements the steps of the credit data access method according to any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910459669.XA CN110188159B (en) | 2019-05-27 | 2019-05-27 | Credit data access method, device, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910459669.XA CN110188159B (en) | 2019-05-27 | 2019-05-27 | Credit data access method, device, equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110188159A CN110188159A (en) | 2019-08-30 |
| CN110188159B true CN110188159B (en) | 2023-05-12 |
Family
ID=67718700
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910459669.XA Active CN110188159B (en) | 2019-05-27 | 2019-05-27 | Credit data access method, device, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110188159B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111192143B (en) * | 2019-12-25 | 2023-07-18 | 达闼机器人股份有限公司 | Data processing method, device, storage medium and blockchain node |
| CN111400174B (en) * | 2020-03-05 | 2022-08-12 | 支付宝(杭州)信息技术有限公司 | Method and device for determining application efficiency of data source and server |
| CN112667730B (en) * | 2021-01-13 | 2023-04-07 | 永辉云金科技有限公司 | External data verification method, system, equipment and storage medium |
| CN113535568B (en) * | 2021-07-22 | 2023-09-05 | 工银科技有限公司 | Verification method, device, equipment and medium for application deployment version |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007328509A (en) * | 2006-06-07 | 2007-12-20 | Sony Corp | Information processor and information processing method, program, and recording medium |
| CN105786695A (en) * | 2014-12-26 | 2016-07-20 | 北大医疗信息技术有限公司 | Data test method and system |
| CN109308251A (en) * | 2017-07-27 | 2019-02-05 | 阿里巴巴集团控股有限公司 | The method of calibration and device of test data |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102693317B (en) * | 2012-05-29 | 2014-11-05 | 华为软件技术有限公司 | Method and device for data mining process generating |
| CN105488061B (en) * | 2014-09-18 | 2019-08-09 | 阿里巴巴集团控股有限公司 | A kind of method and device of verify data validity |
| CN104391934B (en) * | 2014-11-21 | 2016-03-16 | 深圳市银雁金融服务有限公司 | Data verification method and device |
| CN107194804B (en) * | 2017-05-27 | 2020-07-28 | 国家计算机网络与信息安全管理中心 | Automatic verification method for P2P network credit data |
| CN108320256A (en) * | 2017-12-08 | 2018-07-24 | 中国电子科技集团公司电子科学研究院 | Social security events recognition methods, equipment and storage medium based on big data |
| CN108269187A (en) * | 2018-01-29 | 2018-07-10 | 深圳壹账通智能科技有限公司 | Verification method, device, equipment and the computer storage media of financial business |
| CN109460653B (en) * | 2018-10-22 | 2021-06-25 | 武汉极意网络科技有限公司 | Rule engine based verification method, verification device, storage medium and apparatus |
-
2019
- 2019-05-27 CN CN201910459669.XA patent/CN110188159B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007328509A (en) * | 2006-06-07 | 2007-12-20 | Sony Corp | Information processor and information processing method, program, and recording medium |
| CN105786695A (en) * | 2014-12-26 | 2016-07-20 | 北大医疗信息技术有限公司 | Data test method and system |
| CN109308251A (en) * | 2017-07-27 | 2019-02-05 | 阿里巴巴集团控股有限公司 | The method of calibration and device of test data |
Non-Patent Citations (2)
| Title |
|---|
| Weilei Zhang 等.Discovering accurate interclass test dependences.《PASTE '07: Proceedings of the 7th ACM SIGPLAN-SIGSOFT workshop on Program analysis for software tools and engineering》.2007,55–62. * |
| 佘艺 等.基于测试例生成的Android应用数据竞争验证方法.《计算机科学》.2017,27-32. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110188159A (en) | 2019-08-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110188159B (en) | Credit data access method, device, equipment and computer readable storage medium | |
| KR102244281B1 (en) | Kernel module loading method and device | |
| CN110221948B (en) | Test script generation method, test script generation device, computer device and storage medium | |
| CN110659206A (en) | Simulation architecture establishing method, device, medium and electronic equipment based on microservice | |
| CN107634947A (en) | Limitation malice logs in or the method and apparatus of registration | |
| CN112631911A (en) | Automatic testing method and device, computer equipment and storage medium | |
| CN113038396B (en) | Scheduling method, device and equipment of short message channel and storage medium | |
| CN111813701A (en) | HTTP-based interface testing method and device, computer equipment and storage medium | |
| CN109324956B (en) | System testing method, apparatus and computer readable storage medium | |
| CN105812424A (en) | Method and device used for checking electronic invoices | |
| CN110764979A (en) | Log identification method, system, electronic device and computer readable medium | |
| CN113938408B (en) | Data traffic testing method and device, server and storage medium | |
| CN113434254B (en) | Client deployment method, client deployment apparatus, computer device, and storage medium | |
| CN110688827A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN110717315B (en) | System data batch modification method and device, storage medium and electronic equipment | |
| CN115426299B (en) | Method and device for identifying characteristic-free data, computer equipment and storage medium | |
| CN108573354B (en) | Grain processing loss data analysis system and method | |
| CN110765610A (en) | PDM (product data management) integration method and device, computer equipment and storage medium | |
| CN111131369B (en) | APP use condition transmission method and device, electronic equipment and storage medium | |
| CN115203178A (en) | Data quality inspection method and device, electronic equipment and storage medium | |
| CN111625465A (en) | Program generation method, device and system and electronic equipment | |
| CN113449167A (en) | Data acquisition abnormity detection method and device, electronic equipment and readable storage medium | |
| US20080001959A1 (en) | System, Method and Computer Program Product for Performing Information Transfer Using a Virtual Operator | |
| CN112612674A (en) | Method, device, equipment and computer readable storage medium for monitoring buried point data | |
| CN111679885A (en) | Method, device, medium and electronic equipment for determining virtual machine drift |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |