WO2019205382A1 - 电子装置、采集征信数据的方法及存储介质 - Google Patents

电子装置、采集征信数据的方法及存储介质 Download PDF

Info

Publication number
WO2019205382A1
WO2019205382A1 PCT/CN2018/102199 CN2018102199W WO2019205382A1 WO 2019205382 A1 WO2019205382 A1 WO 2019205382A1 CN 2018102199 W CN2018102199 W CN 2018102199W WO 2019205382 A1 WO2019205382 A1 WO 2019205382A1
Authority
WO
WIPO (PCT)
Prior art keywords
time
credit
credit data
collection task
collecting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2018/102199
Other languages
English (en)
French (fr)
Inventor
吴启
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ping An Technology Shenzhen Co Ltd
Original Assignee
Ping An Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ping An Technology Shenzhen Co Ltd filed Critical Ping An Technology Shenzhen Co Ltd
Publication of WO2019205382A1 publication Critical patent/WO2019205382A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/26—Government or public services
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0609—Qualifying participants for shopping transactions

Definitions

  • the present application relates to the field of communications technologies, and in particular, to an electronic device, a method for collecting credit data, and a storage medium.
  • Credit supervision refers to: the supervision and management department of credit reporting implements supervision and management of credit reporting agencies, regulates the business operations of credit reporting agencies, and guarantees the legitimate rights and interests of all parties involved in credit reporting activities. It is an important part of the construction of credit reporting systems. After the supervisory and administrative department instructs the credit reporting agency to report the credit data, the credit reporting agency needs to report the accumulated undiscovered stock data and the incremental data added every day. Before reporting to the supervisory management department, the credit reporting agency shall proceed from the business system. The collection is carried out and reported.
  • the collection is performed by means of more manual intervention, resulting in a slower acquisition speed.
  • Manually switching the critical time points of collecting the stored data and collecting the incremental data cannot be accurate. Determining the critical time point can easily lead to the acquisition of duplicate data or the lack of critical data.
  • the purpose of the present application is to provide an electronic device, a method for collecting credit data, and a storage medium, which are intended to accurately determine a critical time point of the credit data inventory increment.
  • the present application provides an electronic device including a memory and a processor coupled to the memory, the memory storing a processing system operable on the processor, the processing The system implements the following steps when executed by the processor:
  • the first collecting step before collecting the credit information data from the monitoring system, when collecting the credit information of the stock from the business system, determining the earliest generation time of the credit information of the stock in a predetermined manner, and configuring the first predetermined a time step, a first collection task whose start time is the first acquisition duration, and the first collection task is used to collect the credit data within the first time step with the earliest generation time as the starting time, the first The time step is greater than the first collection duration;
  • An analysis step if yes, determining an end time of the first time step, obtaining a time difference between the current time and the end time, and analyzing whether the time difference is less than the first time step;
  • a second collecting step if yes, configuring a predetermined second time step, wherein the end time is used as a critical time point of the credit data of the credit data increment of the stock, and the second time of the second collecting time is the starting time And collecting, by the second collection task, the credit time data in the second time step with the critical time point as a starting time, the second time step is smaller than the first time step, the first The second time step is greater than or equal to the second collection time.
  • the present application further provides a method for collecting credit data, and the method for collecting credit data includes:
  • S1 Before collecting the credit information data from the monitoring system, when collecting the credit information of the stock from the business system, determining the earliest generation time of the credit information of the stock in a predetermined manner, and configuring the predetermined first time step And the first collection task with the startup time being the first acquisition duration, and collecting, by using the first collection task, the credit generation data within the first time step with the earliest generation time as the starting time, the first time step Greater than the first collection duration;
  • the present application also provides a computer readable storage medium having stored thereon a processing system that, when executed by a processor, implements the steps of the method of collecting credit data as described above.
  • FIG. 1 is a schematic diagram of an optional application environment of each embodiment of the present application.
  • FIG. 2 is a specific example diagram for determining a critical time point of a stock transfer increment
  • FIG. 3 is a schematic flowchart diagram of an embodiment of a method for collecting credit data according to the present application.
  • FIG. 1 it is a schematic diagram of an application environment of a preferred embodiment of the method for collecting credit data in the present application.
  • the application environment diagram includes an electronic device 1, a business system of a plurality of financial institutions, and a supervision system.
  • the electronic device 1 can perform data interaction with a business system and a supervisory system of a plurality of financial institutions through a suitable technology such as a network or a near field communication technology.
  • the electronic device 1 is an apparatus capable of automatically performing numerical calculation and/or information processing in accordance with an instruction set or stored in advance.
  • the electronic device 1 may be a computer, a single network server, a server group composed of multiple network servers, or a cloud-based cloud composed of a large number of hosts or network servers, where cloud computing is a type of distributed computing.
  • a super virtual computer consisting of a group of loosely coupled computers.
  • the electronic device 1 may include, but is not limited to, a memory 11 communicably connected to each other through a system bus, a processor 12, and a network interface 13, and the memory 11 stores a processing system operable on the processor 12. It should be noted that FIG. 1 only shows the electronic device 1 having the components 11-13, but it should be understood that not all illustrated components are required to be implemented, and more or fewer components may be implemented instead.
  • the storage device 11 includes a memory and at least one type of readable storage medium.
  • the memory provides a cache for the operation of the electronic device 1;
  • the readable storage medium may be, for example, a flash memory, a hard disk, a multimedia card, a card type memory (eg, SD or DX memory, etc.), a random access memory (RAM), a static random access memory (SRAM).
  • a non-volatile storage medium such as a read only memory (ROM), an electrically erasable programmable read only memory (EEPROM), a programmable read only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, or the like.
  • the readable storage medium may be an internal storage unit of the electronic device 1, such as a hard disk of the electronic device 1; in other embodiments, the non-volatile storage medium may also be external to the electronic device 1.
  • a storage device such as a plug-in hard disk equipped with an electronic device 1, a smart memory card (SMC), a Secure Digital (SD) card, a flash card, or the like.
  • the readable storage medium of the storage device 11 is generally used to store an operating system installed in the electronic device 1 and various types of application software, such as program code for storing the processing system in an embodiment of the present application. Further, the storage device 11 can also be used to temporarily store various types of data that have been output or are to be output.
  • the processor 12 may be a Central Processing Unit (CPU), controller, microcontroller, microprocessor, or other data processing chip in some embodiments.
  • the processor 12 is typically used to control the overall operation of the electronic device 1, such as performing control and processing related to data interaction or communication with a business system or a supervisory system of a plurality of financial institutions.
  • the processor 12 is configured to run program code or process data stored in the memory 11, such as running the processing system or the like.
  • the network interface 13 may comprise a wireless network interface or a wired network interface, which is typically used to establish a communication connection between the electronic device 1 and other electronic devices.
  • the network interface 13 is mainly used to connect the electronic device 1 with the business systems and the supervision systems of a plurality of financial institutions, and establish a data transmission channel and a communication connection.
  • the processing system is stored in the memory 11 and includes at least one computer readable instruction stored in the memory 11, the at least one computer readable instruction being executable by the processor 12 to implement the methods of various embodiments of the present application;
  • the at least one computer readable instruction can be classified into different logic modules depending on the functions implemented by its various parts.
  • the first collecting step before collecting the credit information data from the monitoring system, when collecting the credit information of the stock from the business system, determining the earliest generation time of the credit information of the stock in a predetermined manner, and configuring the first predetermined a time step, a first collection task whose start time is the first acquisition duration, and the first collection task is used to collect the credit data within the first time step with the earliest generation time as the starting time, the first The time step is greater than the first collection duration;
  • the supervision system is, for example, a credit information system of the People's Bank of China
  • the business system is a business system under each financial institution, for example, a guarantee system, a loan system, and the like.
  • the credit data of the stock is a long-term (for example, 1 year) accumulated and unreported credit data, which is of a very large number, for example, a credit rating of 10 million or even hundreds of millions.
  • determining the earliest generation time of the credit information of the inventory in a predetermined manner comprises: automatically detecting the generation time of the earliest credit data in the credit data of the inventory, for example, the earliest one of the credit information of the stock When the generation time of the transcript data is 2016.10.01, the generation time of the earliest credit data is 2016.10.01 as the earliest generation time of the credit data of the stock, or the credit data of the staff according to the stock.
  • the quantity level estimates a past time, which is closer to the time when the last time the credit data was collected, and the past time is used as the manually configured time, and the configured time is used as the earliest credit data of the stock.
  • Generate time Preferably, in order to collect the collected credit data as soon as possible, the embodiment determines the earliest generation time of the credit data of the stock in the first automatic detection manner.
  • the first time step is a large time span, for example, 20 days or 1 month, and the first collection duration is, for example, 1 week or 10 days, etc., wherein the first collection task is used to collect
  • the first time step of the configuration is greater than the first acquisition time, that is, the credit data of the large time span is collected in a shorter time. In order to collect the credit data of the stock as soon as possible.
  • a detection task may be scheduled.
  • the detection task is started, and it is detected whether the first collection task has ended.
  • the flag of the first collection task is that the collection of the credit data is no longer performed. Operation to determine the next step.
  • the next analysis step if the first collection task has been completed, performing the next analysis step, if the first collection task is not completed, waiting for the first collection task to end, after the first collection task ends,
  • the end time of the first time step is determined, for example, the start time is 2016.10.01, and the first time step is 1 month, then the end time of the first time step is 2016.11.01, and ends with the first collection task.
  • the end time is used as the current time, the time difference between the current time and the end time is calculated, and the next analysis step is performed.
  • An analysis step if yes, determining an end time of the first time step, obtaining a time difference between the current time and the end time, and analyzing whether the time difference is less than the first time step;
  • the difference is the current time: the first acquisition is performed while the first acquisition time is cut off.
  • the corresponding current time is earlier, and the calculated time difference is smaller.
  • the first collection time is cut off, the first collection task is not ended, and the corresponding current time is later, the calculated time difference is larger, and the time difference is the same.
  • a time step is compared to analyze whether the next step is to collect the credit data in a larger first time step, or to collect the credit data in a smaller second time step.
  • a second collecting step if yes, configuring a predetermined second time step, wherein the end time is used as a critical time point of the credit data of the credit data increment of the stock, and the second time of the second collecting time is the starting time And collecting, by the second collection task, the credit time data in the second time step with the critical time point as a starting time, the second time step is smaller than the first time step, the first The second time step is greater than or equal to the second collection time.
  • the credit data is collected in a second second time step, and the configured second time step is, for example, 1 day, the end point of the first time step.
  • the time is taken as the critical time point of the credit data of the credit information of the stock, and the second collection task is the second collection time, and the second collection time is, for example, one day, and the second collection task is used to collect the data.
  • the critical time point is the start time and the credit data within the second time step.
  • the first collection task is still collected to collect a larger first time step of the credit data, so as to collect the credit data as soon as possible. After the acquisition is completed, it is detected whether the first time step of the credit information is collected by detecting whether the first collection task is finished, and after the first time step of the credit data is collected, the time difference and the first time step are again performed. Compare and cycle accordingly.
  • FIG. 2 is a specific example diagram for determining a critical time point of the inventory transfer increment, and the earliest generation time of the credit information for determining the inventory is 2016.10.01, the first time step.
  • the length is 1 month
  • the first collection time is 10 days
  • the second time step is 1 day
  • the second collection time is 1 day.
  • the first collection task is started to collect the stock of 2016.10.01-2016.11.01 within one month. Credit data;
  • the first collection task wait for the first collection task to end (for example, it takes one more day to complete the acquisition), and then calculate the time difference between the current time and the end time 2016.11.01;
  • the end time time 2016.11.01 is used as the next starting time, and the credit data of the first collection task with the acquisition time of 10 days is again started;
  • the time difference is less than 1 month (for example, the current time is 2016.11.11), and the end time 2016.11.01 is used as the starting time, the second collection task with another acquisition time of 1 day is started again to collect the credit data.
  • the present application first collects a large amount of credit data of the first time step to collect the credit data quickly, and analyzes the end time of the first time step at the end of each acquisition.
  • the time difference of the current time if the time difference is less than the first time step, it can be determined that the end time is the critical time point of the credit data of the credit data transfer increment of the stock, after the critical time point, the acquisition operation is compared by the acquisition.
  • the large credit data of the first time step is converted into the collected credit data of the second time step, which can accurately determine the critical time point of the inventory transfer increment, and avoid collecting repeated credit data or The lack of critical credit data occurs.
  • the electronic device processes the credit information, and in order to reduce manual intervention, improve processing efficiency before reporting the credit data.
  • the processing system is executed by the processor, the following steps are also implemented:
  • the processing node includes an assembly node, a pre-processing node, and a reporting node of the credit data; and when the processing node processes the credit data, if the processing node has an abnormality, recording the The processing node is abnormally once; each processing node is periodically scanned by using a preset scanning task, and the number of abnormalities corresponding to each processing node is counted; if the number of abnormalities of the processing node is greater than or equal to a preset threshold number, an early warning is performed.
  • the node in the processing stage before the report of the credit report, the node is divided according to the processing process, and preferably, the assembly node, the pre-processing node and the reporting node of the credit data can be divided according to the order of processing.
  • the credit data can be transmitted between the processing nodes in the form of a network.
  • the credit information system provides three data exchange methods: FTP, HTTP and SMTP.
  • the assembly node degree assembles the collected credit data according to the format of the predetermined credit system, and the pre-processing node performs the verification processing on the assembled credit data according to a predetermined rule engine, and the reporting node will perform the verification processing.
  • the credit data is reported to the predetermined credit information system.
  • the number of abnormalities corresponding to each processing node is periodically scanned by using a scan task set in advance, for example, the number of abnormalities corresponding to each processing node is scanned every one hour. Since some processing nodes can be automatically processed in the process of processing the credit data without manual intervention, the present embodiment performs manual intervention when the number of abnormalities of the processing node is greater than or equal to the preset number. For example, if the number of abnormalities is greater than or equal to 5, a reminder message is generated to perform manual intervention, which can reduce manual intervention and improve the processing efficiency before reporting the credit data.
  • FIG. 3 is a schematic flowchart of a method for collecting credit data according to an embodiment of the present application.
  • the method for collecting credit data includes the following steps:
  • Step S1 Before collecting the credit data to the supervisory system, when collecting the credit information of the stock from the business system, determining the earliest generation time of the credit data of the stock in a predetermined manner, and configuring the predetermined first time step Long, the first acquisition task whose start time is the first acquisition duration, and the first acquisition task is used to collect the credit data within the first time step with the earliest generation time as the starting time, the first time step The length is greater than the first collection duration;
  • the supervision system is, for example, a credit information system of the People's Bank of China
  • the business system is a business system under each financial institution, for example, a guarantee system, a loan system, and the like.
  • the credit data of the stock is a long-term (for example, 1 year) accumulated and unreported credit data, which is of a very large number, for example, a credit rating of 10 million or even hundreds of millions.
  • determining the earliest generation time of the credit information of the inventory in a predetermined manner comprises: automatically detecting the generation time of the earliest credit data in the credit data of the inventory, for example, the earliest one of the credit information of the stock When the generation time of the transcript data is 2016.10.01, the generation time of the earliest credit data is 2016.10.01 as the earliest generation time of the credit data of the stock, or the credit data of the staff according to the stock.
  • the quantity level estimates a past time, which is closer to the time when the last time the credit data was collected, and the past time is used as the manually configured time, and the configured time is used as the earliest credit data of the stock.
  • Generate time Preferably, in order to collect the collected credit data as soon as possible, the embodiment determines the earliest generation time of the credit data of the stock in the first automatic detection manner.
  • the first time step is a large time span, for example, 20 days or 1 month, and the first collection duration is, for example, 1 week or 10 days, etc., wherein the first collection task is used to collect
  • the first time step of the configuration is greater than the first acquisition time, that is, the credit data of the large time span is collected in a shorter time. In order to collect the credit data of the stock as soon as possible.
  • Step S2 detecting, when the first collection duration is cut off, detecting whether the first collection task has ended;
  • a detection task may be scheduled.
  • the detection task is started, and it is detected whether the first collection task has ended.
  • the flag of the first collection task is that the collection of the credit data is no longer performed. Operation to determine the next step.
  • the end time of the first time step is determined, for example, the start time is 2016.10.01, and the first time step is 1 month, then the end time of the first time step is 2016.11.01, and ends with the first collection task.
  • the end time is used as the current time, and the time difference between the current time and the end time is calculated, and the next step S3 is performed.
  • Step S3 if yes, determining an end time of the first time step, obtaining a time difference between the current time and the end time, and analyzing whether the time difference is less than the first time step;
  • the difference is the current time: the first acquisition is performed while the first acquisition time is cut off.
  • the corresponding current time is earlier, and the calculated time difference is smaller.
  • the first collection time is cut off, the first collection task is not ended, and the corresponding current time is later, the calculated time difference is larger, and the time difference is the same.
  • a time step is compared to analyze whether the next step is to collect the credit data in a larger first time step, or to collect the credit data in a smaller second time step.
  • Step S4 if yes, configuring a predetermined second time step, wherein the end time is used as the critical time point of the credit data of the credit data increment of the inventory, and the second collection task of the second acquisition duration is started. And using the second collection task to collect the credit data in the second time step with the critical time point as the starting time, the second time step is smaller than the first time step, and the second The time step is greater than or equal to the second acquisition duration.
  • the credit data is collected in a second second time step, and the configured second time step is, for example, 1 day, the end point of the first time step.
  • the time is taken as the critical time point of the credit data of the credit information of the stock, and the second collection task is the second collection time, and the second collection time is, for example, one day, and the second collection task is used to collect the data.
  • the critical time point is the start time and the credit data within the second time step.
  • the first collection task is still collected to collect a larger first time step of the credit data, so as to collect the credit data as soon as possible. After the acquisition is completed, it is detected whether the first time step of the credit information is collected by detecting whether the first collection task is finished, and after the first time step of the credit data is collected, the time difference and the first time step are again performed. Compare and cycle accordingly.
  • the present application first collects a large amount of credit data of the first time step to collect the credit data quickly, and analyzes the end time of the first time step at the end of each acquisition.
  • the time difference of the current time if the time difference is less than the first time step, it can be determined that the end time is the critical time point of the credit data of the credit data transfer increment of the stock, after the critical time point, the acquisition operation is compared by the acquisition.
  • the large credit data of the first time step is converted into the collected credit data of the second time step, which can accurately determine the critical time point of the inventory transfer increment, and avoid collecting repeated credit data or The lack of critical credit data occurs.
  • the electronic device before the reporting data is reported to the monitoring system, the electronic device processes the credit information, and in order to reduce manual intervention, improve processing efficiency before reporting the credit data.
  • the method further includes:
  • the processing node includes an assembly node, a pre-processing node, and a reporting node of the credit data; and when the processing node processes the credit data, if the processing node has an abnormality, recording the The processing node is abnormally once; each processing node is periodically scanned by using a preset scanning task, and the number of abnormalities corresponding to each processing node is counted; if the number of abnormalities of the processing node is greater than or equal to a preset threshold number, an early warning is performed.
  • the node in the processing stage before the report of the credit report, the node is divided according to the processing process, and preferably, the assembly node, the pre-processing node and the reporting node of the credit data can be divided according to the order of processing.
  • the credit data can be transmitted between the processing nodes in the form of a network.
  • the credit information system provides three data exchange methods: FTP, HTTP and SMTP.
  • the assembly node degree assembles the collected credit data according to the format of the predetermined credit system, and the pre-processing node performs the verification processing on the assembled credit data according to a predetermined rule engine, and the reporting node will perform the verification processing.
  • the credit data is reported to the predetermined credit information system.
  • the number of abnormalities corresponding to each processing node is periodically scanned by using a scan task set in advance, for example, the number of abnormalities corresponding to each processing node is scanned every one hour. Since some processing nodes can be automatically processed in the process of processing the credit data without manual intervention, the present embodiment performs manual intervention when the number of abnormalities of the processing node is greater than or equal to the preset number. For example, if the number of abnormalities is greater than or equal to 5, a reminder message is generated to perform manual intervention, which can reduce manual intervention and improve the processing efficiency before reporting the credit data.
  • the present application also provides a computer readable storage medium having stored thereon a processing system that, when executed by a processor, implements the steps of the method of collecting credit data as described above.
  • the foregoing embodiment method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be through hardware, but in many cases, the former is better.
  • Implementation Based on such understanding, the technical solution of the present application, which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk,
  • the optical disc includes a number of instructions for causing a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the methods described in various embodiments of the present application.

Landscapes

  • Business, Economics & Management (AREA)
  • Strategic Management (AREA)
  • Engineering & Computer Science (AREA)
  • Tourism & Hospitality (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Finance (AREA)
  • Accounting & Taxation (AREA)
  • Marketing (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • Health & Medical Sciences (AREA)
  • Primary Health Care (AREA)
  • Educational Administration (AREA)
  • Human Resources & Organizations (AREA)
  • General Health & Medical Sciences (AREA)
  • Debugging And Monitoring (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

一种电子装置、采集征信数据的方法及存储介质，该方法包括：以预定的方式确定该存量的征信数据的最早生成时间，配置预定的第一时间步长，启动第一采集任务采集以该最早生成时间为起点时间、该第一时间步长内的征信数据；在第一采集时长截止时，检测该第一采集任务是否已结束；若是，则确定所述第一时间步长的终点时间，获取当前时间与该终点时间之间的时间差，并分析该时间差是否小于所述第一时间步长；若是，则以该终点时间作为存量的征信数据转增量的征信数据的临界时间点，启动第二采集任务采集以该临界时间点为起点时间、该第二时间步长内的征信数据，本方法能够准确确定征信数据存量转增量的临界时间点。

Description

电子装置、采集征信数据的方法及存储介质
本申请要求于2018年4月28日提交中国专利局，申请号为201810404428.0、发明名称为“电子装置、采集征信数据的方法及存储介质”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及通信技术领域，尤其涉及一种电子装置、采集征信数据的方法及存储介质。
背景技术
征信监管是指：征信监督管理部门对征信机构实施监督管理，规范征信机构经营行为，保障征信活动各方的合法权益，是征信体系建设中一个重要组成部分。监督管理部门在指示征信机构上报征信数据后，征信机构需要将积攒未上报的存量数据及每天新增的增量数据进行上报，在上报至监督管理部门前，征信机构从业务系统中进行采集再上报。
目前，在从业务系统中采集征信数据的过程中，通过较多的人工干预的方式进行采集，导致采集速度较慢，人工手动切换采集存量数据与采集增量数据的临界时间点，无法准确确定临界时间点，容易导致采集得到重复数据或缺少临界数据的情况。
发明内容
本申请的目的在于提供一种电子装置、采集征信数据的方法及存储介质，旨在准确确定征信数据存量转增量的临界时间点。
为实现上述目的，本申请提供一种电子装置，所述电子装置包括存储器及与所述存储器连接的处理器，所述存储器中存储有可在所述处理器上运行 的处理系统，所述处理系统被所述处理器执行时实现如下步骤：
第一采集步骤，在向监管系统报送征信数据之前，当从业务系统中采集存量的征信数据时，以预定的方式确定该存量的征信数据的最早生成时间，配置预定的第一时间步长，启动时长为第一采集时长的第一采集任务，并利用该第一采集任务采集以该最早生成时间为起点时间、该第一时间步长内的征信数据，所述第一时间步长大于所述第一采集时长；
检测步骤，在第一采集时长截止时，检测该第一采集任务是否已结束；
分析步骤，若是，则确定所述第一时间步长的终点时间，获取当前时间与该终点时间之间的时间差，并分析该时间差是否小于所述第一时间步长；
第二采集步骤，若是，则配置预定的第二时间步长，以该终点时间作为存量的征信数据转增量的征信数据的临界时间点，启动时长为第二采集时长的第二采集任务，并利用该第二采集任务采集以该临界时间点为起点时间、该第二时间步长内的征信数据，所述第二时间步长小于所述第一时间步长，所述第二时间步长大于等于所述第二采集时长。
为实现上述目的，本申请还提供一种采集征信数据的方法，所述采集征信数据的方法包括：
S1，在向监管系统报送征信数据之前，当从业务系统中采集存量的征信数据时，以预定的方式确定该存量的征信数据的最早生成时间，配置预定的第一时间步长，启动时长为第一采集时长的第一采集任务，并利用该第一采集任务采集以该最早生成时间为起点时间、该第一时间步长内的征信数据，所述第一时间步长大于所述第一采集时长；
S2，在第一采集时长截止时，检测该第一采集任务是否已结束；
S3，若是，则确定所述第一时间步长的终点时间，获取当前时间与该终点时间之间的时间差，并分析该时间差是否小于所述第一时间步长；
S4，若是，则配置预定的第二时间步长，以该该终点时间作为存量的征 信数据转增量的征信数据的临界时间点，启动时长为第二采集时长的第二采集任务，并利用该第二采集任务采集以该临界时间点为起点时间、该第二时间步长内的征信数据，所述第二时间步长小于所述第一时间步长，所述第二时间步长大于等于所述第二采集时长。
本申请还提供一种计算机可读存储介质，所述计算机可读存储介质上存储有处理系统，所述处理系统被处理器执行时实现上述的采集征信数据的方法的步骤。
附图说明
图1为本申请各个实施例一可选的应用环境示意图；
图2为确定存量转增量的临界时间点的一具体示例图；
图3为本申请采集征信数据的方法一实施例的流程示意图。
具体实施方式
为了使本申请的目的、技术方案及优点更加清楚明白，以下结合附图及实施例，对本申请进行进一步详细说明。应当理解，此处所描述的具体实施例仅用以解释本申请，并不用于限定本申请。基于本申请中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。
需要说明的是，在本申请中涉及“第一”、“第二”等的描述仅用于描述目的，而不能理解为指示或暗示其相对重要性或者隐含指明所指示的技术特征的数量。由此，限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个该特征。另外，各个实施例之间的技术方案可以相互结合，但是必须是以本领域普通技术人员能够实现为基础，当技术方案的结合出现相互矛盾或无法实现时应当认为这种技术方案的结合不存在，也不在本申请要求的 保护范围之内。
参阅图1所示，是本申请采集征信数据的方法的较佳实施例的应用环境示意图。该应用环境示意图包括电子装置1、多个金融机构的业务系统及监管系统。电子装置1可以通过网络、近场通信技术等适合的技术与多个金融机构的业务系统及监管系统进行数据交互。
电子装置1是一种能够按照事先设定或者存储的指令，自动进行数值计算和/或信息处理的设备。所述电子装置1可以是计算机、也可以是单个网络服务器、多个网络服务器组成的服务器组或者基于云计算的由大量主机或者网络服务器构成的云，其中云计算是分布式计算的一种，由一群松散耦合的计算机集组成的一个超级虚拟计算机。
在本实施例中，电子装置1可包括，但不仅限于，可通过系统总线相互通信连接的存储器11、处理器12、网络接口13，存储器11存储有可在处理器12上运行的处理系统。需要指出的是，图1仅示出了具有组件11-13的电子装置1，但是应理解的是，并不要求实施所有示出的组件，可以替代的实施更多或者更少的组件。
其中，存储设备11包括内存及至少一种类型的可读存储介质。内存为电子装置1的运行提供缓存；可读存储介质可为如闪存、硬盘、多媒体卡、卡型存储器(例如，SD或DX存储器等)、随机访问存储器(RAM)、静态随机访问存储器(SRAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、可编程只读存储器(PROM)、磁性存储器、磁盘、光盘等的非易失性存储介质。在一些实施例中，可读存储介质可以是电子装置1的内部存储单元，例如该电子装置1的硬盘；在另一些实施例中，该非易失性存储介质也可以是电子装置1的外部存储设备，例如电子装置1上配备的插接式硬盘，智能存储卡(Smart Media Card,SMC)，安全数字(Secure Digital,SD)卡，闪存卡(Flash Card)等。本实施例中，存储设备11的可读存储介 质通常用于存储安装于电子装置1的操作系统和各类应用软件，例如存储本申请一实施例中的处理系统的程序代码等。此外，存储设备11还可以用于暂时地存储已经输出或者将要输出的各类数据。
所述处理器12在一些实施例中可以是中央处理器(Central Processing Unit，CPU)、控制器、微控制器、微处理器、或其他数据处理芯片。该处理器12通常用于控制所述电子装置1的总体操作，例如执行与多个金融机构的业务系统或监管系统进行数据交互或者通信相关的控制和处理等。本实施例中，所述处理器12用于运行所述存储器11中存储的程序代码或者处理数据，例如运行所述处理系统等。
所述网络接口13可包括无线网络接口或有线网络接口，该网络接口13通常用于在所述电子装置1与其他电子设备之间建立通信连接。本实施例中，网络接口13主要用于将电子装置1与多个金融机构的业务系统及监管系统相连，建立数据传输通道和通信连接。
所述处理系统存储在存储器11中，包括至少一个存储在存储器11中的计算机可读指令，该至少一个计算机可读指令可被处理器器12执行，以实现本申请各实施例的方法；以及，该至少一个计算机可读指令依据其各部分所实现的功能不同，可被划为不同的逻辑模块。
在一实施例中，上述处理系统被所述处理器12执行时实现如下步骤：
第一采集步骤，在向监管系统报送征信数据之前，当从业务系统中采集存量的征信数据时，以预定的方式确定该存量的征信数据的最早生成时间，配置预定的第一时间步长，启动时长为第一采集时长的第一采集任务，并利用该第一采集任务采集以该最早生成时间为起点时间、该第一时间步长内的征信数据，所述第一时间步长大于所述第一采集时长；
本实施例中，监管系统例如为中国人民银行的征信系统，业务系统为各个金融机构下的业务系统，例如包括担保系统、贷款系统等等。存量的征信 数据为长时间(例如1年)积攒而未上报的征信数据，其数量级别极大，例如为千万级别甚至上亿级别的征信数据。
在一实施例中，以预定的方式确定该存量的征信数据的最早生成时间包括：自动检测存量的征信数据中最早一笔征信数据的生成时间，例如存量的征信数据中最早一笔征信数据的生成时间为2016.10.01，则以该最早一笔征信数据的生成时间2016.10.01作为该存量的征信数据的最早生成时间，或者，由工作人员根据存量的征信数据的数量级别估计一过去的时间，该过去的时间离上一次采集征信数据的时间较近，以该过去的时间作为人工配置的时间，以该配置的时间作为该存量的征信数据的最早生成时间。优选地，为了尽快采集完存量的征信数据，本实施例以第一种自动检测的方式确定该存量的征信数据的最早生成时间。
本实施例中，第一时间步长为一个较大的时间跨度，例如为20天或者1个月等，第一采集时长例如为1星期或者10天等，其中，利用该第一采集任务采集第一时间步长内的征信数据时，基本不需要人工进行干预，配置的第一时间步长大于第一采集时长，即以较短的时间采集较大的时间跨度的存量的征信数据，以便尽快采集完存量的征信数据。
检测步骤，在第一采集时长截止时，检测该第一采集任务是否已结束；
本实施例中，可以预定一检测任务，在第一采集时长截止时，该检测任务启动，检测该第一采集任务是否已结束，第一采集任务结束的标志是不再进行采集征信数据的操作，以此来确定下一步的操作。
在一实施例中，若该第一采集任务已结束，则执行下一步的分析步骤，若该第一采集任务未结束，则等待该第一采集任务结束，在该第一采集任务结束后，确定第一时间步长的终点时间，例如起点时间为2016.10.01，第一时间步长为1个月，则该第一时间步长的终点时间为2016.11.01，并以第一采集任务结束的结束时间作为当前时间，计算当前时间与终点时间之间的时 间差，执行下一步的分析步骤。
分析步骤，若是，则确定所述第一时间步长的终点时间，获取当前时间与该终点时间之间的时间差，并分析该时间差是否小于所述第一时间步长；
其中，在第一采集时长截止时，第一采集任务结束或未结束，对应的第一时间步长的终点时间都相同，所不同的是当前时间：在第一采集时长截止的同时第一采集任务结束，对应的当前时间较早，计算得到的时间差较小；在第一采集时长截止的同时第一采集任务未结束，对应的当前时间较晚，计算得到的时间差较大，将时间差与第一时间步长进行比较，以分析下一步是以较大的第一时间步长来采集征信数据，还是以较小的第二时间步长来采集征信数据。
第二采集步骤，若是，则配置预定的第二时间步长，以该终点时间作为存量的征信数据转增量的征信数据的临界时间点，启动时长为第二采集时长的第二采集任务，并利用该第二采集任务采集以该临界时间点为起点时间、该第二时间步长内的征信数据，所述第二时间步长小于所述第一时间步长，所述第二时间步长大于等于所述第二采集时长。
本实施例中，如果时间差小于第一时间步长，则以较小的第二时间步长来采集征信数据，配置的第二时间步长例如为1天，以第一时间步长的终点时间作为存量的征信数据转增量的征信数据的临界时间点，启动时长为第二采集时长的第二采集任务，第二采集时长例如为1天，利用该第二采集任务采集以该临界时间点为起点时间、该第二时间步长内的征信数据。
在一实施例中，若该时间差大于等于所述第一时间步长，则仍然以第一采集任务采集来采集较大的第一时间步长的征信数据，以便尽快将存量的征信数据采集完，通过检测第一采集任务是否结束来检测第一时间步长的征信数据是否采集完，并在采集完第一时间步长的征信数据后，再次将时间差与第一时间步长进行比较，依此循环。
在一具体的实例中，如图2所示，图2为确定存量转增量的临界时间点的一具体示例图，确定存量的征信数据的最早生成时间为2016.10.01，第一时间步长为1个月，第一采集时长为10天，第二时间步长为1天，第二采集时长为1天，启动第一采集任务采集2016.10.01-2016.11.01该一个月内的存量的征信数据；
当采集了10天后，检测第一采集任务是否已结束；
若第一采集任务已结束，确定第一时间步长的终点时间为2016.11.01，计算当前时间(例如为2016.11.11或者2017.11.11)与该终点时间2016.11.01之间的时间差；
若第一采集任务未结束，等待第一采集任务结束(例如需要多一天才采集结束)，再执行计算当前时间与该终点时间2016.11.01之间的时间差；
分析该时间差是否小于1个月；
若该时间差大于等于1个月(例如当前时间为2017.11.11)，则以终点时间2016.11.01作为下一起点时间，再次启动采集时间为10天的第一采集任务采集存量的征信数据；
若该时间差小于1个月(例如当前时间为2016.11.11)，以终点时间2016.11.01为起点时间，再次启动另一采集时间为1天的第二采集任务采集征信数据。
与现有技术相比，本申请首先采集较大的第一时间步长的存量的征信数据，以快速采集征信数据，在每次采集结束时，分析第一时间步长的终点时间与当前时间的时间差，如果时间差小于第一时间步长，则可以确定该终点时间为存量的征信数据转增量的征信数据的临界时间点，在该临界时间点之后，采集操作由采集较大的第一时间步长的存量的征信数据转为采集较小的第二时间步长的征信数据，能够准确确定存量转增量的临界时间点，避免采集得到重复的征信数据或缺少临界的征信数据的情况发生。
在一实施例中，在上述实施例的基础上，在将征信数据上报至监管系统前，该电子装置对征信数据进行处理，为了减少人工干预，提高征信数据上报前的处理效率，所述处理系统被所述处理器执行时，还实现如下步骤：
按照征信数据的处理进程划分处理节点，所述处理节点包括征信数据的组装节点、预处理节点及上报节点；在各个处理节点处理征信数据时，若有处理节点出现异常，则记录该处理节点出现异常一次；利用预先设置的扫描任务定时扫描各个处理节点，统计各个处理节点对应的异常次数；若有处理节点的异常次数大于等于预设的阈值数量，则进行预警。
本实施例中，在征信报文上报前的处理阶段，对其按照处理进程分节点，优选地，按照处理的先后顺序可以分为征信数据的组装节点、预处理节点及上报节点。各个处理节点之间可通过网络的形式传送征信数据。征信系统提供FTP、HTTP及SMTP三种数据交换方式。其中，组装节点度将采集的征信数据进行按照预定的征信系统的格式进行组装，预处理节点将组装后的征信数据按照预定的规则引擎进行校验处理，上报节点将校验处理后的征信数据上报至预定的征信系统。
本实施例中，对于每一处理节点，如果处理出现异常，则记录该处理节点出现异常一次，后续统计异常次数sum＝1。该处理节点继续处理征信数据，如果又出现异常，则再次统计异常次数sum＝sum+1，其他处理节点也依照该方法统计异常次数。
本实施例中，利用预先设置的扫描任务定时扫描各个处理节点对应的异常次数，例如每隔1小时扫描各个处理节点对应的异常次数。由于各个处理节点在处理征信数据的过程中有些异常是可以自动处理掉而不需要人工干预的，因此，本实施例在有处理节点的异常次数大于等于预设的数量时才进行人工干预，例如异常次数大于等于5，则生成提醒消息，以进行人工干预， 这样能够减少人工干预，提高征信数据上报前的处理效率。
如图3所示，图3为本申请采集征信数据的方法一实施例的流程示意图，该采集征信数据的方法包括以下步骤：
步骤S1，在向监管系统报送征信数据之前，当从业务系统中采集存量的征信数据时，以预定的方式确定该存量的征信数据的最早生成时间，配置预定的第一时间步长，启动时长为第一采集时长的第一采集任务，并利用该第一采集任务采集以该最早生成时间为起点时间、该第一时间步长内的征信数据，所述第一时间步长大于所述第一采集时长；
本实施例中，监管系统例如为中国人民银行的征信系统，业务系统为各个金融机构下的业务系统，例如包括担保系统、贷款系统等等。存量的征信数据为长时间(例如1年)积攒而未上报的征信数据，其数量级别极大，例如为千万级别甚至上亿级别的征信数据。
在一实施例中，以预定的方式确定该存量的征信数据的最早生成时间包括：自动检测存量的征信数据中最早一笔征信数据的生成时间，例如存量的征信数据中最早一笔征信数据的生成时间为2016.10.01，则以该最早一笔征信数据的生成时间2016.10.01作为该存量的征信数据的最早生成时间，或者，由工作人员根据存量的征信数据的数量级别估计一过去的时间，该过去的时间离上一次采集征信数据的时间较近，以该过去的时间作为人工配置的时间，以该配置的时间作为该存量的征信数据的最早生成时间。优选地，为了尽快采集完存量的征信数据，本实施例以第一种自动检测的方式确定该存量的征信数据的最早生成时间。
本实施例中，第一时间步长为一个较大的时间跨度，例如为20天或者1个月等，第一采集时长例如为1星期或者10天等，其中，利用该第一采集任务采集第一时间步长内的征信数据时，基本不需要人工进行干预，配置的 第一时间步长大于第一采集时长，即以较短的时间采集较大的时间跨度的存量的征信数据，以便尽快采集完存量的征信数据。
步骤S2，在第一采集时长截止时，检测该第一采集任务是否已结束；
本实施例中，可以预定一检测任务，在第一采集时长截止时，该检测任务启动，检测该第一采集任务是否已结束，第一采集任务结束的标志是不再进行采集征信数据的操作，以此来确定下一步的操作。
在一实施例中，若该第一采集任务已结束，则执行下一步的步骤S3，若该第一采集任务未结束，则等待该第一采集任务结束，在该第一采集任务结束后，确定第一时间步长的终点时间，例如起点时间为2016.10.01，第一时间步长为1个月，则该第一时间步长的终点时间为2016.11.01，并以第一采集任务结束的结束时间作为当前时间，计算当前时间与终点时间之间的时间差，执行下一步的步骤S3。
步骤S3，若是，则确定所述第一时间步长的终点时间，获取当前时间与该终点时间之间的时间差，并分析该时间差是否小于所述第一时间步长；
其中，在第一采集时长截止时，第一采集任务结束或未结束，对应的第一时间步长的终点时间都相同，所不同的是当前时间：在第一采集时长截止的同时第一采集任务结束，对应的当前时间较早，计算得到的时间差较小；在第一采集时长截止的同时第一采集任务未结束，对应的当前时间较晚，计算得到的时间差较大，将时间差与第一时间步长进行比较，以分析下一步是以较大的第一时间步长来采集征信数据，还是以较小的第二时间步长来采集征信数据。
步骤S4，若是，则配置预定的第二时间步长，以该该终点时间作为存量的征信数据转增量的征信数据的临界时间点，启动时长为第二采集时长的第二采集任务，并利用该第二采集任务采集以该临界时间点为起点时间、该第二时间步长内的征信数据，所述第二时间步长小于所述第一时间步长，所 述第二时间步长大于等于所述第二采集时长。
本实施例中，如果时间差小于第一时间步长，则以较小的第二时间步长来采集征信数据，配置的第二时间步长例如为1天，以第一时间步长的终点时间作为存量的征信数据转增量的征信数据的临界时间点，启动时长为第二采集时长的第二采集任务，第二采集时长例如为1天，利用该第二采集任务采集以该临界时间点为起点时间、该第二时间步长内的征信数据。
在一实施例中，若该时间差大于等于所述第一时间步长，则仍然以第一采集任务采集来采集较大的第一时间步长的征信数据，以便尽快将存量的征信数据采集完，通过检测第一采集任务是否结束来检测第一时间步长的征信数据是否采集完，并在采集完第一时间步长的征信数据后，再次将时间差与第一时间步长进行比较，依此循环。
与现有技术相比，本申请首先采集较大的第一时间步长的存量的征信数据，以快速采集征信数据，在每次采集结束时，分析第一时间步长的终点时间与当前时间的时间差，如果时间差小于第一时间步长，则可以确定该终点时间为存量的征信数据转增量的征信数据的临界时间点，在该临界时间点之后，采集操作由采集较大的第一时间步长的存量的征信数据转为采集较小的第二时间步长的征信数据，能够准确确定存量转增量的临界时间点，避免采集得到重复的征信数据或缺少临界的征信数据的情况发生。
在一实施例中，在上述实施例的基础上，在将征信数据上报至监管系统前，该电子装置对征信数据进行处理，为了减少人工干预，提高征信数据上报前的处理效率，所述步骤S4之后，还包括：
按照征信数据的处理进程划分处理节点，所述处理节点包括征信数据的组装节点、预处理节点及上报节点；在各个处理节点处理征信数据时，若有处理节点出现异常，则记录该处理节点出现异常一次；利用预先设置的扫描 任务定时扫描各个处理节点，统计各个处理节点对应的异常次数；若有处理节点的异常次数大于等于预设的阈值数量，则进行预警。
本实施例中，在征信报文上报前的处理阶段，对其按照处理进程分节点，优选地，按照处理的先后顺序可以分为征信数据的组装节点、预处理节点及上报节点。各个处理节点之间可通过网络的形式传送征信数据。征信系统提供FTP、HTTP及SMTP三种数据交换方式。其中，组装节点度将采集的征信数据进行按照预定的征信系统的格式进行组装，预处理节点将组装后的征信数据按照预定的规则引擎进行校验处理，上报节点将校验处理后的征信数据上报至预定的征信系统。
本实施例中，对于每一处理节点，如果处理出现异常，则记录该处理节点出现异常一次，后续统计异常次数sum＝1。该处理节点继续处理征信数据，如果又出现异常，则再次统计异常次数sum＝sum+1，其他处理节点也依照该方法统计异常次数。
本实施例中，利用预先设置的扫描任务定时扫描各个处理节点对应的异常次数，例如每隔1小时扫描各个处理节点对应的异常次数。由于各个处理节点在处理征信数据的过程中有些异常是可以自动处理掉而不需要人工干预的，因此，本实施例在有处理节点的异常次数大于等于预设的数量时才进行人工干预，例如异常次数大于等于5，则生成提醒消息，以进行人工干预，这样能够减少人工干预，提高征信数据上报前的处理效率。
本申请还提供一种计算机可读存储介质，所述计算机可读存储介质上存储有处理系统，所述处理系统被处理器执行时实现上述的采集征信数据的方法的步骤。
上述本申请实施例序号仅仅为了描述，不代表实施例的优劣。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通 过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得一台终端设备(可以是手机，计算机，服务器，空调器，或者网络设备等)执行本申请各个实施例所述的方法。
以上仅为本申请的优选实施例，并非因此限制本申请的专利范围，凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换，或直接或间接运用在其他相关的技术领域，均同理包括在本申请的专利保护范围内。

Claims (20)

  1. 一种电子装置，其特征在于，所述电子装置包括存储器及与所述存储器连接的处理器，所述存储器中存储有可在所述处理器上运行的处理系统，所述处理系统被所述处理器执行时实现如下步骤：
    第一采集步骤，在向监管系统报送征信数据之前，当从业务系统中采集存量的征信数据时，以预定的方式确定该存量的征信数据的最早生成时间，配置预定的第一时间步长，启动时长为第一采集时长的第一采集任务，并利用该第一采集任务采集以该最早生成时间为起点时间、该第一时间步长内的征信数据，所述第一时间步长大于所述第一采集时长；
    检测步骤，在第一采集时长截止时，检测该第一采集任务是否已结束；
    分析步骤，若是，则确定所述第一时间步长的终点时间，获取当前时间与该终点时间之间的时间差，并分析该时间差是否小于所述第一时间步长；
    第二采集步骤，若是，则配置预定的第二时间步长，以该终点时间作为存量的征信数据转增量的征信数据的临界时间点，启动时长为第二采集时长的第二采集任务，并利用该第二采集任务采集以该临界时间点为起点时间、该第二时间步长内的征信数据，所述第二时间步长小于所述第一时间步长，所述第二时间步长大于等于所述第二采集时长。
  2. 根据权利要求1所述的电子装置，其特征在于，所述以预定的方式确定该存量的征信数据的最早生成时间的步骤包括：
    自动检测存量的征信数据中最早一笔征信数据的生成时间，以该最早一笔征信数据的生成时间作为该存量的征信数据的最早生成时间，或者，接收配置的时间，以该配置的时间作为该存量的征信数据的最早生成时间。
  3. 根据权利要求1所述的电子装置，其特征在于，所述检测步骤之后，所述处理系统被所述处理器执行时，还实现如下步骤：
    若该第一采集任务未结束，则在等待该第一采集任务结束后，确定所述 第一时间步长的终点时间，并以第一采集任务结束的结束时间作为当前时间，返回执行所述步骤分析步骤。
  4. 根据权利要求2所述的电子装置，其特征在于，所述检测步骤之后，所述处理系统被所述处理器执行时，还实现如下步骤：
    若该第一采集任务未结束，则在等待该第一采集任务结束后，确定所述第一时间步长的终点时间，并以第一采集任务结束的结束时间作为当前时间，返回执行所述分析步骤。
  5. 根据权利要求1所述的电子装置，其特征在于，所述分析步骤之后，所述处理系统被所述处理器执行时，还实现如下步骤：
    若该时间差大于等于所述第一时间步长，则再启动该第一采集任务，并利用该第一采集任务采集以该终点时间为起点时间、该第一时间步长内的征信数据，返回执行所述检测步骤。
  6. 根据权利要求2所述的电子装置，其特征在于，所述分析步骤之后，所述处理系统被所述处理器执行时，还实现如下步骤：
    若该时间差大于等于所述第一时间步长，则再启动该第一采集任务，并利用该第一采集任务采集以该终点时间为起点时间、该第一时间步长内的征信数据，返回执行所述检测步骤。
  7. 根据权利要求1-6任一项所述的电子装置，其特征在于，所述第二采集步骤之后，所述处理系统被所述处理器执行时，还实现如下步骤：
    按照征信数据的处理进程划分处理节点，所述处理节点包括征信数据的组装节点、预处理节点及上报节点；
    在各个处理节点处理征信数据时，若有处理节点出现异常，则记录该处理节点出现异常一次；
    利用预先设置的扫描任务定时扫描各个处理节点，统计各个处理节点对应的异常次数；
    若有处理节点的异常次数大于等于预设的阈值数量，则进行预警。
  8. 一种采集征信数据的方法，其特征在于，所述采集征信数据的方法包括：
    S1，在向监管系统报送征信数据之前，当从业务系统中采集存量的征信数据时，以预定的方式确定该存量的征信数据的最早生成时间，配置预定的第一时间步长，启动时长为第一采集时长的第一采集任务，并利用该第一采集任务采集以该最早生成时间为起点时间、该第一时间步长内的征信数据，所述第一时间步长大于所述第一采集时长；
    S2，在第一采集时长截止时，检测该第一采集任务是否已结束；
    S3，若是，则确定所述第一时间步长的终点时间，获取当前时间与该终点时间之间的时间差，并分析该时间差是否小于所述第一时间步长；
    S4，若是，则配置预定的第二时间步长，以该该终点时间作为存量的征信数据转增量的征信数据的临界时间点，启动时长为第二采集时长的第二采集任务，并利用该第二采集任务采集以该临界时间点为起点时间、该第二时间步长内的征信数据，所述第二时间步长小于所述第一时间步长，所述第二时间步长大于等于所述第二采集时长。
  9. 根据权利要求8所述的采集征信数据的方法，其特征在于，所述以预定的方式确定该存量的征信数据的最早生成时间的步骤包括：
    自动检测存量的征信数据中最早一笔征信数据的生成时间，以该最早一笔征信数据的生成时间作为该存量的征信数据的最早生成时间，或者，接收配置的时间，以该配置的时间作为该存量的征信数据的最早生成时间。
  10. 根据权利要求8所述的采集征信数据的方法，其特征在于，所述步骤S2之后，还包括：
    若该第一采集任务未结束，则在等待该第一采集任务结束后，确定所述第一时间步长的终点时间，并以第一采集任务结束的结束时间作为当前时 间，返回执行所述步骤S3。
  11. 根据权利要求9所述的采集征信数据的方法，其特征在于，所述步骤S2之后，还包括：
    若该第一采集任务未结束，则在等待该第一采集任务结束后，确定所述第一时间步长的终点时间，并以第一采集任务结束的结束时间作为当前时间，返回执行所述步骤S3。
  12. 根据权利要求8所述的采集征信数据的方法，其特征在于，所述步骤S3之后，还包括：
    若该时间差大于等于所述第一时间步长，则再启动该第一采集任务，并利用该第一采集任务采集以该终点时间为起点时间、该第一时间步长内的征信数据，返回执行所述步骤S2。
  13. 根据权利要求9所述的采集征信数据的方法，其特征在于，所述步骤S3之后，还包括：
    若该时间差大于等于所述第一时间步长，则再启动该第一采集任务，并利用该第一采集任务采集以该终点时间为起点时间、该第一时间步长内的征信数据，返回执行所述步骤S2。
  14. 根据权利要求8-13任一项所述的采集征信数据的方法，其特征在于，所述步骤S4之后，还包括：
    按照征信数据的处理进程划分处理节点，所述处理节点包括征信数据的组装节点、预处理节点及上报节点；
    在各个处理节点处理征信数据时，若有处理节点出现异常，则记录该处理节点出现异常一次；
    利用预先设置的扫描任务定时扫描各个处理节点，统计各个处理节点对应的异常次数；
    若有处理节点的异常次数大于等于预设的阈值数量，则进行预警。
  15. 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质上存储有处理系统，所述处理系统被处理器执行时实现如下步骤：
    第一采集步骤，在向监管系统报送征信数据之前，当从业务系统中采集存量的征信数据时，以预定的方式确定该存量的征信数据的最早生成时间，配置预定的第一时间步长，启动时长为第一采集时长的第一采集任务，并利用该第一采集任务采集以该最早生成时间为起点时间、该第一时间步长内的征信数据，所述第一时间步长大于所述第一采集时长；
    检测步骤，在第一采集时长截止时，检测该第一采集任务是否已结束；
    分析步骤，若是，则确定所述第一时间步长的终点时间，获取当前时间与该终点时间之间的时间差，并分析该时间差是否小于所述第一时间步长；
    第二采集步骤，若是，则配置预定的第二时间步长，以该终点时间作为存量的征信数据转增量的征信数据的临界时间点，启动时长为第二采集时长的第二采集任务，并利用该第二采集任务采集以该临界时间点为起点时间、该第二时间步长内的征信数据，所述第二时间步长小于所述第一时间步长，所述第二时间步长大于等于所述第二采集时长。
  16. 根据权利要求15所述的计算机可读存储介质，其特征在于，所述以预定的方式确定该存量的征信数据的最早生成时间的步骤包括：
    自动检测存量的征信数据中最早一笔征信数据的生成时间，以该最早一笔征信数据的生成时间作为该存量的征信数据的最早生成时间，或者，接收配置的时间，以该配置的时间作为该存量的征信数据的最早生成时间。
  17. 根据权利要求15所述的计算机可读存储介质，其特征在于，所述检测步骤之后，所述处理系统被所述处理器执行时，还实现如下步骤：
    若该第一采集任务未结束，则在等待该第一采集任务结束后，确定所述第一时间步长的终点时间，并以第一采集任务结束的结束时间作为当前时间，返回执行所述分析步骤。
  18. 根据权利要求15所述的计算机可读存储介质，其特征在于，所述分析步骤之后，所述处理系统被所述处理器执行时，还实现如下步骤：
    若该时间差大于等于所述第一时间步长，则再启动该第一采集任务，并利用该第一采集任务采集以该终点时间为起点时间、该第一时间步长内的征信数据，返回执行所述检测步骤。
  19. 根据权利要求16所述的计算机可读存储介质，其特征在于，所述分析步骤之后，所述处理系统被所述处理器执行时，还实现如下步骤：
    若该时间差大于等于所述第一时间步长，则再启动该第一采集任务，并利用该第一采集任务采集以该终点时间为起点时间、该第一时间步长内的征信数据，返回执行所述步骤检测步骤。
  20. 根据权利要求15-19任一项所述的计算机可读存储介质，其特征在于，所述第二采集步骤之后，所述处理系统被所述处理器执行时，还实现如下步骤：
    按照征信数据的处理进程划分处理节点，所述处理节点包括征信数据的组装节点、预处理节点及上报节点；
    在各个处理节点处理征信数据时，若有处理节点出现异常，则记录该处理节点出现异常一次；
    利用预先设置的扫描任务定时扫描各个处理节点，统计各个处理节点对应的异常次数；
    若有处理节点的异常次数大于等于预设的阈值数量，则进行预警。
PCT/CN2018/102199 2018-04-28 2018-08-24 电子装置、采集征信数据的方法及存储介质 Ceased WO2019205382A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810404428.0 2018-04-28
CN201810404428.0A CN108805778B (zh) 2018-04-28 2018-04-28 电子装置、采集征信数据的方法及存储介质

Publications (1)

Publication Number Publication Date
WO2019205382A1 true WO2019205382A1 (zh) 2019-10-31

Family

ID=64093120

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/102199 Ceased WO2019205382A1 (zh) 2018-04-28 2018-08-24 电子装置、采集征信数据的方法及存储介质

Country Status (2)

Country Link
CN (1) CN108805778B (zh)
WO (1) WO2019205382A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113760972A (zh) * 2020-06-11 2021-12-07 北京沃东天骏信息技术有限公司 一种数据查找方法和装置

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105469303A (zh) * 2015-12-24 2016-04-06 安徽融信金模信息技术有限公司 一种针对中小企业的征信方法
CN107453831A (zh) * 2016-05-31 2017-12-08 阿里巴巴集团控股有限公司 分布式交易系统的时间同步方法和装置
CN107657057A (zh) * 2017-10-19 2018-02-02 河北省科学院应用数学研究所 一种企业征信信息融合图形化方法
CN107705149A (zh) * 2017-09-22 2018-02-16 平安科技（深圳）有限公司 数据实时监控方法、装置、终端设备及存储介质

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016018210A1 (en) * 2014-07-28 2016-02-04 Hewlett-Packard Development Company, L.P. Detection of abnormal transaction loops
CN104598551B (zh) * 2014-12-31 2018-06-05 华为软件技术有限公司 一种数据统计方法及装置
CN104917639B (zh) * 2015-06-10 2018-07-03 北京奇虎科技有限公司 基于集群监控分配数据业务方法及装置
CN105610915A (zh) * 2015-12-15 2016-05-25 深圳市慧动创想科技有限公司 数据上报方法和系统
CN105843935A (zh) * 2016-03-30 2016-08-10 乐视控股（北京）有限公司 一种数据采集方法以及etl组件

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105469303A (zh) * 2015-12-24 2016-04-06 安徽融信金模信息技术有限公司 一种针对中小企业的征信方法
CN107453831A (zh) * 2016-05-31 2017-12-08 阿里巴巴集团控股有限公司 分布式交易系统的时间同步方法和装置
CN107705149A (zh) * 2017-09-22 2018-02-16 平安科技（深圳）有限公司 数据实时监控方法、装置、终端设备及存储介质
CN107657057A (zh) * 2017-10-19 2018-02-02 河北省科学院应用数学研究所 一种企业征信信息融合图形化方法

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113760972A (zh) * 2020-06-11 2021-12-07 北京沃东天骏信息技术有限公司 一种数据查找方法和装置
CN113760972B (zh) * 2020-06-11 2024-05-17 北京沃东天骏信息技术有限公司 一种数据查找方法和装置

Also Published As

Publication number Publication date
CN108805778A (zh) 2018-11-13
CN108805778B (zh) 2023-11-24

Similar Documents

Publication Publication Date Title
US11645293B2 (en) Anomaly detection in big data time series analysis
CN107992398B (zh) 一种业务系统的监控方法和监控系统
CN107908494B (zh) 异常事件的处理方法、装置、电子设备及存储介质
CN110781372B (zh) 一种优化网站的方法、装置、计算机设备及存储介质
CN113472858B (zh) 埋点数据处理方法、装置及电子设备
WO2019062189A1 (zh) 电子装置、数据表归档处理的方法、系统及存储介质
CN109460343A (zh) 基于日志的系统异常监控方法、装置、设备及存储介质
CN105812202A (zh) 日志实时监控预警方法及其装置
CN116910079B (zh) 一种Flink关于CDC数据维表延迟关联实现方法、系统、装置及存储介质
CN111078513A (zh) 日志处理方法、装置、设备、存储介质及日志告警系统
WO2021184588A1 (zh) 集群优化方法、装置、服务器及介质
CN110363381A (zh) 一种信息处理方法和装置
WO2019205382A1 (zh) 电子装置、采集征信数据的方法及存储介质
WO2019100684A1 (zh) 电子装置、征信数据处理的方法、系统及存储介质
CN112800089B (zh) 一种中间数据存储级别调整方法、存储介质及计算机设备
CN113254313A (zh) 一种监控指标异常检测方法、装置、电子设备及存储介质
CN113781101A (zh) 基于实时计算的事件中心管理方法、装置及可读介质
CN105653551A (zh) 分布式系统中数据更新和统计的方法及其装置
US10956369B1 (en) Data aggregations in a distributed environment
JP6707646B2 (ja) ユーティリティシステムにおける供給停止に対処するためのシステムおよび方法
US11914704B2 (en) Method and system for detecting coordinated attacks against computing resources using statistical analyses
CN117640336A (zh) 工单处理方法、装置、设备及存储介质
CN101894119B (zh) 用于监控的海量数据的储存
US12411818B2 (en) Method and apparatus of comparing data of heterogeneous data sources, device, and storage medium
CN120316078B (zh) 数据处理方法、系统和装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18915986

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 27/01/2021)

122 Ep: pct application non-entry in european phase

Ref document number: 18915986

Country of ref document: EP

Kind code of ref document: A1