CN108520073A - Air control data integration method, device, equipment and computer readable storage medium - Google Patents
Air control data integration method, device, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN108520073A CN108520073A CN201810335529.7A CN201810335529A CN108520073A CN 108520073 A CN108520073 A CN 108520073A CN 201810335529 A CN201810335529 A CN 201810335529A CN 108520073 A CN108520073 A CN 108520073A
- Authority
- CN
- China
- Prior art keywords
- data
- air control
- business
- cleaning
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q20/00—Payment architectures, schemes or protocols
- G06Q20/38—Payment protocols; Details thereof
- G06Q20/40—Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
- G06Q20/401—Transaction verification
- G06Q20/4016—Transaction verification involving fraud or risk level assessment in transaction processing
Abstract
The present invention provides a kind of air control data integration method, and this method includes：Initial data is acquired from data source, and the initial data is corresponded to according to default cleaning strategy and is cleaned, obtains cleaning data；Identity normalized is carried out to the cleaning data according to the user identifier in the cleaning data, obtains the subscriber data set with same user identifier；It is the user data addition business-subject label in the subscriber data set according to air control type of service；Business-subject index corresponding with the business-subject label is generated, and business-subject index is pushed into corresponding air control system, so that the air control system carries out air control calling.The present invention also provides a kind of air control data integration device, equipment and computer readable storage mediums.The data acquisition system that the present invention can provide for air control business processing is accurate, orderly, integrated reduces application end to the data call time of database, and advantageously reduces server stress, improve treatment effeciency.
Description
Technical field
The present invention relates to data processing field more particularly to a kind of air control data integration method, device, equipment and computers
Readable storage medium storing program for executing.
Background technology
With the continuous development of Internet technology and society, big data is gradually applied to all trades and professions.In financial technology
Field, big data air control are just gradually replacing traditional artificial experience control mode, the method by building model with big data
Risk control and indicating risk are carried out to borrower.
When using this big data air control method, it is necessary first to get a large amount of initial data；And these original numbers
According to typical from different data sources, these data sources are not necessarily what only air control system was serviced, therefore in data
Initial data include often dirty data (such as unrelated with air control redundant data, mistake) and these data due to coming
Source difference will present out randomness；And during air control, it is inevitable if these initial data is directly used to carry out air control business
The time that data call can be extended increases calculating and the processing pressure of system server, to reduce air control efficiency.
Invention content
The main purpose of the present invention is to provide a kind of air control data integration method, device, equipment and computer-readable deposit
Storage media, it is intended to realize the orderly integrated of air control data, improve the efficiency of air control data call.
To achieve the above object, the present invention provides a kind of air control data integration method, the air control data integration method packet
Include following steps：
Initial data is acquired from data source, and the initial data is corresponded to according to default cleaning strategy and is cleaned, is obtained
Clean data；
Identity normalized is carried out to the cleaning data according to the user identifier in the cleaning data, is had
The subscriber data set of same user identifier；
It is the user data addition business-subject label in the subscriber data set according to air control type of service；
Corresponding with business-subject label business-subject index is generated, and the business-subject indexed and is pushed to pair
The air control system answered, so that the air control system carries out air control calling.
Optionally, the default cleaning strategy of the basis corresponds to the initial data and is cleaned, and obtains the step of cleaning data
Suddenly include：
The demand type of the data source is determined according to the default cleaning strategy, and need are determined according to the demand type
Seek field；
The initial data is once filtered according to the demand field, obtains a data field；
Numerical value missing detection is carried out to a data field, to carry out secondary filter to a data field,
Obtain secondary data field；
Numerical value conflict/repetition detection is carried out to the secondary data field, to be carried out three times to the secondary data field
Filtering obtains cleaning data.
Optionally, the default cleaning strategy of the basis corresponds to the initial data and is cleaned, and obtains the step of cleaning data
Suddenly further include：
Corresponding cleaning daily record is generated according to data cleansing process, the cleaning daily record includes the filtering rope of each filter node
Draw and filtration yield.
Optionally, the user identifier according in the cleaning data carries out at identity normalization the cleaning data
Reason, obtain with same user identifier subscriber data set the step of include：
Validated user identity is determined based on default identity system, and user identifier is determined according to the validated user identity；
Classified to the cleaning data according to the user identifier, obtains the user data with same user identifier
Set.
Optionally, described to generate corresponding with business-subject label business-subject and index, and by the business-subject
Index pushes to corresponding air control system, after the step of air control system progress air control calling, further includes：
When receiving the air control data call request that the air control system is sent, the air control data call request is obtained
The target user's mark and target service theme for including；
It is identified according to the target user and inquires corresponding target user data set, and according to the target service theme
Obtain corresponding end user service data；
The end user service data are returned into the air control system.
Optionally, described when receiving the air control data call request that the air control system is sent, obtain the air control
After the step of target user's mark and target service theme that data call request includes, further include：
Obtain the air control data call and ask the calling capability identification for including, and according to the calling capability identification,
Target user identifies and target service theme judges whether the air control system has and calls permission；
If the air control system, which has, calls permission, thens follow the steps to be identified according to the target user and inquire corresponding mesh
Subscriber data set is marked, and corresponding end user service data are obtained according to the target service theme.
Optionally, described that business-subject is added for the user data in the subscriber data set according to air control type of service
After the step of label, further include：
Corresponding business datum set is established according to the air control type of service, and will be according to corresponding business-subject mark
The user data of label is added to the business datum set；
Global business index corresponding with the business datum set is generated, and the global business indexed and is pushed to pair
The management system answered, so that the management system carries out business diagnosis calling.
In addition, to achieve the above object, the present invention also provides a kind of air control data integration device, the air control Data Integration
Device includes：
Data cleansing module for acquiring initial data from data source, and is corresponded to according to default cleaning strategy described original
Data are cleaned, and cleaning data are obtained；
First establishes module, returns for carrying out identity to the cleaning data according to the user identifier in the cleaning data
One change is handled, and obtains the subscriber data set with same user identifier；
Label add module, for being that the user data in the subscriber data set adds industry according to air control type of service
Business theme label；
First pushing module is indexed for generating corresponding with business-subject label business-subject, and by the industry
Business subject index pushes to corresponding air control system, so that the air control system carries out air control calling.
In addition, to achieve the above object, the present invention also provides a kind of air control Data Integration equipment, the air control Data Integration
Equipment includes processor, memory and to be stored in the air control data that can be executed on the memory and by the processor whole
Program is closed, wherein when the air control data integration program is executed by the processor, realizes such as above-mentioned air control Data Integration side
The step of method.
In addition, to achieve the above object, it is described computer-readable the present invention also provides a kind of computer readable storage medium
It is stored with air control data integration program on storage medium, wherein when the air control data integration program is executed by processor, realizes
Such as the step of above-mentioned air control data integration method.
When the present invention gets initial data from data source, data cleansing, identity normalization and industry are carried out to initial data
The processing such as labeling of being engaged in reduce application end and arrive to provide accurate, orderly, integrated data acquisition system for subsequent business processing
The data call time of database, and calculating and the processing pressure of server are advantageously reduced, improve business processing efficiency.
Description of the drawings
Fig. 1 is the hardware architecture diagram of the air control Data Integration equipment involved in the embodiment of the present invention；
Fig. 2 is the flow diagram of air control data integration method first embodiment of the present invention；
Fig. 3 is the flow diagram of air control data integration method second embodiment of the present invention；
Fig. 4 is the flow diagram of air control data integration method 3rd embodiment of the present invention；
Fig. 5 is the high-level schematic functional block diagram of air control data integration device first embodiment of the present invention.
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.
Specific implementation mode
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
The present embodiments relate to air control data integration method be mainly used in air control Data Integration equipment, the air control number
Can be the equipment that PC, pocket computer, mobile terminal etc. have display and processing function according to integration equipment.
Referring to Fig.1, Fig. 1 is the hardware configuration signal of the air control Data Integration equipment involved in the embodiment of the present invention
Figure.In the embodiment of the present invention, air control Data Integration equipment may include processor 1001 (such as CPU), and communication bus 1002 is used
Family interface 1003, network interface 1004, memory 1005.Wherein, communication bus 1002 is for realizing the company between these components
Connect letter；User interface 1003 may include display screen (Display), input unit such as keyboard (Keyboard)；Network connects
It may include standard wireline interface and wireless interface (such as WI-FI interfaces) that mouth 1004 is optional；Memory 1005 can be high speed
RAM memory can also be stable memory (non-volatile memory), such as magnetic disk storage, memory 1005
The optional storage device that can also be independently of aforementioned processor 1001.It will be understood by those skilled in the art that being shown in Fig. 1
Hardware configuration do not constitute limitation of the invention, may include than illustrating more or fewer components, or combination is certain
Component or different components arrangement.
With continued reference to Fig. 1, in Fig. 1 as a kind of memory 1005 of computer readable storage medium may include operation system
System, network communication module and air control data integration program.In Fig. 1, network communication module is mainly used for connecting data source, with
Data source is into row data communication；And processor 1001 can call the air control data integration program stored in memory 1005, and
Execute air control data integration method provided in an embodiment of the present invention.
An embodiment of the present invention provides a kind of air control data integration methods.
It is the flow diagram of air control data integration method first embodiment of the present invention with reference to Fig. 2, Fig. 2.
In the present embodiment, the air control data integration method includes the following steps：
Step S10 acquires initial data from data source, and corresponds to the initial data according to default cleaning strategy and carry out clearly
It washes, obtains cleaning data；
At present when using this big data air control method, it is necessary first to get a large amount of initial data；And these are former
For beginning data typical from different data sources, these data sources are not necessarily what only air control system was serviced, therefore number
Initial data in include often dirty data (such as unrelated with air control redundant data, mistake) and these data by
In source, difference will present out randomness；And during air control, if these initial data is directly used to carry out air control business,
The time that data call will necessarily be extended increases calculating and the processing pressure of system server, to reduce air control effect
Rate.The present embodiment proposes a kind of data processing method, and data are carried out to initial data when getting initial data from data source
Cleaning and integrate etc. pretreatments, for subsequent business processing provide it is orderly, integrate data acquisition system, reduce data call when
Between, reduce calculating and the processing pressure of server.
Air control data integration method in the present embodiment is realized that the equipment is realized according to it by air control Data Integration equipment
Function can be described as platform for data arrangement again.One end of the platform for data arrangement is docked with data resource interface, to be adopted from data source
Collect initial data；The other end then with air control system docking, to provide the services such as data call, inquiry for air control system.Wherein,
The form of data source can be various including special credit investigation system, terminal application software, operation system etc., that is to say, that
The acquisition of initial data can be that government's credit investigation system or main strategies mechanism obtain original collage-credit data, can also be logical
Cross in application software embed SDK obtain user primitive behavior data, can also be from operation system collect business datum,
Daily record data.
Platform for data arrangement first has to clean initial data, data when getting initial data from data source
Cleaning mainly filters out undesirable dirty data in initial data, and dirty data type includes hash, incomplete
Data (field contents missing), the data of mistake, the data etc. repeated.And according to the difference of dirty data type, it can also be by number
It is divided into multiple cleaning nodes according to cleaning process, each filtering cleaned node and be mainly responsible for the dirty data of a certain type.
Specifically, be provided with cleaning strategy file in the present embodiment in platform for data arrangement in advance, the cleaning strategy file
In include to define corresponding demand data type (needs that original number got from the data source for different data sources
According to) and demand field name of the demand data in initial data, for example, the demand data of banking system data source is to use
The demand data of the bank transaction flowing water and account fund data at family, real estate management organization data source is the real estate letter of user
Breath and associated transaction data；Platform for data arrangement when getting initial data, will according to the demand field to initial data into
The primary filtering of row, filters out the field of non-demand data, obtains a data field.It, will be to primary when obtaining a segment
Data field carries out numerical value missing detection, judges whether there is determining data value in a data field, for example, user
Bank transaction pipelined data pays June, only has gauge outfit field (expenditure in June), and has lacked the number of specific determination
According to value (empty or null), for the data field of this kind of numerical value missing, platform for data arrangement can be filtered in secondary filter
Fall, obtains secondary data field.For the secondary data field after secondary filter, the detection that conflicts/repeat can be carried out to it, judged
Whether the duplicate data and field name that have field name consistent with contents value are consistent and colliding data that contents value is different,
If in the presence of the duplicate data and/or colliding data are filtered three times, when filtering is completed three times, that is, cleaned
Data.Certainly, during cleaning, also filter node can be accordingly increased according to actual requirement, for example, cleaning strategy file
Further include the standard content format of these demand datas, such as bank transaction flowing water includes time (real-coded GA), the amount of money
(real-coded GA), funds flow (character string forms) etc., real estate information include to obtain time (real-coded GA), address
(real-coded GA denotation coordination position), area (real-coded GA) etc., can also be to data field when carrying out data cleansing
Numerical value carry out format detection, the Field Sanitization etc. of call format will be unsatisfactory for.And the node sequence of above-mentioned filtering, it can also root
It is adjusted according to actual conditions.
Further, it during being cleaned to initial data, can also be recorded, to generate corresponding cleaning day
Will, the content for cleaning daily record may include the data directory that filters out of the data filtering amount of each filter node, each filter node (only
Do not include specific data including shorthand information), the contents such as filtering reason, so as to administrative staff according to cleaning daily record to cleaning work(
It can be safeguarded and be optimized.
Step S20 carries out identity normalized according to the user identifier in the cleaning data to the cleaning data,
Obtain the subscriber data set with same user identifier；
In the present embodiment, when obtaining cleaning data, platform for data arrangement (will be counted according to the user identifier of data record
According to towards user object) to cleaning data carry out identity normalization, establish subscriber data set (scheme), i.e., with user
Dimension classifies to cleaning data.Specifically, in view of the data of different data sources, the same user may be made
It is recorded with different user names (or account name etc.), thus it is for example possible to be to have used name, have plenty of and used identity card
Number；At this time, it may be necessary to which the identity uniquely determined according to one, which is used as major key, establishes the subscriber data set.It can be in the present embodiment
An identity system is defined according to actual conditions, using the identification card number of user as the unique identity in the system, referred to as
Effective identity；Can also include secondary identity in certain identity system, an effective identity can correspond to multiple secondary identity, such as
Address name, user mobile phone number etc..Corresponding effective identity field is can determine that according to effective identity, is then established corresponding
Subscriber data set；Then traversal cleaning data carry out effective identity field matching and classification, will have same effective identity
Cleaning data or corresponded to the cleaning data of same effective identity and be directed into the same set and return to get having arrived identity
One subscriber data set changed.
Step S30 is the user data addition business-subject mark in the subscriber data set according to air control type of service
Label；
In the present embodiment in view of platform for data arrangement may be with multiple and different air control system dockings, and these are not
When handling different business, used user data may be different same air control system, in order to facilitate air control system
Calling, when having obtained subscriber data set, can also according to type of service to user data carry out topicalization labeling.
Specifically, the needs based on air control type of service, can pre-define corresponding business-subject label, such as the master of housing loan class business
It includes house property data label, marriage situation label, social security label etc. to inscribe label, and the principals tab of car insurance class business includes vapour
Vehicle essential information label, auto repair record label, driver's violation history tab etc.；Then it is each user in user data
Data add corresponding business-subject label.Wherein, can increase industry newly directly in user data for business-subject label
Business theme label field, and corresponding theme label character string is added in label field；It can also be new business theme mark
Table is signed, to record the data content included by each business-subject label.It is worth noting that for same item data, it may
There can be multiple business-subject labels (such as user ID data while to there is lending class service label and car insurance class simultaneously
Service label).
Step S40 generates business-subject index corresponding with the business-subject label, and the business-subject is indexed
Corresponding air control system is pushed to, so that the air control system carries out air control calling.
In the present embodiment, when the business-subject label to user data adds completion to get to towards air control business
, business operation to user data.In order to facilitate the calling of air control system, integration platform will generate and business-subject label pair
The business-subject answered indexes, and includes the business added label in subscriber data set and be related in business-subject index；So
The business-subject can be indexed and push to corresponding air control system by platform for data arrangement afterwards, so that the air control system is into sector-style
Control is called.
In the present embodiment, by acquiring initial data from data source, and the original number is corresponded to according to default cleaning strategy
According to being cleaned, cleaning data are obtained；Identity is carried out according to the user identifier in the cleaning data to the cleaning data to return
One change is handled, and obtains the subscriber data set with same user identifier；It is the user data set according to air control type of service
User data in conjunction adds business-subject label；Business-subject index corresponding with the business-subject label is generated, and will
The business-subject index pushes to corresponding air control system, so that the air control system carries out air control calling.Pass through above-mentioned side
When the present embodiment gets initial data from data source, data cleansing, identity normalization and business mark are carried out to initial data for formula
The processing such as labelization reduce application end to data to provide accurate, orderly, integrated data acquisition system for subsequent business processing
The data call time in library, and calculating and the processing pressure of server are advantageously reduced, improve business processing efficiency.
It is the flow diagram of air control data integration method second embodiment of the present invention with reference to Fig. 3, Fig. 3.
Based on above-mentioned embodiment illustrated in fig. 2, in the present embodiment, include after step S40：
Step S50 obtains the air control data when receiving the air control data call request that the air control system is sent
The target user's mark and target service theme that call request includes；
In the present embodiment, platform for data arrangement is after carry out Data Integration to get to customer service number orderly, integrated
According to set, and air control can be provided for air control system and call service.Specifically, air control system can be to Data Integration according to business needs
Platform sends air control data call request, includes target user's mark and this calling institute of air control object in the request
The target service theme being related to.Platform for data arrangement is when receiving air control data call request, it will obtains mesh therein
User identifier and corresponding target service theme are marked, to carry out the lookup of user service data.
Further, due to include in platform for data arrangement user mass data, these data may be related to
The privacy of user.In order to protect the privacy of user, platform for data arrangement that will carry out permission control to the data call of air control system
System.Specifically, the air control type of service that each air control system is related to according to it, all has respective calling permission；It is sending
When data call is asked, air control system can add the calling capability identification of itself in the request.Platform for data arrangement is receiving
When being asked to the data call, air control will be judged according to wherein calling capability identification, target user's mark and target service theme
Whether system has the calling permission of the relevant user data of this target business-subject；It is weighed if the air control system has to call
Limit, then enter step S60；If the air control system, which does not have, calls permission, returns to corresponding lack of competence to the air control system and carry
Show.
Step S60 is identified according to the target user and is inquired corresponding target user data set, and according to the target
Business-subject obtains corresponding end user service data；
In the present embodiment, platform for data arrangement, will be according to mesh when getting target user's mark and target service theme
It marks user identifier and searches corresponding target user data set, and looked into target user data set according to target service theme
Look for the end user service data with corresponding business-subject label.
The end user service data are returned to the air control system by step S70.
In the present embodiment, when finding corresponding end user service data, platform for data arrangement can use target
Family business datum returns to the air control system.Certainly, in order to ensure the safety of data transmission, air control system and Data Integration are flat
Platform can also appointment data cryptographic protocol, platform for data arrangement when obtaining end user service data, first according to the data encryption
Agreement is encrypted, then encrypted data are back to air control system.
It is the flow diagram of air control data integration method 3rd embodiment of the present invention with reference to Fig. 4, Fig. 4.
Based on above-mentioned embodiment illustrated in fig. 2, in the present embodiment, further include after step S30：
Step S80 establishes corresponding business datum set according to the air control type of service, and will be according to corresponding industry
The user data of business theme label is added to the business datum set；
In the present embodiment, platform for data arrangement can also carry out the user service data of multiple users from business dimension whole
Close, to for management system provide service management to data call service.Specifically, in the business-subject mark to user data
When label addition is completed, platform for data arrangement will establish corresponding business datum set according to air control type of service；Then data are whole
Closing platform will extract in a manner of across subscriber data set, from different subscriber data sets with same business-subject label
User data, and these user data are added in corresponding business datum set.For example, the tool in platform for data arrangement
There are subscriber data set A and subscriber data set B, includes the user data of housing loan service class in two subscriber data sets
(being denoted as A-h, B-h respectively) and vehicle borrow the user data (being denoted as A-c, B-c respectively) of service class；Platform for data arrangement establishes room
Business datum set h is borrowed, then respectively by housing loan the service-user data A-h and subscriber data set B in subscriber data set A
In housing loan service-user data B-h be added in housing loan business datum set h；Similar, platform for data arrangement can also be established
Vehicle borrows business datum set c, borrows service-user data A-c which includes vehicle and vehicle borrows service-user data B-c, to obtain
Across the business datum set of user.
Step S90 generates global business index corresponding with the business datum set, and the global business is indexed
Corresponding management system is pushed to, so that the management system carries out business diagnosis calling.
In the present embodiment, when obtaining business datum set, in order to facilitate the calling of related management system, integration platform will
It generates and is indexed with corresponding global business, include the type of business datum set in overall situation business index；Then data are whole
Corresponding management system can be pushed to by overall situation business index by closing platform, so that management system calls relevant business datum simultaneously
Carry out business diagnosis.It is worth noting that the type of service included by overall situation business index can be and the industry in step S40
Subject index of being engaged in is identical；Certainly, when the mode classification of the type of service of business datum set and business-subject label differs a pair
At once, the included type of service of overall situation business index can also be different from business-subject index.
In addition, the embodiment of the present invention also provides a kind of air control data integration device.
Air control data integration device of the present invention is the memory that virtual bench is stored in the equipment of air control Data Integration shown in Fig. 1
It is functional for realizing the institute of air control data integration program in 1005；Each module of air control data integration device is by processor
1001 when executing, it can be achieved that get initial data from data source, and to initial data carry out data cleansing, identity normalization and
The processing such as service label, to provide accurate, orderly, integrated data acquisition system for subsequent business processing.
Specifically, with reference to Fig. 5, Fig. 5 is the high-level schematic functional block diagram of air control data integration device first embodiment of the present invention.
In the present embodiment, the air control data integration device includes：
Data cleansing module 10 for acquiring initial data from data source, and corresponds to the original according to default cleaning strategy
Beginning data are cleaned, and cleaning data are obtained；
First establishes module 20, for carrying out identity to the cleaning data according to the user identifier in the cleaning data
Normalized obtains the subscriber data set with same user identifier；
Label add module 30, for being that the user data in the subscriber data set is added according to air control type of service
Business-subject label；
First pushing module 40, for generating business-subject index corresponding with the business-subject label, and will be described
Business-subject index pushes to corresponding air control system, so that the air control system carries out air control calling.
Further, the data cleansing module 10 includes：
Demand determination unit, the demand type for determining the data source according to the default cleaning strategy, and according to
The demand type determines demand field；
First cleaning unit obtains primary for once being filtered to the initial data according to the demand field
Data field；
Second cleaning unit, for carrying out numerical value missing detection to a data field, with to a data
Field carries out secondary filter, obtains secondary data field；
Third cleaning unit is detected for carrying out numerical value conflict/repetition to the secondary data field, with to described secondary
Data field is filtered three times, obtains cleaning data.
Further, the data cleansing module 10 includes：
Daily record generation unit, for generating corresponding cleaning daily record according to data cleansing process, the cleaning daily record includes
The filtering index and filtration yield of each filter node
Further, it described first establishes module 20 and includes：
Field determination unit, for determining validated user identity based on default identity system, and according to the validated user
Identity determines user identifier；
Data sorting unit is obtained for being classified to the cleaning data according to the user identifier with same
The subscriber data set of user identifier.
Further, the air control data integration device further includes：
Request receiving module, for when receiving the air control data call request that the air control system is sent, obtaining institute
State the target user's mark and target service theme that air control data call request includes；
Data acquisition module inquires corresponding target user data set for being identified according to the target user, and root
Corresponding end user service data are obtained according to the target service theme；
Data return to module, for the end user service data to be returned to the air control system.
Further, the air control data integration device further includes：
Permission judgment module, the calling capability identification for including for obtaining the air control data call request, and according to
The calling capability identification, target user's mark and target service theme judge whether the air control system has and call permission；
The data acquisition module calls permission if being additionally operable to the air control system and having, thens follow the steps according to
Target user, which identifies, inquires corresponding target user data set, and obtains corresponding target according to the target service theme and use
Family business datum
Further, the air control data integration device further includes：
Second establishes module, for establishing corresponding business datum set according to the air control type of service, and by basis
User data with corresponding business-subject label is added to the business datum set；
Second pushing module, for generating global business index corresponding with the business datum set, and will be described complete
Office's business index pushes to corresponding management system, so that the management system carries out business diagnosis calling.
Wherein, the function of modules is realized and above-mentioned air control data integration method reality in above-mentioned air control data integration device
It is corresponding to apply each step in example, function and realization process no longer repeat one by one here.
In addition, the embodiment of the present invention also provides a kind of computer readable storage medium.
Air control data integration program is stored on computer readable storage medium of the present invention, wherein the air control Data Integration
When program is executed by processor, realize such as the step of above-mentioned air control data integration method.
Wherein, air control data integration program is performed realized method and can refer to air control data integration method of the present invention
Each embodiment, details are not described herein again.
It should be noted that herein, the terms "include", "comprise" or its any other variant are intended to non-row
His property includes, so that process, method, article or system including a series of elements include not only those elements, and
And further include other elements that are not explicitly listed, or further include for this process, method, article or system institute it is intrinsic
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including this
There is also other identical elements in the process of element, method, article or system.
The embodiments of the present invention are for illustration only, can not represent the quality of embodiment.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on this understanding, technical scheme of the present invention substantially in other words does the prior art
Going out the part of contribution can be expressed in the form of software products, which is stored in one as described above
In storage medium (such as ROM/RAM, magnetic disc, CD), including some instructions use so that a station terminal equipment (can be mobile phone,
Computer, server, air conditioner or network equipment etc.) execute method described in each embodiment of the present invention.
It these are only the preferred embodiment of the present invention, be not intended to limit the scope of the invention, it is every to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (10)
1. a kind of air control data integration method, which is characterized in that the air control data integration method includes the following steps：
Initial data is acquired from data source, and the initial data is corresponded to according to default cleaning strategy and is cleaned, is cleaned
Data；
Identity normalized is carried out to the cleaning data according to the user identifier in the cleaning data, is obtained with same
The subscriber data set of user identifier；
It is the user data addition business-subject label in the subscriber data set according to air control type of service；
Generate corresponding with business-subject label business-subject index, and the business-subject indexed push to it is corresponding
Air control system, so that the air control system carries out air control calling.
2. air control data integration method as described in claim 1, which is characterized in that the basis presets cleaning strategy and corresponds to institute
It states initial data to be cleaned, obtaining the step of cleaning data includes：
The demand type of the data source is determined according to the default cleaning strategy, and demand word is determined according to the demand type
Section；
The initial data is once filtered according to the demand field, obtains a data field；
Numerical value missing detection is carried out to a data field to obtain to carry out secondary filter to a data field
Secondary data field；
Numerical value conflict/repetition detection is carried out to the secondary data field, to be filtered three times to the secondary data field,
Obtain cleaning data.
3. air control data integration method as claimed in claim 2, which is characterized in that the basis presets cleaning strategy and corresponds to institute
It states initial data to be cleaned, obtaining the step of cleaning data further includes：
Generate corresponding cleaning daily record according to data cleansing process, the cleaning daily record include each filter node filtering index and
Filtration yield.
4. air control data integration method as described in claim 1, which is characterized in that the use according in the cleaning data
Family mark carries out identity normalized to the cleaning data, obtains the step of the subscriber data set with same user identifier
Suddenly include：
Validated user identity is determined based on default identity system, and user identifier is determined according to the validated user identity；
Classified to the cleaning data according to the user identifier, obtains the user data set with same user identifier
It closes.
5. air control data integration method as described in claim 1, which is characterized in that the generation and the business-subject label
Corresponding business-subject index, and business-subject index is pushed into corresponding air control system, for the air control system
After the step of carrying out air control calling, further include：
When receiving the air control data call request that the air control system is sent, obtains and wrapped in the air control data call request
The target user's mark and target service theme included；
It is identified according to the target user and inquires corresponding target user data set, and obtained according to the target service theme
Corresponding end user service data；
The end user service data are returned into the air control system.
6. air control data integration method as claimed in claim 5, which is characterized in that described to receive the air control system hair
When the air control data call request sent, the target user's mark and target service that the air control data call request includes are obtained
After the step of theme, further include：
It obtains the air control data call and asks the calling capability identification for including, and according to the calling capability identification, target
User identifier and target service theme judge whether the air control system has and call permission；
If the air control system, which has, calls permission, thens follow the steps to be identified according to the target user and inquire corresponding target use
User data set, and corresponding end user service data are obtained according to the target service theme.
7. such as air control data integration method according to any one of claims 1 to 6, which is characterized in that described according to air control industry
After the step of service type is the user data addition business-subject label in the subscriber data set, further include：
Corresponding business datum set is established according to the air control type of service, and will be with the user for corresponding to business-subject label
Data are added to the business datum set；
Generate global business index corresponding with the business datum set, and the global business indexed push to it is corresponding
Management system, so that the management system carries out business diagnosis calling.
8. a kind of air control data integration device, which is characterized in that the air control data integration device includes：
Data cleansing module for acquiring initial data from data source, and corresponds to the initial data according to default cleaning strategy
It is cleaned, obtains cleaning data；
First establishes module, for carrying out identity normalization to the cleaning data according to the user identifier in the cleaning data
Processing obtains the subscriber data set with same user identifier；
Label add module, for being that the user data in the subscriber data set adds business master according to air control type of service
Inscribe label；
First pushing module is indexed for generating corresponding with business-subject label business-subject, and by the business master
Topic index pushes to corresponding air control system, so that the air control system carries out air control calling.
9. a kind of air control Data Integration equipment, which is characterized in that the air control Data Integration equipment include processor, memory,
And it is stored in the air control data integration program that can be executed on the memory and by the processor, wherein the air control data
When integrated process is executed by the processor, realizing the air control data integration method as described in any one of claim 1 to 7
Step.
10. a kind of computer readable storage medium, which is characterized in that be stored with air control number on the computer readable storage medium
According to integrated process, wherein when the air control data integration program is executed by processor, realize such as any one of claim 1 to 7
The step of described air control data integration method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810335529.7A CN108520073A (en) | 2018-04-13 | 2018-04-13 | Air control data integration method, device, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810335529.7A CN108520073A (en) | 2018-04-13 | 2018-04-13 | Air control data integration method, device, equipment and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108520073A true CN108520073A (en) | 2018-09-11 |
Family
ID=63429271
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810335529.7A Withdrawn CN108520073A (en) | 2018-04-13 | 2018-04-13 | Air control data integration method, device, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108520073A (en) |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109634951A (en) * | 2018-10-23 | 2019-04-16 | 平安科技（深圳）有限公司 | Big data acquisition method, device, computer equipment and storage medium |
| CN109657914A (en) * | 2018-11-19 | 2019-04-19 | 平安科技（深圳）有限公司 | Information-pushing method, device, computer equipment and storage medium |
| CN109785047A (en) * | 2018-12-17 | 2019-05-21 | 深圳壹账通智能科技有限公司 | Order method for pushing, device, computer equipment and the storage medium of financial product |
| CN109784641A (en) * | 2018-12-13 | 2019-05-21 | 深圳壹账通智能科技有限公司 | Data-pushing device, equipment, method and readable storage medium storing program for executing |
| CN110246033A (en) * | 2019-06-21 | 2019-09-17 | 深圳前海微众银行股份有限公司 | Credit risk monitoring method, device, equipment and storage medium |
| CN110609815A (en) * | 2019-07-30 | 2019-12-24 | 河钢股份有限公司承德分公司 | Data file storage and sharing method and terminal equipment |
| CN110751575A (en) * | 2019-10-21 | 2020-02-04 | 中国民航信息网络股份有限公司 | Method and device for processing civil aviation passenger service data |
| CN111680108A (en) * | 2019-03-11 | 2020-09-18 | 杭州海康威视数字技术股份有限公司 | Data storage method and device and data acquisition method and device |
| CN112508720A (en) * | 2020-12-11 | 2021-03-16 | 中国人寿保险股份有限公司 | Insurance client identity attribute screening method and screening device and electronic equipment |
| CN112734525A (en) * | 2021-01-12 | 2021-04-30 | 中交智运有限公司 | Multi-source data processing method, system, equipment and readable storage medium |
| CN113347220A (en) * | 2020-03-02 | 2021-09-03 | 北京金山云网络技术有限公司 | Inter-service data sharing method, device, server and medium |
| CN113407604A (en) * | 2021-05-21 | 2021-09-17 | 上汽通用五菱汽车股份有限公司 | Data integration method, system and computer readable storage medium |
| CN113434524A (en) * | 2021-06-24 | 2021-09-24 | 江苏创源电子有限公司 | Data integration method and device, electronic equipment and storage medium |
| CN113468340A (en) * | 2021-06-28 | 2021-10-01 | 北京众标智能科技有限公司 | Construction system and construction method of industrial knowledge map |
| WO2021203858A1 (en) * | 2020-04-09 | 2021-10-14 | 深圳壹账通智能科技有限公司 | Data application system security control method and system, and computer device |
| CN114385606A (en) * | 2021-12-09 | 2022-04-22 | 湖北省信产通信服务有限公司数字科技分公司 | Big data cleaning method and system, storage medium and electronic equipment |
-
2018
- 2018-04-13 CN CN201810335529.7A patent/CN108520073A/en not_active Withdrawn
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109634951B (en) * | 2018-10-23 | 2023-12-22 | 平安科技（深圳）有限公司 | Big data acquisition method, device, computer equipment and storage medium |
| CN109634951A (en) * | 2018-10-23 | 2019-04-16 | 平安科技（深圳）有限公司 | Big data acquisition method, device, computer equipment and storage medium |
| CN109657914A (en) * | 2018-11-19 | 2019-04-19 | 平安科技（深圳）有限公司 | Information-pushing method, device, computer equipment and storage medium |
| CN109784641A (en) * | 2018-12-13 | 2019-05-21 | 深圳壹账通智能科技有限公司 | Data-pushing device, equipment, method and readable storage medium storing program for executing |
| CN109785047A (en) * | 2018-12-17 | 2019-05-21 | 深圳壹账通智能科技有限公司 | Order method for pushing, device, computer equipment and the storage medium of financial product |
| CN111680108A (en) * | 2019-03-11 | 2020-09-18 | 杭州海康威视数字技术股份有限公司 | Data storage method and device and data acquisition method and device |
| CN111680108B (en) * | 2019-03-11 | 2023-11-03 | 杭州海康威视数字技术股份有限公司 | Data storage method and device and data acquisition method and device |
| CN110246033A (en) * | 2019-06-21 | 2019-09-17 | 深圳前海微众银行股份有限公司 | Credit risk monitoring method, device, equipment and storage medium |
| CN110609815B (en) * | 2019-07-30 | 2022-05-24 | 河钢股份有限公司承德分公司 | Data file storage and sharing method and terminal equipment |
| CN110609815A (en) * | 2019-07-30 | 2019-12-24 | 河钢股份有限公司承德分公司 | Data file storage and sharing method and terminal equipment |
| CN110751575A (en) * | 2019-10-21 | 2020-02-04 | 中国民航信息网络股份有限公司 | Method and device for processing civil aviation passenger service data |
| CN113347220A (en) * | 2020-03-02 | 2021-09-03 | 北京金山云网络技术有限公司 | Inter-service data sharing method, device, server and medium |
| CN113347220B (en) * | 2020-03-02 | 2022-10-04 | 北京金山云网络技术有限公司 | Inter-service data sharing method, device, server and medium |
| WO2021203858A1 (en) * | 2020-04-09 | 2021-10-14 | 深圳壹账通智能科技有限公司 | Data application system security control method and system, and computer device |
| CN112508720A (en) * | 2020-12-11 | 2021-03-16 | 中国人寿保险股份有限公司 | Insurance client identity attribute screening method and screening device and electronic equipment |
| CN112734525A (en) * | 2021-01-12 | 2021-04-30 | 中交智运有限公司 | Multi-source data processing method, system, equipment and readable storage medium |
| CN113407604A (en) * | 2021-05-21 | 2021-09-17 | 上汽通用五菱汽车股份有限公司 | Data integration method, system and computer readable storage medium |
| CN113434524A (en) * | 2021-06-24 | 2021-09-24 | 江苏创源电子有限公司 | Data integration method and device, electronic equipment and storage medium |
| CN113468340A (en) * | 2021-06-28 | 2021-10-01 | 北京众标智能科技有限公司 | Construction system and construction method of industrial knowledge map |
| CN114385606A (en) * | 2021-12-09 | 2022-04-22 | 湖北省信产通信服务有限公司数字科技分公司 | Big data cleaning method and system, storage medium and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108520073A (en) | Air control data integration method, device, equipment and computer readable storage medium | |
| US11829997B2 (en) | Self-enforcing security token implementing smart-contract-based compliance rules consulting smart-contract-based global registry of investors | |
| JP6754495B2 (en) | Methods and systems for the protection and verification of identities and certificates via the blockchain | |
| CN109784934A (en) | A kind of transaction risk control method, apparatus and relevant device and medium | |
| CN107563757B (en) | Data risk identification method and device | |
| US10346620B2 (en) | Systems and methods for authentication of access based on multi-data source information | |
| US20090006315A1 (en) | Structured method for schema matching using multiple levels of ontologies | |
| US20200051067A1 (en) | Self-enforcing security token implementing smart-contract-based compliance rules consulting smart-contract-based global registry of investors | |
| US20200175403A1 (en) | Systems and methods for expediting rule-based data processing | |
| CN111507638A (en) | Risk information output and risk information construction method and device | |
| US20060184995A1 (en) | Creating a privacy policy from a process model and verifying the compliance | |
| CN110019540A (en) | Implementation method, methods of exhibiting and the device of enterprise's map, equipment | |
| CN110399533A (en) | Funds flow querying method and device | |
| CN109003192A (en) | A kind of insurance underwriting method and relevant device based on block chain | |
| CN107800894A (en) | A kind of phonetic prompt method and terminal device for telephony service system | |
| CN108205575A (en) | Data processing method and device | |
| US8839449B1 (en) | Assessing risk of information leakage | |
| CN111951052B (en) | Method and device for acquiring potential clients based on knowledge graph | |
| CN110246033A (en) | Credit risk monitoring method, device, equipment and storage medium | |
| CN114186275A (en) | Privacy protection method and device, computer equipment and storage medium | |
| CN107256479B (en) | Transaction mode classification execution method and device | |
| CN112200660A (en) | Method, device and equipment for supervising bank counter business | |
| CN107729330B (en) | Method and apparatus for acquiring data set | |
| CN110516120A (en) | Information processing method and device, storage medium, electronic device | |
| CN112910953B (en) | Business data pushing method and device and server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 1258063 Country of ref document: HK |
|
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20180911 |