CN109635029B - Data processing method, device, equipment and medium based on label index system - Google Patents
Data processing method, device, equipment and medium based on label index system Download PDFInfo
- Publication number
- CN109635029B CN109635029B CN201811502435.0A CN201811502435A CN109635029B CN 109635029 B CN109635029 B CN 109635029B CN 201811502435 A CN201811502435 A CN 201811502435A CN 109635029 B CN109635029 B CN 109635029B
- Authority
- CN
- China
- Prior art keywords
- index
- entity
- tag
- data
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/02—Banking, e.g. interest calculation or account maintenance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/04—Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
Abstract
The invention discloses a data processing method based on a label index system, which comprises the following steps: acquiring service data, wherein the service data corresponds to a plurality of entities; based on the preset label corresponding to the entity, adding corresponding label information to the service data corresponding to the entity; acquiring a preset index and a calculation mode of the preset index; identifying first label information corresponding to the index and second label information with preset association with the index; and calling the service data corresponding to the first label information and the second label according to the calculation mode to calculate the index data of the index. The invention also discloses a data processing device, equipment and medium based on the label index system. The method and the system can calculate the index in multiple dimensions based on the entity for which the index aims and the service data corresponding to the related entity, so that the data rule can be reflected more completely, and the information reference value of the index data is improved.
Description
Technical Field
The present invention relates to the field of data processing, and in particular, to a data processing method, apparatus, device, and medium based on a tag index system.
Background
With the development of the financial market, the data volume of financial business is greatly increased, and financial institutions such as banks often need to comprehensively analyze business data obtained from multiple sources, and hopefully obtain valuable reference results from a large amount of data.
An entity refers to objects or things that are present in the real world and that can be distinguished from each other, each entity possibly being related to other entities, such as customers, borrowers, orders, etc.; the label is a characteristic attribute of the entity, and can be a description of the entity or a measurement attribute of the entity; the index is a statistical value of a plurality of entities, and enterprises often monitor, forecast, measure the development, backtrack and the like of the business through the index.
The existing processing method for service data constructs a calculation model for a specific index, the index calculation is based on calculation of single service data, the data dimension is single, the influence of the association relationship between a single entity and other entities on the index is not considered, and the information value of the index data in the single dimension is very low.
Disclosure of Invention
The invention mainly aims to provide a data processing method, device, equipment and medium based on a label index system, which aim to calculate indexes in a multi-dimension mode based on the entity aimed at by the indexes and the service data corresponding to the entity associated with the indexes, so that the data rule can be reflected more completely, and the information reference value of the index data is improved.
In order to achieve the above object, the present invention provides a data processing method based on a tag index system, the method comprising the steps of:
acquiring service data, wherein the service data corresponds to a plurality of entities;
based on the preset label corresponding to the entity, adding corresponding label information to the service data corresponding to the entity;
acquiring a preset index and a calculation mode of the preset index;
identifying first label information corresponding to the index and second label information with preset association with the index;
and calling the service data corresponding to the first label information and the second label according to the calculation mode to calculate the index data of the index.
Optionally, the step of adding corresponding tag information to the service data corresponding to the entity based on the preset tag corresponding to the entity further includes:
detecting whether a preset label corresponding to the entity is updated or not;
when the preset label corresponding to the entity is detected to be updated, corresponding label information is added to the service data corresponding to the entity according to the updated preset label.
Optionally, after the step of calling the service data corresponding to the first tag information and the second tag to calculate the index data of the index according to the calculation mode, the method further includes:
acquiring user-defined indexes and a calculation mode of the user-defined indexes;
detecting whether a calculation instruction aiming at the user-defined index is received or not;
if yes, the steps are entered: and identifying first label information corresponding to the index and second label information with preset association with the index.
Optionally, the step of identifying the first tag information corresponding to the index and the second tag information having a preset association with the index includes:
identifying first tag information corresponding to the index;
determining a second entity with preset association with the first entity according to the first entity corresponding to the first tag information, wherein the second entity at least comprises an event information entity;
second tag information corresponding to the second entity is identified.
Optionally, the step of adding corresponding tag information to the service data corresponding to the entity based on the preset tag corresponding to the entity further includes:
based on the identified multiple entities and the association relation among the multiple entities, establishing a label set according to a preset rule; the tag set comprises a plurality of preset tags, wherein the preset tags comprise basic tags aiming at the basic attributes of the entity and derivative tags aiming at the derivative attributes of the entity.
Optionally, after the step of calling the service data corresponding to the first tag information and the second tag to calculate the index data of the index according to the calculation mode, the method further includes:
and sending the index data to an analysis platform so that the analysis platform obtains an analysis result according to the index data.
In addition, the invention also provides a data processing device based on the label index system, which comprises: the system comprises a first acquisition module, a label adding module, a second acquisition module, an identification module and a calculation module;
the first acquisition module is used for acquiring service data, and the service data corresponds to a plurality of entities;
the label adding module is used for adding corresponding label information to the business data corresponding to the entity based on the preset label corresponding to the entity;
the second acquisition module is used for acquiring preset indexes and a calculation mode of the preset indexes;
the identification module is used for identifying first label information corresponding to the index and second label information with preset association with the index;
and the calculation module is used for calling the service data corresponding to the first label information and the second label according to the calculation mode to calculate the index data of the index.
Optionally, the apparatus further comprises: the first detection module and the updating module;
the first detection module is used for detecting whether a preset label corresponding to the entity is updated or not;
the updating module is configured to add corresponding tag information to service data corresponding to the entity according to the updated preset tag when the first detection module detects that the preset tag corresponding to the entity is updated.
Optionally, the apparatus further comprises: the third acquisition module and the second detection module;
the third obtaining module is configured to obtain a user-defined index and a calculation mode of the user-defined index, and send the user-defined index and the calculation mode of the user-defined index to the identification module and the calculation module when receiving that the detection result sent by the second detection module is yes;
the second detection module is configured to detect whether a calculation instruction for the custom index is received, and send a detection result to the third acquisition module.
Optionally, the identification module includes: the system comprises a first identification sub-module, a determination module and a second identification sub-module;
the first identification sub-module is used for identifying first label information corresponding to the index;
the determining module is configured to determine, according to a first entity corresponding to the first tag information, a second entity having a preset association with the first entity, where the second entity includes at least an event information entity;
the second identification sub-module is used for identifying second tag information corresponding to the second entity.
Optionally, the apparatus further comprises: the label set establishing module is used for establishing a label set according to a preset rule based on the identified entities and the association relation among the entities; the tag set comprises a plurality of preset tags, wherein the preset tags comprise basic tags aiming at the basic attributes of the entity and derivative tags aiming at the derivative attributes of the entity.
Optionally, the computing module is connected with an analysis platform;
the calculation module is further configured to send the index data to the analysis platform, so that the analysis platform obtains an analysis result according to the index data.
In addition, the invention also provides a data processing device based on the label index system, which comprises: the data processing program based on the tag index system comprises a memory, a processor and a data processing program based on the tag index system, wherein the data processing program based on the tag index system is stored in the memory and can run on the processor, and the data processing program based on the tag index system realizes the steps of the data processing method based on the tag index system.
In addition, the invention also provides a storage medium, which is applied to a computer, wherein the storage medium stores a data processing program based on a label index system, and the data processing program based on the label index system realizes the steps of the data processing method based on the label index system when being executed by a processor.
The invention obtains the service data, which corresponds to a plurality of entities; based on the preset label corresponding to the entity, adding corresponding label information to the service data corresponding to the entity; acquiring a preset index and a calculation mode of the preset index; identifying first label information corresponding to the index and second label information with preset association with the index; according to the calculation mode, invoking the service data corresponding to the first label information and the second label to calculate to obtain index data of the index; therefore, by identifying the first label information corresponding to the index and the second label information which is associated with the index in a preset manner, the multi-dimensional calculation of the index based on the entity aimed by the index and the service data corresponding to the entity associated with the index is realized, the data rule can be reflected more completely, and the information reference value of the index data is improved.
Drawings
FIG. 1 is a schematic diagram of a device architecture of a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a flowchart of a first embodiment of a tag index system-based data processing method according to the present invention;
FIG. 3 is a detailed step diagram of step S400 in a first embodiment of a tag index system based data processing method of the present invention;
FIG. 4 is a flowchart of a second embodiment of a tag index system-based data processing method according to the present invention;
FIG. 5 is a flowchart of a third embodiment of a tag index system-based data processing method according to the present invention;
fig. 6 is a flowchart of a fourth embodiment of a data processing method based on a tag index system according to the present invention.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
The main solutions of the embodiments of the present invention are: acquiring service data, wherein the service data corresponds to a plurality of entities; based on the preset label corresponding to the entity, adding corresponding label information to the service data corresponding to the entity; acquiring a preset index and a calculation mode of the preset index; identifying first label information corresponding to the index and second label information with preset association with the index; and calling the service data corresponding to the first label information and the second label according to the calculation mode to calculate the index data of the index.
In the prior art, a processing method for service data is to construct a calculation model for a specific index, the index calculation is based on the calculation of a single service data, the data dimension is single, the influence of the association relationship between a single entity and other entities on the index is not considered, and the information value of the index data in the single dimension is very low.
According to the method and the device, the first label information corresponding to the index and the second label information which is associated with the index in a preset mode are identified, so that multidimensional calculation of the index based on the entity aimed at by the index and the service data corresponding to the associated entity is realized, the data rule can be reflected more completely, and the information reference value of the index data is improved.
Referring to fig. 1, fig. 1 is a schematic device structure of a hardware running environment according to an embodiment of the present invention.
The data processing device based on the tag index system in the embodiment of the invention can be a server, a PC or a virtual machine device.
As shown in fig. 1, the apparatus may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. Wherein the communication bus 1002 is used to enable connected communication between these components. The user interface 1003 may include a Display, an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
It will be appreciated by those skilled in the art that the device structure shown in fig. 1 is not limiting of the device and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.
As shown in fig. 1, an operating system, a network communication module, a user interface module, and a data processing program based on a tag index hierarchy may be included in a memory 1005 as one type of computer storage medium.
In the device shown in fig. 1, the network interface 1004 is mainly used for connecting to a background server, and performing data communication with the background server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the processor 1001 may be configured to call a tag index hierarchy-based data handler stored in the memory 1005 and perform the following operations:
acquiring service data, wherein the service data corresponds to a plurality of entities;
based on the preset label corresponding to the entity, adding corresponding label information to the service data corresponding to the entity;
acquiring a preset index and a calculation mode of the preset index;
identifying first label information corresponding to the index and second label information with preset association with the index;
and calling the service data corresponding to the first label information and the second label according to the calculation mode to calculate the index data of the index.
Further, the processor 1001 may call a data processing program based on the tag index hierarchy stored in the memory 1005, and further perform the following operations:
detecting whether a preset label corresponding to the entity is updated or not;
when the preset label corresponding to the entity is detected to be updated, corresponding label information is added to the service data corresponding to the entity according to the updated preset label.
Further, the processor 1001 may call a data processing program based on the tag index hierarchy stored in the memory 1005, and further perform the following operations:
acquiring user-defined indexes and a calculation mode of the user-defined indexes;
detecting whether a calculation instruction aiming at the user-defined index is received or not;
if yes, the steps are entered: and identifying first label information corresponding to the index and second label information with preset association with the index.
Further, the processor 1001 may call a data processing program based on the tag index hierarchy stored in the memory 1005, and further perform the following operations:
identifying first tag information corresponding to the index;
determining a second entity with preset association with the first entity according to the first entity corresponding to the first tag information, wherein the second entity at least comprises an event information entity;
second tag information corresponding to the second entity is identified.
Further, the processor 1001 may call a data processing program based on the tag index hierarchy stored in the memory 1005, and further perform the following operations:
based on the identified multiple entities and the association relation among the multiple entities, establishing a label set according to a preset rule; the tag set comprises a plurality of preset tags, wherein the preset tags comprise basic tags aiming at the basic attributes of the entity and derivative tags aiming at the derivative attributes of the entity.
Further, the processor 1001 may call a data processing program based on the tag index hierarchy stored in the memory 1005, and further perform the following operations:
and sending the index data to an analysis platform so that the analysis platform obtains an analysis result according to the index data.
Based on the hardware structure, the embodiment of the data processing method based on the tag index system is provided.
Referring to fig. 2, fig. 2 is a flowchart of a first embodiment of a data processing method based on a tag index system according to the present invention, where the method includes:
step S100, obtaining service data;
with the increasing development of the financial market, the data volume of financial transactions has increased substantially, and banks or financial institutions often need to perform comprehensive analysis of transaction data obtained from multiple sources, so that it is desirable to obtain valuable reference results from a large amount of data.
In this embodiment, the service data source may be a database of an intra-industry service management system, such as a wind control system, a platform system, an accounting system, and an event management system, in the bank, where the wind control system includes service application information, the platform system includes order information, the accounting system includes accounting information, the event management system includes event information, and the service data source may also be a disk file.
In this embodiment, the service system data is drawn into the patch source library by the ETL (Extract-Transform-Load) to form a structured patch source data table, where the service data corresponds to a plurality of entities, and the entities refer to objects or things that exist in the real world in an objective manner and can be distinguished from each other, and each entity may have a relationship with other entities, for example, the corresponding entity in the client data may have an application form, an order form, a borrowing form, event information, etc., and these entities do not exist independently, and the related entity of a certain entity has a great influence and reference value on its index.
Step S200, based on a preset label corresponding to the entity, adding corresponding label information to the business data corresponding to the entity;
the label is defined as a characteristic attribute of an entity, which may be either a description of the entity or a measurement attribute of the entity, and as an implementation manner, the label management of this embodiment organizes the entity and the association relationship between the entities according to the period division of the banking product, for example: for the product period of reminding the bill to collect the loan product bill, the data relationship between entities of reminding and collecting relevant clients and the relationship between tables are collected in the robot collecting stage; and determining processing and processing fields according to service requirements, processing main attributes of each table to form a tag table, namely adding corresponding tag information to service data corresponding to the entity based on a preset tag corresponding to the entity.
Further, according to logic and actual conditions, the derivative attributes of part of the entities are combed into derivative entities, so that the derivative attributes of the entities are processed.
Taking customer data as an example, the main entities are application form, customer basic information, customer pedestrian credit, order form, borrowing, income-accelerating details, event information and the like; the main labels are sequentially corresponding to an application book label set, a basic information label, a credit sign label set, an order label set, a borrowing label set, a dialing label set, an event label set and the like, and the labels derived by the functions are transaction derived labels, induction derived labels, external event derived labels and the like.
Step S300, obtaining a preset index and a calculation mode of the preset index;
based on the service requirement, the indexes to be calculated and the calculation mode of the indexes are obtained from a preset index library, for example, which indexes need to be obtained from which label tables in which logic.
Step S400, identifying first label information corresponding to the index and second label information with preset association with the index;
in actual business, each entity does not exist independently and has association relation with other entities, so that index data acquired based on single business data is unreliable.
Further, referring to fig. 3, in other embodiments, step S400 may include the following refinement steps:
step S401, identifying first label information corresponding to the index;
step S402, determining a second entity with preset association with the first entity according to the first entity corresponding to the first tag information, wherein the second entity at least comprises an event information entity;
step S403, identifying second tag information corresponding to the second entity.
Specifically, taking the example of calculating the call completing rate index of the customer under the product period of reminding the loan product bill to collect the bill, wherein the service data tag set corresponding to the call completing rate index is a dialing tag set, the service data corresponding to the dialing tag set has data such as accumulated calling times, effective calling times, busy tone times, unmanned response times and the like, and if the call completing rate index is calculated only according to the service data corresponding to the dialing tag set, the data dimension is single, and the reference value of the index is low; in this embodiment, the service data and the event information data, which have an association relationship with the call completing rate indicator, in the actual service scenario are also combined during the calculation of the call completing rate indicator, and as an implementation manner, the service data having an association relationship with the call completing rate indicator may include customer group classification data under a customer transaction label, customer in-line scoring data under a customer application label, customer suggestion credit data, and the like.
The event information entity, that is, the external event has a non-negligible influence on the service index, it can be understood that when the call completing rate index is calculated as described above, for example, when the caller dials the customer call, the record data corresponding to the external event, that is, the external event displayed on the mobile phone end of the customer, is not the service data in the label set, but in practice, the customer will choose whether to answer the call according to the different external event displayed on the mobile phone end, so that the service index is calculated by combining the influence of the external event on the index, and finer analysis of the user index can be realized.
And step S500, calling the service data corresponding to the first label information and the second label according to the calculation mode to calculate the index data of the index.
After the service data is processed into the labels, the index is calculated in a multi-dimension mode based on the whole service data according to the index data of a label processing index library required by the service, the index can be calculated in a multi-dimension mode according to a plurality of label tables and a plurality of associated label tables and different dimensions, a user can check the calculated service index data through authority verification, the service history data can be effectively and comprehensively applied, customer images are clear, and a more effective guiding effect can be achieved on the service.
In the embodiment, service data is acquired, wherein the service data corresponds to a plurality of entities; based on the preset label corresponding to the entity, adding corresponding label information to the service data corresponding to the entity; acquiring a preset index and a calculation mode of the preset index; identifying first label information corresponding to the index and second label information with preset association with the index; according to the calculation mode, invoking the service data corresponding to the first label information and the second label to calculate to obtain index data of the index; therefore, by identifying the first label information corresponding to the index and the second label information which is associated with the index in a preset manner, the multi-dimensional calculation of the index based on the entity aimed at by the index and the service data corresponding to the associated entity is realized, the data rule can be reflected more completely, and the information reference value of the index data is improved.
Further, referring to fig. 4, fig. 4 is a flowchart illustrating a second embodiment of a data processing method based on a tag index system according to the present invention. Based on the embodiment shown in fig. 2, step S200, after the step of adding corresponding tag information to the service data corresponding to the entity based on the preset tag corresponding to the entity, further includes:
step S201, detecting whether a preset label corresponding to the entity is updated;
step S202, when the preset label corresponding to the entity is detected to be updated, corresponding label information is added to the service data corresponding to the entity according to the updated preset label.
In this embodiment, after adding tag attributes to a service data table based on a preset tag library, it is detected whether all service data tables have corresponding newly added tag attributes or some tag attributes need to be deleted by the service data table, and when it is detected that an entity, that is, the tag attributes of the service data table are updated, the attributes of the service data table are modified correspondingly.
The user can dynamically add or delete the labels according to the actual demands, specifically, in online transaction, the user can maintain the labels and corresponding entities according to the index data and the calculated dimension which are obtained according to the demands, and the index data based on the dynamically adjusted labels is obtained by calculation according to the label table data maintained by the user during index calculation.
In the prior art, most of enterprises adopt independent data processing models for single service, service data can only be based on the existing data models, preset index data of the models can be calculated according to set label data, the constructed models are not reusable and inconvenient to adjust, so that the practicability of data processing is greatly affected.
Further, referring to fig. 5, fig. 5 is a flowchart illustrating a third embodiment of a data processing method based on a tag index system according to the present invention. Based on the embodiment shown in fig. 4, step S500 further includes, after the step of calling the index data of the index calculated by the service data corresponding to the first tag information and the second tag according to the calculation mode:
step S501, obtaining a user-defined index and a calculation mode of the user-defined index;
step S502, detecting whether a calculation instruction aiming at the custom index is received;
if yes, step S400 is performed, the first label information corresponding to the index and the second label information having a preset association with the index are identified, and the service data corresponding to the first label information and the second label are called according to the calculation mode to calculate and obtain the index data of the index.
In this embodiment, the user accesses the index data of the preset index calculated in the index library based on the authority of the user, if the current index data cannot well meet the service requirement, based on the service requirement, the user can customize the index and the calculation mode of the customized index, for example, a certain index is newly established, and the index data of the newly established index can be obtained from which label tables in which logic.
In the prior art, the index system has weak resetting capability, so that the data expansibility and the practicability are poor, namely, the index system is established in the system, but the attribute and the algorithm of the index are determined by a system model, a great deal of modification and even redesign are required to be carried out on the model in order to acquire different indexes, and the required index data cannot be quickly and effectively obtained.
According to the embodiment, the user can dynamically set the index and the calculation logic thereof based on the data analysis platform, and the complex change model is simplified into simple configuration work, so that the resetting capability of an index system is improved, and the expandability and the practicability of data processing are enhanced.
Further, referring to fig. 6, fig. 6 is a flowchart of a fourth embodiment of a data processing method based on a tag index system according to the present invention. Based on the embodiment shown in fig. 2, step S200, before the step of adding corresponding tag information to the service data corresponding to the entity based on the preset tag corresponding to the entity, further includes:
step S101, based on the identified multiple entities and the association relation among the multiple entities, a label set is established according to a preset rule;
the tag set comprises a plurality of preset tags, wherein the preset tags comprise basic tags aiming at the basic attributes of the entity and derivative tags aiming at the derivative attributes of the entity.
Based on the business requirement index dimension, the analysis dimension and the association relation between business entities, a label set is established, and the derivative attributes of part of the entities are combed out to form derivative entities according to logic and actual conditions, so that the derivative attributes of the entities are processed.
Further, step S500, after the step of calling the service data corresponding to the first tag information and the second tag to calculate the index data of the index according to the calculation mode, further includes:
step S503, sending the index data to an analysis platform, so that the analysis platform obtains an analysis result according to the index data.
The index data are sent to a visual analysis platform, the visual analysis platform performs visual analysis on service history data, visually presents the relation between the data, and assists the service to analyze clients more accurately so as to guide adjustment of a service scheme.
According to the embodiment, the index data are combined with the visual analysis platform, and in a more visual level, the label dimension of the business is analyzed in a finer granularity mode and visually presented, and financial institutions such as banks are assisted to analyze historical business data more accurately so as to guide targeted adjustment of a business scheme.
The embodiment of the invention also provides a data processing device based on the label index system, which comprises: the system comprises a first acquisition module, a label adding module, a second acquisition module, an identification module and a calculation module;
the first acquisition module is used for acquiring service data, and the service data corresponds to a plurality of entities;
the label adding module is used for adding corresponding label information to the business data corresponding to the entity based on the preset label corresponding to the entity;
the second acquisition module is used for acquiring preset indexes and a calculation mode of the preset indexes;
the identification module is used for identifying first label information corresponding to the index and second label information with preset association with the index;
and the calculation module is used for calling the service data corresponding to the first label information and the second label according to the calculation mode to calculate the index data of the index.
Preferably, the apparatus further comprises: the first detection module and the updating module;
the first detection module is used for detecting whether a preset label corresponding to the entity is updated or not;
the updating module is configured to add corresponding tag information to service data corresponding to the entity according to the updated preset tag when the first detection module detects that the preset tag corresponding to the entity is updated.
Preferably, the apparatus further comprises: the third acquisition module and the second detection module;
the third obtaining module is configured to obtain a user-defined index and a calculation mode of the user-defined index, and send the user-defined index and the calculation mode of the user-defined index to the identification module and the calculation module when receiving that the detection result sent by the second detection module is yes;
the second detection module is configured to detect whether a calculation instruction for the custom index is received, and send a detection result to the third acquisition module.
Preferably, the identification module includes: the system comprises a first identification sub-module, a determination module and a second identification sub-module;
the first identification sub-module is used for identifying first label information corresponding to the index;
the determining module is configured to determine, according to a first entity corresponding to the first tag information, a second entity having a preset association with the first entity, where the second entity includes at least an event information entity;
the second identification sub-module is used for identifying second tag information corresponding to the second entity.
Preferably, the apparatus further comprises: the label set establishing module is used for establishing a label set according to a preset rule based on the identified entities and the association relation among the entities; the tag set comprises a plurality of preset tags, wherein the preset tags comprise basic tags aiming at the basic attributes of the entity and derivative tags aiming at the derivative attributes of the entity.
Preferably, the computing module is connected with an analysis platform;
the calculation module is further configured to send the index data to the analysis platform, so that the analysis platform obtains an analysis result according to the index data.
The steps of the data processing method based on the tag index system described above are implemented when each module of the data processing device based on the tag index system provided in this embodiment is running, and are not described herein again.
The invention also provides a data processing device based on the label index system.
The data processing device based on the label index system of the invention comprises: the data processing program based on the tag index system comprises a memory, a processor and a data processing program based on the tag index system, wherein the data processing program based on the tag index system is stored in the memory and can run on the processor, and the data processing program based on the tag index system realizes the steps of the data processing method based on the tag index system.
The method implemented when the data processing program based on the tag index system running on the processor is executed may refer to various embodiments of the data processing method based on the tag index system of the present invention, which are not described herein.
The invention also provides a computer readable storage medium.
The computer readable storage medium of the present invention stores a data processing program based on a tag index system, which when executed by a processor, implements the steps of the data processing method based on a tag index system as described above.
The method implemented when the data processing program based on the tag index system running on the processor is executed may refer to various embodiments of the data processing method based on the tag index system of the present invention, which are not described herein.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) as described above, comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The foregoing description is only of the preferred embodiments of the present invention, and is not intended to limit the scope of the invention, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.
Claims (10)
1. A data processing method based on a tag index system, the method comprising the steps of:
acquiring service data, pumping the service system data into a patch source library through an ETL to form a structured patch source data table, and extracting a plurality of entities corresponding to the service data;
based on the preset label corresponding to the entity, adding corresponding label information to the service data corresponding to the entity; the preset labels comprise basic labels aiming at the basic attributes of the entity and derivative labels aiming at the derivative attributes of the entity;
acquiring a preset index and a calculation mode of the preset index;
identifying first tag information corresponding to the index, determining a second entity with preset association with the first entity according to the first entity corresponding to the first tag information, wherein the second entity at least comprises event information entities, and identifying second tag information corresponding to the second entity; according to the calculation mode, invoking the service data corresponding to the first label information and the second label to calculate to obtain index data of the index;
acquiring user-defined indexes and a calculation mode of the user-defined indexes; detecting whether a calculation instruction aiming at the user-defined index is received or not; if yes, the steps are entered: and identifying first label information corresponding to the index and second label information with preset association with the index.
2. The method for processing data based on a tag index system according to claim 1, wherein the step of adding corresponding tag information to the service data corresponding to the entity based on the preset tag corresponding to the entity further comprises:
detecting whether a preset label corresponding to the entity is updated or not;
when the preset label corresponding to the entity is detected to be updated, corresponding label information is added to the service data corresponding to the entity according to the updated preset label.
3. The method for processing data based on a tag index system according to claim 1, wherein the step of adding corresponding tag information to the service data corresponding to the entity based on the preset tag corresponding to the entity further comprises:
based on the identified multiple entities and the association relation among the multiple entities, establishing a label set according to a preset rule; the tag set includes a plurality of preset tags.
4. The method for processing data based on a tag index system according to claim 3, wherein the step of calling the service data corresponding to the first tag information and the second tag according to the calculation mode to calculate the index data of the index further comprises:
and sending the index data to an analysis platform so that the analysis platform obtains an analysis result according to the index data.
5. A data processing apparatus based on a tag indexing system, the apparatus comprising: the system comprises a first acquisition module, a label adding module, a second acquisition module, an identification module and a calculation module;
the first acquisition module is used for acquiring service data, pumping the service system data into a source library through ETL to form a structured source pasting data table so as to extract a plurality of entities corresponding to the service data;
the label adding module is used for adding corresponding label information to the business data corresponding to the entity based on the preset label corresponding to the entity; the preset labels comprise basic labels aiming at the basic attributes of the entity and derivative labels aiming at the derivative attributes of the entity;
the second acquisition module is used for acquiring preset indexes and a calculation mode of the preset indexes;
the identification module is used for identifying first tag information corresponding to the index, determining a second entity with preset association with the first entity according to the first entity corresponding to the first tag information, wherein the second entity at least comprises an event information entity, and identifying second tag information corresponding to the second entity;
the calculation module is used for calling the service data corresponding to the first label information and the second label according to the calculation mode to calculate the index data of the index;
the third acquisition module is used for acquiring the user-defined index and the calculation mode of the user-defined index, and sending the calculation mode of the user-defined index and the user-defined index to the identification module and the calculation module when receiving that the detection result sent by the second detection module is yes;
the second detection module is used for detecting whether a calculation instruction aiming at the self-defined index is received or not, and sending a detection result to the third acquisition module.
6. The tag index system based data processing apparatus of claim 5, wherein the apparatus further comprises: the first detection module and the updating module;
the first detection module is used for detecting whether a preset label corresponding to the entity is updated or not;
the updating module is configured to add corresponding tag information to service data corresponding to the entity according to the updated preset tag when the first detection module detects that the preset tag corresponding to the entity is updated.
7. The tag index system based data processing apparatus of claim 5, wherein the apparatus further comprises:
the label set establishing module is used for establishing a label set according to a preset rule based on the identified entities and the association relation among the entities; the tag set includes a plurality of preset tags.
8. The data processing device based on the tag index system according to claim 7, wherein the calculating module is connected with an analyzing platform;
the calculation module is further configured to send the index data to the analysis platform, so that the analysis platform obtains an analysis result according to the index data.
9. A tag-based data processing apparatus, the tag-based data processing apparatus comprising: a memory, a processor and a tag-based data handler stored on the memory and executable on the processor, which when executed by the processor, implements the steps of the tag-based data handling method of any one of claims 1 to 4.
10. A storage medium for use in a computer, said storage medium having stored thereon a data processing program based on a tag index system, said data processing program based on a tag index system, when executed by a processor, implementing the steps of the data processing method based on a tag index system according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811502435.0A CN109635029B (en) | 2018-12-07 | 2018-12-07 | Data processing method, device, equipment and medium based on label index system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811502435.0A CN109635029B (en) | 2018-12-07 | 2018-12-07 | Data processing method, device, equipment and medium based on label index system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109635029A CN109635029A (en) | 2019-04-16 |
| CN109635029B true CN109635029B (en) | 2023-10-13 |
Family
ID=66072255
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811502435.0A Active CN109635029B (en) | 2018-12-07 | 2018-12-07 | Data processing method, device, equipment and medium based on label index system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109635029B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112199269B (en) * | 2019-07-08 | 2023-10-20 | 腾讯科技（深圳）有限公司 | Data processing method and related device |
| CN111191125A (en) * | 2019-12-24 | 2020-05-22 | 长威信息科技发展股份有限公司 | Data analysis method based on tagging |
| CN112288614A (en) * | 2020-11-17 | 2021-01-29 | 珠海大横琴科技发展有限公司 | Data processing method and device based on data resource platform |
| CN112527919A (en) * | 2020-12-04 | 2021-03-19 | 广州橙行智动汽车科技有限公司 | Data processing method and device |
| CN112445875B (en) * | 2020-12-14 | 2024-03-01 | 招商局金融科技有限公司 | Data association and verification method and device, electronic equipment and storage medium |
| CN112613917A (en) * | 2020-12-30 | 2021-04-06 | 平安壹钱包电子商务有限公司 | Information pushing method, device and equipment based on user portrait and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102722560A (en) * | 2012-05-31 | 2012-10-10 | 深圳市远行科技有限公司 | Automatic identification method and system on basis of master data in telecom industry |
| CN104025130A (en) * | 2011-02-22 | 2014-09-03 | 汤姆森路透社全球资源公司 | Association Significance |
| CN107122369A (en) * | 2016-02-25 | 2017-09-01 | 阿里巴巴集团控股有限公司 | A kind of business data processing method, device and system |
| CN107679103A (en) * | 2017-09-08 | 2018-02-09 | 口碑(上海)信息技术有限公司 | For entity attributes analysis method and system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7912773B1 (en) * | 2006-03-24 | 2011-03-22 | Sas Institute Inc. | Computer-implemented data storage systems and methods for use with predictive model systems |
-
2018
- 2018-12-07 CN CN201811502435.0A patent/CN109635029B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104025130A (en) * | 2011-02-22 | 2014-09-03 | 汤姆森路透社全球资源公司 | Association Significance |
| CN102722560A (en) * | 2012-05-31 | 2012-10-10 | 深圳市远行科技有限公司 | Automatic identification method and system on basis of master data in telecom industry |
| CN107122369A (en) * | 2016-02-25 | 2017-09-01 | 阿里巴巴集团控股有限公司 | A kind of business data processing method, device and system |
| CN107679103A (en) * | 2017-09-08 | 2018-02-09 | 口碑(上海)信息技术有限公司 | For entity attributes analysis method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109635029A (en) | 2019-04-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109635029B (en) | Data processing method, device, equipment and medium based on label index system | |
| CN108876133B (en) | Risk assessment processing method, device, server and medium based on business information | |
| CN113093958B (en) | Data processing method and device and server | |
| WO2019179030A1 (en) | Product purchasing prediction method, server and storage medium | |
| US20150170036A1 (en) | Determining document classification probabilistically through classification rule analysis | |
| WO2016084642A1 (en) | Credit examination server, credit examination system, and credit examination program | |
| CN109840676B (en) | Big data-based wind control method and device, computer equipment and storage medium | |
| CN111178005A (en) | Data processing system, method and storage medium | |
| CN111666346A (en) | Information merging method, transaction query method, device, computer and storage medium | |
| CN110942392A (en) | Service data processing method, device, equipment and medium | |
| CN112037026A (en) | Automatic abnormal transaction work order processing method, device and system | |
| CN113034046A (en) | Data risk metering method and device, electronic equipment and storage medium | |
| CN115470785A (en) | Bond risk information processing method based on big data and related equipment | |
| CN112950359B (en) | User identification method and device | |
| CN108711109B (en) | Method, device, storage medium and apparatus for updating preparation gold computing system | |
| US20130006705A1 (en) | Small business intelligence tool | |
| CN115204881A (en) | Data processing method, device, equipment and storage medium | |
| CN110659413A (en) | Account number association method and device between user and salesman, electronic equipment and medium | |
| CN113706223B (en) | Data processing method and device | |
| CN110827137A (en) | Credit evaluation method and device | |
| CN110147441B (en) | Data integration display method and device, terminal equipment and medium | |
| CN113762894A (en) | Data processing method and device, electronic equipment and storage medium | |
| US20170098280A1 (en) | Systems and methods for detecting fraud in subscriber enrollment | |
| CN114596147A (en) | Data reconciliation method and device, computer equipment and storage medium | |
| CN107533686A (en) | Method and system for monitoring business operation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |