CN109344162A - Business data processing method and device - Google Patents

Business data processing method and device Download PDF

Info

Publication number
CN109344162A
CN109344162A CN201811078908.9A CN201811078908A CN109344162A CN 109344162 A CN109344162 A CN 109344162A CN 201811078908 A CN201811078908 A CN 201811078908A CN 109344162 A CN109344162 A CN 109344162A
Authority
CN
China
Prior art keywords
data
mark
mark data
time
business
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811078908.9A
Other languages
Chinese (zh)
Inventor
周晓峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jingdong Financial Technology Holding Co Ltd
Original Assignee
Beijing Jingdong Financial Technology Holding Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jingdong Financial Technology Holding Co Ltd filed Critical Beijing Jingdong Financial Technology Holding Co Ltd
Priority to CN201811078908.9A priority Critical patent/CN109344162A/en
Publication of CN109344162A publication Critical patent/CN109344162A/en
Pending legal-status Critical Current

Links

Landscapes

  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

Present disclose provides a kind of business data processing methods, calculate node applied to server cluster, it include: the mark acquisition request about specified services data issued in response to data server, mark data corresponding with the specified services data is generated based on pre-defined rule, the mark data includes: characterizing the machine identification of the service identification of the corresponding business information of the specified services data, the time identifier of the time of the characterization generation mark data and this calculate node;The mark data is sent to the data server, it will be in the mark data and the corresponding deposit database of the specified services data by the data server.The disclosure additionally provides a kind of service data processing apparatus, a kind of computer equipment and a kind of computer readable storage medium.

Description

Business data processing method and device
Technical field
This disclosure relates to Internet technical field, more particularly, to a kind of business data processing method and device.
Background technique
In Internet world, especially under distributed environment, corresponding unique mark is configured for each business datum Know, is indispensable one of the demand of each system, is played in terms of guarantee system correctly runs, maintains data neat and tidy Irreplaceable role.According to the different demands of different business, different mark configuration modes might have, although mark Generating mode it is varied, the create-rule of mark is also varied, but changes ten thousand times without leaving the original aim or stand, need most guarantee be mark With the unique association of business datum.
During realizing disclosure design, at least there are the following problems in the prior art: existing skill for inventor's discovery The mark configured in art by business datum does not have business meaning, i.e., mark is weaker with the relevance of business datum, is based on industry The mark of business data can not effectively assist to carry out the follow-up business treatment process about business datum.
Summary of the invention
In view of this, present disclose provides a kind of configured for business datum it is globally unique, orderly and with business meaning The business data processing method and device of mark data.
An aspect of this disclosure provides a kind of business data processing method, the calculating section applied to server cluster Point, comprising: in response to the mark acquisition request about specified services data that data server issues, generated based on pre-defined rule Mark data corresponding with the specified services data, the mark data includes: it is corresponding to characterize the specified services data The service identification of business information, characterization generate the time identifier of the time of the mark data and the machine of this calculate node Mark;The mark data is sent to the data server, by the data server by the mark data and described In the corresponding deposit database of specified services data.
In accordance with an embodiment of the present disclosure, the mark data further includes characterizing the server cluster to generate the mark The sequence number of the quantity of generated mark data in unit time belonging to the time of data.It is described to be generated based on pre-defined rule Mark data corresponding with the specified services data includes: obtaining the corresponding sequence number of current time;When the current time When the corresponding quantity of corresponding sequence number is less than preset threshold, using the corresponding sequence number of the current time as the mark The sequence number of data obtains time identifier of the corresponding time identifier of current time as the mark data;When the sequence When number corresponding quantity is more than preset threshold, the current one time is waited to terminate, obtains time corresponding sequence number after waiting, when When the corresponding quantity of time corresponding sequence number is less than preset threshold after the waiting, by time corresponding sequence after the waiting Sequence number of the row number as the mark data, obtain wait after time corresponding time identifier as the mark data when Between identify.
In accordance with an embodiment of the present disclosure, the mark data further includes at least one of following: characterizing the data server The distribution indicator for the interface message called when issuing the mark acquisition request, characterizes corresponding to the server cluster The start context of business release information, and/or, characterize the positive and negative symbol logo of the mark data.
In accordance with an embodiment of the present disclosure, the service identification includes the first quantity bit, and the time identifier includes Second quantity bit, the machine identification include third quantity bit, and the sequence number compares including the 4th quantity Special position, the distribution indicator include the 5th quantity bit, and the start context includes the 6th quantity bit, the symbol Number mark include the 7th quantity bit.It is described that mark number corresponding with the specified services data is generated based on pre-defined rule According to including: successively to be spliced to form the service identification, the time identifier and the machine identification according to the first predetermined order The mark data;Alternatively, by the service identification, the time identifier, the machine identification and the sequence number, At least one in the distribution indicator, the start context and/or the symbol logo is successively spelled according to the second predetermined order It connects and constitutes the mark data.
In accordance with an embodiment of the present disclosure, the mark acquisition request includes the corresponding business letter of the specified services data Breath, the business information includes type of service and Asset Type.The service identification includes the type of service corresponding first Second identifier corresponding with the Asset Type is identified, the bit that the first identifier is included is wrapped with the second identifier The sum of bit contained is first quantity.
Another aspect of the disclosure provides a kind of business data processing method, is applied to data server, comprising: obtain Fetching determines business datum;Any calculate node into server cluster is sent to be obtained about the mark of the specified services data Request receives the mark data that the calculate node returns, and the mark data includes: it is corresponding to characterize the specified services data The service identification of business information, characterization generate the mark data time time identifier and the calculate node Machine identification;It will be in the mark data and the corresponding deposit database of the specified services data.
In accordance with an embodiment of the present disclosure, the above method further include: when receiving mark data failure, based on pre- set pattern Mark data corresponding with the specified services data is then generated, the mark data includes: characterizing the specified services data The service identification of corresponding business information, characterization generate time identifier and the notebook data service of the time of the mark data The machine identification of device.
In accordance with an embodiment of the present disclosure, the mark data further includes at least one of following: characterizing the server cluster The sequence number of the quantity of generated mark data in the unit time belonging to the time for generating the mark data, characterizes institute The distribution indicator for stating the interface message that data server is called when issuing the mark acquisition request, characterizes the server The start context of business release information corresponding to cluster, and/or, characterize the positive and negative symbol logo of the mark data.
In accordance with an embodiment of the present disclosure, the service identification includes the first quantity bit, and the time identifier includes Second quantity bit, the machine identification include third quantity bit, and the sequence number compares including the 4th quantity Special position, the distribution indicator include the 5th quantity bit, and the start context includes the 6th quantity bit, the symbol Number mark include the 7th quantity bit.The mark data is the service identification, the time identifier and the machine Mark is successively spliced according to the first predetermined order and is constituted, alternatively, the mark data is the service identification, the time Mark, the machine identification and in the sequence number, the distribution indicator, the start context and/or the symbol logo In at least one of successively splice according to the second predetermined order and constitute.
In accordance with an embodiment of the present disclosure, the above method further include: obtain search condition information, the search condition packet Include at least one of following: business information, temporal information, the identification information of calculate node, calculate node interface message, and/or Business release information;For any business datum in database, institute is found in the corresponding mark data of the business datum The corresponding data slot of search condition information is stated, the anti-solution of the data slot found is converted into corresponding information, after conversion Information and search condition information when matching, determine that the business datum meets search condition;It filters out in database The business datum for meeting search condition carries out predetermined process.
Another aspect of the disclosure provides a kind of service data processing apparatus, the calculating section applied to server cluster Point, comprising: generation module is used for the mark acquisition request about specified services data issued in response to data server, is based on Pre-defined rule generates mark data corresponding with the specified services data.The mark data includes: the characterization specified industry The service identification of the corresponding business information of data of being engaged in, characterization generate the time identifier and this meter of the time of the mark data The machine identification of operator node.Sending module is used to the mark data being sent to the data server, is taken by the data Being engaged in device will be in the mark data and the corresponding deposit database of the specified services data.
In accordance with an embodiment of the present disclosure, the mark data further includes characterizing the server cluster to generate the mark The sequence number of the quantity of generated mark data in unit time belonging to the time of data.Generation module is based on pre-defined rule Generating mark data corresponding with the specified services data includes: generation module is for obtaining the corresponding sequence of current time Number;It is when the corresponding quantity of the corresponding sequence number of the current time is less than preset threshold, the current time is corresponding Sequence number of the sequence number as the mark data, obtain the corresponding time identifier of current time as the mark data when Between identify;When the corresponding quantity of the sequence number is more than preset threshold, the current one time is waited to terminate, when obtaining after waiting Between corresponding sequence number will be described when the corresponding quantity of time corresponding sequence number is less than preset threshold after the waiting Sequence number of the time corresponding sequence number as the mark data after waiting obtains time corresponding time identifier after waiting and makees For the time identifier of the mark data.
In accordance with an embodiment of the present disclosure, the mark data further includes at least one of following: characterizing the data server The distribution indicator for the interface message called when issuing the mark acquisition request, characterizes corresponding to the server cluster The start context of business release information, and/or, characterize the positive and negative symbol logo of the mark data.
In accordance with an embodiment of the present disclosure, the service identification includes the first quantity bit, and the time identifier includes Second quantity bit, the machine identification include third quantity bit, and the sequence number compares including the 4th quantity Special position, the distribution indicator include the 5th quantity bit, and the start context includes the 6th quantity bit, the symbol Number mark include the 7th quantity bit.Generation module is based on pre-defined rule and generates mark corresponding with the specified services data Knowing data includes: generation module for making a reservation for the service identification, the time identifier and the machine identification according to first Sequence is successively spliced to form the mark data;Alternatively, by the service identification, the time identifier, the machine identification, with And at least one in the sequence number, the distribution indicator, the start context and/or the symbol logo is according to second Predetermined order is successively spliced to form the mark data.
In accordance with an embodiment of the present disclosure, the mark acquisition request includes the corresponding business letter of the specified services data Breath, the business information includes type of service and Asset Type.The service identification includes the type of service corresponding first Second identifier corresponding with the Asset Type is identified, the bit that the first identifier is included is wrapped with the second identifier The sum of bit contained is first quantity.
Another aspect of the disclosure provides a kind of service data processing apparatus, is applied to data server, comprising: the One acquisition module is for obtaining specified services data.Second obtains module for any calculate node hair into server cluster The mark acquisition request about the specified services data is sent, the mark data that the calculate node returns is received.The mark Data include: the service identification of the corresponding business information of the characterization specified services data, the characterization generation mark data The machine identification of the time identifier of time and the calculate node.Store processing module be used for the mark data and In the corresponding deposit database of the specified services data.
In accordance with an embodiment of the present disclosure, above-mentioned apparatus further includes generation module, for when the reception mark data failure When, mark data corresponding with the specified services data is generated based on pre-defined rule.The mark data includes: described in characterization The service identification of the corresponding business information of specified services data, characterization generate the time of the mark data time identifier, with And the machine identification of notebook data server.
In accordance with an embodiment of the present disclosure, the mark data further includes at least one of following: characterizing the server cluster The sequence number of the quantity of generated mark data in the unit time belonging to the time for generating the mark data, characterizes institute The distribution indicator for stating the interface message that data server is called when issuing the mark acquisition request, characterizes the server The start context of business release information corresponding to cluster, and/or, characterize the positive and negative symbol logo of the mark data.
In accordance with an embodiment of the present disclosure, the service identification includes the first quantity bit, and the time identifier includes Second quantity bit, the machine identification include third quantity bit, and the sequence number compares including the 4th quantity Special position, the distribution indicator include the 5th quantity bit, and the start context includes the 6th quantity bit, the symbol Number mark include the 7th quantity bit.The mark data is the service identification, the time identifier and the machine Mark is successively spliced according to the first predetermined order and is constituted, alternatively, the mark data is the service identification, the time Mark, the machine identification and in the sequence number, the distribution indicator, the start context and/or the symbol logo In at least one of successively splice according to the second predetermined order and constitute.
In accordance with an embodiment of the present disclosure, above-mentioned apparatus further includes retrieval analysis module, for obtaining search condition information, institute It includes at least one of following for stating search condition information: business information, temporal information, the identification information of calculate node, calculate node Interface message, and/or business release information;It is corresponding in the business datum for any business datum in database The corresponding data slot of the search condition information is found in mark data, and the anti-solution of the data slot found is converted to accordingly Information determine that the business datum meets search condition when information after conversion and the search condition information match; Filter out the business datum progress predetermined process for meeting search condition in database.
Another aspect of the disclosure provides a kind of computer equipment, including memory, processor and is stored in storage On device and the computer program that can run on a processor, the processor realize side as described above when executing described program Method.
Another aspect of the present disclosure provides a kind of computer readable storage medium, is stored with computer executable instructions, Described instruction is when executed for realizing method as described above.
Another aspect of the present disclosure provides a kind of computer program, and the computer program, which includes that computer is executable, to be referred to It enables, described instruction is when executed for realizing method as described above.
In accordance with an embodiment of the present disclosure, can at least be partially solved/mitigation/inhibit/or even avoid be in the prior art The mark of business datum configuration is associated with the problem of weak, without business meaning with business datum, and this programme can be business datum With business meaning, orderly, unique mark data is configured, is conducive to follow-up business processing efficiently, accurately and fast, flexibly Ground carries out.
Detailed description of the invention
By referring to the drawings to the description of the embodiment of the present disclosure, the above-mentioned and other purposes of the disclosure, feature and Advantage will be apparent from, in the accompanying drawings:
Fig. 1 diagrammatically illustrate according to the embodiment of the present disclosure can be with the example of applied business data processing method and device Property system architecture;
Fig. 2 diagrammatically illustrates the flow chart of business data processing method according to an embodiment of the present disclosure;
Fig. 3 diagrammatically illustrates the flow chart of business data processing method according to another embodiment of the present disclosure;
Fig. 4 A diagrammatically illustrates the schematic diagram of business data processing process according to an embodiment of the present disclosure;
Fig. 4 B diagrammatically illustrates the schematic diagram of the content of mark data according to an embodiment of the present disclosure;
Fig. 5 diagrammatically illustrates the block diagram of service data processing apparatus according to an embodiment of the present disclosure;
Fig. 6 diagrammatically illustrates the block diagram of service data processing apparatus according to another embodiment of the present disclosure;
Fig. 7 diagrammatically illustrates the block diagram of service data processing apparatus according to another embodiment of the present disclosure;And
Fig. 8 diagrammatically illustrates the computer equipment for being adapted for carrying out business data processing method according to the embodiment of the present disclosure Block diagram.
Specific embodiment
Hereinafter, will be described with reference to the accompanying drawings embodiment of the disclosure.However, it should be understood that these descriptions are only exemplary , and it is not intended to limit the scope of the present disclosure.In the following detailed description, to elaborate many specific thin convenient for explaining Section is to provide the comprehensive understanding to the embodiment of the present disclosure.It may be evident, however, that one or more embodiments are not having these specific thin It can also be carried out in the case where section.In addition, in the following description, descriptions of well-known structures and technologies are omitted, to avoid Unnecessarily obscure the concept of the disclosure.
Term as used herein is not intended to limit the disclosure just for the sake of description specific embodiment.It uses herein The terms "include", "comprise" etc. show the presence of the feature, step, operation and/or component, but it is not excluded that in the presence of Or add other one or more features, step, operation or component.
There are all terms (including technical and scientific term) as used herein those skilled in the art to be generally understood Meaning, unless otherwise defined.It should be noted that term used herein should be interpreted that with consistent with the context of this specification Meaning, without that should be explained with idealization or excessively mechanical mode.
It, in general should be according to this using statement as " at least one in A, B and C etc. " is similar to Field technical staff is generally understood the meaning of the statement to make an explanation (for example, " system at least one in A, B and C " Should include but is not limited to individually with A, individually with B, individually with C, with A and B, with A and C, have B and C, and/or System etc. with A, B, C).Using statement as " at least one in A, B or C etc. " is similar to, generally come Saying be generally understood the meaning of the statement according to those skilled in the art to make an explanation (for example, " having in A, B or C at least One system " should include but is not limited to individually with A, individually with B, individually with C, with A and B, have A and C, have B and C, and/or the system with A, B, C etc.).It should also be understood by those skilled in the art that substantially arbitrarily indicating two or more The adversative conjunction and/or phrase of optional project shall be construed as either in specification, claims or attached drawing A possibility that giving including one of these projects, either one or two projects of these projects.For example, phrase " A or B " should A possibility that being understood to include " A " or " B " or " A and B ".
Embodiment of the disclosure provides a kind of business data processing method and device.This method includes that mark data generates Process and business datum are put in storage process.In mark data generating process, being generated based on preset rules includes service identification, time The mark data of mark and machine identification.During business datum storage, the mark data of generation is back to data service Device, data server will be in mark datas and the corresponding deposit database of corresponding specified services data.
Fig. 1 diagrammatically illustrate according to the embodiment of the present disclosure can be with the example of applied business data processing method and device Property system architecture 100.It should be noted that be only the example that can apply the system architecture of the embodiment of the present disclosure shown in Fig. 1, with The technology contents of the disclosure are helped skilled in the art to understand, but are not meant to that the embodiment of the present disclosure may not be usable for other Equipment, system, environment or scene.
As shown in Figure 1, system architecture 100 may include data server 101,102,103, network according to this embodiment 104 and server cluster 105.Network 104 between data server 101,102,103 and server cluster 105 to provide The medium of communication link.Network 104 may include various connection types, such as wired, wireless communication link or fiber optic cables Etc..
It should be noted that business data processing scheme provided by the embodiment of the present disclosure generally can be by data server 101, it 102,103 is executed with the mutual cooperation of server cluster 105.Data server 101,102,103 obtains industry from operation system Business data, are interacted by network 104 with server cluster 105, corresponding with each business datum for obtaining the generation of server cluster 105 Mark data.Data server 101,102,103 can be PC (personal computer, PC), network service Device, database server etc. can have identical or different computing capability.It include that multiple electronics are set in server cluster 105 Standby, multiple electronic equipments can be PC (personal computer, PC), network server, database server Deng multiple electronic equipments can have identical or different computing capability.
It should be understood that the number of the data server in Fig. 1, the number of server cluster, electronics is set in server cluster Standby number is only schematical.According to realize needs, can have any number of data server, server cluster and Electronic equipment.
Fig. 2 diagrammatically illustrates the flow chart of business data processing method according to an embodiment of the present disclosure.
As shown in Fig. 2, this method is applied to server cluster and data server cooperation is business datum configuration identifier number According to scene, method shown in Fig. 2 is described from the calculate node side of server cluster, comprising:
It is based in operation S201 in response to the mark acquisition request about specified services data that data server issues Pre-defined rule generates mark data corresponding with the specified services data, and the mark data includes: the characterization specified industry The service identification of the corresponding business information of data of being engaged in, characterization generate the time identifier and this meter of the time of the mark data The machine identification of operator node.
In this operation, business datum is data relevant to specific business item, important during business data processing One ring is to generate the corresponding mark data of business datum, and then be put in storage business datum for index with mark data, basic herein It is above subsequent the business processings such as retrospective search, positioning problems, statistical analysis to be carried out to business datum, to assist corresponding service item Purpose is gone on smoothly.This operation mark data generated includes service identification, time identifier and machine identification, service identification table Levy the corresponding business information of corresponding service data, such as can be class of service, business tine etc., time identifier characterization generates mark Know the time of data, machine identification characterization generates the current calculate node of mark data.
Then, in operation S202, the mark data is sent to the data server, it will by the data server In the mark data and the corresponding deposit database of the specified services data.
As it can be seen that method shown in Fig. 2 is that business datum configures mark data corresponding with business datum, mark data and phase The business datum answered is corresponded in deposit database, and the corresponding mark data of each business datum includes service identification, time identifier And machine identification, wherein time identifier ensure that the trend of the corresponding mark data of each business datum is orderly, time identifier and machine Device mark ensure that the corresponding mark data of any business datum is complete in the mark data caused by server cluster together Office's uniqueness, service identification embody the business meaning of corresponding service data, that is, this programme can have for business datum configuration Business meaning, orderly, unique mark data is conducive to follow-up business processing and efficiently, accurately and fast, neatly carries out.
In one embodiment of the present disclosure, operation S201 mark data generated further includes characterizing the server set The sequence number of group's quantity of generated mark data in the unit time belonging to the time for generating the mark data.Pass through One preset threshold characterizes the total quantity of the mark data of allowed server cluster generation in the unit time, and a calculating saves Point needs to check the mark that unit time server cluster has generated belonging to current time when preparing for mark data The quantity of data, if preset threshold has not yet been reached, which can directly generate mark data, if had reached default Threshold value, the calculate node need to regenerate mark data until next unit time, and this makes it possible to effectively adjust server Cluster generates the rhythm of mark data, is allowed to more uniform, so that the load of server cluster also can remain for a long time more balanced State.S201, which is then operated, based on pre-defined rule generation mark data corresponding with the specified services data includes: acquisition is worked as Preceding time corresponding sequence number;When the corresponding quantity of the corresponding sequence number of the current time is less than preset threshold, by institute Sequence number of the corresponding sequence number of current time as the mark data is stated, the corresponding time identifier conduct of current time is obtained The time identifier of the mark data;When the corresponding quantity of the sequence number is more than preset threshold, the current one time is waited Terminate, obtains time corresponding sequence number after waiting, the corresponding quantity of time corresponding sequence number is less than after the waiting When preset threshold, using time corresponding sequence number after the waiting as the sequence number of the mark data, when obtaining after waiting Between time identifier of the corresponding time identifier as the mark data.The mark data generated in this way is not only marked by the time Knowledge can embody orderly growth of the mark data in overall time dimension, can also embody mark data by sequence number Orderly growth in unit time dimension, very clearly, clearly, effectively realize index to business datum.
Further, as an optional embodiment, operating S201 mark data generated can also include publication Mark, start context, symbol logo, etc. in information at least one of, business datum to be described from more various dimensions.Its In, distribution indicator is used to characterize the interface message that the data server is called when issuing the mark acquisition request, example REST interface if data server passes through calling calculate node sends the mark acquisition request about specified services data, then phase The distribution indicator in mark data answered is that the mark for characterizing REST interface such as data server are saved by calling to calculate The RPC interface of point sends the mark acquisition request about specified services data, then the distribution indicator in corresponding mark data is It is such to characterize mark of RPC interface, etc..Start context is for characterizing business release corresponding to the server cluster Information, after business release occurs correcting or updates, start context can also change therewith.Symbol logo is for characterizing the mark Data it is positive and negative.As it can be seen that the present embodiment mark data generated further includes other meanings in addition to business meaning, marked by publication Knowledge is further associated with the interface configuring condition of server cluster, further associated with practical business by start context, Business datum is more three-dimensionally described, subsequent foundation one or more of them is also beneficial to and business datum is indexed and is positioned.
In a specific embodiment, operation S201 mark data generated can be expressed by binary form, Specifically, each section can be identified and is collectively expressed as binary form, that is, the service identification includes the first quantity bit Position, the time identifier include the second quantity bit, and the machine identification includes third quantity bit, the sequence Number include the 4th quantity bit, the distribution indicator include the 5th quantity bit, the start context include the 6th Quantity bit, the symbol logo include the 7th quantity bit.It then operates S201 and is based on pre-defined rule generation and institute Stating the corresponding mark data of specified services data includes: when in mark data only include service identification, time identifier and machine mark When knowledge, the service identification, the time identifier and the machine identification are successively spliced to form institute according to the first predetermined order State mark data.When in addition to service identification, time identifier and machine identification, further include in mark data it is at least one of above-mentioned its When he identifies, by the service identification, the time identifier, the machine identification and the sequence number, the publication mark Know, in the start context and/or the symbol logo at least one of be successively spliced to form according to the second predetermined order it is described Mark data.For the mark data generated in this manner, easily anti-the meaning that wherein each segment characterizes can be solved, just It is handled in the subsequent analysis to business datum.
In operation S201, calculate node in server cluster includes the corresponding business of specified services data to generate The mark data of information needs to get the corresponding business information of the specified services data in advance.It is optional real as one Example is applied, the mark acquisition request that data server issues includes the corresponding business information of the specified services data, specifically, root According to the actual conditions of business, the business information may include type of service and Asset Type.Getting above-mentioned business information Afterwards, the service identification in mark data that calculate node generates includes the corresponding first identifier of the type of service and the assets The corresponding second identifier of type, the sum of the bit that the bit and the second identifier that the first identifier is included are included For first quantity.In other embodiments, according to the different actual conditions of different business, business information is segmented into difference Subclass, identified accordingly respectively according to the different subclasses of business information in mark data, more comprehensively meticulously to describe Practical business situation.
Fig. 3 diagrammatically illustrates the flow chart of business data processing method according to another embodiment of the present disclosure.
As shown in figure 3, this method is applied to server cluster and data server cooperation is business datum configuration identifier number According to scene, method shown in Fig. 3 is described from data server side, comprising:
In operation S301, specified services data are obtained.
In operation S302, any calculate node into server cluster sends the mark about the specified services data Acquisition request receives the mark data that the calculate node returns, and the mark data includes: characterizing the specified services data The service identification of corresponding business information, characterization generate the time identifier and calculating section of the time of the mark data The machine identification of point.
It, will be in the mark data and the corresponding deposit database of the specified services data in operation S303.
As it can be seen that method shown in Fig. 3 is that business datum configures mark data corresponding with business datum, mark data and phase The business datum answered is corresponded in deposit database, and the corresponding mark data of each business datum includes service identification, time identifier And machine identification, wherein time identifier ensure that the trend of the corresponding mark data of each business datum is orderly, time identifier and machine Device mark ensure that the corresponding mark data of any business datum is complete in the mark data caused by server cluster together Office's uniqueness, service identification embody the business meaning of corresponding service data, that is, this programme can have for business datum configuration Business meaning, orderly, unique mark data is conducive to follow-up business processing and efficiently, accurately and fast, neatly carries out.
In embodiment of the disclosure, in order to improve the availability of business data processing scheme, method shown in Fig. 3 is also wrapped It includes: in operation S304, when receiving mark data failure, being generated based on pre-defined rule corresponding with the specified services data Mark data, the mark data includes: characterize the corresponding business information of the specified services data service identification, characterization Generate the time identifier of the time of the mark data and the machine identification of notebook data server.
It specifically can be, data server is after getting specified services data, one into server cluster Calculate node A sends the mark acquisition request about the specified services data, gets if could not succeed from calculate node A The corresponding mark data of the specified services data, illustrates that calculate node A goes wrong, then data server can be from server Another calculate node B is selected in cluster, sends the mark acquisition request about the specified services data to calculate node B, To obtain the corresponding mark data of the specified services data, if entire server cluster goes wrong, data server When can not get the corresponding mark data of the specified services data from server cluster, then need oneself to generate institute local State the corresponding mark data of specified services data, similarly, local generated mark data include service identification, time identifier and Machine identification is uniformly processed with guaranteeing the specification consistency with server cluster mark data generated convenient for subsequent.This Embodiment ensure that the high availability of business data processing scheme, and one or more calculate nodes are asked in server cluster The generation of the mark data of business datum is not influenced when topic.
In one embodiment of the present disclosure, the corresponding mark data of specified services data of above-mentioned generation can also include It is at least one of following: to characterize the server cluster and generated in the unit time belonging to the time for generating the mark data Mark data quantity sequence number, characterize the data server issue it is described mark acquisition request when called connect The distribution indicator of message breath, characterizes the start context of business release information corresponding to the server cluster, and/or, characterization The positive and negative symbol logo of the mark data.As it can be seen that this programme identification data may also include call number, distribution indicator, version This mark etc. more three-dimensionally describes business datum so that mark data further includes other meanings in addition to business meaning, is also beneficial to It is subsequent that business datum is indexed and is positioned according to one or more of them.
Specifically, as an optional embodiment, the mark data of above-mentioned generation can be expressed by binary form, Such as each section can be identified and be collectively expressed as binary form, that is, the service identification includes the first quantity bit, The time identifier includes the second quantity bit, and the machine identification includes third quantity bit, the sequence number Including the 4th quantity bit, the distribution indicator includes the 5th quantity bit, and the start context includes the 6th number A bit is measured, the symbol logo includes the 7th quantity bit.Then the mark data is the service identification, described Time identifier and the machine identification successively splice according to the first predetermined order and are constituted, alternatively, the mark data is institute It states service identification, the time identifier, the machine identification and is compiled in the sequence number, the distribution indicator, the version Number and/or the symbol logo at least one of successively splice according to the second predetermined order and constitute.As it can be seen that the present embodiment Middle each section is identified as binary data, the mark data of binary form is constituted according to certain sequential concatenation, for according to this The mark data that kind of mode generates, can the easily anti-meaning that solve wherein each segment characterization, convenient for subsequent to business datum Analysis processing.
The corresponding mark data of business datum is got above-mentioned, by mark data deposit number corresponding with the business datum After in library, it can the index using mark data as business datum carries out various operations to business datum.As one Optional embodiment, further, method shown in Fig. 3 further include:
In operation S305, search condition information is obtained, the search condition information includes at least one of following: business letter Breath, temporal information, the identification information of calculate node, the interface message of calculate node, and/or business release information.
In operation S306, for any business datum in database, in the corresponding mark data of the business datum The corresponding data slot of the search condition information is found, the anti-solution of the data slot found is converted into corresponding information, when When information and the search condition information after conversion match, determine that the business datum meets search condition.
In operation S307, the business datum progress predetermined process for meeting search condition in database is filtered out.
As it can be seen that in the present embodiment, each business datum storage corresponding with respective mark data in database, then known When search condition information, portion corresponding with search condition information can be found by the anti-each mark data solved in database Point, by with the part and the comparison of search condition information found, it can find the business for meeting search condition in database Data then can be convenient the business datum retrieved, quickly carry out such as data cleansing, be positioning problems, log analysis, comprehensive The various predetermined process such as statistics are closed, the process demand of practical business is met.
Below with reference to Fig. 4 A~Fig. 4 B, Fig. 2~method shown in Fig. 3 is described further in conjunction with specific embodiments.
Fig. 4 A diagrammatically illustrates the schematic diagram of business data processing process according to an embodiment of the present disclosure.
In the present embodiment, specific business is asset securitization (ABS) business, then specific business datum is the progress of ABS business The business datum generated in the process.Server cluster can select one of various clusters, such as the present embodiment that can select Zookeeper cluster.It should be appreciated that specific business, business datum, server cluster etc. that the present embodiment is lifted are intended to The implementation logic of the bright disclosure, does not make limitation to the disclosure.
As shown in Figure 4 A, the sequencing of data flow is indicated in the figure with serial number firstly, data server is from operation system Business datum X is obtained, then, is based on load balancing principle, calculate node A hair of the data server into server cluster The mark acquisition request about business datum X is sent, includes the business information of business datum X, the business in the mark acquisition request Information specifically includes the corresponding type of service of business datum X and Asset Type.
Calculate node A gets above-mentioned mark acquisition request, generates mark corresponding with business datum X based on pre-defined rule Data ID, the mark data ID include: the service identification id1 for characterizing the corresponding business information of business datum X, characterization generation institute The time identifier id2 of the time of mark data ID, the machine identification id3 of the calculate node, the characterization server cluster is stated to exist Generate the sequence number id4 of the quantity of generated mark data in the unit time belonging to the time of the mark data ID, table The distribution indicator id5 for levying the interface message that the data server is called when issuing the mark acquisition request, characterizes institute The start context id6 of business release information corresponding to server cluster is stated, and characterizes the positive and negative of the mark data ID Symbol logo id7.Wherein, service identification id1 is by the mark id11 of characterization Asset Type and the mark id12 of characterization type of service It constitutes, each section mark is successively spliced to form the corresponding mark data ID of business datum X according to predetermined order.
Fig. 4 B diagrammatically illustrates the schematic diagram of the content of mark data according to an embodiment of the present disclosure.
As shown in Figure 4 B, specifically, the corresponding mark data ID of business datum X that calculate node A is generated in the present embodiment Length includes 64 bits (from the 0th to the 63rd), conforms exactly in java language Long type in length.Wherein each position The representative meaning set is as follows:
63rd: highest order belongs to sign bit in binary system, indicates the symbol logo id7 in mark data ID, accounts for 1 Bit, in the present embodiment, because the ID generated is positive number, the 63rd is fixed as 0.
62nd~the 59th: indicating the mark id11 in mark data ID, represent the corresponding assets class of business datum X Type, accounts for 4 bits, and maximum supports 24=16 kinds of Asset Types.
58th~the 56th: indicating the mark id12 in mark data ID, represent the corresponding service class of business datum X Type, accounts for 3 bits, and maximum supports 23=8 kinds of types of service.
It can be seen that the 62nd~the 56th composition service identification id1 in above-mentioned mark data ID, represents business datum The corresponding business information of X accounts for 7 bits altogether.
55th~the 54th: it indicates the distribution indicator id5 in mark data ID, represents the published method of calculate node A, Characterize the meter that the data server is called when issuing the mark acquisition request about business datum X to calculate node A The interface message of operator node A, accounts for 2 bits, and maximum supports 22=4 kinds of ID published methods.This mark data ID generating mode, A variety of published methods, such as the publication of REST interface, the publication of RPC interface, the calculate node in server cluster are supported to go out In the existing not available situation of problem, the local publication of local data service device is also supported.
53rd~the 46th: indicating the start context id6 in mark data ID, characterize corresponding to the server cluster Business release information represent the start context of ABS business in the present embodiment, account for 8, maximum supports 28=256 associations View distribution.
45th~the 16th: indicating the time identifier id2 in mark data ID, characterization generates the mark data ID's Time accounts for 30, maximum supports 2 with second grade time measurement in the present embodiment30/ 365/24/60/60 ≈ use in 34 years.Its In, it can guarantee that each calculate node clock is synchronous in server cluster by Network Time Protocol (NTP).
15th~the 10th: indicating the machine identification id3 in mark data ID, represent the mark of calculate node A, account for 6 Position, then it is maximum in server cluster belonging to calculate node A to support 26=64 calculate nodes, the corresponding machine of each calculate node Mark is different.
9th~the 0th: indicating the sequence number id4 in mark data ID, characterize the server cluster described in the generation The quantity of generated mark data in unit time belonging to the time of mark data ID, accounts for 10, unit in the present embodiment Time is measured in seconds, then server cluster maximum belonging to calculate node A supports production 2 per second10=1024 mark datas.
It can be seen that being based on this mark data ID generating mode, ID metadata is converted using binary bit arithmetic, most The numerical value that a long can be generated eventually is used using the order of time, and in second grade unit from increasing sequence, complete to reach Office is unique, and trend is orderly.It is anti-to solve mark data ID to the segment that is defined according to figure 4 above B, it can be with from mark data ID Obtain the various information relevant to business datum X needed.Also, this mark data ID generating mode uses reciprocity cluster The mode that+local data service device relies on guarantees High Availabitity, hangs a calculate node not shadow in entire server cluster Ring the generation of mark data ID.The worst situation, entire server cluster are hung, and can be quickly switched into local data service device To generate mark data ID.To guarantee High Availabitity.Wherein can one be manufactured by pre-defined rule and meets demand according to the actual situation Mark data ID, in chopping rule every section it is configurable, can be configured according to the actual situation, then according to the new rule of configuration Mark data ID is generated, and supports Mass production mark data ID.
Calculate node A generate mark data ID shown in Fig. 4 B and then it is secondary return to process shown in Fig. 4 A, calculate section Mark data ID is back to data server by point A, and mark data ID and business datum X is corresponded to deposit data by data server In library.As it can be seen that any business datum accessed by data server configures each business datum according to mode shown in Fig. 4 A Corresponding mark data, then corresponding storage saves again, so that the business datum in database all has globally unique, trend Distributed mark data orderly, associated with specific business tine.
It is recognised that above process Fig. 4 A mark data as shown in Figure 4 B generated have high-performance, High Availabitity, can It instead solves, can manufacture, the features such as trend is orderly, being based on these features, can use the business data processing scheme of the disclosure in number Table, statistical analysis etc. and business is divided to combine according to cleaning, log analysis, positioning problems, a point library.
Specifically, for any business datum, the corresponding mark of business datum is obtained according to process shown in above-mentioned Fig. 4 A In data and corresponding deposit database, it is based on this, when carrying out data cleansing to business datum, by each industry in database The anti-solution of the mark data for data of being engaged in can find out those business datums and there is missing, need to repair, and can be according to anti-solution Mark data navigate to the information that corresponding business datum needs to repair, and then carry out the reparation of corresponding service data so that The business datum that business datum and operation system after reparation generate logically is consistent.
Alternatively, can quickly be navigated to and be asked by the anti-solution to mark data when carrying out log analysis to business datum Data, such as the period that can occur by the anti-time identifier solved in mark data with quick positioning question are inscribed, then when corresponding Between the corresponding business datum of section be problem data.
Alternatively, can vertically be split by the business information in mark data when carrying out a point library to business datum and dividing table, Such as can be split according to the classification of the business in mark data and/or start context, it can also be according in mark data Sequence number is split, it should be noted that in order to avoid carrying out the distribution of business datum when table is divided in point library according to sequence number not , sequence number does not repeat back to instead of and is classified as 0 and starts counting within each unit time, returns according to random algorithm as in 0~9 A number start counting again.
Alternatively, business datum can be pressed when for statistical analysis to business datum by the anti-solution to mark data It is grouped, such as can be grouped according to the Asset Type in mark data according to various information, it can be according in mark data Type of service grouping, can be grouped according to the start context in mark data, can be according to the time identifier in mark data point Group, etc..Can according to the actual situation depending on, herein with no restrictions.
Fig. 5 diagrammatically illustrates the block diagram of service data processing apparatus according to an embodiment of the present disclosure.
As shown in figure 5, the service data processing apparatus 500 is applied to the calculate node of server cluster, including generate mould Block 510 and sending module 520.
Generation module 510 is used for the mark acquisition request about specified services data issued in response to data server, Mark data corresponding with the specified services data is generated based on pre-defined rule, the mark data includes: characterizing the finger Determine the service identification of the corresponding business information of business datum, characterization generate the mark data time time identifier and The machine identification of this calculate node.
Sending module 520 is used to the mark data being sent to the data server, will by the data server In the mark data and the corresponding deposit database of the specified services data.
Further, in one embodiment of the present disclosure, above-mentioned mark data further includes characterizing the server cluster The sequence number of the quantity of generated mark data in the unit time belonging to the time for generating the mark data.Generate mould Block 510 is based on pre-defined rule generation mark data corresponding with the specified services data: generation module 510 is for obtaining The corresponding sequence number of current time will when the corresponding quantity of the corresponding sequence number of the current time is less than preset threshold Sequence number of the corresponding sequence number of the current time as the mark data obtains the corresponding time identifier of current time and makees For the time identifier of the mark data.When the corresponding quantity of the sequence number is more than preset threshold, when waiting current one Between terminate, obtain wait after time corresponding sequence number, the corresponding quantity of time corresponding sequence number does not surpass after the waiting When crossing preset threshold, using time corresponding sequence number after the waiting as the sequence number of the mark data, obtain after waiting Time identifier of the time corresponding time identifier as the mark data.
In one embodiment of the present disclosure, above-mentioned mark data further includes at least one of following: characterizing the data clothes It is right to characterize the server cluster institute for the distribution indicator for the interface message that business device is called when issuing the mark acquisition request The start context for the business release information answered, and/or, characterize the positive and negative symbol logo of the mark data.
In one embodiment of the present disclosure, above-mentioned service identification includes the first quantity bit, the time identifier Including the second quantity bit, the machine identification includes third quantity bit, and the sequence number includes the 4th quantity A bit, the distribution indicator include the 5th quantity bit, and the start context includes the 6th quantity bit, institute Stating symbol logo includes the 7th quantity bit.
On this basis, generation module 510 is based on pre-defined rule and generates mark number corresponding with the specified services data According to include: generation module 510 be used to according to first make a reservation for the service identification, the time identifier and the machine identification it is suitable Sequence is successively spliced to form the mark data alternatively, generation module 510 is used for the service identification, the time identifier, institute State machine identification and in the sequence number, the distribution indicator, the start context and/or the symbol logo extremely One item missing is successively spliced to form the mark data according to the second predetermined order.
Wherein, as an optional embodiment, the mark acquisition request includes that the specified services data are corresponding Business information, the business information include type of service and Asset Type.The service identification includes that the type of service is corresponding First identifier and the corresponding second identifier of the Asset Type, bit that the first identifier is included and second mark Knowing the sum of included bit is first quantity.
Fig. 6 diagrammatically illustrates the block diagram of service data processing apparatus according to another embodiment of the present disclosure.
As shown in fig. 6, the service data processing apparatus 600 be applied to data server, including first obtain module 610, Second obtains module 620 and storage processing module 630.
First acquisition module 610 is for obtaining specified services data.
Second, which obtains module 620, sends for any calculate node into server cluster about the specified services number According to mark acquisition request, receive the mark data that the calculate node returns, the mark data includes: characterization is described specified The service identification of the corresponding business information of business datum, characterization generate time identifier, the Yi Jisuo of the time of the mark data State the machine identification of calculate node.
Processing module 630 is stored for will be in the corresponding deposit database of the mark data and the specified services data.
In one embodiment of the present disclosure, above-mentioned mark data can also include at least one of following: characterize the clothes The sequence for device cluster quantity of generated mark data in the unit time belonging to the time for generating the mark data of being engaged in Number, characterize the distribution indicator for the interface message that the data server is called when issuing the mark acquisition request, characterization The start context of business release information corresponding to the server cluster, and/or, characterize the positive and negative symbol of the mark data Number mark.
Specifically, as an optional embodiment, the service identification includes the first quantity bit, the time Mark includes the second quantity bit, and the machine identification includes third quantity bit, and the sequence number includes the 4th Quantity bit, the distribution indicator include the 5th quantity bit, and the start context includes the 6th quantity bit Position, the symbol logo include the 7th quantity bit.Then the mark data is the service identification, the time identifier Successively splice with the machine identification according to the first predetermined order and constitutes.Alternatively, the mark data is the business mark Knowledge, the time identifier, the machine identification and the sequence number, the distribution indicator, the start context and/or At least one in the symbol logo is successively spliced according to the second predetermined order and is constituted.
Fig. 7 diagrammatically illustrates the block diagram of service data processing apparatus according to another embodiment of the present disclosure.
As shown in fig. 7, the service data processing apparatus 700 be applied to data server, including first obtain module 610, Second obtains module 620, storage processing module 630, generation module 640 and retrieval analysis module 650.Wherein first obtain module 610, the second acquisition module 620 and storage processing module 630 have been described above, and duplicate part repeats no more.
Generation module 640 is used to generate and the specified industry when receiving mark data failure based on pre-defined rule The corresponding mark data of data of being engaged in, the mark data includes: characterizing the industry of the corresponding business information of the specified services data Business mark, characterization generate the time identifier of the time of the mark data and the machine identification of notebook data server.
Retrieval analysis module 650 includes at least one of following for obtaining search condition information, the search condition information: Business information, temporal information, the identification information of calculate node, the interface message of calculate node, and/or business release information;It is right Any business datum in database finds the search condition information pair in the corresponding mark data of the business datum The anti-solution of the data slot found is converted to corresponding information by the data slot answered, information after conversion and the retrieval When conditional information matches, determine that the business datum meets search condition;Filter out the industry for meeting search condition in database Data of being engaged in carry out predetermined process.
It should be noted that in device section Example each module/unit/subelement etc. embodiment, the skill of solution Art problem, the function of realization and the technical effect reached respectively with the implementation of corresponding step each in method section Example Mode, the technical issues of solving, the function of realization and the technical effect that reaches are same or like, and details are not described herein.
It is module according to an embodiment of the present disclosure, submodule, unit, any number of or in which any more in subelement A at least partly function can be realized in a module.It is single according to the module of the embodiment of the present disclosure, submodule, unit, son Any one or more in member can be split into multiple modules to realize.According to the module of the embodiment of the present disclosure, submodule, Any one or more in unit, subelement can at least be implemented partly as hardware circuit, such as field programmable gate Array (FPGA), programmable logic array (PLA), system on chip, the system on substrate, the system in encapsulation, dedicated integrated electricity Road (ASIC), or can be by the hardware or firmware for any other rational method for integrate or encapsulate to circuit come real Show, or with any one in three kinds of software, hardware and firmware implementations or with wherein any several appropriately combined next reality It is existing.Alternatively, can be at least by part according to one or more of the module of the embodiment of the present disclosure, submodule, unit, subelement Ground is embodied as computer program module, when the computer program module is run, can execute corresponding function.
For example, any number of may be incorporated in a module in generation module 510 and sending module 520 is realized, or Person's any one module therein can be split into multiple modules.Alternatively, one or more modules in these modules are extremely Small part function can be combined at least partly function of other modules, and be realized in a module.According to the disclosure Embodiment, at least one of generation module 510 and sending module 520 can at least be implemented partly as hardware circuit, example As on field programmable gate array (FPGA), programmable logic array (PLA), system on chip, substrate system, in encapsulation be System, specific integrated circuit (ASIC), or can be hard by carrying out any other rational method that is integrated or encapsulating etc. to circuit Part or firmware realize, or with any one in three kinds of software, hardware and firmware implementations or with wherein any several It is appropriately combined to realize.Alternatively, at least one of generation module 510 and sending module 520 can be at least at least partially implemented Corresponding function can be executed when the computer program module is run for computer program module.
In another example first obtains the acquisition of module 610, second module 620, storage processing module 630,640 and of generation module Any number of in retrieval analysis module 650, which may be incorporated in a module, to be realized or any one module therein can To be split into multiple modules.Alternatively, at least partly function of one or more modules in these modules can be with other moulds At least partly function of block combines, and realizes in a module.In accordance with an embodiment of the present disclosure, first obtain module 610, Second obtains at least one of module 620, storage processing module 630, generation module 640 and retrieval analysis module 650 can be with At least it is implemented partly as hardware circuit, such as field programmable gate array (FPGA), programmable logic array (PLA), piece The system in system, encapsulation, specific integrated circuit (ASIC) in upper system, substrate, or can be by being integrated to circuit Or the hardware such as any other rational method or firmware of encapsulation are realized, or with three kinds of software, hardware and firmware realization sides Any one in formula several appropriately combined is realized with wherein any.Alternatively, first obtains the acquisition mould of module 610, second At least one of block 620, storage processing module 630, generation module 640 and retrieval analysis module 650 can be at least by parts Ground is embodied as computer program module, when the computer program module is run, can execute corresponding function.
Fig. 8 is diagrammatically illustrated according to the computer equipment for being adapted for carrying out method as described above of the embodiment of the present disclosure Block diagram.Computer equipment shown in Fig. 8 is only an example, should not function to the embodiment of the present disclosure and use scope bring Any restrictions.
As shown in figure 8, include processor 801 according to the computer equipment 800 of the embodiment of the present disclosure, it can be according to storage It is loaded into random access storage device (RAM) 803 in the program in read-only memory (ROM) 802 or from storage section 808 Program and execute various movements appropriate and processing.Processor 801 for example may include general purpose microprocessor (such as CPU), refer to Enable set processor and/or related chip group and/or special microprocessor (for example, specific integrated circuit (ASIC)), etc..Processing Device 801 can also include the onboard storage device for caching purposes.Processor 801 may include for executing according to disclosure reality Apply single treatment unit either multiple processing units of the different movements of the method flow of example.
In RAM 803, it is stored with equipment 800 and operates required various programs and data.Processor 801, ROM 802 with And RAM 803 is connected with each other by bus 804.Processor 801 is held by executing the program in ROM 802 and/or RAM 803 The various operations gone according to the method flow of the embodiment of the present disclosure.It is noted that described program also can store except ROM 802 In one or more memories other than RAM 803.Processor 801 can also be stored in one or more of by execution Program in memory executes the various operations of the method flow according to the embodiment of the present disclosure.
In accordance with an embodiment of the present disclosure, equipment 800 can also include input/output (I/O) interface 805, input/output (I/O) interface 805 is also connected to bus 804.Equipment 800 can also include be connected to I/O interface 805 with one in lower component Item is multinomial: the importation 806 including keyboard, mouse etc.;Including such as cathode-ray tube (CRT), liquid crystal display (LCD) Deng and loudspeaker etc. output par, c 807;Storage section 808 including hard disk etc.;And including such as LAN card, modulatedemodulate Adjust the communications portion 809 of the network interface card of device etc..Communications portion 809 executes communication process via the network of such as internet. Driver 810 is also connected to I/O interface 805 as needed.Detachable media 811, such as disk, CD, magneto-optic disk, semiconductor Memory etc. is mounted on as needed on driver 810, in order to be pacified as needed from the computer program read thereon It is packed into storage section 808.
In accordance with an embodiment of the present disclosure, computer software journey may be implemented as according to the method flow of the embodiment of the present disclosure Sequence.For example, embodiment of the disclosure includes a kind of computer program product comprising be carried on computer readable storage medium Computer program, which includes the program code for method shown in execution flow chart.In such implementation In example, which can be downloaded and installed from network by communications portion 809, and/or from detachable media 811 It is mounted.When the computer program is executed by processor 801, the above-mentioned function limited in the system of the embodiment of the present disclosure is executed Energy.In accordance with an embodiment of the present disclosure, system as described above, unit, module, unit etc. can pass through computer program Module is realized.
The disclosure additionally provides a kind of computer readable storage medium, which can be above-mentioned reality It applies included in equipment/device/system described in example;Be also possible to individualism, and without be incorporated the equipment/device/ In system.Above-mentioned computer readable storage medium carries one or more program, when said one or multiple program quilts When execution, the method according to the embodiment of the present disclosure is realized.
In accordance with an embodiment of the present disclosure, computer readable storage medium can be non-volatile computer-readable storage medium Matter, such as can include but is not limited to: portable computer diskette, hard disk, random access storage device (RAM), read-only memory (ROM), erasable programmable read only memory (EPROM or flash memory), portable compact disc read-only memory (CD-ROM), light Memory device, magnetic memory device or above-mentioned any appropriate combination.In the disclosure, computer readable storage medium can With to be any include or the tangible medium of storage program, the program can be commanded execution system, device or device use or Person is in connection.For example, in accordance with an embodiment of the present disclosure, computer readable storage medium may include above-described One or more memories other than ROM 802 and/or RAM 803 and/or ROM 802 and RAM 803.
Flow chart and block diagram in attached drawing are illustrated according to the system of the various embodiments of the disclosure, method and computer journey The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation A part of one module, program segment or code of table, a part of above-mentioned module, program segment or code include one or more Executable instruction for implementing the specified logical function.It should also be noted that in some implementations as replacements, institute in box The function of mark can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are practical On can be basically executed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.Also it wants It is noted that the combination of each box in block diagram or flow chart and the box in block diagram or flow chart, can use and execute rule The dedicated hardware based systems of fixed functions or operations is realized, or can use the group of specialized hardware and computer instruction It closes to realize.
It will be understood by those skilled in the art that the feature recorded in each embodiment and/or claim of the disclosure can To carry out multiple combinations or/or combination, even if such combination or combination are not expressly recited in the disclosure.Particularly, exist In the case where not departing from disclosure spirit or teaching, the feature recorded in each embodiment and/or claim of the disclosure can To carry out multiple combinations and/or combination.All these combinations and/or combination each fall within the scope of the present disclosure.
Embodiment of the disclosure is described above.But the purpose that these embodiments are merely to illustrate that, and It is not intended to limit the scope of the present disclosure.Although respectively describing each embodiment above, but it is not intended that each reality Use cannot be advantageously combined by applying the measure in example.The scope of the present disclosure is defined by the appended claims and the equivalents thereof.It does not take off From the scope of the present disclosure, those skilled in the art can make a variety of alternatives and modifications, these alternatives and modifications should all fall in this Within scope of disclosure.

Claims (22)

1. a kind of business data processing method, the calculate node applied to server cluster, comprising:
In response to the mark acquisition request about specified services data that data server issues, based on pre-defined rule generation and institute The corresponding mark data of specified services data is stated, the mark data includes: characterizing the corresponding business of the specified services data The service identification of information, characterization generate the time identifier of the time of the mark data and the machine identification of this calculate node;
The mark data is sent to the data server, by the data server by the mark data and the finger Determine in the corresponding deposit database of business datum.
2. according to the method described in claim 1, wherein:
The mark data further includes when characterizing server cluster unit belonging to the time for generating the mark data The sequence number of the quantity of interior generated mark data;
It is described to include based on pre-defined rule generation mark data corresponding with the specified services data:
Obtain the corresponding sequence number of current time;
It is when the corresponding quantity of the corresponding sequence number of the current time is less than preset threshold, the current time is corresponding Sequence number of the sequence number as the mark data, obtain the corresponding time identifier of current time as the mark data when Between identify;
When the corresponding quantity of the sequence number is more than preset threshold, the current one time is waited to terminate, obtains the time after waiting Corresponding sequence number will be described etc. when the corresponding quantity of time corresponding sequence number is less than preset threshold after the waiting Sequence number of the time corresponding sequence number as the mark data after obtains time corresponding time identifier conduct after waiting The time identifier of the mark data.
3. according to the method described in claim 1, wherein, the mark data further includes at least one of following: characterizing the number According to the distribution indicator for the interface message that server is called when issuing the mark acquisition request, the server cluster is characterized The start context of corresponding business release information, and/or, characterize the positive and negative symbol logo of the mark data.
4. method according to any one of claim 1-3, in which:
The service identification includes the first quantity bit, and the time identifier includes the second quantity bit, the machine Device mark includes third quantity bit, and the sequence number includes the 4th quantity bit, and the distribution indicator includes the Five quantity bits, the start context include the 6th quantity bit, and the symbol logo compares including the 7th quantity Special position;
It is described to include based on pre-defined rule generation mark data corresponding with the specified services data:
The service identification, the time identifier and the machine identification are successively spliced to form according to the first predetermined order described Mark data;Or
By the service identification, the time identifier, the machine identification and in the sequence number, the distribution indicator, institute State in start context and/or the symbol logo at least one of be successively spliced to form the mark number according to the second predetermined order According to.
5. according to the method described in claim 4, wherein:
The mark acquisition request includes the corresponding business information of the specified services data, and the business information includes service class Type and Asset Type;
The service identification includes the corresponding first identifier of the type of service and the corresponding second identifier of the Asset Type, institute The sum of the bit that first identifier is included and the bit that the second identifier is included are stated as first quantity.
6. a kind of business data processing method is applied to data server, comprising:
Obtain specified services data;
Any calculate node into server cluster sends the mark acquisition request about the specified services data, receives institute The mark data of calculate node return is stated, the mark data includes: characterizing the corresponding business information of the specified services data Service identification, characterization generate the mark data time time identifier and the calculate node machine identification;
It will be in the mark data and the corresponding deposit database of the specified services data.
7. according to the method described in claim 6, further include:
When receiving mark data failure, mark number corresponding with the specified services data is generated based on pre-defined rule According to the mark data includes: characterizing the service identification of the corresponding business information of the specified services data, characterize described in generation The time identifier of the time of mark data and the machine identification of notebook data server.
8. according to the method described in claim 6, wherein, the mark data further includes at least one of following: characterizing the clothes The sequence for device cluster quantity of generated mark data in the unit time belonging to the time for generating the mark data of being engaged in Number, characterize the distribution indicator for the interface message that the data server is called when issuing the mark acquisition request, characterization The start context of business release information corresponding to the server cluster, and/or, characterize the positive and negative symbol of the mark data Number mark.
9. according to the method described in claim 8, wherein,
The service identification includes the first quantity bit, and the time identifier includes the second quantity bit, the machine Device mark includes third quantity bit, and the sequence number includes the 4th quantity bit, and the distribution indicator includes the Five quantity bits, the start context include the 6th quantity bit, and the symbol logo compares including the 7th quantity Special position;
The mark data be the service identification, the time identifier and the machine identification according to the first predetermined order successively Splicing and constitute, alternatively, the mark data be the service identification, the time identifier, the machine identification, Yi Ji At least one in the sequence number, the distribution indicator, the start context and/or the symbol logo is predetermined according to second Sequence is successively spliced and is constituted.
10. according to the method described in claim 9, further include:
Search condition information is obtained, the search condition information includes at least one of following: business information, temporal information, calculating The identification information of node, the interface message of calculate node, and/or business release information;
For any business datum in database, the search condition is found in the corresponding mark data of the business datum The corresponding data slot of information, is converted to corresponding information for the anti-solution of the data slot found, information and institute after conversion When stating search condition information and matching, determine that the business datum meets search condition;
Filter out the business datum progress predetermined process for meeting search condition in database.
11. a kind of service data processing apparatus, the calculate node applied to server cluster, comprising:
Generation module, the mark acquisition request about specified services data for being issued in response to data server, based on pre- Set pattern then generates mark data corresponding with the specified services data, and the mark data includes: characterizing the specified services The service identification of the corresponding business information of data, characterization generate time identifier and this calculating of the time of the mark data The machine identification of node;
Sending module, for the mark data to be sent to the data server, by the data server by the mark Know in data and the corresponding deposit database of the specified services data.
12. device according to claim 11, in which:
The mark data further includes when characterizing server cluster unit belonging to the time for generating the mark data The sequence number of the quantity of interior generated mark data;
The generation module is based on pre-defined rule generation mark data corresponding with the specified services data: the generation Module, for obtaining the corresponding sequence number of current time;When the corresponding quantity of the corresponding sequence number of the current time is less than When preset threshold, using the corresponding sequence number of the current time as the sequence number of the mark data, current time pair is obtained Time identifier of the time identifier answered as the mark data;When the corresponding quantity of the sequence number is more than preset threshold, It waits the current one time to terminate, obtains time corresponding sequence number after waiting, the time corresponding sequence number after waiting When corresponding quantity is less than preset threshold, using time corresponding sequence number after the waiting as the sequence of the mark data Number, obtain time identifier of the time corresponding time identifier as the mark data after waiting.
13. device according to claim 11, wherein the mark data further includes at least one of following: described in characterization The distribution indicator for the interface message that data server is called when issuing the mark acquisition request, characterizes the server set The start context of business release information corresponding to group, and/or, characterize the positive and negative symbol logo of the mark data.
14. device described in any one of 1-13 according to claim 1, in which:
The service identification includes the first quantity bit, and the time identifier includes the second quantity bit, the machine Device mark includes third quantity bit, and the sequence number includes the 4th quantity bit, and the distribution indicator includes the Five quantity bits, the start context include the 6th quantity bit, and the symbol logo compares including the 7th quantity Special position;
The generation module is based on pre-defined rule generation mark data corresponding with the specified services data: the generation Module, for the service identification, the time identifier and the machine identification successively to be spliced structure according to the first predetermined order At the mark data;Alternatively, by the service identification, the time identifier, the machine identification and in the sequence Number, in the distribution indicator, the start context and/or the symbol logo at least one of according to the second predetermined order successively It is spliced to form the mark data.
15. device according to claim 14, in which:
The mark acquisition request includes the corresponding business information of the specified services data, and the business information includes service class Type and Asset Type;
The service identification includes the corresponding first identifier of the type of service and the corresponding second identifier of the Asset Type, institute The sum of the bit that first identifier is included and the bit that the second identifier is included are stated as first quantity.
16. a kind of service data processing apparatus is applied to data server, comprising:
First obtains module, for obtaining specified services data;
Second obtains module, sends the mark about the specified services data for any calculate node into server cluster Know acquisition request, receives the mark data that the calculate node returns, the mark data includes: characterizing the specified services number According to the service identification of corresponding business information, the time identifier of the time of the characterization generation mark data and the calculating The machine identification of node;
Processing module is stored, for will be in the corresponding deposit database of the mark data and the specified services data.
17. device according to claim 16, further includes:
Generation module, for being generated and the specified services data based on pre-defined rule when receiving mark data failure Corresponding mark data, the mark data includes: characterize the corresponding business information of the specified services data service identification, Characterization generates the time identifier of the time of the mark data and the machine identification of notebook data server.
18. device according to claim 16, wherein the mark data further includes at least one of following: described in characterization The sequence of server cluster quantity of generated mark data in the unit time belonging to the time for generating the mark data Row number characterizes the distribution indicator for the interface message that the data server is called when issuing the mark acquisition request, table The start context of business release information corresponding to the server cluster is levied, and/or, characterize the positive and negative of the mark data Symbol logo.
19. device according to claim 18, wherein
The service identification includes the first quantity bit, and the time identifier includes the second quantity bit, the machine Device mark includes third quantity bit, and the sequence number includes the 4th quantity bit, and the distribution indicator includes the Five quantity bits, the start context include the 6th quantity bit, and the symbol logo compares including the 7th quantity Special position;
The mark data be the service identification, the time identifier and the machine identification according to the first predetermined order successively Splicing and constitute, alternatively, the mark data be the service identification, the time identifier, the machine identification, Yi Ji At least one in the sequence number, the distribution indicator, the start context and/or the symbol logo is predetermined according to second Sequence is successively spliced and is constituted.
20. device according to claim 19, further includes:
Retrieval analysis module, for obtaining search condition information, the search condition information includes at least one of following: business letter Breath, temporal information, the identification information of calculate node, the interface message of calculate node, and/or business release information;For data Any business datum in library finds the corresponding number of the search condition information in the corresponding mark data of the business datum According to segment, the anti-solution of the data slot found is converted into corresponding information, information after conversion and the search condition are believed When manner of breathing matches, determine that the business datum meets search condition;Filter out the business datum for meeting search condition in database Carry out predetermined process.
21. a kind of computer equipment including memory, processor and stores the meter that can be run on a memory and on a processor Calculation machine program, the processor are realized when executing described program:
Such as business data processing method according to any one of claims 1 to 5, and/or
Business data processing method as described in any one of claim 6~10.
22. a kind of computer readable storage medium, is stored thereon with executable instruction, which makes to handle when being executed by processor Device executes:
Such as business data processing method according to any one of claims 1 to 5, and/or
Business data processing method as described in any one of claim 6~10.
CN201811078908.9A 2018-09-14 2018-09-14 Business data processing method and device Pending CN109344162A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811078908.9A CN109344162A (en) 2018-09-14 2018-09-14 Business data processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811078908.9A CN109344162A (en) 2018-09-14 2018-09-14 Business data processing method and device

Publications (1)

Publication Number Publication Date
CN109344162A true CN109344162A (en) 2019-02-15

Family

ID=65305838

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811078908.9A Pending CN109344162A (en) 2018-09-14 2018-09-14 Business data processing method and device

Country Status (1)

Country Link
CN (1) CN109344162A (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109951541A (en) * 2019-03-11 2019-06-28 中国银联股份有限公司 A kind of serial number generation method and server
CN110008269A (en) * 2019-03-26 2019-07-12 阿里巴巴集团控股有限公司 A kind of data reflow method, device, equipment and system
CN110442642A (en) * 2019-06-19 2019-11-12 北京航天智造科技发展有限公司 Data processing method, device and the storage medium of distributed data base
CN110489391A (en) * 2019-07-25 2019-11-22 深圳壹账通智能科技有限公司 A kind of data processing method and relevant device
CN110798358A (en) * 2019-11-05 2020-02-14 泰康保险集团股份有限公司 Distributed service identification method and device, computer readable medium and electronic equipment
CN110955696A (en) * 2019-11-12 2020-04-03 中国经济信息社有限公司 Data reading method, device, equipment and storage medium
CN111046057A (en) * 2019-12-26 2020-04-21 京东数字科技控股有限公司 Data processing method and device for server cluster, computer equipment and medium
CN111400322A (en) * 2020-03-25 2020-07-10 北京字节跳动网络技术有限公司 Method, apparatus, electronic device, and medium for storing data
CN111722918A (en) * 2019-03-21 2020-09-29 北京沃东天骏信息技术有限公司 Service identification code generation method and device, storage medium and electronic equipment
CN112398968A (en) * 2020-11-24 2021-02-23 天津五八到家货运服务有限公司 ID generation system and method, generation terminal, server terminal and storage medium
CN112785431A (en) * 2021-01-19 2021-05-11 北京笔新互联网科技有限公司 Distributed energy asset securitization system
CN114896331A (en) * 2022-03-15 2022-08-12 中国人寿保险股份有限公司 Database distributed method and device
CN115510815A (en) * 2022-11-17 2022-12-23 山东未来网络研究院(紫金山实验室工业互联网创新应用基地) Rule-based identification generation method and apparatus

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105812248A (en) * 2016-05-09 2016-07-27 腾讯科技(深圳)有限公司 Distribution method and device for identification value
CN106452933A (en) * 2015-08-05 2017-02-22 腾讯科技(北京)有限公司 Service data statistical method, device and system
CN106572165A (en) * 2016-10-26 2017-04-19 宜人恒业科技发展(北京)有限公司 Distributed global unique ID application method
CN107864233A (en) * 2017-11-08 2018-03-30 千寻位置网络有限公司 Globally unique ID structures and generation method
CN108108252A (en) * 2017-12-20 2018-06-01 马上消费金融股份有限公司 Global unique ID generation method, system and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106452933A (en) * 2015-08-05 2017-02-22 腾讯科技(北京)有限公司 Service data statistical method, device and system
CN105812248A (en) * 2016-05-09 2016-07-27 腾讯科技(深圳)有限公司 Distribution method and device for identification value
CN106572165A (en) * 2016-10-26 2017-04-19 宜人恒业科技发展(北京)有限公司 Distributed global unique ID application method
CN107864233A (en) * 2017-11-08 2018-03-30 千寻位置网络有限公司 Globally unique ID structures and generation method
CN108108252A (en) * 2017-12-20 2018-06-01 马上消费金融股份有限公司 Global unique ID generation method, system and storage medium

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109951541A (en) * 2019-03-11 2019-06-28 中国银联股份有限公司 A kind of serial number generation method and server
CN111722918A (en) * 2019-03-21 2020-09-29 北京沃东天骏信息技术有限公司 Service identification code generation method and device, storage medium and electronic equipment
CN110008269A (en) * 2019-03-26 2019-07-12 阿里巴巴集团控股有限公司 A kind of data reflow method, device, equipment and system
CN110442642A (en) * 2019-06-19 2019-11-12 北京航天智造科技发展有限公司 Data processing method, device and the storage medium of distributed data base
CN110442642B (en) * 2019-06-19 2021-11-23 北京航天智造科技发展有限公司 Data processing method and device for distributed database and storage medium
CN110489391B (en) * 2019-07-25 2022-06-28 深圳壹账通智能科技有限公司 Data processing method and related equipment
CN110489391A (en) * 2019-07-25 2019-11-22 深圳壹账通智能科技有限公司 A kind of data processing method and relevant device
CN110798358A (en) * 2019-11-05 2020-02-14 泰康保险集团股份有限公司 Distributed service identification method and device, computer readable medium and electronic equipment
CN110955696A (en) * 2019-11-12 2020-04-03 中国经济信息社有限公司 Data reading method, device, equipment and storage medium
CN111046057A (en) * 2019-12-26 2020-04-21 京东数字科技控股有限公司 Data processing method and device for server cluster, computer equipment and medium
CN111400322A (en) * 2020-03-25 2020-07-10 北京字节跳动网络技术有限公司 Method, apparatus, electronic device, and medium for storing data
CN111400322B (en) * 2020-03-25 2023-10-03 抖音视界有限公司 Method, apparatus, electronic device and medium for storing data
CN112398968A (en) * 2020-11-24 2021-02-23 天津五八到家货运服务有限公司 ID generation system and method, generation terminal, server terminal and storage medium
CN112785431A (en) * 2021-01-19 2021-05-11 北京笔新互联网科技有限公司 Distributed energy asset securitization system
CN114896331A (en) * 2022-03-15 2022-08-12 中国人寿保险股份有限公司 Database distributed method and device
CN115510815A (en) * 2022-11-17 2022-12-23 山东未来网络研究院(紫金山实验室工业互联网创新应用基地) Rule-based identification generation method and apparatus

Similar Documents

Publication Publication Date Title
CN109344162A (en) Business data processing method and device
CN105453040B (en) The method and system of data flow is handled in a distributed computing environment
CN108628947A (en) A kind of business rule matched processing method, device and processing equipment
CN106888254A (en) A kind of exchange method between container cloud framework based on Kubernetes and its each module
CN104317928A (en) Service ETL (extraction-transformation-loading) method and service ETL system both based on distributed database
CN109992407A (en) A kind of YARN cluster GPU resource dispatching method, device and medium
CN113282795B (en) Data structure diagram generation and updating method and device, electronic equipment and storage medium
CN103942099B (en) Executing tasks parallelly method and device based on Hive
CN109697537A (en) The method and apparatus of data audit
CN108984542A (en) Distribution type data collection method and system
CN108255607A (en) Task processing method, device, electric terminal and readable storage medium storing program for executing
CN110471754A (en) Method for exhibiting data, device, equipment and storage medium in job scheduling
CN110166507A (en) More resource regulating methods and device
CN109587997A (en) Method, electronic equipment and the computer readable storage medium of distribution server position
CN112035556A (en) Data center cabinet management method and device and electronic equipment
CN110309142A (en) The method and apparatus of regulation management
CN109784862A (en) Power equipment management system and equipment
CN109684059A (en) Method and device for monitoring data
CN110532559B (en) Rule processing method and device
CN108427709A (en) A kind of multi-source mass data processing system and method
CN113076186B (en) Task processing method, device, electronic equipment and storage medium
CN114579469A (en) Full link interface test method and device, electronic equipment and storage medium
CN106779439A (en) A kind of task distribution method and device
CN116151804A (en) Automatic operation ticket generation method, device, equipment and storage medium
CN116431668A (en) Metadata acquisition-based data blood-edge analysis method and device and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: Room 221, 2nd floor, Block C, 18 Kechuang 11th Street, Beijing Daxing District, Beijing

Applicant after: JINGDONG DIGITAL TECHNOLOGY HOLDINGS Co.,Ltd.

Address before: Room 221, 2nd floor, Block C, 18 Kechuang 11th Street, Beijing Daxing District, Beijing

Applicant before: BEIJING JINGDONG FINANCIAL TECHNOLOGY HOLDING Co.,Ltd.

CB02 Change of applicant information
CB02 Change of applicant information

Address after: Room 221, 2 / F, block C, 18 Kechuang 11th Street, Daxing District, Beijing, 100176

Applicant after: Jingdong Technology Holding Co.,Ltd.

Address before: Room 221, 2 / F, block C, 18 Kechuang 11th Street, Daxing District, Beijing, 100176

Applicant before: JINGDONG DIGITAL TECHNOLOGY HOLDINGS Co.,Ltd.

CB02 Change of applicant information
RJ01 Rejection of invention patent application after publication

Application publication date: 20190215

RJ01 Rejection of invention patent application after publication