CN109685454A - Data checking method, device, equipment and storage medium - Google Patents
Data checking method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN109685454A CN109685454A CN201811525851.2A CN201811525851A CN109685454A CN 109685454 A CN109685454 A CN 109685454A CN 201811525851 A CN201811525851 A CN 201811525851A CN 109685454 A CN109685454 A CN 109685454A
- Authority
- CN
- China
- Prior art keywords
- data
- auditing
- audit
- pending
- input rank
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 87
- 238000012550 audit Methods 0.000 claims abstract description 123
- 238000012552 review Methods 0.000 claims abstract description 72
- 230000008569 process Effects 0.000 claims description 27
- 230000002159 abnormal effect Effects 0.000 claims description 22
- 230000008859 change Effects 0.000 claims description 13
- 238000012797 qualification Methods 0.000 claims description 8
- 238000012545 processing Methods 0.000 abstract description 12
- 238000010586 diagram Methods 0.000 description 10
- 238000004891 communication Methods 0.000 description 8
- 238000003745 diagnosis Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 241001269238 Data Species 0.000 description 2
- 229940079593 drug Drugs 0.000 description 2
- 239000003814 drug Substances 0.000 description 2
- 235000013399 edible fruits Nutrition 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 238000004321 preservation Methods 0.000 description 1
- 230000000630 rising effect Effects 0.000 description 1
- 238000012954 risk control Methods 0.000 description 1
- 238000002560 therapeutic procedure Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
- G06Q10/103—Workflow collaboration or project management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/08—Insurance
Landscapes
- Business, Economics & Management (AREA)
- Engineering & Computer Science (AREA)
- Strategic Management (AREA)
- Human Resources & Organizations (AREA)
- Accounting & Taxation (AREA)
- General Physics & Mathematics (AREA)
- Economics (AREA)
- Marketing (AREA)
- Finance (AREA)
- Entrepreneurship & Innovation (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- Quality & Reliability (AREA)
- Tourism & Hospitality (AREA)
- Data Mining & Analysis (AREA)
- Operations Research (AREA)
- Development Economics (AREA)
- Technology Law (AREA)
- Medical Treatment And Welfare Office Work (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The present invention provides a kind of data checking method, device, equipment and storage medium, i.e., when receiving data audit instruction, pending Nuclear Data is obtained, and the input rank of idle state is obtained in preset message input rank cluster, as current input rank；According to the number of queues of the current input rank, the pending Nuclear Data is grouped, and the pending packet data after grouping is corresponded into distribution to the current input rank；Auditing module is preset by several, each pending packet data in the current input rank is audited parallel respectively, and each auditing result is sent to preset message output queue, with each auditing result of parallel output.The present invention adds message input rank beyond the clouds, carries out data grouping, and carries out parallel data processing by several auditing modules.The review efficiency for improving high-volume medical data solves the low technical problem of existing medical data review efficiency.
Description
Technical field
The present invention relates to technical field of data processing more particularly to a kind of data checking method, device, equipment and computers
Readable storage medium storing program for executing.
Background technique
With steeply rising for medical expense, the event that insurance fund wears bottom happens occasionally.Therefore, medical insurance is carried out
Risk control just it is aobvious it is particularly significant with it is urgent.Currently, since the portfolio of medical insurance Claims Resolution is increasing, it is therefore desirable into
The medical data of row risk audit also in high volume increases.Medical data auditing rule is according to the successive of reception medical data at present
Sequence successively carries out data audit, causes existing medical data review efficiency low.
Therefore, it is low how to solve existing medical data review efficiency, becomes a technical problem to be solved urgently.
Summary of the invention
The main purpose of the present invention is to provide a kind of data checking method, device, equipment and computer-readable storage mediums
Matter, it is intended to solve the low technical problem of existing medical data review efficiency.
To achieve the above object, the present invention provides a kind of data checking method, and the data checking method includes following step
It is rapid:
When receiving data audit instruction, pending Nuclear Data is obtained, and obtain in preset message input rank cluster
The input rank for taking idle state, as current input rank；
According to the number of queues of the current input rank, the pending Nuclear Data is grouped, and will be after grouping
Pending packet data is corresponding to distribute to the current input rank；
Preset auditing module by several, respectively to each pending packet data in the current input rank into
The parallel audit of row, and each auditing result is sent to preset message output queue, with each auditing result of parallel output.
Optionally, the number of queues according to the current input rank, the pending Nuclear Data is grouped, and
Include: by the corresponding distribution of pending packet data to the step of current input rank after grouping
According to the Data Identification of preset data type and the pending Nuclear Data, the pending Nuclear Data is classified；
The number of types of the pending Nuclear Data and the number of queues of the current input rank are obtained, judges the class
Whether type quantity matches with the number of queues；
If the number of types matches with the number of queues, by sorted pending Nuclear Data according to data type
It is grouped, and the pending packet data after grouping is distributed to corresponding current input rank.
Optionally, described to preset auditing module by several, respectively to each pending in the current input rank
Core packet data is audited parallel, and each auditing result is sent to preset message output queue, each with parallel output
The step of a auditing result includes:
According to the corresponding type of packet data of pending packet data each in the current input rank, respectively described
The auditing module of several corresponding types is obtained in default auditing module；
Respectively by the auditing module of several corresponding types, the pending packet data of each type is carried out simultaneously
Row audit, and each auditing result is sent to preset message output queue, with each auditing result of parallel output.
Optionally, described to preset auditing module by several, respectively to each pending in the current input rank
Core packet data is audited parallel, and each auditing result is sent to preset message output queue, each with parallel output
After the step of a auditing result, further includes:
When receiving data review core instruction, the change data in each pending packet data are obtained；
Several processes in corresponding auditing module are run, respectively by the change data in corresponding pending packet data
It is audited parallel；
The auditing result of each pending packet data is sent to the message output queue, and is read by asynchronous system
Auditing result data in the message output queue, with each auditing result of parallel output.
Optionally, described to preset auditing module by several, respectively to each pending in the current input rank
Core packet data is audited parallel, and each auditing result is sent to preset message output queue, each with parallel output
The step of a auditing result includes:
Preset auditing module by several, respectively to each pending packet data in the current input rank into
The parallel audit of row；
The corresponding auditing result of each pending packet data is obtained, is judged in the auditing result with the presence or absence of different
Often audit data；
The abnormal audit data if it does not exist, then be sent to preset message output queue for each auditing result, with
The each auditing result of parallel output.
Optionally, described to obtain the corresponding auditing result of each pending packet data, judge the auditing result
In with the presence or absence of abnormal audit data the step of after, further includes:
The abnormal corresponding pending packet data of data of auditing then is added to by the abnormal audit data if it exists
Preset secondary review queue；
It, will by other auditing modules to the secondary audit of the abnormal corresponding pending packet data progress of auditing result
The auditing result of secondary audit is sent to the message output queue and exports the auditing result of the secondary audit.
Optionally, the data checking method further include:
Data bulk and the audit time of each pending packet data are obtained, and according to the data bulk and audit
Time calculates the corresponding each review efficiency of each pending packet data；
Qualified review efficiency in each review efficiency is obtained, and judges whether the accounting of the qualified review efficiency reaches
To standard proportional value, wherein the qualification review efficiency is to reach the review efficiency of preset threshold；
If the accounting of the qualification review efficiency is not up to standard proportional value, the prompting that simultaneously viewing hardware need to upgrade is generated
Message, to increase auditing module quantity by increasing hardware resource.
In addition, to achieve the above object, the present invention also provides a kind of data to audit device, the data audit device packet
It includes:
When receiving data audit instruction, pending Nuclear Data is obtained, and obtain in preset message input rank cluster
The input rank for taking idle state, as current input rank；
According to the number of queues of the current input rank, the pending Nuclear Data is grouped, and will be after grouping
Pending packet data is corresponding to distribute to the current input rank；
Preset auditing module by several, respectively to each pending packet data in the current input rank into
The parallel audit of row, and each auditing result is sent to preset message output queue, with each auditing result of parallel output.
In addition, to achieve the above object, the present invention also provides a kind of data to audit equipment, the data audit equipment includes
Processor, memory and it is stored in the data review procedure that can be executed on the memory and by the processor, wherein institute
When stating data review procedure and being executed by the processor, realize such as the step of above-mentioned data checking method.
In addition, to achieve the above object, it is described computer-readable the present invention also provides a kind of computer readable storage medium
Data review procedure is stored on storage medium, wherein realizing when the data review procedure is executed by processor as above-mentioned
The step of data checking method.
The present invention provides a kind of data checking method, i.e., when receiving data audit instruction, obtains pending Nuclear Data, and
The input rank that idle state is obtained in preset message input rank cluster, as current input rank；Worked as according to described
The pending Nuclear Data is grouped by the number of queues of preceding input rank, and the pending packet data after grouping is corresponding
It distributes to the current input rank；Auditing module is preset by several, respectively to each in the current input rank
Pending packet data is audited parallel, and each auditing result is sent to preset message output queue, with parallel defeated
Each auditing result out.By the above-mentioned means, the present invention adds message input rank, then pending Nuclear Data is grouped,
And by several auditing modules, parallel processing is carried out to the pending packet data in each message input rank, is then led to
Cross presetting message output queue parallel output auditing result.By parallel data processing, examining for high-volume medical data is improved
Core efficiency solves the low technical problem of existing medical data review efficiency.
Detailed description of the invention
Fig. 1 is the hardware structural diagram that data involved in the embodiment of the present invention audit equipment；
Fig. 2 is the flow diagram of data checking method first embodiment of the present invention；
Fig. 3 is the flow diagram of data checking method second embodiment of the present invention；
Fig. 4 is the flow diagram of data checking method 3rd embodiment of the present invention；
Fig. 5 is the functional block diagram that data of the present invention audit device first embodiment.
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.
Specific embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
The present embodiments relate to data checking method be mainly used in data audit equipment, the data audit equipment can
To be the equipment with display and processing function such as PC, portable computer, mobile terminal.
Referring to Fig.1, Fig. 1 is the hardware structural diagram that data involved in the embodiment of the present invention audit equipment.This
In inventive embodiments, it may include processor 1001 (such as CPU), communication bus 1002, user interface that data, which audit equipment,
1003, network interface 1004, memory 1005.Wherein, communication bus 1002 is for realizing the connection communication between these components；
User interface 1003 may include display screen (Display), input unit such as keyboard (Keyboard)；Network interface 1004 can
Choosing may include standard wireline interface and wireless interface (such as WI-FI interface)；Memory 1005 can be high-speed RAM storage
Device, is also possible to stable memory (non-volatile memory), such as magnetic disk storage, and memory 1005 is optional
It can also be the storage device independently of aforementioned processor 1001.
It will be understood by those skilled in the art that hardware configuration shown in Fig. 1 not structure paired data audit equipment limit
It is fixed, it may include perhaps combining certain components or different component layouts than illustrating more or fewer components.
With continued reference to Fig. 1, the memory 1005 in Fig. 1 as a kind of computer readable storage medium may include operation system
System, network communication module and data review procedure.
In Fig. 1, network communication module is mainly used for connecting server, carries out data communication with server；And processor
1001 can call the data review procedure stored in memory 1005, and execute data audit side provided in an embodiment of the present invention
Method.
The embodiment of the invention provides a kind of data checking methods.
It is the flow diagram of data checking method first embodiment of the present invention referring to Fig. 2, Fig. 2.
In the present embodiment, the data checking method the following steps are included:
Step S10 obtains pending Nuclear Data, and in preset message input rank when receiving data audit instruction
The input rank that idle state is obtained in cluster, as current input rank；
In the present embodiment, in order to solve the low technical problem of existing medical data review efficiency, it is careful to provide a kind of data
Kernel method is applied to data auditing system.The data auditing system includes server and data review procedure.The data
Auditing system term audits medical audit data, which is that the insurant of medical insurance arrives in application Claims Resolution
To during the entire process of compensation, the offer mechanism of medical insurance it is collected about insurant's diagnosis and treatment process, compensate process
Related data.Wherein, pending Nuclear Data specifically include generated in insurant's therapeutic process diagnosis and treatment data (such as diagnostic result,
Medicining condition examines situation etc.) and insurant in the relevant cost data of Claims Resolution process (such as treatment settlement amounts, medication
Expense detail, social security compensate the amount of money, compensation amount of money etc.).It can specifically be obtained according to the audit project in air control auditing rule above-mentioned
Medical audit data, as pending Nuclear Data.Specifically, server constructs multiple message queues in advance and forms message queue collection
Group.Message queue cluster may particularly include input message queue cluster and output message queue cluster, input message queue cluster
For receiving original medical audit data, output message queue cluster is used to receive the auditing result of medical audit data.Its
In, redis can be used as message queue in the present embodiment, and message (is not saved in memory to message queue by persistent storage data
In, it is not persisted in the equipment such as hard disk).Server refers to receiving the data audit that user triggered by data review procedure
When enabling, the message queue being in idle condition in input message queue cluster is determined, using idle message queue as current defeated
Enqueue.
The pending Nuclear Data is grouped by step S20 according to the number of queues of the current input rank, and will
Pending packet data after grouping corresponds to distribution to the current input rank；
In the present embodiment, data grouping, i.e., the number of current input rank are carried out according to the number of queues of current input rank
It measures identical as the group number that pending Nuclear Data divides.The mode being grouped at random, such as random number, line number, modulus specifically can be used.Point
Each pending packet data after group can carry out random pair with current input rank, and each pending packet data is distinguished
It is sent to corresponding current input rank.Specific embodiment, different types of pending Nuclear Data can be corresponding with different message teams
Column, different types of message queue carry out data audit using corresponding treatment progress, to improve the efficiency of data audit.
Step S30 presets auditing module by several, respectively to each pending point in the current input rank
Group data are audited parallel, and each auditing result is sent to preset message output queue, are examined so that parallel output is each
Core result.
In the present embodiment, by each pending in the current input rank of auditing module parallel processing preset in server
Core packet data.Wherein, an auditing module includes multiple audit processes.Each process runs same data review procedure,
Data review procedure is compiled according to the audit project in air control auditing rule.It may include one or more lines in each process
Journey, each process for data audit can carry out asynchronous reading to the medical data in each pending packet data respectively,
Each current input rank can be respectively simultaneously using one or more processes to the pending packet count in the current input rank
According to being read out and audit.In order to optimize allocation of resources, the quantity of thread specifically can be according in the quantity of process and each process
Be determined according to the processing time and data volume to be treated of user demand, different types of data can run it is different into
Cheng Jinhang audit.The mode being randomly assigned is used to distribute process and its corresponding thread progress data for each current input rank
It reads and audits.The data of the number as the Thread Count distributed, multiple processes are chosen from each input message queue
It synchronizes and the pending packet data in current input rank is handled.During data audit, per thread can be pressed
It successively audits, will audit not to corresponding data is extracted according to each audit project according to the preset order in air control auditing rule
By data item generate corresponding auditing result, auditing result may particularly include the unacceptable initial data of audit, not pass through
Judgement reason, risk class etc..After determining auditing result, determine that message queue idle in output message queue cluster is made
To export message queue, auditing result is sent to any one output message queue, each thread parallel sends auditing result, line
Communication is established in the way of random fit between journey and output message queue.The server of database can be to each output message
Change data in queue are monitored, and are read the change data in output message queue and are saved.In the process of preservation
In, distributed storage can be carried out to unacceptable data are audited according to different audit projects.
Further, after the step S30, further includes:
Data bulk and the audit time of each pending packet data are obtained, and according to the data bulk and audit
Time calculates the corresponding each review efficiency of each pending packet data；
Qualified review efficiency in each review efficiency is obtained, and judges whether the accounting of the qualified review efficiency reaches
To standard proportional value, wherein the qualification review efficiency is to reach the review efficiency of preset threshold；
If the accounting of the qualification review efficiency is not up to standard proportional value, the prompting that simultaneously viewing hardware need to upgrade is generated
Message, to increase auditing module quantity by increasing hardware resource.
In the present embodiment, after default time is audited in the manner described above, the number of each pending packet data is obtained
Amount and its audit time (i.e. audit deadline), the audit of each pending packet data is calculated according to quantity and audit time
Efficiency.It determines the qualified review efficiency number for reaching standard in each review efficiency, and calculates the qualified review efficiency and account for respectively
The ratio of a review efficiency sum.Wherein, the qualified review efficiency is to reach the review efficiency of preset threshold.And in the conjunction
The accounting of lattice review efficiency be not up to standard proportional to when, i.e. current review inefficiency issues the prompt information of HardwareUpgring,
To remind user to upgrade hardware, such as increase hardware resource, the replacement higher hardware resource of processing capacity.
The present embodiment provides a kind of data checking methods, i.e., when receiving data audit instruction, obtain pending Nuclear Data,
And the input rank of idle state is obtained in preset message input rank cluster, as current input rank；According to described
The number of queues of current input rank, the pending Nuclear Data is grouped, and by the pending packet data pair after grouping
It should distribute to the current input rank；Auditing module is preset by several, respectively to each in the current input rank
A pending packet data is audited parallel, and each auditing result is sent to preset message output queue, with parallel
Export each auditing result.By the above-mentioned means, the present invention adds message input rank, then pending Nuclear Data is divided
Group, and by several auditing modules, parallel processing is carried out to the pending packet data in each message input rank, then
Pass through presetting message output queue parallel output auditing result.By parallel data processing, high-volume medical data is improved
Review efficiency solves the low technical problem of existing medical data review efficiency.
It is the flow diagram of data checking method second embodiment of the present invention referring to Fig. 3, Fig. 3.
Based on above-mentioned embodiment illustrated in fig. 2, in the present embodiment, the step S20 includes:
Step S21, according to the Data Identification of preset data type and the pending Nuclear Data, by the pending Nuclear Data into
Row classification；
In the present embodiment, different types of medical audit data can be corresponding with different message queues, different types of to disappear
It ceases queue and data audit is carried out using corresponding treatment progress, to improve the efficiency of data audit.Therefore, receive it is pending
When data, first pending Nuclear Data can be classified according to data type.I.e. by diagnostic result, medicining condition, inspection situation etc.
Data are divided into diagnosis and treatment data type, and treatment settlement amounts, drug cost detail, social security are compensated the numbers such as the amount of money, the compensation amount of money
According to being divided into cost data type etc..
Step S22 obtains the number of types of the pending Nuclear Data and the number of queues of the current input rank, sentences
Whether the number of types of breaking matches with the number of queues；
In the present embodiment, the number of types of pending Nuclear Data and the number of queues of current input rank are obtained, and by class
Type quantity is compared with the number of queues, judges whether the number of types is equal with number of queues.If currently inputting team
The number of queues of column is identical as the number of types of the pending Nuclear Data, can distribute the data of each type to each team
Column.
Step S23, if the number of types matches with the number of queues, by sorted pending Nuclear Data according to
Data type is grouped, and the pending packet data after grouping is distributed to corresponding current input rank.
In the present embodiment, if the number of queues of current input rank is identical as the number of types of the pending Nuclear Data, i.e.,
The data of each type can be distributed to each queue, different types of message queue is carried out using corresponding treatment progress
Data audit.
Further, the step S30 is specifically included:
According to the corresponding type of packet data of pending packet data each in the current input rank, respectively described
The auditing module of several corresponding types is obtained in default auditing module；
Respectively by the auditing module of several corresponding types, the pending packet data of each type is carried out simultaneously
Row audit, and each auditing result is sent to preset message output queue, with each auditing result of parallel output.
In the present embodiment, the corresponding type of packet data of each pending packet data in current input rank is determined, so
The corresponding audit data type of each auditing module in default auditing module is obtained afterwards, according to the type of packet data and audit
Data type matches each pending packet data with each auditing module.It can be corresponding by each type of message
One message queue, same type of auditing module only handle the data in a certain message queue, or only handle each message
A certain certain types of message in queue.Multiple same type auditing module examples can be performed simultaneously, and handle data to concurrency, also
Processing module example can dynamically be increased, improve system throughput.
It is the flow diagram of data checking method 3rd embodiment of the present invention referring to Fig. 4, Fig. 4.
Based on above-mentioned embodiment illustrated in fig. 3, in the present embodiment, after the step S10, further includes:
Step S41 obtains the change number in each pending packet data when receiving data review core instruction
According to；
Step S42 runs several processes in corresponding auditing module, respectively will be in corresponding pending packet data
Change data are audited parallel；
The auditing result of each pending packet data is sent to the message output queue by step S43, and by asynchronous
Mode reads the auditing result data in the message output queue, with each auditing result of parallel output.
In the present embodiment, after the completion of audit, if receive other medical datas operation triggering of user's upload again
When data review core instruction, that is, other medical datas uploaded to user is needed to audit.Other medical treatment that can will be received
Data, corresponding distribution is into each pending packet data.Each input message queue can be respectively simultaneously using one or more
Process is read out and audits to the change data in the input message queue.In order to optimize allocation of resources, the quantity of process
And the quantity of thread can specifically carry out really according to the processing time of user demand and data volume to be treated in each process
Fixed, different types of data can run different processes and be audited.Determine message team idle in output message queue cluster
Column are used as message output queue, auditing result are sent to any one output message queue, each thread parallel sends audit knot
Fruit establishes communication between thread and output message queue in the way of random fit.The server of database can disappear to each
Change data in breath output queue are monitored, and are read the change data in message output queue and are saved.It is saving
During, distributed storage can be carried out to unacceptable data are audited according to different audit projects.
Further, after the step S30, further includes:
Preset auditing module by several, respectively to each pending packet data in the current input rank into
The parallel audit of row；
The corresponding auditing result of each pending packet data is obtained, is judged in the auditing result with the presence or absence of different
Often audit data；
The abnormal audit data if it does not exist, then be sent to preset message output queue for each auditing result, with
The each auditing result of parallel output.
The abnormal corresponding pending packet data of data of auditing then is added to by the abnormal audit data if it exists
Preset secondary review queue；
It, will by other auditing modules to the secondary audit of the abnormal corresponding pending packet data progress of auditing result
The auditing result of secondary audit is sent to the message output queue and exports the auditing result of the secondary audit.
It is settable to retry queue in the present embodiment, it saves and executes abnormal data, other are audited according to policy selection is retried
Module re-executes.Each pending packet data in the current input rank is being audited by several auditing modules
Later, abnormal audit data are judged whether there is, if review process is interrupted, auditing result parameter is wrong parameter etc..It should
The corresponding pending packet data of abnormal audit data, wherein the corresponding pending packet data of audit data extremely can be with
It is specific a certain data or a plurality of data in packet data.This is audited to the corresponding pending packet data of data extremely
It is added in secondary review queue, and carry out secondary audit by auditing out the auditing module audited except data extremely.So
The auditing result of secondary audit will be sent to the message output queue afterwards and carries out parallel output.
In addition, the embodiment of the present invention also provides a kind of data audit device.
It is the functional block diagram that data of the present invention audit device first embodiment referring to Fig. 5, Fig. 5.
In the present embodiment, the data audit device includes:
Queue generation module 10, for obtaining pending Nuclear Data, and disappear preset when receiving data audit instruction
The input rank that idle state is obtained in input rank cluster is ceased, as current input rank；
Data grouping module 20, for the number of queues according to the current input rank, by the pending Nuclear Data into
Row grouping, and the pending packet data after grouping is corresponded into distribution to the current input rank；
Parallel auditing module 30, for presetting auditing module by several, respectively in the current input rank
Each pending packet data is audited parallel, and each auditing result is sent to preset message output queue, with simultaneously
Row exports each auditing result.
Further, the data audit device further include:
Data bulk and the audit time of each pending packet data are obtained, and according to the data bulk and audit
Time calculates the corresponding each review efficiency of each pending packet data；
Qualified review efficiency in each review efficiency is obtained, and judges whether the accounting of the qualified review efficiency reaches
To standard proportional value, wherein the qualification review efficiency is to reach the review efficiency of preset threshold；
If the accounting of the qualification review efficiency is not up to standard proportional value, the prompting that simultaneously viewing hardware need to upgrade is generated
Message, to increase auditing module quantity by increasing hardware resource.
Further, the data grouping module 20 includes:
Data sorting unit, for the Data Identification according to preset data type and the pending Nuclear Data, will it is described to
Audit data are classified；
Quantity judging unit, for obtaining the number of types of the pending Nuclear Data and the team of the current input rank
Number of columns, judges whether the number of types matches with the number of queues；
Data packet units will be sorted pending if matching for the number of types and the number of queues
Nuclear Data is grouped according to data type, and the pending packet data after grouping is distributed to corresponding current input team
Column.
Further, the parallel auditing module 30 includes:
Module matching unit, for according to the corresponding packet count of pending packet data each in the current input rank
According to type, the auditing module of several corresponding types is obtained in the default auditing module respectively；
Parallel audit unit, for respectively by the auditing module of several corresponding types, to each type to
Audit packet data is audited parallel, and each auditing result is sent to preset message output queue, with parallel output
Each auditing result.
Further, the data audit device further include:
Data monitoring module, for obtaining each pending packet data when receiving data review core instruction
In change data；
First auditing module, for running several processes in corresponding auditing module, respectively by corresponding pending point
Change data in group data are audited parallel；
First output module, for the auditing result of each pending packet data to be sent to the message output queue,
And the auditing result data in the message output queue are read by asynchronous system, with each auditing result of parallel output.
Further, the data audit device further include:
First auditing module, for presetting auditing module by several, respectively to each in the current input rank
A pending packet data is audited parallel；
Abnormal judgment module judges described examine for obtaining the corresponding auditing result of each pending packet data
With the presence or absence of abnormal audit data in core result；
Each auditing result is then sent to default by the second output module for the abnormal audit data if it does not exist
Message output queue, with each auditing result of parallel output.
Data adding module, for the abnormal audit data if it exists, then by the abnormal audit data it is corresponding to
Audit packet data, which is added to, presets secondary review queue；
Secondary auditing module, for passing through other auditing modules to the corresponding pending packet count of the exception auditing result
According to secondary audit is carried out, the auditing result of secondary audit is sent to the message output queue and exports the secondary audit
Auditing result.
Wherein, modules are opposite with each step in above-mentioned data checking method embodiment in above-mentioned data audit device
It answers, function and realization process no longer repeat one by one here.
In addition, the embodiment of the present invention also provides a kind of computer readable storage medium.
Data review procedure is stored on computer readable storage medium of the present invention, wherein the data review procedure is located
When managing device execution, realize such as the step of above-mentioned data checking method.
Wherein, data review procedure, which is performed realized method, can refer to each reality of data checking method of the present invention
Example is applied, details are not described herein again.
It should be noted that, in this document, the terms "include", "comprise" or its any other variant are intended to non-row
His property includes, so that the process, method, article or the system that include a series of elements not only include those elements, and
And further include other elements that are not explicitly listed, or further include for this process, method, article or system institute it is intrinsic
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including being somebody's turn to do
There is also other identical elements in the process, method of element, article or system.
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can be realized by means of software and necessary general hardware platform, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on this understanding, technical solution of the present invention substantially in other words does the prior art
The part contributed out can be embodied in the form of software products, which is stored in one as described above
In storage medium (such as ROM/RAM, magnetic disk, CD), including some instructions are used so that terminal device (it can be mobile phone,
Computer, server, air conditioner or network equipment etc.) execute method described in each embodiment of the present invention.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (10)
1. a kind of data checking method, which is characterized in that the data checking method the following steps are included:
When receiving data audit instruction, pending Nuclear Data is obtained, and sky is obtained in preset message input rank cluster
The input rank of not busy state, as current input rank；
According to the number of queues of the current input rank, the pending Nuclear Data is grouped, and will be pending after grouping
Core packet data is corresponding to distribute to the current input rank；
Auditing module is preset by several, each pending packet data in the current input rank is carried out simultaneously respectively
Row audit, and each auditing result is sent to preset message output queue, with each auditing result of parallel output.
2. data checking method as described in claim 1, which is characterized in that the queue according to the current input rank
The pending Nuclear Data is grouped by quantity, and the pending packet data after grouping is corresponded to and is distributed to described current defeated
The step of enqueue includes:
According to the Data Identification of preset data type and the pending Nuclear Data, the pending Nuclear Data is classified；
The number of types of the pending Nuclear Data and the number of queues of the current input rank are obtained, judges the number of types
Whether amount matches with the number of queues；
If the number of types matches with the number of queues, sorted pending Nuclear Data is carried out according to data type
Grouping, and the pending packet data after grouping is distributed to corresponding current input rank.
3. data checking method as claimed in claim 2, which is characterized in that it is described to preset auditing module by several, point
Other each pending packet data in the current input rank is audited parallel, and each auditing result is sent to
The step of preset message output queue, auditing result each with parallel output includes:
According to the corresponding type of packet data of pending packet data each in the current input rank, respectively described default
The auditing module of several corresponding types is obtained in auditing module；
Respectively by the auditing module of several corresponding types, the pending packet data of each type is examined parallel
Core, and each auditing result is sent to preset message output queue, with each auditing result of parallel output.
4. data checking method as described in claim 1, which is characterized in that it is described to preset auditing module by several, point
Other each pending packet data in the current input rank is audited parallel, and each auditing result is sent to
After the step of preset message output queue, auditing result each with parallel output, further includes:
When receiving data review core instruction, the change data in each pending packet data are obtained；
Several processes in corresponding auditing module are run, respectively carry out the change data in corresponding pending packet data
Parallel audit；
The auditing result of each pending packet data is sent to the message output queue, and by described in asynchronous system reading
Auditing result data in message output queue, with each auditing result of parallel output.
5. data checking method as described in claim 1, which is characterized in that it is described to preset auditing module by several, point
Other each pending packet data in the current input rank is audited parallel, and each auditing result is sent to
The step of preset message output queue, auditing result each with parallel output includes:
Auditing module is preset by several, each pending packet data in the current input rank is carried out simultaneously respectively
Row audit；
The corresponding auditing result of each pending packet data is obtained, is judged in the auditing result with the presence or absence of abnormal careful
Nuclear Data；
The abnormal audit data if it does not exist, then be sent to preset message output queue for each auditing result, with parallel
Export each auditing result.
6. data checking method as claimed in claim 5, which is characterized in that described to obtain each pending packet data
Corresponding auditing result, after the step of judging in the auditing result with the presence or absence of abnormal audit data, further includes:
The corresponding pending packet data of the exception audit data is then added to default by the abnormal audit data if it exists
Secondary review queue；
It, will be secondary by other auditing modules to the secondary audit of the abnormal corresponding pending packet data progress of auditing result
The auditing result of audit is sent to the message output queue and exports the auditing result of the secondary audit.
7. such as data checking method described in any one of claims 1 to 6, which is characterized in that the data checking method is also
Include:
Data bulk and the audit time of each pending packet data are obtained, and according to the data bulk and when auditing
Between, calculate the corresponding each review efficiency of each pending packet data；
Qualified review efficiency in each review efficiency is obtained, and judges whether the accounting of the qualified review efficiency reaches mark
Quasi- ratio value, wherein the qualification review efficiency is to reach the review efficiency of preset threshold；
If the accounting of the qualification review efficiency is not up to standard proportional value, generates the prompting that simultaneously viewing hardware need to upgrade and disappear
Breath, to increase auditing module quantity by increasing hardware resource.
8. a kind of data audit device, which is characterized in that the data audit device and include:
Queue generation module for when receiving data audit instruction, obtaining pending Nuclear Data, and is inputted in preset message
The input rank that idle state is obtained in queue cluster, as current input rank；
The pending Nuclear Data is grouped by data grouping module for the number of queues according to the current input rank,
And the pending packet data after grouping is corresponded into distribution to the current input rank；
Parallel auditing module, for by several default auditing modules, respectively in the current input rank it is each to
Audit packet data is audited parallel, and each auditing result is sent to preset message output queue, with parallel output
Each auditing result.
9. a kind of data audit equipment, which is characterized in that the data audit equipment includes processor, memory and storage
On the memory and the data review procedure that can be executed by the processor, wherein the data review procedure is by the place
When managing device and executing, the step of realizing data checking method as described in any one of claims 1 to 7.
10. a kind of computer readable storage medium, which is characterized in that be stored with data on the computer readable storage medium and examine
Core program, wherein realizing the number as described in any one of claims 1 to 7 when the data review procedure is executed by processor
The step of according to checking method.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811525851.2A CN109685454A (en) | 2018-12-13 | 2018-12-13 | Data checking method, device, equipment and storage medium |
| PCT/CN2019/095841 WO2020119115A1 (en) | 2018-12-13 | 2019-07-12 | Data verification method, device, apparatus, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811525851.2A CN109685454A (en) | 2018-12-13 | 2018-12-13 | Data checking method, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109685454A true CN109685454A (en) | 2019-04-26 |
Family
ID=66186614
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811525851.2A Pending CN109685454A (en) | 2018-12-13 | 2018-12-13 | Data checking method, device, equipment and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN109685454A (en) |
| WO (1) | WO2020119115A1 (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110610344A (en) * | 2019-07-29 | 2019-12-24 | 黑龙江金域医学检验所有限公司 | Method, device and equipment for improving auditing speed of automatic auditing system |
| CN110648054A (en) * | 2019-09-04 | 2020-01-03 | 中国建设银行股份有限公司 | Task parallel processing method and device for robot process automation |
| CN111240846A (en) * | 2020-01-15 | 2020-06-05 | 平安医疗健康管理股份有限公司 | Data auditing method and device, computer equipment and storage medium |
| WO2020119115A1 (en) * | 2018-12-13 | 2020-06-18 | 平安医疗健康管理股份有限公司 | Data verification method, device, apparatus, and storage medium |
| CN111414585A (en) * | 2020-03-26 | 2020-07-14 | 深圳前海微众银行股份有限公司 | Variable management method, device, equipment and computer readable storage medium |
| CN111628859A (en) * | 2020-06-05 | 2020-09-04 | 上海创蓝文化传播有限公司 | Method and device for auditing short message text based on distributed high concurrency condition |
| CN111639902A (en) * | 2020-04-29 | 2020-09-08 | 深圳壹账通智能科技有限公司 | Data auditing method based on kafka, control device, computer equipment and storage medium |
| CN113779472A (en) * | 2021-07-30 | 2021-12-10 | 阿里巴巴（中国）有限公司 | Content auditing method and device and electronic equipment |
| CN114255019A (en) * | 2022-03-01 | 2022-03-29 | 飞狐信息技术（天津）有限公司 | Data pushing method and device, storage medium and electronic equipment |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11922026B2 (en) | 2022-02-16 | 2024-03-05 | T-Mobile Usa, Inc. | Preventing data loss in a filesystem by creating duplicates of data in parallel, such as charging data in a wireless telecommunications network |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102158408A (en) * | 2011-04-01 | 2011-08-17 | 华为技术有限公司 | Method for processing data stream and device thereof |
| CN103078897A (en) * | 2012-11-29 | 2013-05-01 | 中山大学 | System for implementing fine grit classification and management of Web services |
| CN107784205A (en) * | 2017-10-17 | 2018-03-09 | 百度在线网络技术（北京）有限公司 | A kind of method, apparatus, server and the storage medium of consumer products examination ＆ verification |
| CN108257029A (en) * | 2017-09-13 | 2018-07-06 | 平安科技（深圳）有限公司 | Insurance data checking method, device, computer equipment and readable storage medium storing program for executing |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020176377A1 (en) * | 2001-05-22 | 2002-11-28 | Hamilton Thomas E. | Service platform on wireless network |
| CN109685454A (en) * | 2018-12-13 | 2019-04-26 | 平安医疗健康管理股份有限公司 | Data checking method, device, equipment and storage medium |
-
2018
- 2018-12-13 CN CN201811525851.2A patent/CN109685454A/en active Pending
-
2019
- 2019-07-12 WO PCT/CN2019/095841 patent/WO2020119115A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102158408A (en) * | 2011-04-01 | 2011-08-17 | 华为技术有限公司 | Method for processing data stream and device thereof |
| CN103078897A (en) * | 2012-11-29 | 2013-05-01 | 中山大学 | System for implementing fine grit classification and management of Web services |
| CN108257029A (en) * | 2017-09-13 | 2018-07-06 | 平安科技（深圳）有限公司 | Insurance data checking method, device, computer equipment and readable storage medium storing program for executing |
| CN107784205A (en) * | 2017-10-17 | 2018-03-09 | 百度在线网络技术（北京）有限公司 | A kind of method, apparatus, server and the storage medium of consumer products examination ＆ verification |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020119115A1 (en) * | 2018-12-13 | 2020-06-18 | 平安医疗健康管理股份有限公司 | Data verification method, device, apparatus, and storage medium |
| CN110610344A (en) * | 2019-07-29 | 2019-12-24 | 黑龙江金域医学检验所有限公司 | Method, device and equipment for improving auditing speed of automatic auditing system |
| CN110648054B (en) * | 2019-09-04 | 2022-05-17 | 中国建设银行股份有限公司 | Task parallel processing method and device for robot flow automation |
| CN110648054A (en) * | 2019-09-04 | 2020-01-03 | 中国建设银行股份有限公司 | Task parallel processing method and device for robot process automation |
| CN111240846A (en) * | 2020-01-15 | 2020-06-05 | 平安医疗健康管理股份有限公司 | Data auditing method and device, computer equipment and storage medium |
| CN111414585A (en) * | 2020-03-26 | 2020-07-14 | 深圳前海微众银行股份有限公司 | Variable management method, device, equipment and computer readable storage medium |
| CN111414585B (en) * | 2020-03-26 | 2023-05-05 | 深圳前海微众银行股份有限公司 | Variable management method, device, equipment and computer readable storage medium |
| CN111639902A (en) * | 2020-04-29 | 2020-09-08 | 深圳壹账通智能科技有限公司 | Data auditing method based on kafka, control device, computer equipment and storage medium |
| CN111628859B (en) * | 2020-06-05 | 2021-01-05 | 上海创蓝文化传播有限公司 | Method and device for auditing short message text based on distributed high concurrency condition |
| CN111628859A (en) * | 2020-06-05 | 2020-09-04 | 上海创蓝文化传播有限公司 | Method and device for auditing short message text based on distributed high concurrency condition |
| CN113779472A (en) * | 2021-07-30 | 2021-12-10 | 阿里巴巴（中国）有限公司 | Content auditing method and device and electronic equipment |
| CN114255019A (en) * | 2022-03-01 | 2022-03-29 | 飞狐信息技术（天津）有限公司 | Data pushing method and device, storage medium and electronic equipment |
| CN114255019B (en) * | 2022-03-01 | 2022-05-27 | 飞狐信息技术（天津）有限公司 | Data pushing method and device, storage medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2020119115A1 (en) | 2020-06-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109685454A (en) | Data checking method, device, equipment and storage medium | |
| US10558719B2 (en) | Apparatuses, methods and systems for insight discovery and presentation from structured and unstructured data | |
| US7925638B2 (en) | Quality management in a data-processing environment | |
| CN113269547B (en) | Data processing method, device, electronic equipment and storage medium | |
| CN107798461A (en) | Attend a banquet monitoring method, device, equipment and computer-readable recording medium | |
| CN109669766A (en) | Processing method, device, equipment and the storage medium of batch processing job | |
| Yan et al. | Detection of crashes and rebounds in major equity markets | |
| CN107784205B (en) | User product auditing method, device, server and storage medium | |
| CN110162458A (en) | Test data building method, device and storage medium | |
| CN109445768B (en) | Database script generation method and device, computer equipment and storage medium | |
| CN110084561A (en) | Breakpoint follow-up method, electronic device and readable storage medium storing program for executing | |
| CN109670993A (en) | Contradiction and disputes processing method and processing device | |
| JP2016099915A (en) | Server for credit examination, system for credit examination, and program for credit examination | |
| CN109828790A (en) | A kind of data processing method and system based on Shen prestige isomery many-core processor | |
| CN111581258A (en) | Safety data analysis method, device, system, equipment and storage medium | |
| US20180276685A1 (en) | Remote Supervision of Client Device Activity | |
| CN108510399B (en) | Method and device for automatically distributing insurance policy, computer equipment and storage medium | |
| CN109284975A (en) | Policy information batch modification method, apparatus, computer equipment and storage medium | |
| US8359255B2 (en) | Computer system for applying proactive referral model to long term disability claims | |
| CN107578329A (en) | Automatic account checking method and system | |
| WO2011150097A2 (en) | Identifying and using critical fields in quality management | |
| CN103326950B (en) | A kind of bank card data flow control method and system | |
| CN109818920A (en) | Mail checking method, device, computer equipment and computer readable storage medium | |
| US20160267230A1 (en) | Touchless processing | |
| CN110351330A (en) | Data uploading method, device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190426 |
|
| RJ01 | Rejection of invention patent application after publication |