CN108959514B - Data processing method and device - Google Patents

Data processing method and device Download PDF

Info

Publication number
CN108959514B
CN108959514B CN201810685887.0A CN201810685887A CN108959514B CN 108959514 B CN108959514 B CN 108959514B CN 201810685887 A CN201810685887 A CN 201810685887A CN 108959514 B CN108959514 B CN 108959514B
Authority
CN
China
Prior art keywords
query
message
target
preset
data processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810685887.0A
Other languages
Chinese (zh)
Other versions
CN108959514A (en
Inventor
刘波
汤益嘉
田黎明
卜林杰
李虹锋
罗镭
曹志杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Construction Bank Corp
Original Assignee
China Construction Bank Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Construction Bank Corp filed Critical China Construction Bank Corp
Priority to CN201810685887.0A priority Critical patent/CN108959514B/en
Publication of CN108959514A publication Critical patent/CN108959514A/en
Application granted granted Critical
Publication of CN108959514B publication Critical patent/CN108959514B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The embodiment of the invention provides a data processing method and device, and belongs to the technical field of banking business data processing. The method comprises the steps of obtaining a query message; judging whether the query message meets a first preset rule or not; if yes, judging whether a preset field in the query message meets a preset check condition; if so, performing data cleaning on all indexes contained in the query message through a second preset rule to generate a first target message; judging whether the total number of indexes contained in the first target message is greater than a preset value or not; if not, acquiring mapping information corresponding to each index in the first target message; filtering the query conditions of all indexes in the first target message which is not matched with the mapping information to generate a second target message; constructing an empty return message, wherein the return message comprises filtered result information corresponding to all indexes; acquiring a query result based on a query condition carried by the second target message; and filling the query result into a return message to realize mass data query.

Description

Data processing method and device
Technical Field
The invention relates to the technical field of banking business data processing, in particular to a data processing method and device.
Background
At present, when a banking staff checks data such as AUM of a client, sales of a client manager, sales of a website and the like, firstly, business data generated by each business system are processed and calculated in batches, and then online transactions are respectively developed according to different checking modes. Because similar index data are complicated and diverse in statistical granularity, and different facing client groups are different, different transactions need to be developed aiming at different index data, and the processing mode brings a large amount of workload, so that the query of mass data cannot be carried out in real time. Therefore, how to solve the above technical problems is a technical problem which needs to be solved urgently.
Disclosure of Invention
The invention provides a data processing method and a data processing device, and aims to solve the problems.
The invention provides a data processing method, which comprises the following steps: acquiring a query message; judging whether the query message meets a first preset rule or not; if yes, judging whether a preset field in the query message meets a preset check condition or not; if so, performing data cleaning on all indexes contained in the query message through a second preset rule to generate a first target message; judging whether the total number of indexes contained in the first target message is greater than a preset value or not; if not, acquiring mapping information corresponding to each index in the first target message; generating a second target message by filtering query conditions of all indexes in the first target message which are not matched with the mapping information; constructing an empty return message, wherein the return message comprises filtered result information corresponding to all indexes; acquiring a query result based on the query condition carried by the second target message; and filling the query result into the return message.
Optionally, the determining whether the query packet satisfies a first preset rule includes: and judging whether the message field of the query message meets a first preset rule or not.
Optionally, the data cleaning is performed on all indexes included in the query message through a second preset rule, so as to generate a first target message, including; acquiring identification information corresponding to each index contained in the query message; and filtering the index of which the identification information is empty to generate a first target message.
Optionally, the mapping information includes address mapping information and time mapping information, and the generating a second target packet by filtering query conditions of all indicators in the first target packet that do not match with the mapping information includes: judging whether the query time and the query address of the index in the first target message are null or not based on the address mapping information and the time mapping information; and if so, filtering indexes corresponding to the query time and the query address being null to generate a second target message.
Optionally, the obtaining a query result based on the query condition carried by the second target packet includes: respectively constructing a database query instruction according to the query condition corresponding to each index in the second target message; and acquiring a query result corresponding to each database query instruction.
Optionally, after determining whether the preset field in the query message satisfies the preset check condition, the method further includes: and storing the data corresponding to the preset field into a cache.
The invention provides a data processing device, comprising: the data acquisition unit is used for acquiring the query message; the first data processing unit is used for judging whether the query message meets a first preset rule or not; the second data processing unit is used for judging whether a preset field in the query message meets a preset check condition or not if the preset field in the query message meets the preset check condition; the third data processing unit is used for carrying out data cleaning on all indexes contained in the query message through a second preset rule if the first target message is found, so as to generate a first target message; the fourth data processing unit is used for judging whether the total number of indexes contained in the first target message is greater than a preset value or not; a fifth data processing unit, configured to, if not, obtain mapping information corresponding to each index in the first target packet; a sixth data processing unit, configured to filter query conditions of all indicators in the first target packet that do not match the mapping information, to generate a second target packet; the message construction unit is used for constructing an empty return message, and the return message comprises filtered result information corresponding to all indexes; a result query unit, configured to obtain a query result based on a query condition carried by the second target packet; and the data return unit is used for filling the query result into the return message.
Optionally, the first data processing unit is specifically configured to: and judging whether the message field of the query message meets a first preset rule or not.
Optionally, the third data processing unit is specifically configured to: acquiring identification information corresponding to each index contained in the query message; and filtering the index of which the identification information is empty to generate a first target message.
Optionally, after the second data processing unit, the method further includes: and the data storage unit is used for storing the data corresponding to the preset field into a cache.
The data processing method and the data processing device provided by the invention firstly acquire the query message; judging whether the query message meets a first preset rule or not; when the query message meets a first preset rule, judging whether a preset field in the query message meets a preset check condition; when the preset field meets the preset check condition, performing data cleaning on all indexes contained in the query message through a second preset rule to generate a first target message; then judging whether the total number of indexes contained in the first target message is greater than a preset value or not; when the total number is not greater than a preset value, then acquiring mapping information corresponding to each index in the first target message; then, filtering the query conditions of all indexes in the first target message which are not matched with the mapping information to generate a second target message; then constructing an empty return message, wherein the return message comprises filtered result information corresponding to all indexes; then, acquiring a query result based on the query condition carried by the second target message; and finally, filling the query result into the return message, thereby realizing real-time query of mass data and improving the efficiency of data query and the accuracy of the query result.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.
Fig. 1 is a block diagram of an electronic device according to an embodiment of the present invention;
fig. 2 is a flowchart of a data processing method according to a first embodiment of the present invention;
fig. 3 is a functional block diagram of a data processing apparatus according to a second embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention. Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a block diagram of an electronic device according to an embodiment of the present invention. The electronic device 300 comprises a data processing apparatus 400, a memory 302, a storage controller 303, a processor 304 and a peripheral interface 305.
The memory 302, memory controller 303, processor 304 and peripheral interface 305 are electrically connected to each other, directly or indirectly, to enable data transfer or interaction. For example, the components may be electrically connected to each other via one or more communication buses or signal lines. The data processing apparatus 400 includes at least one software function module which can be stored in the memory 302 in the form of software or firmware (firmware) or solidified in an Operating System (OS) of the electronic device 300. The processor 304 is adapted to execute executable modules stored in the memory 302, such as software functional modules or computer programs comprised by the data processing apparatus 400.
The Memory 302 may be, but is not limited to, a Random Access Memory (RAM), a Read Only Memory (ROM), a Programmable Read-Only Memory (PROM), an Erasable Read-Only Memory (EPROM), an electrically Erasable Read-Only Memory (EEPROM), and the like. The memory 302 is used for storing programs, and the processor 304 executes the programs after receiving execution instructions.
The processor 304 may be an integrated circuit chip having signal processing capabilities. The Processor 304 may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; but may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components. The various methods, steps and logic blocks disclosed in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The peripheral interface 305 couples various input/output devices to the processor 304 as well as to the memory 302. In some embodiments, the peripheral interface 305, the processor 304, and the memory controller 303 may be implemented in a single chip. In other examples, they may be implemented separately from the individual chips.
Fig. 2 is a flowchart of a data processing method according to a first embodiment of the invention. The specific process shown in fig. 2 will be described in detail below.
Step S101, obtaining a query message.
The query message comprises a plurality of indexes, each index corresponds to one piece of identification information, and the identification information comprises time information and attribution information. Wherein, the time information is time type information, such as year, month, day, etc.
And the indexes are distributed and stored in different database tables according to the principle of database division and table division.
Step S102, judging whether the query message meets a first preset rule.
As an implementation manner, it is determined whether a message field of the query message satisfies a first preset rule, and if the message field of the query message includes a key field or an identification field, it is determined that the first preset rule is satisfied, otherwise, it is not satisfied. For example, the key field or the identification field may be a packet header, a packet type, a packet version, a packet length, or a packet entity, and is not limited in this respect.
And when the query message does not meet the first preset rule, judging that the query message is abnormal, and finishing the query.
Step S103, if yes, judging whether a preset field in the query message meets a preset check condition.
When the query message meets a first preset rule, determining whether a preset field in the query message meets a preset check condition, where the preset condition may be set according to actual needs, for example, when a value corresponding to the preset field in the query message is 1 or 2, it is determined that the preset check condition is met, and otherwise, it is not met.
As an implementation manner, the data corresponding to the preset field may be stored in a cache in real time, so as to solve the problems of automatic caching and automatic synchronization of hot data used by a bank system at high frequency.
And step S104, if so, performing data cleaning on all indexes contained in the query message through a second preset rule to generate a first target message.
The second preset rule is to judge whether the identification information corresponding to each index included in the query message is empty, that is, to wash out the index whose identification information is empty, and to reserve the index whose identification information is not empty.
The data cleaning is to filter the data with repeated or invalid query conditions in all indexes contained in the query message.
As an implementation manner, when a preset field in the query message meets a preset check condition, acquiring identification information corresponding to each index included in the query message; and filtering the index of which the identification information is empty to generate a first target message.
The identification information includes time information and attribution information, that is, when the time information and the attribution information are empty, the indexes corresponding to the time information and the attribution information being empty are filtered, so that the first target message is generated by the indexes which are not filtered.
In this embodiment, the first target packet may be generated by repackaging the index that is not filtered, or the first target packet may be generated by directly using the index that is not filtered in the query packet. Here, the number of the carbon atoms is not particularly limited.
Step S105, determining whether the total number of the indicators included in the first target packet is greater than a preset value.
In this embodiment, the preset value may be 5, may also be any natural number greater than 5, and may also be an integer smaller than 5. Preferably, the preset value is 5.
As an implementation manner, it is determined whether the total number of indexes included in the first target packet is greater than 5.
As another embodiment, it may be determined whether a total number of queries of an indicator included in the first target packet is greater than 360, where the total number of queries satisfies:
Figure BDA0001710954080000071
m is the total number of inquires n is the total number of indexes, C is the number of attribution information of the indexes, and Ti is the number of inquiry dates of the ith index.
And step S106, if not, acquiring mapping information corresponding to each index in the first target message.
When the total number of the indexes included in the first target packet is not greater than a preset value, obtaining mapping information corresponding to each index in the first target packet, for example, by obtaining mapping information corresponding to each index pre-stored in a cache, the mapping information includes address mapping information and time mapping information.
The address mapping information is used to obtain the storage location of the index, for example, it can be known through the address mapping information which column in which table the index is stored, and the time mapping information is used to reflect the time record of the existence of a certain index.
As an embodiment, the mapping information may be stored in a cache, so as to solve the problem of automatic caching and automatic synchronization of hot data used by a banking system at high frequency.
Step S107, filtering the query conditions of all the indicators in the first target packet that do not match the mapping information, to generate a second target packet.
Wherein, matching means that the time or address required to be queried by the query condition is the same as or equal to the mapping information.
As an implementation manner, whether the query time and the query address of the indicator in the first target message are empty is determined based on the address mapping information and the time mapping information; and if so, filtering indexes corresponding to the query time and the query address being null to generate a second target message. Specifically, the address mapping information is matched with a query address of an index in the first target message, and when the address mapping information includes the query address, that is, the address mapping information is not empty, it is determined to be matched, otherwise, it is not matched. Similarly, the time mapping information is matched with the query time of the index in the first target message, and when the query time is included in the time mapping information, that is, the time mapping information is not empty, the time mapping information is determined to be matched, otherwise, the time mapping information is not matched.
And S108, constructing an empty return message, wherein the return message comprises the result information corresponding to all the filtered indexes.
And the filtered indexes are obtained by subtracting the indexes contained in the second target message from the indexes contained in the query condition.
In this embodiment, by writing the result information corresponding to the filtered indexes into the return message, when the user receives the return message, the user can check why the indexes do not inquire the result through the return message, for example, whether the indexes do not exist, time does not exist, or attribution information does not exist and does not have a value. Thereby enabling the user to quickly ascertain the reason why no query was made. So as to save the time for processing the data which is not inquired by the user.
Step S109, obtaining a query result based on the query condition carried by the second target packet.
As an implementation manner, respectively constructing a database query instruction according to the query condition corresponding to each index in the second target message; and acquiring a query result corresponding to each database query instruction. For example, database query instructions, such as SQL query statements, are respectively constructed according to the query address in the query condition or the table in the storage database corresponding to each index. And the query result is quickly acquired by reestablishing the database query instruction.
Step S110, the query result is filled into the return message.
After the query result is filled in the return message, the return message can be encrypted and then sent to the target end. To avoid the return message being intercepted or lost and seen by other users.
As an implementation scene, when a worker inquires mass data in real time, the data processing method provided by the invention can enable the worker to directly inquire whether a repeated inquiry condition or an invalid inquiry condition exists in the sent inquiry message or not, and effectively reduce the inquiry data amount of the inquiry message through multiple data cleaning, so that the data inquiry result is obtained, the worker can quickly realize the chart display speed of the related data on an operation interface, and better user experience is brought.
Fig. 3 is a schematic functional module diagram of a data processing apparatus according to a second embodiment of the present invention. The data processing apparatus 400 includes a data acquisition unit 410, a first data processing unit 420, a second data processing unit 430, a third data processing unit 440, a fourth data processing unit 450, a fifth data processing unit 460, a sixth data processing unit 470, a message construction unit 480, a result query unit 490, and a data return unit 491.
A data obtaining unit 410, configured to obtain the query message.
The first data processing unit 420 is configured to determine whether the query packet satisfies a first preset rule.
The first data processing unit 420 is specifically configured to: and judging whether the message field of the query message meets a first preset rule or not.
And a second data processing unit 430, configured to determine whether a preset field in the query message satisfies a preset check condition if the preset field in the query message satisfies the preset check condition.
As an embodiment, after the second data processing unit 430, the method further includes: and a data storage unit.
The data storage unit is used for storing the data corresponding to the preset field into a cache.
And the third data processing unit 440 is configured to, if yes, perform data cleaning on all indexes included in the query packet according to a second preset rule, so as to generate a first target packet.
Wherein, the third data processing unit 440 is specifically configured to: acquiring identification information corresponding to each index contained in the query message; and filtering the index of which the identification information is empty to generate a first target message.
The fourth data processing unit 450 is configured to determine whether a total number of the indicators included in the first target packet is greater than a preset value.
A fifth data processing unit 460, configured to, if not, obtain mapping information corresponding to each indicator in the first target packet.
A sixth data processing unit 470, configured to generate a second target packet by filtering query conditions of all indicators in the first target packet that do not match the mapping information.
The message constructing unit 480 is configured to construct an empty return message, where the return message includes result information corresponding to all the filtered indexes.
And the result query unit 490 is configured to obtain a query result based on the query condition carried in the second target packet.
As an embodiment, the result query unit 490 is configured to respectively construct a database query instruction according to the query condition corresponding to each indicator in the second target message; and acquiring a query result corresponding to each database query instruction.
A data returning unit 491, configured to fill the query result in the return packet.
In summary, the data processing method and apparatus provided by the present invention obtain the query message first; judging whether the query message meets a first preset rule or not; when the query message meets a first preset rule, judging whether a preset field in the query message meets a preset check condition; when the preset field meets the preset check condition, performing data cleaning on all indexes contained in the query message through a second preset rule to generate a first target message; then judging whether the total number of indexes contained in the first target message is greater than a preset value or not; when the total number is not greater than a preset value, then acquiring mapping information corresponding to each index in the first target message; then, filtering the query conditions of all indexes in the first target message which are not matched with the mapping information to generate a second target message; then constructing an empty return message, wherein the return message comprises filtered result information corresponding to all indexes; then, acquiring a query result based on the query condition carried by the second target message; and finally, filling the query result into the return message, thereby realizing real-time query of mass data and improving the efficiency of data query and the accuracy of the query result.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented in other ways. The apparatus embodiments described above are merely illustrative, and for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, the functional modules in the embodiments of the present invention may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes. It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention. It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.

Claims (10)

1. A data processing method, comprising:
acquiring a query message;
judging whether the query message meets a first preset rule or not;
if yes, judging whether a preset field in the query message meets a preset check condition or not;
if so, performing data cleaning on all indexes contained in the query message through a second preset rule to generate a first target message;
judging whether the total number of indexes contained in the first target message is greater than a preset value or not;
if not, acquiring mapping information corresponding to each index in the first target message;
generating a second target message by filtering query conditions of all indexes in the first target message which are not matched with the mapping information;
constructing a return message, wherein the return message comprises result information corresponding to all filtered indexes;
acquiring a query result based on the query condition carried by the second target message;
and filling the query result into the return message.
2. The method according to claim 1, wherein said determining whether the query packet satisfies a first predetermined rule comprises:
and judging whether the message field of the query message meets a first preset rule or not.
3. The method according to claim 1, wherein the data cleaning is performed on all indexes included in the query message through a second preset rule to generate a first target message, including;
acquiring identification information corresponding to each index contained in the query message;
and filtering the index of which the identification information is empty to generate a first target message.
4. The method according to claim 1, wherein the mapping information includes address mapping information and time mapping information, and the generating a second target packet by filtering query conditions of all indicators in the first target packet that do not match the mapping information includes:
judging whether the query time and the query address of the index in the first target message are null or not based on the address mapping information and the time mapping information;
and if so, filtering indexes corresponding to the query time and the query address being null to generate a second target message.
5. The method according to claim 1, wherein the obtaining a query result based on the query condition carried by the second target packet comprises:
respectively constructing a database query instruction according to the query condition corresponding to each index in the second target message;
and acquiring a query result corresponding to each database query instruction.
6. The method of claim 1, wherein after determining whether the predetermined field in the query message satisfies a predetermined check condition, the method further comprises:
and storing the data corresponding to the preset field into a cache.
7. A data processing apparatus, comprising:
the data acquisition unit is used for acquiring the query message;
the first data processing unit is used for judging whether the query message meets a first preset rule or not;
the second data processing unit is used for judging whether a preset field in the query message meets a preset check condition or not if the preset field in the query message meets the preset check condition;
the third data processing unit is used for carrying out data cleaning on all indexes contained in the query message through a second preset rule if the first target message is found, so as to generate a first target message;
the fourth data processing unit is used for judging whether the total number of indexes contained in the first target message is greater than a preset value or not;
a fifth data processing unit, configured to, if not, obtain mapping information corresponding to each index in the first target packet;
a sixth data processing unit, configured to filter query conditions of all indicators in the first target packet that do not match the mapping information, to generate a second target packet;
the message construction unit is used for constructing a return message, and the return message comprises result information corresponding to all the filtered indexes;
a result query unit, configured to obtain a query result based on a query condition carried by the second target packet;
and the data return unit is used for filling the query result into the return message.
8. The apparatus according to claim 7, wherein the first data processing unit is specifically configured to:
and judging whether the message field of the query message meets a first preset rule or not.
9. The apparatus according to claim 7, wherein the third data processing unit is specifically configured to:
acquiring identification information corresponding to each index contained in the query message;
and filtering the index of which the identification information is empty to generate a first target message.
10. The apparatus of claim 7, wherein the second data processing unit is followed by further comprising:
and the data storage unit is used for storing the data corresponding to the preset field into a cache.
CN201810685887.0A 2018-06-27 2018-06-27 Data processing method and device Active CN108959514B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810685887.0A CN108959514B (en) 2018-06-27 2018-06-27 Data processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810685887.0A CN108959514B (en) 2018-06-27 2018-06-27 Data processing method and device

Publications (2)

Publication Number Publication Date
CN108959514A CN108959514A (en) 2018-12-07
CN108959514B true CN108959514B (en) 2021-02-26

Family

ID=64487448

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810685887.0A Active CN108959514B (en) 2018-06-27 2018-06-27 Data processing method and device

Country Status (1)

Country Link
CN (1) CN108959514B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110619083B (en) * 2019-08-19 2022-04-19 深圳市鹏海运电子数据交换有限公司 Data filtering method and device
CN113434564B (en) * 2020-03-23 2024-09-20 北京国双科技有限公司 Mysql metadata access method, device, equipment and medium
CN111881356A (en) * 2020-07-30 2020-11-03 北京奇艺世纪科技有限公司 Content recommendation method and device, electronic equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101639855A (en) * 2009-09-02 2010-02-03 华为技术有限公司 Report inquiry method and device thereof
CN102098221A (en) * 2011-01-28 2011-06-15 华为技术有限公司 Message query method and device
CN101414914B (en) * 2008-11-26 2012-01-25 北京星网锐捷网络技术有限公司 Method and apparatus for filtrating data content, finite state automata and conformation apparatus
US9280597B2 (en) * 2009-12-01 2016-03-08 Apple Inc. System and method for customizing search results from user's perspective
CN106469175A (en) * 2015-08-20 2017-03-01 互联网域名系统北京市工程研究中心有限公司 Data processing method and device
CN106713061A (en) * 2015-11-17 2017-05-24 阿里巴巴集团控股有限公司 Method, system and device for monitoring attack message

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100306214A1 (en) * 2009-05-28 2010-12-02 Microsoft Corporation Identifying modifiers in web queries over structured data

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101414914B (en) * 2008-11-26 2012-01-25 北京星网锐捷网络技术有限公司 Method and apparatus for filtrating data content, finite state automata and conformation apparatus
CN101639855A (en) * 2009-09-02 2010-02-03 华为技术有限公司 Report inquiry method and device thereof
US9280597B2 (en) * 2009-12-01 2016-03-08 Apple Inc. System and method for customizing search results from user's perspective
CN102098221A (en) * 2011-01-28 2011-06-15 华为技术有限公司 Message query method and device
CN106469175A (en) * 2015-08-20 2017-03-01 互联网域名系统北京市工程研究中心有限公司 Data processing method and device
CN106713061A (en) * 2015-11-17 2017-05-24 阿里巴巴集团控股有限公司 Method, system and device for monitoring attack message

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
Research on Data Processing of Bank Credit System;Guorong Xiao;《2012 International Conference on Communication Systems and Network Technologies》;20120517;第905-908页 *
Towards Trusted Services: Result Verification Schemes for MapReduce;Chu Huang et al;《2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)》;20120614;第41-48页 *
云数据管理系统中查询技术研究综述;史英杰 等;《计算机学报》;20130228;第36卷(第2期);第209-225页 *
基于Spark平台的电压指标管理系统的设计与实现;肖培根;《中国优秀硕士学位论文全文数据库 信息科技辑》;20180515;第2018年卷(第05期);第I138-248页 *
基于指标数据关联性的报表生成系统设计及实现;陈娜;《信息技术应用》;20140827;第2014年卷(第13期);第163-164页 *

Also Published As

Publication number Publication date
CN108959514A (en) 2018-12-07

Similar Documents

Publication Publication Date Title
CN108647357B (en) Data query method and device
CN108388604B (en) User authority data management apparatus, method and computer readable storage medium
US10120907B2 (en) Scaling event processing using distributed flows and map-reduce operations
CN110019292B (en) Data query method and device
US9846902B2 (en) Augmented aggregation of emailed product order and shipping information
CN108959514B (en) Data processing method and device
WO2012148616A1 (en) Joining tables in a mapreduce procedure
CN110704486B (en) Data processing method, device, system, storage medium and server
CN112860737B (en) Data query method and device, electronic equipment and readable storage medium
US10282353B2 (en) Proactive duplicate identification
WO2019136812A1 (en) Electronic device, data calling log generation and query method, and storage medium
US20160132496A1 (en) Data filtering
CN112597168A (en) Processing method, device and platform of multi-source customer data and storage medium
CN111639965B (en) Integral updating method and device
CN111258819A (en) Data acquisition method, device and system for MySQL database backup file
CN112420213B (en) Method for inquiring drug balance according to time
CN108595685B (en) Data processing method and device
CN110619006A (en) Statistical data management method, device, platform and storage medium based on Internet of things
WO2017095480A1 (en) Spreadsheet with unit parsing
CN113609000A (en) Test data generation method and device
CN105786990B (en) The method and device of database data storage and quick search
CN111914171A (en) Product retrieval method, device, system and storage medium
CN116842106A (en) Resource clue generation method and device
CN113609407B (en) Regional consistency verification method and device
CN106874327B (en) Counting method and device for business data

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant