CN109446167A - A kind of storage of daily record data, extracting method and device - Google Patents
A kind of storage of daily record data, extracting method and device Download PDFInfo
- Publication number
- CN109446167A CN109446167A CN201811175338.5A CN201811175338A CN109446167A CN 109446167 A CN109446167 A CN 109446167A CN 201811175338 A CN201811175338 A CN 201811175338A CN 109446167 A CN109446167 A CN 109446167A
- Authority
- CN
- China
- Prior art keywords
- log
- value
- field
- database
- daily record
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The present invention discloses a kind of storage of daily record data, extracting method and device, comprising: obtains daily record data to be stored, identifies that field and log details field extract the log identification field value and log details field value of the daily record data according to preset log；Calculate the MD5 value of the log identification field value, the unique identification as the daily record data；It inquires and whether there is the MD5 value in first database, and if it exists, then update the number of repetition of MD5 value described in the first database, and the log details field value is stored in the second database；Conversely, if it does not exist, then increasing the MD5 value and log identification field value newly in first database, and increase the MD5 value and the log details field value newly in the second database.Log field when can solve log processing by this method repeats the problem of storing, and reduces the storage resource occupancy of log, data are separately read and write using disparate databases can be improved log analysis efficiency.
Description
Technical field
The present invention relates to technical field of data processing more particularly to a kind of log storages, extracting method and device.
Background technique
As the technologies such as the construction of enterprises and institutions' internal applications system and mobile Internet, Internet of Things are in enterprise
Propulsion use, data type and data volume caused by enterprises and institutions are more and more, in fact inside enterprises and institutions caused by number
According to mostly daily record data, such as server log, network equipment log, terminal computer daily record data, daily record data
It is the significant data source realizing the monitoring of enterprises application system O&, security audit, behavioural analysis, data value and excavating, mesh
It is preceding to have there is mature ETL (Extract-Transform-Load) technology and tool to realize adopting for enterprises daily record data
Collection, search, analysis and visualization, such as Elasticsearch, LogstashKibana tool that Elastic company provides, pole
The effect of business data storage storage means and displaying is enriched greatly.
Under normal conditions, daily record data caused by enterprises and institutions inside is duplicate mostly, such as network switch device institute
The daily record data of generation, format is almost the same, the difference is that log generation time and journalizing content, if facing enterprises and institutions
The situation that internal network is huge, network flow is more, network equipment log amount is larger, the duplicate log of this majority field is not only
Server performance is wasted when collecting, storage resource is consumed in storage, processing speed can be more reduced in calculating or displaying.Its
, all there is a certain amount of repeat number in his log such as terminal computer operation log, server log, application system audit log etc.
According to.Therefore, duplicate removal processing is carried out to the log data stream acquired in real time, is that can enterprises and institutions efficiently use its own data
Important prerequisite.
Therefore, the present invention provides a kind of log storage, extracting method and device, proposes one kind to a large amount of Repeating Field logs
Optimization method of the data before storage mitigates the redundancy of daily record data, and separately reads and writes data using disparate databases, both drops
Low daily record data carrying cost, and improve daily record data analytical calculation efficiency.
Summary of the invention
The purpose of the present invention is to provide a kind of log storage, extracting method and devices, are stored and are put in storage by daily record data
Preceding duplicate removal processing and disparate databases is stored separately, and on the one hand mitigates the redundancy of daily record data, reduces carrying cost, separately
On the one hand the efficiency of daily record data extraction and analysis is improved.
Firstly, the present invention provides a kind of daily record data storage methods, comprising the following steps:
Daily record data to be stored is obtained, identifies that field and log details field extract the log according to preset log
The log identification field value and log details field value of data；
Calculate the MD5 value of the log identification field value, the unique identification as the daily record data；
It inquires and whether there is the MD5 value in first database, and if it exists, then update described in the first database
The number of repetition of MD5 value, and the log details field value is stored in the second database；
Conversely, if it does not exist, then increase the MD5 value and log identification field value newly in first database, and
Increase the MD5 value and the log details field value newly in the second database.
It further, further include configuration log identification field and log details before obtaining daily record data to be stored
Field, the log identification field are the field for referring to distinguish daily record data, including device id, IP address of equipment, equipment MAC
Address, equipment institutional affiliation, the access address URL and access target IP address；The log details field refers to needing to open up
Show the field of log details, including access level, event content and log recording time.
Further, if can be classified as to such data value there are repeated a kind of data value in daily record data
The field configuration can be at this time that log identifies field by some field.
Secondly, the present invention also provides a kind of daily record data extracting methods, comprising the following steps:
The extraction request for obtaining daily record data obtains the log identification field value for extracting request or/and log details
Field value；
Field value or/and log details field value are identified according to the log, from first database or/and the second database
The middle all logs identification field value for extracting the log or/and log details field value.
Further, according to the classification of field value in the request data, following three kinds of situations are specifically included:
If 1) only identify field comprising log in extraction request, need to only be identified according to the log value of field from
Other logs are extracted in first database identifies field value；
If 2) both comprising log identification field or include log details field in extraction request, first according to the day
The value of will identification field obtains MD5 value and all logs identification field value from first database, further according to the MD5 value from
Corresponding log details field value is extracted in second database, the field value of the acquisition is merged, and is retrieved original
Daily record data；
If 3) only include log details field in extraction request, according to the value of the log details field from second
MD5 value and all log details field values are obtained in database, are extracted from first database accordingly further according to the MD5 value
Log identify field value, the field value of the acquisition is merged, log data is retrieved.
Correspondingly, the present invention provides a kind of log data storage, described device includes:
Obtain module, for obtaining daily record data to be stored, extract the daily record data log identification field value and
Log details field value；
Computing module, for calculating the MD5 value of the log identification field value；
Enquiry module, for inquiring in first database with the presence or absence of the MD5 value；
Memory module, for storing the MD5 value, log identification field value and the log details field value.
Further, described device further includes configuration module, for configuration log identification field and log details field, is divided
It is not stored in first database and the second database.
Further, the configuration module further includes working as in daily record data there are repeated a kind of data value, then may be used
Some field is classified as to such data value, the field configuration can be also that log identifies word by the configuration module at this time
Section.
Correspondingly, present invention provides the device that a kind of daily record data extracts, described device includes:
Module is obtained, the extraction for obtaining daily record data is requested, and the log identification field extracted in request is obtained
Value or/and log details field value；
Extraction module, for according to the log identify field value or/and log details field value from first database or/
Field value or/and log details field value are identified with all logs for extracting the log in the second database.
Further, according to the classification of field value in the request data, the extraction module also specifically includes following three
Kind situation:
1) if described lift in request only comprising log identification field, the value of field need to be only identified according to the log
Other logs are extracted from first database identifies field value；
If 2) both comprising log identification field or include log details field in extraction request, first according to the day
The value of will identification field obtains MD5 value and all logs identification field value from first database, further according to the MD5 value from
Corresponding log details field value is extracted in second database, the field value of the acquisition is merged, and is retrieved original
Daily record data；
If 3) only include log details field in extraction request, according to the value of the log details field from second
MD5 value and all log details field values are obtained in database, are extracted from first database accordingly further according to the MD5 value
Log identify field value, the field value of the acquisition is merged, log data is retrieved.
Duplicate removal processing and disparate databases before being put in storage by daily record data storage are stored separately, and on the one hand mitigate log
The redundancy of data reduces carrying cost, on the other hand improves the efficiency of daily record data extraction and analysis；Furthermore it is asked according to extraction
Whether contain log details field in asking, judges whether to need to generate, returns to log data, effectively improve daily record data
Extraction efficiency.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, attached drawing used in being described below to embodiment
It is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, general for this field
For logical technical staff, under the premise of not paying creativeness, it is also possible to obtain other drawings based on these drawings.
Fig. 1 is a kind of method flow diagram of daily record data storage provided in an embodiment of the present invention；
Fig. 2 is the method flow diagram that a kind of daily record data provided in an embodiment of the present invention extracts；
Fig. 3 is a kind of apparatus structure schematic diagram of daily record data storage provided in an embodiment of the present invention；
Fig. 4 is the apparatus structure schematic diagram that a kind of daily record data provided in an embodiment of the present invention extracts.
Specific embodiment
To make the objectives, technical solutions, and advantages of the present invention clearer, below in conjunction in the embodiment of the present invention
Attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it should be pointed out that described reality
Applying example is only a part of the embodiments of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, this field
Technical staff's every other embodiment obtained without making creative work belongs to the model that the present invention protects
It encloses.
It should be noted that all statements for using " first " and " second " are for differentiation two in the embodiment of the present invention
The non-equal entity of a same names or non-equal parameter, it is seen that " first " " second " only for the convenience of statement, does not answer
It is interpreted as the restriction to the embodiment of the present invention, subsequent embodiment no longer illustrates this one by one.
Fig. 1 is a kind of method flow diagram of daily record data storage provided in an embodiment of the present invention, as described in Figure 1, the side
Method the following steps are included:
Step S101 obtains daily record data to be stored, and identifies that field and log details field mention according to preset log
The log of the daily record data is taken to identify field value and log details field value；
Step S102 calculates the MD5 value of the log identification field value, the unique identification as the daily record data；
Step S103 is inquired and be whether there is the MD5 value in first database；If it exists, then S104 is entered step；Instead
It enters step S105 if the MD5 value is not present in the first database；
Step S104, updates the number of repetition of MD5 value described in the first database, and by the log details field
Value is stored in the second database；
Step S105 increases the MD5 value and log identification field value newly in first database, and in the second number
According to increasing the MD5 value and the log details field value in library newly.
Before the above method, including configuration log identification field and log details field, the log identification field are
Refer to distinguish the field of daily record data, including device id, IP address of equipment, device mac address, equipment institutional affiliation, access
The address URL and access target IP address；The log details field refers to needing to show the field of log details, including visits
Ask classification, event content and log recording time.
The log identification field and log identification field that are respectively configured shown in following Tables 1 and 2 and its field value
Table is respectively stored in first database and the second database.The log identification field passes through with log identification field
MD5 value is associated.
1 log of table identifies field and its field value table
| MD5 value | Number of repetition | Device id | IP address of equipment | …… |
| 1001 | 2 | DESKtop_V5ERIHO | x1.x2.x3.x4 | …… |
| 1002 | 1 | DESKtop_V6ERIHO | X1.X2.X3.X4 | …… |
2 log details field of table and its field value table
| MD5 value | Access level | The log recording time | …… |
| 1001 | A | 20180904 | |
| 1001 | B | 20180903 | |
| 1002 | A | 20180903 |
In above-mentioned steps S104, if the existing log details field value in second database, described
Increase a log details field value in second database newly.
For in daily record data there are repeated a kind of data value, then some word can be classified as to such data value
The field configuration can be that the log identifies field, such as access people's information, terminal equipment configuration information, service by section at this time
Device device configuration information etc., although these fields to identification one log without key effect, equally exist a large amount of repetitions, because
This can be classified as in log identification field reducing repetition storage quantity.
In above-mentioned steps S105, the MD5 value is increased newly, the corresponding number of repetition of the MD5 value is 1 at this time.
If needing the daily record data stored next time, it is 1001 that its MD5 value, which is calculated, in daily record data identification field value,
Then explanation has existed the log identification field value of the data in first database, is only needed at this time by above-mentioned daily record data
MD5 value and log details field value according to preset log details field be added the second database in, MD5 value is at this time
1001 number of repetition will become 3.
Fig. 2 is the method flow diagram that a kind of daily record data provided in an embodiment of the present invention extracts, as described in Figure 2, the side
Method the following steps are included:
Step S201, obtain daily record data extraction request, obtain it is described extract request log identification field value or/and
Log details field value；
Whether step S202 includes log details field in the extraction request；If not including log details field, i.e. institute
It states in extraction request and only identifies field comprising log, then enter step S203；Conversely, if detailed comprising log in extraction request
Feelings field, then enter step S204；
Step S203 need to only identify that the value of field extracts other log identification fields from first database according to log
Value；
Whether step S204 comprising log identifies field in the extraction request；If in the request data including log
It identifies field, i.e., both identifies field comprising log in extractions request or include log details field, then enter step S205；
Conversely, only including log details field in that is, described extraction request, then if not including log in extraction request identifies field
Enter step S206；
Step S205 first identifies that the value of field obtains MD5 value and all days from first database according to the log
Will identifies field value, corresponding log details field value is extracted from the second database further according to the MD5 value, by the acquisition
Field value merge, retrieve log data；
Step S206 obtains MD5 value and all logs according to the value of the log details field from the second database
Details field value extracts corresponding log further according to the MD5 value from first database and identifies field value, by the acquisition
Field value merges, and retrieves log data.
Fig. 3 is a kind of apparatus structure schematic diagram of daily record data storage provided in an embodiment of the present invention, as shown, described
Device includes four modules:
Module 11 is obtained, for obtaining daily record data to be stored, extracts the log identification field value of the daily record data
With log details field value；
Computing module 12, for calculating the MD5 value of the log identification field value；
Enquiry module 13, for inquiring in first database with the presence or absence of the MD5 value；
Memory module 14, for storing the MD5 value, log identification field value and the log details field
Value.
Described device further includes configuration module, for configuration log identification field and log details field, is respectively stored in
In first database and the second database；The configuration module further includes when there are repeated a kind of data in daily record data
When value, then it can be classified as some field to such data value, the field configuration can be also day by the configuration module at this time
Will identifies field.
Fig. 4 is the apparatus structure schematic diagram that a kind of daily record data provided in an embodiment of the present invention extracts, as shown, described
Device includes:
Module 11 is obtained, the extraction for obtaining daily record data is requested, and the log identification word extracted in request is obtained
Segment value or/and log details field value；
Extraction module 15, for identifying field value or/and log details field value from first database according to the log
Or/and second extract the log in database all logs identification field value or/and log details field value.
According to the classification of field value in the request data, the extraction module also specifically includes following three kinds of situations:
If 1) in the request data only comprising log identify field, only need to according to the log identify field value from
Other logs are extracted in first database identifies field value；
If 2) both comprising log identification field or include log details field in the request data, first according to the day
The value of will identification field obtains MD5 value and all logs identification field value from first database, further according to the MD5 value from
Corresponding log details field value is extracted in second database, the field value of the acquisition is merged, and is retrieved original
Daily record data；
If 3) in the request data only include log details field, according to the value of the log details field from second
MD5 value and all log details field values are obtained in database, are extracted from first database accordingly further according to the MD5 value
Log identify field value, the field value of the acquisition is merged, log data is retrieved.
In conclusion the method and device provided through the invention, realizes data storage by dropping redundancy processing to log
Optimization, log field when solving the problems, such as log processing repeats storage, reduces the utilization ratio of storage resources of daily record data, and benefit
Read and write data separately with disparate databases to improve log analysis efficiency.
The above is preferred embodiments of the present invention, but scope of protection of the present invention is not limited thereto, any to be familiar with
In presently disclosed technical scope, modification, equivalent replacement, the improvement that can readily occur in etc. should all be contained the people of the technology
Lid is within that scope of the present invention.
Claims (10)
1. a kind of daily record data storage method, which comprises the following steps:
Daily record data to be stored is obtained, identifies that field and log details field extract the daily record data according to preset log
Log identification field value and log details field value；
Calculate the MD5 value of the log identification field value, the unique identification as the daily record data；
It inquires and whether there is the MD5 value in first database, and if it exists, then update MD5 value described in the first database
Number of repetition, and the log details field value is stored in the second database；
Conversely, if it does not exist, then the MD5 value and log identification field value are increased newly in first database, and the
Increase the MD5 value and the log details field value in two databases newly.
2. the method as described in claim 1, which is characterized in that further include configuration before obtaining daily record data to be stored
Log identifies field and log details field, and the log identification field is the field for referring to distinguish daily record data, including is set
Standby ID, IP address of equipment, device mac address, equipment institutional affiliation, the access address URL and access target IP address；The day
Will details field refers to needing to show the field of log details, including access level, event content and log recording time.
3. method according to claim 2, it is further characterized in that, if there are repeated a kind of data in daily record data
Value, then can be classified as some field to such data value, can be at this time that log identifies field by the field configuration.
4. a kind of daily record data extracting method, it is further characterized in that, comprising the following steps:
The request that daily record data extracts is obtained, the log identification field value or/and log details field for extracting request is obtained
Value；
Field value or/and log details field value are identified according to the log, are mentioned from first database or/and the second database
All logs of the log are taken to identify field value or/and log details field value.
5. method as claimed in claim 4, it is further characterized in that, according to the classification for extracting field value in request, specifically
Include the following three types situation:
If 1) only identify field comprising log in extraction request, it need to only be identified the value of field from first according to the log
Other logs are extracted in database identifies field value；
If 2) first known according to the log in extraction request both comprising log identification field or include log details field
The value of malapropism section obtains MD5 value and all logs identification field value from first database, further according to the MD5 value from second
Corresponding log details field value is extracted in database, and the field value of the acquisition is merged, original log is retrieved
Data；
If 3) only include log details field in extraction request, according to the value of the log details field from the second data
MD5 value and all log details field values are obtained in library, and corresponding day is extracted from first database further according to the MD5 value
Will identifies field value, and the field value of the acquisition is merged, log data is retrieved.
6. a kind of log data storage, which is characterized in that described device includes:
Module is obtained, for obtaining daily record data to be stored, extracts log identification field value and the log of the daily record data
Details field value；
Computing module, for calculating the MD5 value of the log identification field value；
Enquiry module, for inquiring in first database with the presence or absence of the MD5 value；
Memory module, for storing the MD5 value, log identification field value and the log details field value.
7. device as claimed in claim 6, it is further characterized in that, described device further includes configuration module, is used for configuration log
It identifies field and log details field, is respectively stored in first database and the second database.
8. device as claimed in claim 7, it is further characterized in that, the configuration module further includes existing in daily record data
Repeated one kind data value, then can be classified as some field to such data value, and the configuration module can also incite somebody to action at this time
The field configuration is that log identifies field.
9. a kind of daily record data extraction element, which is characterized in that described device includes:
Obtain module, for obtain daily record data extraction request, obtain it is described extract request in log identification field value or/
With log details field value；
Extraction module, for identifying field value or/and log details field value from first database or/and the according to the log
All logs identification field value or/and log details field value of the log are extracted in two databases.
10. device as claimed in claim 9, it is further characterized in that, it is described according to the classification for extracting field value in request
Extraction module also specifically includes following three kinds of situations:
If 1) only identify field comprising log in extraction request, it need to only be identified the value of field from first according to the log
Other logs are extracted in database identifies field value；
If 2) first known according to the log in extraction request both comprising log identification field or include log details field
The value of malapropism section obtains MD5 value and all logs identification field value from first database, further according to the MD5 value from second
Corresponding log details field value is extracted in database, and the field value of the acquisition is merged, original log is retrieved
Data；
If 3) only include log details field in extraction request, according to the value of the log details field from the second data
MD5 value and all log details field values are obtained in library, and corresponding day is extracted from first database further according to the MD5 value
Will identifies field value, and the field value of the acquisition is merged, log data is retrieved.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811175338.5A CN109446167A (en) | 2018-10-10 | 2018-10-10 | A kind of storage of daily record data, extracting method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811175338.5A CN109446167A (en) | 2018-10-10 | 2018-10-10 | A kind of storage of daily record data, extracting method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109446167A true CN109446167A (en) | 2019-03-08 |
Family
ID=65546485
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811175338.5A Pending CN109446167A (en) | 2018-10-10 | 2018-10-10 | A kind of storage of daily record data, extracting method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109446167A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110175161A (en) * | 2019-04-25 | 2019-08-27 | 平安科技（深圳）有限公司 | Method, apparatus, computer equipment and the storage medium of record log |
| CN113010484A (en) * | 2021-03-12 | 2021-06-22 | 维沃移动通信有限公司 | Log file management method and device |
| CN113051336A (en) * | 2019-12-27 | 2021-06-29 | 上海莉莉丝科技股份有限公司 | Visualized data operation method, system, device and medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102880541A (en) * | 2012-09-28 | 2013-01-16 | 用友软件股份有限公司 | Log information acquisition system and log information acquisition method |
| CN106503024A (en) * | 2015-09-08 | 2017-03-15 | 北京国双科技有限公司 | Log information processing method and device |
| CN107291881A (en) * | 2017-06-19 | 2017-10-24 | 北京计算机技术及应用研究所 | Massive logs storage and querying method based on HBase |
| CN107544894A (en) * | 2016-06-23 | 2018-01-05 | 中兴通讯股份有限公司 | The method, apparatus and server of a kind of log processing |
| US20180039646A1 (en) * | 2016-08-03 | 2018-02-08 | Samsung Electronics Co., Ltd. | Method and apparatus for storing access log based on keyword |
| AU2016346740A1 (en) * | 2015-10-27 | 2018-05-10 | A1 Media Group Co., Ltd. | Internet content providing server and computer readable recording medium embodying same method |
| CN108351827A (en) * | 2015-10-07 | 2018-07-31 | 索利通系统株式会社 | Log information generates equipment and storage medium and log information extracting device and storage medium |
| CN108563718A (en) * | 2018-04-02 | 2018-09-21 | 郑州云海信息技术有限公司 | A kind of method and system preventing log flood |
-
2018
- 2018-10-10 CN CN201811175338.5A patent/CN109446167A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102880541A (en) * | 2012-09-28 | 2013-01-16 | 用友软件股份有限公司 | Log information acquisition system and log information acquisition method |
| CN106503024A (en) * | 2015-09-08 | 2017-03-15 | 北京国双科技有限公司 | Log information processing method and device |
| CN108351827A (en) * | 2015-10-07 | 2018-07-31 | 索利通系统株式会社 | Log information generates equipment and storage medium and log information extracting device and storage medium |
| AU2016346740A1 (en) * | 2015-10-27 | 2018-05-10 | A1 Media Group Co., Ltd. | Internet content providing server and computer readable recording medium embodying same method |
| CN107544894A (en) * | 2016-06-23 | 2018-01-05 | 中兴通讯股份有限公司 | The method, apparatus and server of a kind of log processing |
| US20180039646A1 (en) * | 2016-08-03 | 2018-02-08 | Samsung Electronics Co., Ltd. | Method and apparatus for storing access log based on keyword |
| CN107291881A (en) * | 2017-06-19 | 2017-10-24 | 北京计算机技术及应用研究所 | Massive logs storage and querying method based on HBase |
| CN108563718A (en) * | 2018-04-02 | 2018-09-21 | 郑州云海信息技术有限公司 | A kind of method and system preventing log flood |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110175161A (en) * | 2019-04-25 | 2019-08-27 | 平安科技（深圳）有限公司 | Method, apparatus, computer equipment and the storage medium of record log |
| CN110175161B (en) * | 2019-04-25 | 2023-11-14 | 平安科技（深圳）有限公司 | Method, device, computer equipment and storage medium for recording log |
| CN113051336A (en) * | 2019-12-27 | 2021-06-29 | 上海莉莉丝科技股份有限公司 | Visualized data operation method, system, device and medium |
| CN113051336B (en) * | 2019-12-27 | 2023-05-26 | 上海莉莉丝科技股份有限公司 | Visual data operation method, system, equipment and medium |
| CN113010484A (en) * | 2021-03-12 | 2021-06-22 | 维沃移动通信有限公司 | Log file management method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| AU2017202873B2 (en) | Efficient query processing using histograms in a columnar database | |
| CN107315776B (en) | Data management system based on cloud computing | |
| CN103853766B (en) | A kind of on-line processing method and system towards stream data | |
| CN104933112A (en) | Distributed Internet transaction information storage and processing method | |
| JP2016532199A (en) | Generation of multi-column index of relational database by data bit interleaving for selectivity | |
| DE102013206744A1 (en) | DEDUPLICATING STORAGE WITH IMPROVED DETECTION OF COMMON STOPS | |
| CN104536965B (en) | A kind of data query display systems under the conditions of big data and method | |
| US10860562B1 (en) | Dynamic predicate indexing for data stores | |
| CN109446167A (en) | A kind of storage of daily record data, extracting method and device | |
| US20220075791A1 (en) | Storing data items and identifying stored data items | |
| CN108090165A (en) | A kind of acquisition methods of the collection of illustrative plates variation based on embedded chart database | |
| CN109241187A (en) | MongoDB log collection and analysis system based on Kafka message queue | |
| CN103455335A (en) | Multilevel classification Web implementation method | |
| CN106502875A (en) | A kind of daily record generation method and system based on cloud computing | |
| JP2021529367A (en) | Dynamic incremental update of data cube | |
| CN108416016A (en) | A kind of CDN is by prefix caching sweep-out method and system | |
| CN104022913A (en) | Test method and device for data cluster | |
| CN116661685A (en) | Hierarchical storage method and system for object storage metadata of business behavior awareness | |
| CN116611914A (en) | Salary prediction method and device based on grouping statistics | |
| CN110851758A (en) | Webpage visitor number statistical method and device | |
| CN106326400A (en) | Multi-dimension data set-based data processing system | |
| CN115292280A (en) | Cross-region data scheduling method, device, equipment and storage medium | |
| CN114860780A (en) | Data warehouse, data processing system and computer device | |
| CN112966024A (en) | Financial wind control data analysis system based on big data | |
| CN110674080A (en) | Method and system for collecting large-data-volume non-structural files based on NiFi |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20190308 |
|
| WD01 | Invention patent application deemed withdrawn after publication |