CN100449543C - Method and apparatus for holding journal - Google Patents
Method and apparatus for holding journal Download PDFInfo
- Publication number
- CN100449543C CN100449543C CNB2005101033234A CN200510103323A CN100449543C CN 100449543 C CN100449543 C CN 100449543C CN B2005101033234 A CNB2005101033234 A CN B2005101033234A CN 200510103323 A CN200510103323 A CN 200510103323A CN 100449543 C CN100449543 C CN 100449543C
- Authority
- CN
- China
- Prior art keywords
- daily record
- buffer memory
- journal file
- database
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The invention is concerned with the log saving method and the equipment in order to solve problems that the log is easy to lose during the log saving process and the time of input log is long, the step: A. receives and saves the log that produces by the log producing equipment slowly; B. reads the log in the buffer, and saves it in the log file with binary system form; C. transforms the binary system form log file into text form log file, and inputs the text form log file into the database for saving. The equipment includes: the log receiving module, the log outputting module, the data transforming module, the database inputting module. The invention solves the problems of long log inputting time and little consumption of the hardware resource.
Description
Technical field
The present invention relates to daily record preservation technology, relate in particular to a kind of daily record store method and device.
Background technology
It is a kind of technology that is used for recording user in the behavior of network that daily record is preserved, and can inquire about, follow the tracks of and analyze the behavior of user in network easily after the employing daily record preservation technology.The daily record technology of preserving has all obtained using widely in network systems such as instantaneous communication system, banking system, telephone system and web station system, for example, in telephone system, log system can write down both sides' number, the zero-time of each conversation, the contents such as telephone expenses of generation; In banking system, the record of depositing and withdrawing of log system meeting recording user; In web station system, log system can write down the Visitor Logs of website; In instantaneous communication system, even log system can write down the login record of communication software etc.
Figure 1 shows that the structural representation of log system, as seen from the figure, log system mainly comprises daily record generation device and daily record save set, wherein the daily record generation device is used to produce daily record, can be the terminal (as ATM) of managing business, also can be the background server (as telephone exchange, accounting server etc.) of managing business; The daily record save set is used to receive the daily record of daily record generation device generation and it is preserved, and daily record can be preserved hereof, also can be kept in the database, and wherein the latter becomes main flow because of its ease of manageability.
In the log system of prior art, the daily record save set can be arranged in the daily record generation device, also can be independent of the daily record generation device as an independent functional entity, is illustrated respectively below:
It promptly is that daily record with the daily record generation device produces directly is kept in the local disk that the daily record save set is arranged in the daily record generation device, for example, common system of portal website is made up of one or more Website servers, and these Website servers are exactly the daily record generation device.When a user capture website, Website server directly is kept at local disk to user's access log record (as time, IP etc.), regularly gathers these log informations later on again.It is this that the daily record save set is arranged on the realization of the daily record preserving type in the daily record generation device is simple, not be used in the special daily record transmission/receiving network protocol of design between daily record generation device and the daily record save set, but its shortcoming also clearly, because the main mission of daily record generation device is the service request of response and process user, the traffic handing capacity that operation (normally very slow disk operating) can influence the daily record generation device is greatly preserved in frequent daily record.Therefore, thisly the daily record save set is arranged on daily record preserving type in the daily record generation device only to be fit to the daily record amount less, perhaps only need the applied environment of sample note partial log.
Figure 2 shows that the structural representation of the log system that the daily record save set independently is set, as seen from the figure, daily record generation device and daily record save set are independent function entity separately, connect by the particular network port between daily record generation device and the daily record save set, a daily record save set is corresponding with a plurality of daily record generation devices, can preserve the daily record that a plurality of daily record generation devices produce.Need to preestablish daily record transmission/receiving network protocol between daily record generation device and the daily record save set, the daily record generation device is responsible for daily record is sent to daily record save set particular network port, the daily record save set is responsible for monitoring the particular network port, in case have daily record to arrive, just daily record received and it is saved in disk.
Daily record receiver module in the daily record save set is saved in daily record the mode master of disk with there being three kinds, and first kind of mode is that daily record directly is inserted into database, because many one deck database manipulations, so it is slower to preserve velocity ratio; The second way is that daily record directly is saved in file, and it is fast that first kind of mode of the preservation velocity ratio of this mode wanted, but the daily record of document form is inconvenient to gather and inquire about; The third mode is earlier daily record to be saved in file, reads file content again, a delegation ground of daily record or a multirow be inserted in the database, the method for operating of a multirow can improve the database insertion speed greatly.No matter take any in above-mentioned three kinds of preserving types, all face an important problem, because the speed that the speed of magnetic disc i/o (Input/Output, I/O) is unable to catch up with network I/O, therefore under the very big situation of daily record amount, can cause daily record to have little time to write disk and lose.
Usually adopt the mode of daily record save set cluster to solve that magnetic disc i/o is unable to catch up with network I/O in the prior art and the problem of losing daily record, Figure 3 shows that the structural representation of the log system that adopts concentrating type daily record save set, as seen from the figure, a plurality of daily record save sets are formed a cluster, each daily record save set in the cluster is corresponding with one group of daily record generation device, daily record generation device on the same group is not dealt into corresponding daily record save set to daily record, thereby has alleviated the burden of single daily record save set.The advantage of this mode is parallelly to expand, as long as increase the daily record save set of sufficient amount, just can solve the problem that daily record is lost.But the cost of log system also can improve greatly when increasing the daily record save set, and since the daily record distributed and saved in different daily record save sets, be inconvenient to carry out gathering of daily record and inquire about.
Summary of the invention
The invention provides a kind of daily record store method and device, prior art daily record in carrying out daily record preservation process is lost easily in order to solve, long problem consuming time is put in daily record in storage.
The inventive method comprises:
A kind of daily record store method, described daily record is produced by the daily record generation device, comprises step:
Receive the also daily record of log cache generation device generation;
Read the whole daily records in the buffer memory, adopt the mode write in batches in its disposable journal file that is kept at the binary mode on the disk;
The journal file of described binary mode is converted to the journal file of textual form, the journal file of text form is imported in the database preserve.
Every interval schedule time is read buffer memory one time, and the daily record of preserving in the buffer memory is all read.
When the shared storage space of the daily record of preserving in the buffer memory reaches predetermined value, read one time buffer memory, the daily record of preserving in the buffer memory is all read.
Preserved in the journal file of each binary mode and set whole daily records of from buffer memory, reading in the duration.
Preserved the daily record of from buffer memory, reading of setting quantity in the journal file of each binary mode.
Calling the database physical layer interface imports the journal file of textual form in the database in batches.
A kind of daily record save set is used to preserve the daily record that the daily record generation device produces, and comprising:
The daily record receiver module is used to receive the daily record that the daily record generation device produces, and it is kept in the buffer memory;
Module is derived in daily record, and the whole daily records that are used for reading buffer memory adopt the mode write in batches with in its disposable journal file that is kept at the binary mode on the disk;
Data conversion module is used for the journal file of binary mode is converted to the journal file of textual form;
Database imports module, is used for the journal file importing database of textual form is preserved.
Described buffer memory is arranged in the daily record receiver module, perhaps is the module of the independent setting in the described device.
Described daily record receiver module receives the daily record that the daily record generation device produces in real time.
Described daily record is derived module every interval schedule time and is read buffer memory one time, and the daily record of preserving in the buffer memory is all read.
The storage space that the daily record that described daily record derivation module is preserved in buffer memory takies reads buffer memory one time when reaching predetermined value, and the daily record of preserving in the buffer memory is all read.
Described database importing module invokes database physical layer interface imports the journal file of textual form in the database in batches.
Beneficial effect of the present invention is as follows:
The present invention adopts caching technology that buffer memory is carried out in the daily record that the daily record generation device that receives produces, adopt the mode of writing in batches once the daily record of reading from buffer memory all to be write in the journal file of the binary mode on the disk, after the journal file of binary mode was converted to the journal file of textual form, the batch import tool that utilizes database imported the journal file of text form in the database in batches and preserves.Because the access speed of buffer memory is far longer than network speed, therefore can guarantee can not lose the daily record that the daily record generation device produces, adopt the mode of writing in batches once the daily record of reading from buffer memory all to be write in the journal file of the binary mode on the disk, can guarantee the maximal rate that disk writes, avoid because problem is lost in the daily record that disk speed causes; The batch import tool that utilizes database imports the journal file of textual form in batches and preserves in the database time that can shorten the daily record warehouse-in, and the present invention has solved the long problem of daily record entry time fully, and hardware resource consumption seldom.
Description of drawings
Fig. 1 is the structural representation of log system;
Fig. 2 is for independently being provided with the structural representation of the log system of daily record save set;
Fig. 3 is the structural representation of the log system of employing concentrating type daily record save set;
Fig. 4 is the structural representation of daily record save set of the present invention;
Fig. 5 is the process flow diagram that daily record of the present invention is preserved.
Embodiment
The present invention is directed to the defective of prior art, propose a kind of daily record store method and device that is applicable under the very big situation of daily record amount, main realization principle of the present invention and embodiment thereof are explained in detail below in conjunction with each accompanying drawing.
Figure 4 shows that the structural representation of daily record save set of the present invention, as seen from the figure, the structure of daily record save set of the present invention mainly comprises:
The daily record receiver module receives the daily record that the daily record generation device produces, and it is kept in the buffer memory;
Module is derived in daily record, reads the daily record in the buffer memory, and it is kept in the journal file of the binary mode on the disk;
Data conversion module is with the conversion of the journal file of the binary mode on the disk and save as the journal file of textual form;
Database imports module, the journal file of textual form is imported in the database of disk to preserve.
Above-mentioned buffer memory promptly can be arranged in the daily record receiver module, also can be provided with separately, as the standalone module in the daily record save set.
Figure 5 shows that the process flow diagram that daily record of the present invention is preserved, referring to Fig. 5 and in conjunction with Fig. 4, the main implementation procedure that daily record of the present invention is preserved is as follows:
Specific network ports between step S10, daily record receiver module real-time listening daily record generation device and the daily record save set receives the daily record that the daily record generation device sends over.
Step S11, daily record receiver module are saved in the daily record that receives in the one block cache district, because the access speed of internal memory is far longer than network speed, therefore can guarantee can not lose daily record;
Buffer area is realized with " shared drive " technology, buffer area is a ring on data structure, the size of supposing buffer area is the K byte, the current head of buffer area is the H byte, afterbody is the T byte, and the daily record receiver module is always write the daily record that receives the afterbody of buffer area, promptly writes since (T+1) %K byte, wherein, % represents the numerical value of bracket the inside is got surplus operation.That is to say that if T+1=K, the 0th byte from buffer area begins to write so, so just realized the ring-type buffer area;
In general, the form of daily record all is relatively more fixing, when design, be usually designed to the binary data (each bar daily record takies the storage space of identical size) of fixed length, therefore, the content of buffer area is a binary data, this mainly is because binary data is saved storage space than the text data of expression identical content, can reduce the requirement to buffer size.Such as, telephone number 88888888, if represent, need 8 bytes, and when representing with binary data, its data mode is 00000101010011000101011000111000, only needs 4 bytes with text data.
Step S12, daily record derivation module begin to read daily record from the head of buffer area, and it is write in the journal file of the binary mode in the disk;
The storage space that daily record derivation module every interval schedule time or the daily record of preserving in buffer memory take reads one time buffer area when reaching predetermined value, the daily record of preserving in the buffer area is all read, daily record is derived module and has been adopted the mode of writing in batches once the daily record of reading from buffer area all to be write in the journal file of the binary mode on the disk, writing technology can guarantee the maximal rate that disk writes in batches, has avoided because problem is lost in the daily record that disk speed causes.
The preserving type of the journal file of binary mode mainly contains two kinds, a kind of mode is to preserve in the journal file of each binary mode to set whole daily records of reading in the duration (as 24 hours) from buffer memory, promptly sets the journal file that whole daily records of reading from buffer memory in the duration form a binary mode; Preserve the daily record of from buffer memory, reading of setting quantity (as 1,000 ten thousand) in the journal file that another kind of mode is each binary mode, promptly set the journal file that quantity promptly forms a binary mode from buffer memory whenever the daily record of reading reaches.
The size of supposing buffer area is the K byte, and current head is the H byte, and afterbody is the T byte, and the content that needs so to derive is:
1) if H＜=T, the content that need to derive is [H, T];
2) if H＞T, the content that needs so to derive is [H, K-1] and [0, T].
Daily record is derived module and can be realized easily writing in batches with the fwrite () function of standard C function library, for example, fwrite (pszBuffer, iLogLen, iLogCount, pfOutputFile), expression is write the content of buffer area pszBuffe among the file pfOutputFile, write the daily record of iLogCount bar, every daily record iLogLen byte.
Step S13, data conversion module are changed the journal file of the binary mode on the disk and save as the journal file of textual form;
Daily record is kept in the binary file, be inconvenient to do various inquiries, tracking and analysis, we need be put into them in the database, with convenient inquiry, most of database product (as Oracle, DB2, SQLServer, MySQL etc.) all provides the instrument that imports in batches, but these database products can only import text in batches, therefore, need data conversion module the journal file of binary mode to be changed and saved as the journal file of the textual form that meets database importing call format.
For example, for forum's login daily record: user ID (integer), login time (integer), login IP (integer)
The log content of its binary mode is:
00000101010011000101011000111000
01000011000011001000111001101011
11001010100001000010001000100111
The log content of the textual form after its conversion is:
88888888，2005-08-2423:12:43，202.132.34.39
Step S14, database import in the database of module with the journal file importing disk of textual form and preserve;
The present invention is mainly used in the very big applied environment of daily record amount, and as 1,000,000,000 of every days, if insert a large amount of daily record datas with the Insert statement of database, entry time can be very long, needs about 10 hours approximately.The instant inserted mode of using " once inserting multirow " also needs about 5 hours.Inserting slow reason is that database needs frequently the table that is inserted into to be locked/unlocking operation, need do searching/batch operation of list file space continually.
Most of database product (as Oracle, DB2, SQL Server MySQL) provides the instrument that imports in batches, as the Load Data In file statement of MySQL, the Bulk Insert statement of SQL Server etc.;
For example, the statement of the batch of MySQL importing is: Load Data infile '/tmp/source.txt ' intotable TargetTableName fields terminated by ', ';
The statement that the batch of SQL Server imports is: Bulk insert TargetTableName from "/tmp/source.txt " with (FIELDTERMINATOR=', ');
In the present invention, database imports interface or the SQL statement that the module invokes database provides, as above-mentioned Load Data Infile statement or Bulk Insert...From statement, use the batch lead-in mode that the journal file of textual form is imported in the database, because this mode is directly called the database physical layer interface database is carried out write operation, therefore the boot speed of this mode is than Insert statement fast 10～1000 times, and 1,000,000,000 daily records only just can all be put in storage with about 30 minutes.
The present invention adopts caching technology, batch writing technology and imports the preservation that database technology is carried out daily record in batches, solved the long problem of daily record entry time, avoided fully because disk speed is lost less than the daily record that network speed causes, and hardware resource consumption seldom.
Obviously, those skilled in the art can carry out various changes and modification to the present invention and not break away from the spirit and scope of the present invention.Like this, if of the present invention these are revised and modification belongs within the scope of claim of the present invention and equivalent technologies thereof, then the present invention also is intended to comprise these changes and modification interior.
Claims (12)
1, a kind of daily record store method, described daily record is produced by the daily record generation device, it is characterized in that, comprises step:
Receive the also daily record of log cache generation device generation;
Read the whole daily records in the buffer memory, adopt the mode write in batches in its disposable journal file that is kept at the binary mode on the disk;
The journal file of described binary mode is converted to the journal file of textual form, the journal file of text form is imported in the database preserve.
2, daily record store method according to claim 1 is characterized in that, every interval schedule time is read buffer memory one time, and the daily record of preserving in the buffer memory is all read.
3, daily record store method according to claim 1 is characterized in that, reads one time buffer memory when the shared storage space of the daily record of preserving in the buffer memory reaches predetermined value, and the daily record of preserving in the buffer memory is all read.
4, daily record store method according to claim 1 and 2 is characterized in that, has preserved in the journal file of each binary mode and set whole daily records of reading in the duration from buffer memory.
5, according to claim 1 or 3 described daily record store methods, it is characterized in that, preserved the daily record of from buffer memory, reading of setting quantity in the journal file of each binary mode.
6, daily record store method according to claim 1 is characterized in that, calls the database physical layer interface journal file of textual form is imported in the database in batches.
7, a kind of daily record save set is used to preserve the daily record that the daily record generation device produces, and it is characterized in that, comprising:
The daily record receiver module is used to receive the daily record that the daily record generation device produces, and it is kept in the buffer memory;
Module is derived in daily record, and the whole daily records that are used for reading buffer memory adopt the mode write in batches with in its disposable journal file that is kept at the binary mode on the disk;
Data conversion module is used for the journal file of binary mode is converted to the journal file of textual form;
Database imports module, is used for the journal file importing database of textual form is preserved.
8, daily record save set according to claim 7 is characterized in that, described buffer memory is arranged in the daily record receiver module, perhaps is the module of the independent setting in the described device.
9, daily record save set according to claim 7 is characterized in that, described daily record receiver module receives the daily record that the daily record generation device produces in real time.
10, daily record save set according to claim 7 is characterized in that, described daily record is derived module every interval schedule time and read buffer memory one time, and the daily record of preserving in the buffer memory is all read.
11, daily record save set according to claim 7 is characterized in that, the storage space that the daily record that described daily record derivation module is preserved in buffer memory takies reads buffer memory one time when reaching predetermined value, and the daily record of preserving in the buffer memory is all read.
12, daily record save set according to claim 7 is characterized in that, described database importing module invokes database physical layer interface imports the journal file of textual form in the database in batches.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2005101033234A CN100449543C (en) | 2005-09-16 | 2005-09-16 | Method and apparatus for holding journal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2005101033234A CN100449543C (en) | 2005-09-16 | 2005-09-16 | Method and apparatus for holding journal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1932812A CN1932812A (en) | 2007-03-21 |
| CN100449543C true CN100449543C (en) | 2009-01-07 |
Family
ID=37878647
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2005101033234A Active CN100449543C (en) | 2005-09-16 | 2005-09-16 | Method and apparatus for holding journal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100449543C (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103186475A (en) * | 2011-12-29 | 2013-07-03 | 深圳市快播科技有限公司 | Receiving and storage method and system for mass data |
| CN101788948B (en) * | 2010-02-05 | 2013-08-21 | 瑞斯康达科技发展股份有限公司 | Dynamic storage system of journal information and method |
Families Citing this family (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101388790B (en) * | 2007-09-14 | 2010-12-08 | 中兴通讯股份有限公司 | Method for importing radio network performance data |
| CN101267338B (en) * | 2008-04-23 | 2010-10-13 | 杭州思福迪信息技术有限公司 | High-performance log and behavior auditing system |
| CN101321089B (en) * | 2008-07-07 | 2011-04-20 | 中兴通讯股份有限公司 | Warehouse entry method of performance data in telecommunication network management system |
| CN102195795B (en) * | 2010-03-19 | 2014-03-12 | Tcl集团股份有限公司 | Intelligent district log system and log recording method thereof |
| CN101969386A (en) * | 2010-11-09 | 2011-02-09 | 道有道(北京)科技有限公司 | Log acquisition device and log acquisition method |
| CN102118268A (en) * | 2011-02-18 | 2011-07-06 | 中兴通讯股份有限公司 | Telephone traffic data storage method and system |
| CN102110167B (en) * | 2011-03-01 | 2013-07-31 | 上海维宏电子科技股份有限公司 | Method for implementing log information management in numerical control system |
| CN103176888B (en) * | 2011-12-22 | 2018-01-23 | 阿里巴巴集团控股有限公司 | A kind of method and system of log recording |
| CN103309767B (en) * | 2012-03-08 | 2016-01-13 | 阿里巴巴集团控股有限公司 | A kind of client log disposal route and device |
| CN103064779B (en) * | 2012-12-26 | 2016-08-03 | 北京思特奇信息技术股份有限公司 | A kind of method of quick process log information |
| CN104301360B (en) * | 2013-07-19 | 2019-03-12 | 阿里巴巴集团控股有限公司 | A kind of method of logdata record, log server and system |
| CN103475519B (en) * | 2013-09-09 | 2016-09-14 | 北京思特奇信息技术股份有限公司 | The log recording method of a kind of big data quantity and device |
| CN103532943A (en) * | 2013-10-08 | 2014-01-22 | 北京神州绿盟信息安全科技股份有限公司 | Web application firewall device and asynchronous security protection log processing method |
| CN103593440B (en) * | 2013-11-15 | 2017-10-27 | 北京国双科技有限公司 | The reading/writing method and device of journal file |
| CN104657366B (en) * | 2013-11-18 | 2019-05-24 | 深圳市腾讯计算机系统有限公司 | The method, apparatus and log disaster tolerance system of massive logs write-in database |
| CN106161074A (en) * | 2015-04-21 | 2016-11-23 | 中兴通讯股份有限公司 | A kind of cloud terminal log processing method, Apparatus and system |
| CN105045839B (en) * | 2015-06-30 | 2018-09-04 | 上海瀚之友信息技术服务有限公司 | A kind of batch data operating method |
| CN105022822A (en) * | 2015-07-17 | 2015-11-04 | 成都视达科信息技术有限公司 | PHP (Professional Hypertext Preprocessor) based log collection and storage method and system |
| CN105430534B (en) * | 2015-10-29 | 2019-12-10 | Tcl集团股份有限公司 | method and system for reporting data by intelligent equipment |
| CN105404472A (en) * | 2015-11-23 | 2016-03-16 | 天脉聚源(北京)传媒科技有限公司 | Method and apparatus for compressing storage space of log time data |
| CN106874160B (en) * | 2017-01-23 | 2021-10-01 | 深圳市元宇宙科技有限公司 | Log server and management method thereof |
| CN107895039B (en) * | 2017-11-29 | 2020-11-24 | 华中科技大学 | Method for constructing log database of campus network authentication system |
| CN110716695A (en) * | 2019-09-12 | 2020-01-21 | 北京浪潮数据技术有限公司 | Node log storage method and system, electronic device and storage medium |
| CN113703665A (en) * | 2021-07-12 | 2021-11-26 | 深圳市有为信息技术发展有限公司 | Method and device for reducing loss of control terminal data after gateway breakdown and electronic equipment |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5499367A (en) * | 1991-11-15 | 1996-03-12 | Oracle Corporation | System for database integrity with multiple logs assigned to client subsets |
| CN1394034A (en) * | 2001-06-21 | 2003-01-29 | 华为技术有限公司 | Journal management system of integrated network manager |
| WO2004012085A1 (en) * | 2002-07-25 | 2004-02-05 | Sanyo Electric Co., Ltd. | Data storage device capable of storing multiple SETS of history information on input/output processing of security data without duplication |
| CN1477822A (en) * | 2003-07-31 | 2004-02-25 | 北京港湾网络有限公司 | Extension storage method of journal information |
| US20040193654A1 (en) * | 2003-03-31 | 2004-09-30 | Nitzan Peleg | Logical range logging |
| CN1535434A (en) * | 2001-03-09 | 2004-10-06 | ���Ĺ��ʹ�˾ | System and method for maintaining large-grained database concurrency with log monitor incorporating dynamically redefinable business logic |
| CN1564138A (en) * | 2004-03-26 | 2005-01-12 | 清华大学 | Fast synchronous and high performance journal device and synchronous writing operation method |
| CN1592233A (en) * | 2003-08-30 | 2005-03-09 | 华为技术有限公司 | Safety journal realizing method |
| CN1633080A (en) * | 2003-12-24 | 2005-06-29 | 华为技术有限公司 | Method for implementing log in network management system |
| CN1635520A (en) * | 2003-12-27 | 2005-07-06 | 鸿富锦精密工业（深圳）有限公司 | Data processing system and method |
-
2005
- 2005-09-16 CN CNB2005101033234A patent/CN100449543C/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5499367A (en) * | 1991-11-15 | 1996-03-12 | Oracle Corporation | System for database integrity with multiple logs assigned to client subsets |
| CN1535434A (en) * | 2001-03-09 | 2004-10-06 | ���Ĺ��ʹ�˾ | System and method for maintaining large-grained database concurrency with log monitor incorporating dynamically redefinable business logic |
| CN1394034A (en) * | 2001-06-21 | 2003-01-29 | 华为技术有限公司 | Journal management system of integrated network manager |
| WO2004012085A1 (en) * | 2002-07-25 | 2004-02-05 | Sanyo Electric Co., Ltd. | Data storage device capable of storing multiple SETS of history information on input/output processing of security data without duplication |
| US20040193654A1 (en) * | 2003-03-31 | 2004-09-30 | Nitzan Peleg | Logical range logging |
| CN1477822A (en) * | 2003-07-31 | 2004-02-25 | 北京港湾网络有限公司 | Extension storage method of journal information |
| CN1592233A (en) * | 2003-08-30 | 2005-03-09 | 华为技术有限公司 | Safety journal realizing method |
| CN1633080A (en) * | 2003-12-24 | 2005-06-29 | 华为技术有限公司 | Method for implementing log in network management system |
| CN1635520A (en) * | 2003-12-27 | 2005-07-06 | 鸿富锦精密工业（深圳）有限公司 | Data processing system and method |
| CN1564138A (en) * | 2004-03-26 | 2005-01-12 | 清华大学 | Fast synchronous and high performance journal device and synchronous writing operation method |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101788948B (en) * | 2010-02-05 | 2013-08-21 | 瑞斯康达科技发展股份有限公司 | Dynamic storage system of journal information and method |
| CN103186475A (en) * | 2011-12-29 | 2013-07-03 | 深圳市快播科技有限公司 | Receiving and storage method and system for mass data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1932812A (en) | 2007-03-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100449543C (en) | Method and apparatus for holding journal | |
| CN105138592B (en) | A kind of daily record data storage and search method based on distributed structure/architecture | |
| CN107479829A (en) | A kind of Redis cluster mass datas based on message queue quickly clear up system and method | |
| CN103607476B (en) | System and method for distributed multi-stage persistence of huge number of messages | |
| CN105099740A (en) | Log management system and log collection method | |
| CN106933724A (en) | A kind of distributed information tracing system, information processing method and device | |
| CN101557427A (en) | Method for providing diffluent information and realizing the diffluence of clients, system and server thereof | |
| CN106951552A (en) | A kind of user behavior data processing method based on Hadoop | |
| CN104657366A (en) | Method and device for writing mass logs in database and log disaster-tolerant system | |
| CN101997714A (en) | Time processing method, device and system | |
| CN104657435A (en) | Storage management method for application data and network management system | |
| CN113282611B (en) | Method, device, computer equipment and storage medium for synchronizing stream data | |
| CN104794190A (en) | Method and device for effectively storing big data | |
| CN115292414A (en) | Method for synchronizing service data to data bins | |
| CN105610917A (en) | Method and system for achieving repair of synchronous data in system | |
| CN114579532A (en) | Method, device and system for processing pre-written log | |
| CN106301972A (en) | A kind of monitoring data push away method and system in real time | |
| CN109582659A (en) | Request recording method, system, device and the readable storage medium storing program for executing of processing links | |
| CN116186053A (en) | Data processing method, device and storage medium | |
| CN115033646A (en) | Method for constructing real-time warehouse system based on Flink and Doris | |
| CN101594435B (en) | Method and system for managing polyphonic service data | |
| CN103475519B (en) | The log recording method of a kind of big data quantity and device | |
| CN115695587A (en) | Service data processing system, method, device and storage medium | |
| CN101217755A (en) | A front-end processor system and method applied for data acquisition | |
| CN101753335A (en) | Implementation method of statistical statement in enterprise instant communication system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20190807 Address after: 518057 Nanshan District science and technology zone, Guangdong, Zhejiang Province, science and technology in the Tencent Building on the 1st floor of the 35 layer Co-patentee after: Tencent cloud computing (Beijing) limited liability company Patentee after: Tencent Technology (Shenzhen) Co., Ltd. Address before: 2, 518044, East 410 room, SEG science and Technology Park, Zhenxing Road, Shenzhen, Guangdong, Futian District Patentee before: Tencent Technology (Shenzhen) Co., Ltd. |