CN102693164A - Equipment and method for preventing buffer overflow - Google Patents
Equipment and method for preventing buffer overflow Download PDFInfo
- Publication number
- CN102693164A CN102693164A CN2012101338872A CN201210133887A CN102693164A CN 102693164 A CN102693164 A CN 102693164A CN 2012101338872 A CN2012101338872 A CN 2012101338872A CN 201210133887 A CN201210133887 A CN 201210133887A CN 102693164 A CN102693164 A CN 102693164A
- Authority
- CN
- China
- Prior art keywords
- temporary file
- migration
- remaining space
- space size
- local buffer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides equipment and a method for preventing buffer overflow. The equipment comprises: a migration determining module used to calculate a threshold of a free space in a local buffer area and calculate a actual free space in the current local buffer area, wherein the threshold of the free space is compared with the actual free space, and if the threshold of free space is greater than the actual free space, then the need to carry out temporary files migration is determined; a file migration module, by which the temporary files are migrated to a predetermined target directory, and soft links linking to the migrated temporary files are established in the directory of the local buffer area; and a buffer monitoring module which monitors operation on temporary files in the local buffer area by application tasks, when an writing operation upon the temporary files in the local buffer area is detected the migration determining module is controlled to determine whether to carry out temporary file migration or not, if the need to carry out temporary file migration is determined, then the file migration module is controlled to carry out temporary file migration.
Description
Technical field
The application relates to a kind of equipment and method that prevents that buffer memory from overflowing, and relates in particular to a kind ofly in UNIX or linux system, through predicting that possible caching system overflows temporary file to be moved to equipment and the method that prevents in the NFS that buffer memory from overflowing.
Background technology
In all kinds of industries, computing machine is used to carry out the processing and the calculating of data, and in many cases, and the data volume that is used to handle and calculate is quite big.For example, in geophysical survey, need gather a large amount of source book in the open air,, adopt the process software of specialty that these raw data are calculated then according to the address characteristic of different regions.Because the data volume of handling is big, calculated amount is big, especially when carrying out the 3-D seismics Data Processing, also can produce a large amount of intermediate data.Under UNIX or linux system environment, use the cache file system of appointment these intermediate data of stored in form usually with temporary file, wherein, single temporary file is generally 2～10GB size.In the real data processing procedure, tend to occur buffer memory and overflow, cause the job run failure.
The method that is used at present avoid local buffer to remove roughly comprises two kinds.A kind of method is the file system mounted NFS enough big to the space with initial setting up, and the linking of foundation and NFS.The subject matter that this method exists is because the access speed of NFS is slow relatively, so the response speed of overall operation is slow, and the very flexible of job scheduling system.Another kind method is to reduce the space of using with whole temporary file compression.But this method still can cause spatial cache to overflow under the situation that temporary file increases fast.
Therefore, need a kind ofly can under the prerequisite that does not cause the obvious deterioration of job run efficient, prevent the solution that buffer memory overflows effectively.
Summary of the invention
The object of the present invention is to provide a kind of equipment and method that prevents that buffer memory from overflowing; In UNIX or linux system; Through predicting that possible caching system overflows temporary file is moved to equipment and the method that prevents in the NFS that buffer memory from overflowing; Because migration/carry is not whole file system, so can guarantee the not obvious deterioration of the operation of operation.
According to an aspect of the present invention; A kind of equipment that prevents that buffer memory from overflowing is provided; Comprise: the migration judge module, be used for size according to said temporary file, calculate the threshold value of remaining space size in the local buffer according to predetermined algorithm; Calculate remaining space size actual in the current local buffer; The threshold value of remaining space size is compared with actual remaining space size, if the threshold value of remaining space size greater than the remaining space size of reality, is then confirmed to carry out the temporary file migration; The file migration module is moved to temporary file under the expected objective catalogue, and under the catalogue of local buffer, is established to the soft link of the temporary file of migration; The buffer memory monitoring module; The monitoring application job is to the operation of temporary file in the local buffer; When detecting temporary file to local buffer and carry out write operation; Control migration judge module determines whether to carry out the temporary file migration, if confirm to carry out the temporary file migration, then the control documents transferring module is carried out the temporary file migration.
On said equipment, can move UNIX or linux system, and said expected objective catalogue is preferably the predetermined file catalogue in the NFS.
The migration judge module can calculate the threshold value Phi of remaining space size according to following formula: Φ=k * a, and wherein, a is the size of single temporary file, k is a weighting coefficient, is worth for greater than 1 integer.
Said equipment can be confirmed the value of k according to the speed of the I/O of system.
At least one equal-sized temporary file can be arranged in the local buffer; And if the migration judge module is confirmed the remaining space size of the threshold value of remaining space size less than reality; Then move the number of judge module based on the definite temporary file that will move of threshold value of remaining space size, and according to the definite file that will move of the principle of first in first out.
Preferably, said equipment also comprises the migration logging modle, is used to write down the status information of temporary file migration, and said status information comprises filename, access rights, target location and the user mode of the temporary file of migration.
Preferably, said equipment also comprises the cleaning module, is used for after the buffer memory monitoring module confirms to accomplish application job, removing the temporary file under the target directory according to the status information of record.
According to a further aspect in the invention; A kind of method that prevents that buffer memory from overflowing is provided; Comprise of the operation of monitoring application job to temporary file in the local buffer; When carrying out write operation, temporary file to local buffer carries out following steps when detecting:, calculate the threshold value of remaining space size in the local buffer according to predetermined algorithm according to the size of said temporary file; Calculate remaining space size actual in the current local buffer; The threshold value of remaining space size is compared with actual remaining space size; If the threshold value of remaining space size is then moved to temporary file under the expected objective catalogue, and under the catalogue of local buffer, is established to the soft link of the temporary file of migration greater than the remaining space size of reality.
Can under UNIX or Linux environment, carry out said method, and said expected objective catalogue is preferably the predetermined file catalogue in the NFS.
Can calculate the threshold value Phi of remaining space size according to following formula: Φ=k * a, wherein, a is the size of single temporary file, k is a weighting coefficient, is worth for greater than 1 integer.
Can confirm the value of k according to the speed of the I/O of system.
At least one equal-sized temporary file can be arranged in the local buffer; And if the threshold value of remaining space size is less than the remaining space size of reality; The number of the temporary file of then confirming to move based on the threshold value of remaining space size, and confirm the file that will move according to the principle of first in first out.
Can also write down the status information of temporary file migration, said status information comprises filename, access rights, target location and the user mode of the temporary file of migration.
After accomplishing application job, can remove the temporary file under the target directory according to the status information of record.
Description of drawings
Through the description of carrying out below in conjunction with accompanying drawing, above-mentioned and other purposes of the present invention and characteristics will become apparent, wherein:
Fig. 1 illustrates the logic diagram that prevents the equipment that buffer memory overflows according to of the present invention;
Fig. 2 illustrates the process flow diagram that prevents the method that buffer memory overflows according to of the present invention.
Embodiment
Below, specify embodiments of the invention with reference to accompanying drawing.
Usually, operating system in local file system, distribute the buffer zone of predetermined size deposit wherein as application program between the storage space of data, be called local buffer at this.The background program that prevents that equipment that buffer memory overflows and method can be embodied as computer system of the present invention, the visit and the use of its monitoring local buffer.When the write operation that detects the temporary file in the local buffer; Calculate the threshold value of a local buffer remaining space size based on the size of temporary file; When the size of confirming the remaining space that local buffer is actual during less than the threshold value of remaining space size; The temporary file of local buffer is moved in the NFS under the expected objective catalogue; And set up with the said target directory that moves under the linking of temporary file, thereby the operation of carrying out write operation is operated the temporary file under the NFS.
Fig. 1 illustrates the logic diagram that prevents the equipment that buffer memory overflows according to of the present invention.
With reference to Fig. 1, be used to prevent that according to of the present invention the equipment that buffer memory removes from comprising that buffer memory monitoring module 110, migration are provided with module 120, migration judge module 130 and file migration module 140.
Buffer memory monitoring module 110 monitoring application jobs are to the operation of local buffer.During the write operation of buffer memory monitoring module 110 temporary file in detecting, determine whether to carry out the migration of temporary file through migration judge module 130 to local buffer.When migration judge module 130 need to confirm the migration temporary file; Buffer memory monitoring module 110 control documents transferring module 140 are moved to temporary file under the target directory in the NFS of appointment; And foundation links with the soft of temporary file under the target directory, thereby the write operation of application job is able to continue to carry out.
Migration is provided with module 120 and is used to store and the relevant information of temporary file migration is set.Said temporary file moves relevant information and includes but not limited to, the information of assigned catalogue under the NFS of parameter that temporary file migration judgement is relevant and conduct migration target directory.But according to exemplary embodiment of the present invention, the relevant information of said temporary file migration can be predefined constant, and in the case, the equipment that prevents that buffer memory from overflowing of the present invention can not comprise that migration is provided with module 120.
To the calculating of the threshold value of remaining space size in the above-mentioned local buffer,, can confirm the threshold value Phi of said remaining space size according to following algorithm according to exemplary embodiment of the present invention:
Φ＝k×a，
Wherein, a is the size of single temporary file, and k is a weighting coefficient, and the value of k is the integer (as 3 or 5) greater than 1.The value major decision of parameter k the size of Φ.Can confirm the value of k according to the I/O speed of system or file system, can be the k assignment according to the empirical value that experiment draws also.Certainly k is big more, prevents that the security that local cache overflows from improving, but under the situation that produces frequent temporary file migration, the operation response of application job is with deterioration.Can use the k value of constant regularly, also module 120 storage k values are set through migration.In the case, migration judge module 130 is provided with module 120 from migration and transfers the k value.
According to exemplary embodiment of the present invention; When handling super amount intermediate data; Often create a plurality of equal-sized temporary files (according to the configuration of temporary file size and the size of local buffer, last of said a plurality of temporary files maybe less than other temporary file) in local buffer.Which at this moment, when confirming to carry out the temporary file migration, need to confirm the several temporary files of migration and move temporary file.At this moment, move the number of judge module 130 based on the definite temporary file that will move of threshold value of the remaining space size of calculating, and according to the definite file that specifically will move of the principle of first in first out.For example, if local buffer has the space of 10G, existing 4 temporary files, each temporary file are the 2G size, and the k in the above-mentioned formula is 3, and the threshold value of the remaining space size of then calculating is 6G.The remaining space of current reality is 2G, so according to exemplary embodiment of the present invention, can confirm to move 2 temporary files.According to another exemplary embodiment of the present invention, also can confirm to move 3 temporary files.
According to a preferred embodiment of the invention, the equipment that prevents that buffer memory from overflowing of the present invention also comprises migration logging modle 150.When file migration module 140 was carried out the temporary file migration operation, migration logging modle 150 write down the status information of temporary files migration, comprises the information such as filename, access rights, target location and user mode of each temporary file of migration.
According to another preferred embodiment of the invention, the equipment that prevents that buffer memory from overflowing of the present invention also comprises cleaning module 160.When buffer memory monitoring module 110 confirms that application job has been accomplished; Cleaning module 160 is under the control of buffer memory monitoring module 110; The status information that the temporary file that writes down according to migration logging modle 150 moves; Corresponding soft link under the deletion local buffer catalogue and the corresponding temporary file under the target directory, and through the corresponding status information of migration logging modle 150 deletions.
This shows; Prevent that according to of the present invention equipment that buffer memory overflows is when the application job needs carry out write operation; Calculate minimum safe remaining space size according to predetermined algorithm; Through the safe remaining space size of said minimum and the size in real surplus space are compared to confirm whether local buffer has enough spaces to be used for operation; If confirm the current enough big spatial cache that do not have, then incite somebody to action the peer link that part or all of (when having only a temporary file) temporary file is moved under the intended target catalogue in the NFS temporarily and is established to the file of having moved, the temporary file that application job is had moved through said links and accesses.Like this, guarantee that local cache does not overflow, simultaneously the response of also not obvious deterioration application job.
Fig. 2 illustrates the process flow diagram that prevents the method that buffer memory overflows according to of the present invention.
With reference to Fig. 2, according to visit and the operation that prevents monitoring of equipment application job that buffer memory overflows to the temporary file of local buffer of the present invention.At step S210, determine whether the temporary file to local buffer is carried out write operation.To carry out write operation to the temporary file of local buffer if confirm; Then at step S220; Said equipment is according to the size of temporary file; Calculate the threshold value (the minimum remaining space size that can not cause buffer memory to overflow of prediction just) of remaining space size in the local buffer according to predetermined algorithm.According to exemplary embodiment of the present invention, can confirm the threshold value Phi of said remaining space size according to following algorithm:
Φ＝k×a，
Wherein, a is the size of single temporary file, and k is a weighting coefficient, and the value of k is the integer (as 3 or 5) greater than 1.The value major decision of parameter k the size of Φ.Can confirm the value of k according to the I/O speed of system or file system, can be the k assignment according to the empirical value that experiment draws also.Certainly k is big more, prevents that the security that local cache overflows from improving, but under the situation that produces frequent temporary file migration, the operation response of application job is with deterioration.Can use the k value of constant regularly, also module 120 storage k values are set through migration.In the case, migration judge module 130 is provided with module 120 from migration and transfers the k value.
At step S230, remaining space actual in the current local buffer of said calculation of equipments is big or small.
At step S240, said equipment compares with actual remaining space size through the threshold value with the remaining space size and determines whether to carry out the temporary file migration.If confirm the remaining space size (need carry out temporary file migration) of the threshold value of remaining space size greater than reality; Then at step S250; Temporary file is moved under the expected objective catalogue; And step S260 is established to the soft link of the temporary file of migration under the catalogue of local buffer.
Exist in local buffer under the situation of a plurality of temporary files,, also confirm the several temporary files of migration and move which temporary file when when step S240 confirms to select the migration of carrying out temporary file for use.At this moment, based on the number of the big or small definite temporary file that will move of threshold value of the remaining space that calculates, and according to the definite file that specifically will move of the principle of first in first out.At step S250 and S260, the temporary file of confirming migration is moved under the target directory, and set up soft link for the temporary file of said migration.
According to a preferred embodiment of the invention; When carrying out the migration of temporary file at step S250 and S260 and setting up soft link; Also write down the status information of temporary file migration, comprise the information such as filename, access rights, target location and user mode of each temporary file of migration.According to another preferred embodiment of the invention; When definite application job has been accomplished; The status information of also moving according to the temporary file that writes down, corresponding soft link under the deletion local buffer catalogue and the corresponding temporary file under the target directory, and the corresponding status information of deletion record.
Prevent that according to of the present invention method that buffer memory overflows is when the application job needs carry out write operation; Through guaranteeing that local buffer has enough spaces; And incite somebody to action the peer link that part or all of (when having only a temporary file) temporary file is moved under the intended target catalogue in the NFS temporarily and is established to the file of having moved in case of necessity, the temporary file that application job is had moved through said links and accesses.Like this, guarantee that local cache does not overflow, simultaneously the response of also not obvious deterioration application job.
Although represent with reference to preferred embodiment and described the present invention, it should be appreciated by those skilled in the art that under the situation that does not break away from the spirit and scope of the present invention that are defined by the claims, can carry out various modifications and conversion to these embodiment.
Claims (14)
1. equipment that prevents that buffer memory from overflowing comprises:
The migration judge module; Be used for size according to said temporary file; Calculate the big or small threshold value of remaining space in the local buffer according to predetermined algorithm, calculate remaining space size actual in the current local buffer, the threshold value that remaining space is big or small compares with the remaining space size of reality; If the threshold value of remaining space size greater than the remaining space size of reality, is then confirmed to carry out the temporary file migration;
The file migration module is moved to temporary file under the expected objective catalogue, and under the catalogue of local buffer, is established to the soft link of the temporary file of migration;
The buffer memory monitoring module; The monitoring application job is to the operation of temporary file in the local buffer; When detecting temporary file to local buffer and carry out write operation; Control migration judge module determines whether to carry out the temporary file migration, if confirm to carry out the temporary file migration, then the control documents transferring module is carried out the temporary file migration.
2. equipment as claimed in claim 1, wherein, operation UNIX or linux system on said equipment, and said expected objective catalogue is the predetermined file catalogue in the NFS.
3. equipment as claimed in claim 1, wherein, the migration judge module calculates the threshold value Phi of remaining space size according to following formula: Φ=k * a, wherein, a is the size of single temporary file, k is a weighting coefficient, is worth for greater than 1 integer.
4. equipment as claimed in claim 1, wherein, said equipment is confirmed the value of k according to the speed of the I/O of system.
5. equipment as claimed in claim 3 wherein, has at least one equal-sized temporary file in the local buffer, and
If the migration judge module is confirmed the remaining space size of the threshold value of remaining space size less than reality; Then move the number of judge module based on the definite temporary file that will move of threshold value of remaining space size, and according to the definite file that will move of the principle of first in first out.
6. equipment as claimed in claim 5 also comprises the migration logging modle, is used to write down the status information of temporary file migration, and said status information comprises filename, access rights, target location and the user mode of the temporary file of migration.
7. equipment as claimed in claim 5 also comprises the cleaning module, is used for after the buffer memory monitoring module confirms to accomplish application job, removing the temporary file under the target directory according to the status information of record.
8. method that prevents that buffer memory from overflowing comprises the operation of monitoring application job to temporary file in the local buffer, carries out following steps when temporary file to local buffer carries out write operation when detecting:
According to the size of said temporary file, calculate the threshold value of remaining space size in the local buffer according to predetermined algorithm;
Calculate remaining space size actual in the current local buffer;
The threshold value of remaining space size is compared with actual remaining space size;
If the threshold value of remaining space size is then moved to temporary file under the expected objective catalogue, and under the catalogue of local buffer, is established to the soft link of the temporary file of migration greater than the remaining space size of reality.
9. method as claimed in claim 8 wherein, under UNIX or Linux environment, carry out said method, and said expected objective catalogue is the predetermined file catalogue in the NFS.
10. method as claimed in claim 8, wherein, calculate the threshold value Phi of remaining space size according to following formula: Φ=k * a, wherein, a is the size of single temporary file, k is a weighting coefficient, is worth for greater than 1 integer.
11. method as claimed in claim 8 wherein, is confirmed the value of k according to the speed of the I/O of system.
12. method as claimed in claim 10 wherein, has at least one equal-sized temporary file in the local buffer, and
If the threshold value of remaining space size is less than the remaining space size of reality, the number of the temporary file of then confirming to move based on the threshold value of remaining space size, and confirm the file that will move according to the principle of first in first out.
13. method as claimed in claim 12 also comprises: the status information of record temporary file migration, said status information comprises filename, access rights, target location and the user mode of the temporary file of migration.
14. method as claimed in claim 5 also comprises: after accomplishing application job, remove the temporary file under the target directory according to the status information of record.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210133887.2A CN102693164B (en) | 2012-05-03 | 2012-05-03 | Equipment and method for preventing buffer overflow |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210133887.2A CN102693164B (en) | 2012-05-03 | 2012-05-03 | Equipment and method for preventing buffer overflow |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102693164A true CN102693164A (en) | 2012-09-26 |
| CN102693164B CN102693164B (en) | 2014-09-17 |
Family
ID=46858638
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210133887.2A Active CN102693164B (en) | 2012-05-03 | 2012-05-03 | Equipment and method for preventing buffer overflow |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102693164B (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103051678A (en) * | 2012-12-04 | 2013-04-17 | 中国电信股份有限公司云计算分公司 | Method and device for high-reliability data communication |
| CN103294574A (en) * | 2013-06-25 | 2013-09-11 | 浙江宇视科技有限公司 | Device and method for rapidly achieving service storage and switching |
| CN105072494A (en) * | 2015-07-31 | 2015-11-18 | 无锡天脉聚源传媒科技有限公司 | Processing method and device for video relevant information transfer |
| CN105721515A (en) * | 2014-12-02 | 2016-06-29 | 鸿富锦精密工业（深圳）有限公司 | Cloud agent device, cloud storage and file transfer method |
| CN105988941A (en) * | 2015-02-28 | 2016-10-05 | 深圳市腾讯计算机系统有限公司 | Cached data processing method and device |
| CN106202350A (en) * | 2016-07-05 | 2016-12-07 | 浪潮(北京)电子信息产业有限公司 | A kind of distributed file system simplifies the method and system of configuration automatically |
| CN107566405A (en) * | 2017-10-18 | 2018-01-09 | 成都索贝数码科技股份有限公司 | A kind of quick memory resource pool method for accessing and copying |
| CN108415982A (en) * | 2018-02-09 | 2018-08-17 | 上海商米科技有限公司 | The treating method and apparatus of database |
| US10187469B2 (en) | 2014-12-02 | 2019-01-22 | Nanning Fugui Precision Industrial Co., Ltd. | Cloud agent device, cloud storage and file transferring method |
| CN111309129A (en) * | 2020-01-22 | 2020-06-19 | 中国石油集团川庆钻探工程有限公司钻采工程技术研究院 | Remote reset method and system for automatic start failure of well site data acquisition device |
| CN112559390A (en) * | 2016-09-23 | 2021-03-26 | 华为数字技术（成都）有限公司 | Data write-in control method and storage device |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100138571A1 (en) * | 2008-11-27 | 2010-06-03 | International Business Machines Corporation | Method and system for a sharing buffer |
| CN202093513U (en) * | 2011-03-30 | 2011-12-28 | 中国工商银行股份有限公司 | Bulk data processing system |
| CN102394930A (en) * | 2011-11-02 | 2012-03-28 | 宇龙计算机通信科技(深圳)有限公司 | Mobile terminal, cloud server and data processing method |
-
2012
- 2012-05-03 CN CN201210133887.2A patent/CN102693164B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100138571A1 (en) * | 2008-11-27 | 2010-06-03 | International Business Machines Corporation | Method and system for a sharing buffer |
| CN202093513U (en) * | 2011-03-30 | 2011-12-28 | 中国工商银行股份有限公司 | Bulk data processing system |
| CN102394930A (en) * | 2011-11-02 | 2012-03-28 | 宇龙计算机通信科技(深圳)有限公司 | Mobile terminal, cloud server and data processing method |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103051678A (en) * | 2012-12-04 | 2013-04-17 | 中国电信股份有限公司云计算分公司 | Method and device for high-reliability data communication |
| CN103294574B (en) * | 2013-06-25 | 2015-11-25 | 浙江宇视科技有限公司 | A kind of apparatus and method realizing business bank switching fast |
| CN103294574A (en) * | 2013-06-25 | 2013-09-11 | 浙江宇视科技有限公司 | Device and method for rapidly achieving service storage and switching |
| US10187469B2 (en) | 2014-12-02 | 2019-01-22 | Nanning Fugui Precision Industrial Co., Ltd. | Cloud agent device, cloud storage and file transferring method |
| CN105721515A (en) * | 2014-12-02 | 2016-06-29 | 鸿富锦精密工业（深圳）有限公司 | Cloud agent device, cloud storage and file transfer method |
| CN105721515B (en) * | 2014-12-02 | 2019-06-07 | 鸿富锦精密工业（深圳）有限公司 | The method of cloud agent equipment, cloud disk and archives transfer |
| CN105988941A (en) * | 2015-02-28 | 2016-10-05 | 深圳市腾讯计算机系统有限公司 | Cached data processing method and device |
| CN105072494A (en) * | 2015-07-31 | 2015-11-18 | 无锡天脉聚源传媒科技有限公司 | Processing method and device for video relevant information transfer |
| CN106202350A (en) * | 2016-07-05 | 2016-12-07 | 浪潮(北京)电子信息产业有限公司 | A kind of distributed file system simplifies the method and system of configuration automatically |
| CN112559390A (en) * | 2016-09-23 | 2021-03-26 | 华为数字技术（成都）有限公司 | Data write-in control method and storage device |
| CN112559390B (en) * | 2016-09-23 | 2023-06-06 | 成都华为技术有限公司 | Data writing control method and storage device |
| CN107566405A (en) * | 2017-10-18 | 2018-01-09 | 成都索贝数码科技股份有限公司 | A kind of quick memory resource pool method for accessing and copying |
| CN108415982A (en) * | 2018-02-09 | 2018-08-17 | 上海商米科技有限公司 | The treating method and apparatus of database |
| CN108415982B (en) * | 2018-02-09 | 2021-07-06 | 上海商米科技集团股份有限公司 | Database processing method and device |
| CN111309129A (en) * | 2020-01-22 | 2020-06-19 | 中国石油集团川庆钻探工程有限公司钻采工程技术研究院 | Remote reset method and system for automatic start failure of well site data acquisition device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102693164B (en) | 2014-09-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102693164B (en) | Equipment and method for preventing buffer overflow | |
| US11281377B2 (en) | Method and apparatus for managing storage system | |
| US20180373722A1 (en) | System and method for data classification using machine learning during archiving | |
| US10235044B2 (en) | System and methods for storage data deduplication | |
| US9298633B1 (en) | Adaptive prefecth for predicted write requests | |
| EP2422274B1 (en) | Intelligent tiers of backup data | |
| EP2989556B1 (en) | Object storage using multiple dimensions of object information | |
| US9665493B2 (en) | Increased cache performance with multi-level queues of complete tracks | |
| CN102884516B (en) | File system migration | |
| US8984027B1 (en) | Systems and methods for migrating files to tiered storage systems | |
| CN104580439B (en) | Method for uniformly distributing data in cloud storage system | |
| US10127262B2 (en) | Data set connection manager having a plurality of data sets to represent one data set | |
| US10810054B1 (en) | Capacity balancing for data storage system | |
| US10298709B1 (en) | Performance of Hadoop distributed file system operations in a non-native operating system | |
| US8458402B1 (en) | Decision-making system and method for improving operating system level 2 cache performance | |
| US11704038B2 (en) | Processing out of order writes in a log structured file system for improved garbage collection | |
| US9934147B1 (en) | Content-aware storage tiering techniques within a job scheduling system | |
| US10467190B2 (en) | Tracking access pattern of inodes and pre-fetching inodes | |
| WO2018064319A1 (en) | Tracking access pattern of inodes and pre-fetching inodes | |
| JP5853109B2 (en) | Computer, computer system controller and recording medium | |
| KR101686346B1 (en) | Cold data eviction method using node congestion probability for hdfs based on hybrid ssd | |
| KR101252375B1 (en) | Mapping management system and method for enhancing performance of deduplication in storage apparatus | |
| Gao et al. | A load-aware data migration scheme for distributed surveillance video processing with hybrid storage architecture | |
| JP6747018B2 (en) | Storage system, storage system control device, storage system control method and program | |
| CN112748852B (en) | Method, electronic device and computer program product for managing a disk |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20180130 Address after: 072751 Zhuozhou, Baoding, Fan Yang Road West, No. 189 Patentee after: Dongfang Geophysical Exploration Co., Ltd., China Petrochemical Corp. Address before: 610213 No. 1, No. 1, No. 1, Huayang Avenue, Huayang Town, Shuangliu County, Chengdu, Sichuan Patentee before: China National Petroleum Corporation Chuanqing Drilling Engineering Geophysical Exploration Company Ltd. |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20200922 Address after: 100007 Beijing, Dongzhimen, North Street, No. 9, No. Patentee after: CHINA NATIONAL PETROLEUM Corp. Patentee after: BGP Inc., China National Petroleum Corp. Address before: 072751 Zhuozhou, Baoding, Fan Yang Road West, No. 189 Patentee before: BGP Inc., China National Petroleum Corp. |