CN107193642A - Task data compression switching method, suitable compression degree evaluation method and relevant apparatus - Google Patents
Task data compression switching method, suitable compression degree evaluation method and relevant apparatus Download PDFInfo
- Publication number
- CN107193642A CN107193642A CN201610144694.5A CN201610144694A CN107193642A CN 107193642 A CN107193642 A CN 107193642A CN 201610144694 A CN201610144694 A CN 201610144694A CN 107193642 A CN107193642 A CN 107193642A
- Authority
- CN
- China
- Prior art keywords
- compression
- index
- positive
- calculating platform
- task data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007906 compression Methods 0.000 title claims abstract description 431
- 230000006835 compression Effects 0.000 title claims abstract description 431
- 238000000034 method Methods 0.000 title claims abstract description 36
- 238000011156 evaluation Methods 0.000 title claims abstract description 13
- 238000013144 data compression Methods 0.000 title abstract description 25
- 230000005540 biological transmission Effects 0.000 claims description 26
- 230000008859 change Effects 0.000 abstract description 5
- 230000007423 decrease Effects 0.000 abstract description 5
- 230000006870 function Effects 0.000 description 18
- 238000004364 calculation method Methods 0.000 description 12
- 230000009467 reduction Effects 0.000 description 7
- 230000000694 effects Effects 0.000 description 5
- 230000002349 favourable effect Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000012935 Averaging Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000002474 experimental method Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 230000001419 dependent effect Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 240000000797 Hibiscus cannabinus Species 0.000 description 1
- 240000002853 Nelumbo nucifera Species 0.000 description 1
- 235000006508 Nelumbo nucifera Nutrition 0.000 description 1
- 235000006510 Nelumbo pentapetala Nutrition 0.000 description 1
- 244000131316 Panax pseudoginseng Species 0.000 description 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 1
- 235000003140 Panax quinquefolius Nutrition 0.000 description 1
- 235000002905 Rumex vesicarius Nutrition 0.000 description 1
- 238000007418 data mining Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 235000008434 ginseng Nutrition 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/174—Redundancy elimination performed by the file system
- G06F16/1744—Redundancy elimination performed by the file system using compression, e.g. sparse files
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
Abstract
This application discloses a kind of calculating platform task data compression switching method, suitable compression degree evaluation method and relevant apparatus, by the positive compression index and negative sense compression index that obtain calculating platform, to be compressed under overall merit calculating platform present case if appropriate for task data, if be adapted to, meet compression switching condition, then control calculating platform is compressed to the task data produced in the case of this, if practical situations change, switching condition is no longer complies with, then controls calculating platform to be no longer compressed to task data.It can be seen that, the application can be realized is compressed control, switching in real time according to the practical situations of calculating platform, avoid the occurrence of causes tasks carrying efficiency to decline because mass data etc. is to be compressed, or because storing and transmitting the phenomenon that a large amount of uncompressed data cause disk and network pressure to increase.
Description
Technical field
Compress switching method the present invention relates to database technical field, more particularly to a kind of calculating platform task data, preferably press
Contracting degree evaluation method and relevant apparatus.
Background technology
In one large-scale calculating platform, such as Distributed Calculation cluster, it will usually while running substantial amounts of calculating task；
Under certain situation, calculating platform can be compressed to the data that the pilot process and output result of these calculating tasks are produced,
To mitigate disk storage pressure and the follow-up network transmission pressure to data.In correlation technique, generally by parameter preset come
Determine whether to be compressed these task datas, as long as that is, parameter preset represents to be compressed task data, then no matter
How is other actual conditions, and task data is compressed without exception, as long as conversely, parameter preset is represented not to task data
It is compressed, then regardless of other actual conditions, all without compression duty data.
In practical application, there are many drawbacks in the above-mentioned compression control mode to task data.For example, in parameter preset table
Show in the case of being compressed to task data, the data that all calculating tasks are produced all are compressed so that tasks carrying
Need to consume more times, particularly when calculating task amount is very big, the tasks carrying effect of calculating platform can be substantially reduced
Rate；Otherwise in the case where parameter preset represents not to be compressed task data, the data that all calculating tasks are produced are all
Do not compress, disk storage and network transmission that can be to calculating platform bring huge pressure.
The content of the invention
The problem of to overcome correlation technique, the application provides a kind of calculating platform task data compression switching method, preferably compressed
Degree evaluation method and relevant apparatus.
The application first aspect compresses switching method there is provided a kind of calculating platform task data, including：
For the calculating platform, the positive compression index for characterizing and supporting to be compressed to its task data, Yi Jibiao are obtained
Levy the negative sense compression index for not supporting to be compressed its task data；
According to the positive compression index and the negative sense compression index, judge whether the calculating platform meets compression switching
Condition；
If the calculating platform meets compression switching condition, the task data of calculating platform is compressed, otherwise, is not compressed
The task data of calculating platform.
With reference in a first aspect, in the application first aspect the first feasible embodiment, for the calculating platform,
Described obtain characterizes the positive compression index that support is compressed to its task data, including：Described calculate is obtained to put down
At least one of in the CPU surpluses and internal memory surplus of platform；
The acquisition characterizes the negative sense compression index for not supporting to be compressed its task data, including：Obtain described calculate
At least one of in the disk surplus and network transmission surplus of platform.
With reference in a first aspect, or first aspect the first feasible embodiment, can in second of the application first aspect
In capable embodiment, according to the positive compression index and the negative sense compression index, whether the calculating platform is judged
Meet compression switching condition, including：
The positive cake compressibility is calculated according to the positive compression index；Wherein, the positive cake compressibility with it is described just
To compression index positive correlation；
The negative sense cake compressibility is calculated according to the negative sense compression index；Wherein, the negative sense cake compressibility is born with described
To compression index positive correlation；
According to the positive cake compressibility and the reverse compression index, judge whether the calculating platform meets compression switching
Condition.
With reference to second of feasible embodiment of first aspect, in the third feasible embodiment of the application first aspect
In, according to the positive cake compressibility and the reverse compression index, judge whether the calculating platform meets compression switching
Condition, including：
According to the positive cake compressibility and the ratio of the reverse compression index, the compression switching of the calculating platform is determined
Index；
The compression switching index is judged whether in default compression is interval, if it is, judging that the calculating platform meets
Switching condition is compressed, otherwise judges that the calculating platform does not meet compression switching condition.
With reference to second of feasible embodiment of first aspect, in the 4th kind of feasible embodiment of the application first aspect
In, according to the positive cake compressibility and the reverse compression index, judge whether the calculating platform meets compression switching
Condition, including：
Compare the positive compression switching index and pre-set forward compression threshold, and relatively more described negative sense compression switching index with
Default reverse compression threshold value；
If the positive cake compressibility is not more than described not less than the positive compression threshold and the reverse compression index
Reverse compression threshold value, then judge that the calculating platform meets compression switching condition, otherwise judges that the calculating platform is not met
Compress switching condition.
The application second aspect there is provided a kind of suitable compression degree evaluation method of calculating platform task data, including：
Obtain the positive compression index for characterizing and supporting to be compressed to the calculating platform task data；
Obtain the negative sense compression index for characterizing and not supporting to be compressed the calculating platform task data；
According to the positive compression index and the negative sense compression index, preferably pressed it is determined that characterizing the calculating platform task data
The compression switching index of contracting degree.
It is described to obtain the calculating platform just in second aspect in the first feasible embodiment with reference to second aspect
To compression index, including：
Obtain at least one in the CPU surpluses and internal memory surplus of calculating platform；
The reverse compression index for obtaining the calculating platform, including：
Obtain at least one in the disk surplus and network transmission surplus of the calculating platform.
With reference to second aspect, or second aspect the first feasible embodiment, in second of feasible reality of second aspect
Apply in mode, according to the positive compression index and the negative sense compression index, determine the compression switching of the calculating platform
Index, including
Positive cake compressibility is calculated according to the positive compression index；Wherein, the positive cake compressibility and the positive pressure
Contracting index positive correlation；
Reverse compression index is calculated according to the reverse compression index；Wherein, the reverse compression index and the reverse pressure
Contracting index positive correlation；
According to the positive cake compressibility and the ratio of the reverse compression index, the compression switching of the calculating platform is determined
Index.
The application third aspect compresses switching device there is provided a kind of calculating platform task data, including：
Index selection unit, supports to be compressed just its task data for for the calculating platform, obtaining to characterize
To compression index, and characterize the negative sense compression index for not supporting to be compressed its task data；
Judging unit is compressed, for according to the positive compression index and the negative sense compression index, judging that described calculate is put down
Whether platform meets compression switching condition；
Switch execution unit, for when the calculating platform meets compression switching condition, compressing the number of tasks of calculating platform
According to otherwise, the task data of calculating platform not being compressed.
With reference to the third aspect, in the third aspect in the first feasible embodiment, the index selection unit specifically by with
It is set to：
For the calculating platform, at least one in following positive compression index is obtained：CPU surpluses and internal memory surplus,
And obtain in following negative sense compression index at least one of：Disk surplus and network transmission surplus.
With reference to the third aspect, or the third aspect the first feasible embodiment, in second of feasible reality of the third aspect
Apply in mode, the compression judging unit includes：
Index computing module, for calculating the positive cake compressibility according to the positive compression index, and according to described negative
The negative sense cake compressibility is calculated to compression index；Wherein, the positive cake compressibility and the positive compression index positive
Close, the negative sense cake compressibility and the negative sense compression index positive correlation；
Judge module is compressed, for according to the positive cake compressibility and the reverse compression index, judging that described calculate is put down
Whether platform meets compression switching condition.
It is described in the third aspect in the third feasible embodiment with reference to second of feasible embodiment of the third aspect
Compression judge module includes：
First compression judge module, for the ratio according to the positive cake compressibility and the reverse compression index, it is determined that
The compression switching index of the calculating platform, and the compression switching index is judged whether in default compression is interval, if
It is then to judge that the calculating platform meets compression switching condition, otherwise judges that the calculating platform does not meet compression switching bar
Part.
It is described in the 4th kind of feasible embodiment of the third aspect with reference to second of feasible embodiment of the third aspect
Compression judge module includes：
Second compression judge module, for comparing the positive compression switching index and pre-set forward compression threshold, and compares
The negative sense compression switching index and default reverse compression threshold value, if the positive cake compressibility is not less than the positive pressure
The contracting threshold value and reverse compression index is not more than the reverse compression threshold value, then judge that the calculating platform meets compression and cut
Condition is changed, otherwise judges that the calculating platform does not meet compression switching condition.
The application fourth aspect there is provided a kind of suitable compression degree evaluating apparatus of calculating platform task data, including：
Positive index selection unit, the positive pressure for supporting to be compressed the calculating platform task data is characterized for obtaining
Contracting index；
Negative sense index selection unit, the negative sense for not supporting to be compressed the calculating platform task data is characterized for obtaining
Compression index；
Cake compressibility computing unit, for according to the positive compression index and the negative sense compression index, it is determined that characterizing institute
State the compression switching index of the suitable compression degree of calculating platform task data.
With reference to fourth aspect, in fourth aspect in the first feasible embodiment, the positive index selection unit is specific
It is configured as：Obtain at least one in the CPU surpluses and internal memory surplus of calculating platform；
The negative sense index selection unit is specifically configured to：More than the disk surplus and network transmission for obtaining the calculating platform
At least one in amount.
With reference to fourth aspect, or fourth aspect the first feasible embodiment, in second of feasible reality of fourth aspect
Apply in mode, the cake compressibility computing unit is specifically configured to：
Positive cake compressibility is calculated according to the positive compression index, and reverse compression is calculated according to the reverse compression index
Index；Wherein, the positive cake compressibility and the positive compression index positive correlation, the reverse compression index with it is described
Reverse compression index positive correlation；
According to the positive cake compressibility and the ratio of the reverse compression index, the compression switching of the calculating platform is determined
Index.
The technical scheme provided from above technical scheme, the embodiment of the present application, is pressed by obtaining the positive of calculating platform
Contracting index and negative sense compression index, to be compressed under overall merit calculating platform present case if appropriate for task data,
If be adapted to, that is, meet compression switching condition, then control calculating platform to be compressed the task data produced in the case of this,
If practical situations change, switching condition is no longer complies with, then controls calculating platform to be no longer compressed to task data.
It can be seen that, the present embodiment can be realized is compressed control, switching in real time according to the practical situations of calculating platform, relatively
Decide whether the control mode of compression according to parameter preset without exception in correlation technique, the present embodiment passes through the correlation to cluster
Index is monitored in real time, realizes the automatic switchover whether being compressed to task data, it is to avoid occurred because of mass data etc.
It is to be compressed to cause tasks carrying efficiency to decline, or cause disk and network pressure because storing and transmitting a large amount of uncompressed data
The phenomenon of increase.
It should be appreciated that the general description of the above and detailed description hereinafter are only exemplary and explanatory, can not
Limit the application.
Brief description of the drawings
, below will be to embodiment or existing in order to illustrate more clearly of the embodiment of the present application or technical scheme of the prior art
The accompanying drawing used required in technology description is briefly described, it should be apparent that, for those of ordinary skill in the art
Speech, without having to pay creative labor, can also obtain other accompanying drawings according to these accompanying drawings.
Fig. 1 is a kind of integrated stand composition of Distributed Computing Platform shown in the exemplary embodiment of the application one.
Fig. 2 is that a kind of flow of calculating platform task data compression switching method shown in the exemplary embodiment of the application one is shown
It is intended to.
Fig. 3 is the suitable compression degree evaluation method of a kind of calculating platform task data shown in the exemplary embodiment of the application one
Schematic flow sheet.
Fig. 4 is a kind of structural frames of calculating platform task data compression switching device shown in the exemplary embodiment of the application one
Figure.
Fig. 5 is the suitable compression degree evaluating apparatus of a kind of calculating platform task data shown in the exemplary embodiment of the application one
As a result block diagram.
Embodiment
Here exemplary embodiment will be illustrated in detail, its example is illustrated in the accompanying drawings.Following description is related to attached
During figure, unless otherwise indicated, the same numbers in different accompanying drawings represent same or analogous key element.Following exemplary is implemented
Embodiment described in example does not represent all embodiments consistent with the application.On the contrary, they be only with such as
The example of the consistent apparatus and method of some aspects be described in detail in appended claims, the application.
For comprehensive understanding the application, numerous concrete details are refer in the following detailed description, but art technology
Personnel are it should be understood that the application can be realized without these details.In other embodiments, public affairs are not described in detail
Method, process, component and the circuit known, are obscured in order to avoid undesirably resulting in embodiment.
For the application scenarios of clear and definite the embodiment of the present application, the framework of large-scale distributed calculating platform/cluster is situated between first
Continue.As shown in figure 1, on Distributed Calculation cluster one large-scale, generally by Ambari (installation, deployment, configuration
And management tool), Zookeeper (distributed collaborative service), Hbase (real time distributed database), Hive (number
According to warehouse), Pig (Data Stream Processing), Mahout (data mining storehouse), Mapreduce (Distributed Calculation framework),
HDFS (distributed file system), Flume (log collection instrument), Sqoop (database ETL instruments) etc. are multiple
Subsystem is constituted.Cluster in the course of the work, can run substantial amounts of distributed task scheduling daily, and same task may need
The cooperation in pipelined fashion of multiple subsystems performs completion, so the intermediate data produced during tasks carrying is not only
Need disk storage, in addition it is also necessary to be transmitted between different subsystems.Under above-mentioned background, Hive (numbers can be passed through
According to warehouse) data that these task pilot process and output result are produced are compressed, can mitigate follow-up disk and
Network transmission pressure, but the CPU and memory usage of cluster can be increased accordingly, increase task execution time；And if
The data produced to these task pilot process and output result can then save task execution time relatively without compression,
Tasks carrying efficiency is improved, but the pressure of disk storage and network transmission can be increased.In the prior art, Hive acquiescence side
Case judges whether to be compressed task data according only to parameter preset, do not consider the virtual condition of computing cluster if appropriate for,
Can cause when cluster be not suitable for carry out data compression when, still have substantial amounts of task wait data compression, when cluster be adapted into
During row data compression, there is substantial amounts of task to be directly entered network transmission without data compression on the contrary, brought to network transmission
Huge pressure.
In view of this, it is contemplated that being monitored in real time by the virtual condition to cluster, work as so that it is determined that being adapted to cluster
The processing mode of preceding state, that is, realize according to the real-time status of cluster to Hive compression and do not compress two kinds of processing modes it
Between automatic switchover.
Fig. 2 is that a kind of flow of calculating platform task data compression switching method shown in the exemplary embodiment of the application one is shown
It is intended to.As shown in figure 1, methods described includes：
Step S101, for the calculating platform, obtains to characterize and supports the positive compression being compressed to its task data to refer to
Mark, and characterize the negative sense compression index for not supporting to be compressed its task data；
Wherein, positive compression index is to characterize the indices for supporting that (suitable) is compressed to calculating platform task data,
Namely it is worth the bigger variable for representing that progress task data compression is more favourable；Accordingly, negative sense compression index is to characterize not prop up
The indices that (unsuitable) is compressed to calculating platform task data are held, that is, are worth bigger expression and carry out number of tasks
According to the variable that compression is more unfavorable.
Specifically, can be by corresponding detection module directly to the CPU in calculating platform, internal memory, disk and networking etc.
Detected, to obtain the positive compression index and reverse compression index of correlation, and realize step S101.It can also pass through
The parameter related to CPU, internal memory, disk or network transmission etc., is used with this during reading calculating platform tasks carrying
A little parameters calculate for the conventionally calculation function of dependent variable obtains every positive compression index and reverse compression index.
Step S102, according to the positive compression index and the negative sense compression index, judges whether the calculating platform accords with
Combined pressure contracting switching condition；
Step S103, if the calculating platform meets compression switching condition, compresses the task data of calculating platform, no
Then, the task data of calculating platform is not compressed.
It is preferred that, above-mentioned steps S101 is performed in real time, i.e., obtain the positive compression index of calculating platform in real time and bear
To compression index, to judge in real time and synthetically if appropriate for data compression is carried out calculating platform, and then sentencing
When disconnected result and the inconsistent current compressive state of calculating platform, switch its compressive state in time.
For example, in the case where the compressive state of calculating platform is that task data is compressed, if it is decided that result is not
It is adapted to be compressed calculating platform task data, then the compressive state of the calculating platform is switched into not compression duty automatically
Data, so as to avoid the phenomenon to be compressed for causing tasks carrying efficiency to decline such as mass data；Conversely, flat calculating
In the case that the compressive state of platform is not compression duty data, if it is decided that result is entered to be suitable to calculating platform task data
Row compression, then the compressive state of the calculating platform is switched to automatically and task data is compressed, so as to avoid because
Storage and a large amount of uncompressed data of transmission cause the phenomenon that disk and network pressure increase.
From above technical scheme, the application by obtaining the positive compression index and negative sense compression index of calculating platform,
To be compressed under overall merit calculating platform present case if appropriate for task data, if be adapted to, that is, meet compression
Switching condition, then control calculating platform to be compressed the task data produced in the case of this, if practical situations change
Become, be no longer complies with switching condition, then control calculating platform to be no longer compressed to task data.It can be seen that, the present embodiment can
Be compressed control, switching in real time with the practical situations for realizing according to calculating platform, relative in correlation technique without exception
Decide whether the control mode of compression according to parameter preset, the present embodiment is monitored in real time by the index of correlation to cluster,
Realize the automatic switchover whether being compressed to task data, it is to avoid appearance causes tasks carrying because mass data etc. is to be compressed
Efficiency declines, or because storing and transmitting the phenomenon that a large amount of uncompressed data cause disk and network pressure to increase.
Optionally, described in above-mentioned steps S101 the positive compression index of acquisition can specifically include：Obtain calculating platform
One or more in the index such as CPU surpluses and internal memory surplus, magnetic disc i/o surplus.
Optionally, the acquisition negative sense compression index described in above-mentioned steps S101 can specifically include：Obtain calculating platform
One or more in the index such as disk surplus and network transmission surplus.
In one feasible embodiment of the application, described in above-mentioned steps S102 according to the positive compression index and institute
Negative sense compression index is stated, judges whether the calculating platform meets compression switching condition, specifically be may comprise steps of：
S1021, the positive cake compressibility calculated according to the positive compression index；
S1022, the negative sense cake compressibility calculated according to the negative sense compression index；
S1023, according to the positive cake compressibility and the reverse compression index, judge whether the calculating platform meets
Compress switching condition.
Wherein, the positive cake compressibility be used for characterize calculating platform be appropriate for task data compression degree, it is described just
To cake compressibility and every positive compression index positive correlation, i.e. forward direction cake compressibility using every positive compression index as independent variable,
Increase with the increase of every positive compression index, A ∝ A1, A ∝ A2 ... ..., A ∝ An (A can be expressed as
Represent positive cake compressibility, A1, A2 ..., An represent n different positive compression index).
The positive cake compressibility A is bigger, illustrates that calculating platform carries out task data and compresses more favourable, can be by multiple
Experiment, obtains the empirical function between the every positive compression index of A1~An and positive cake compressibility A
A=f (A1, A2 ..., An), is calculated by the empirical function and obtains positive cake compressibility.
It is for instance possible to use function A=(A1+A2+ ...+An)/n is averaging, with the average value of each positive compression index
It is used as positive cake compressibility；Can also using weighted sum function A=A1*Q1+A2*Q2+ ...+An*Qn (Q1,
Q2 ..., Qn for be respectively corresponding positive compression index A1, A2 ..., An weight) or weighted average
Value function A=(A1*Q1+A2*Q2+ ...+An*Qn)/n, regard result of calculation as positive cake compressibility.
Accordingly, the reverse compression index is used to characterize the degree that calculating platform is not suitable for carrying out task data compression, institute
Negative sense compression index and the negative sense cake compressibility positive correlation, i.e. reverse compression index are stated using every reverse compression index as certainly
Variable, increases with the increase of every negative sense compression index, can be expressed as B ∝ B1, B ∝ B2 ... ..., B ∝
Bm (B represents positive cake compressibility, B1, B2 ..., Bm represent m different negative sense compression index).
The reverse compression index is bigger, illustrates that calculating platform carries out task data compression more unfavorable.With above-mentioned positive compression
The acquisition modes of index are similar, can obtain the every reverse compression indexs of B1~Bm and reverse compression by many experiments
Empirical function between index B, such as above-mentioned averaging function, weighted sum function, weighted average value function, and leads to
Cross empirical function calculating and obtain reverse compression index.
From above technical scheme, multinomial positive compression index is integrated into a positive cake compressibility by the present embodiment, will
Multinomial negative sense compression index is integrated into a negative sense cake compressibility, and then according to the positive cake compressibility and negative sense cake compressibility
Determine whether calculating platform meets compression switching condition, realize whole cluster Suitable compression degree corresponding to calculating platform
Comprehensive descision, it is ensured that the compressive state of the calculating platform finally determined is to the best state of practical situations, it is to avoid
Appearance causes tasks carrying efficiency to decline because mass data etc. is to be compressed, or is led because storing and transmitting a large amount of uncompressed data
Cause the phenomenon of disk and network pressure increase.
In one feasible embodiment of the application, described in above-mentioned steps S1023 according to the positive cake compressibility and
The reverse compression index, judges whether the calculating platform meets compression switching condition, can specifically include：
According to the positive cake compressibility and the ratio of the reverse compression index, the compression switching of the calculating platform is determined
Index；
The compression switching index is judged whether in default compression is interval, if it is, judging that the calculating platform meets
Switching condition is compressed, otherwise judges that the calculating platform does not meet compression switching condition.
In a kind of embodiment, compression switching index T calculation formula can be that (A is positive compression to T=A/B
Index, B is reverse compression index)；Corresponding to this calculation formula, the corresponding default pressures of compression switching index T can be set
Contracting it is interval for [T1, ∞), compressed if calculating obtained compression according to formula T=A/B and switching index T not less than first
Threshold value T1 (equivalent to above-mentioned compression switching condition), then judge that the calculating platform meets compression switching condition, and then right
Hereafter the task data produced is compressed, it is possible to reduce calculating platform reading and writing data amount, and reduction hard disk and network transmission are negative
Lotus；, whereas if T is less than T1, then judge that the calculating platform does not meet compression switching condition, from without compression duty
Data, to improve tasks carrying efficiency, reduction CPU and Memory Load.General, above-mentioned first compression threshold T1 is big
In 1, to ensure just to allow compression duty data on the premise of positive cake compressibility is more than negative sense cake compressibility, specifically take
Value can be according to task data compression algorithm efficiency, the average parameter such as compression ratio and network transmission speed of task data by experience
Formula calculates and obtains (empirical equation is obtained according to many experiments), can also be run by user according to current calculating platform
Situation is by virtue of experience configured.
In another embodiment, compression switching index T calculation formula can also be that (A is positive to T=B/A
Cake compressibility, B is reverse compression index)；Corresponding to this calculation formula, compression switching index T can be set corresponding pre-
If compression it is interval for (0, T2], be not more than the second pressure if calculating obtained compression according to formula T=B/A and switching index T
Contracting threshold value T2 (equivalent to above-mentioned compression switching condition), then judge that the calculating platform meets compression switching condition；Conversely,
If T is less than T2, judge that the calculating platform does not meet compression switching condition.General, above-mentioned second compression threshold
T2 is less than 1, to ensure just to allow compression duty data on the premise of positive cake compressibility is more than negative sense cake compressibility；T2
Specific value can refer to above-mentioned T1, here is omitted.
In the application in another feasible embodiment, described in above-mentioned steps S1023 according to the positive cake compressibility
With the reverse compression index, judge whether the calculating platform meets compression switching condition, can specifically include：
Compare the positive compression switching index and pre-set forward compression threshold, and relatively more described negative sense compression switching index with
Default reverse compression threshold value；
If the positive cake compressibility is not more than described not less than the positive compression threshold and the reverse compression index
Reverse compression threshold value, then judge that the calculating platform meets compression switching condition, otherwise judges that the calculating platform is not met
Compress switching condition.
In the present embodiment, positive compression threshold A0 and negative sense compression threshold B0 can be preset, forward direction is obtained in calculating
After cake compressibility A and negative sense cake compressibility B, A is compared with A0, B and B0 respectively, if A >=A0 and
B≤B0 (equivalent to above-mentioned compression switching condition), then judge that the calculating platform meets compression switching condition, otherwise judge
The calculating platform does not meet compression switching condition.
Above-mentioned pre-set forward compression threshold and default reverse compression threshold value specifically can according to task data compression algorithm efficiency,
The average compression ratio of task data and network transmission speed are calculated by empirical equation and obtained.
In addition, present invention also provides a kind of suitable compression degree evaluation method of calculating platform task data, Fig. 3 is this method
Schematic flow sheet.Reference picture 3, the suitable compression degree evaluation method of calculating platform task data includes：
Step S201, obtains the positive compression index for characterizing and supporting to be compressed to the calculating platform task data；
Step S202, obtains the negative sense compression index for characterizing and not supporting to be compressed the calculating platform task data；
Step S203, according to the positive compression index and the negative sense compression index, appoints it is determined that characterizing the calculating platform
The compression switching index of the business suitable compression degree of data.
It can be seen that, the degree of calculating platform task data Suitable compression is quantified as compression switching index by the embodiment of the present application, should
Compression switching index at least can be used for judging under present case being compressed if appropriate for calculating platform task data.Tool
Body, if the compression switches index in default compression is interval, illustrate in the current situation suitably to appoint calculating platform
Business data are compressed, and can play reduction calculating platform reading and writing data amount, the reduction effect such as hard disk and network transmission load；
, whereas if compression switching index illustrates in the current situation to be not suitable for calculating platform not in default compression is interval
Task data be compressed, can play raising tasks carrying efficiency, reduction CPU and Memory Load etc. effect.
Refer to specifically, the present embodiment calculates obtained compression switching based on multinomial positive compression index and negative sense compression index
Number, it is ensured that compression switching index can accurately reflect the integrated application situation of corresponding calculating platform, and then can foundation
The compression switching index accurately judge calculating platform whether Suitable compression task data.
In the present embodiment, the positive compression index represents to support the parameter of task data compression, i.e. its value in calculating platform
Bigger expression compression duty data are more favourable to calculating platform.In a feasible embodiment, above-mentioned positive compression refers to
Mark include but is not limited to it is following any one or a few：CPU surpluses, internal memory surplus, magnetic disc i/o surplus.
Accordingly, in the present embodiment, the negative sense compression index represents not supporting the ginseng that task data is compressed in calculating platform
Compression duty data are not more favourable to calculating platform for the bigger expression of number, i.e. its value.In a feasible embodiment, on
State negative sense compression index include but is not limited to it is following any one or a few：Disk surplus, network transmission surplus.
In the present embodiment, specifically above-mentioned CPU can directly be detected by the setting target detection module in calculating platform
The forward direction compression index such as surplus, internal memory surplus, and the negative sense compression index such as disk surplus, network transmission surplus；Also may be used
With positive/negative to compression index with CPU, internal memory, disk or network transmission etc. during calculating platform tasks carrying by reading
Related parameter, is calculated by corresponding relation function by independent variable of these parameters and obtains positive/negative to compression index.
In one feasible embodiment of the application, described in above-mentioned steps S203 according to positive compression index and negative sense
Compression index calculates compression switching index, may include steps of：
Positive cake compressibility is calculated according to the positive compression index, and negative sense compression is calculated according to the negative sense compression index
Index；
According to the ratio of positive cake compressibility and the reverse compression index, the compression switching index of calculating platform is determined.
Wherein, the positive cake compressibility be used for characterize calculating platform be appropriate for task data compression degree, it is described just
To cake compressibility and every positive compression index positive correlation, i.e. forward direction cake compressibility using every positive compression index as independent variable,
Increase with the increase of every positive compression index.The negative sense cake compressibility is used to characterize the unsuitable progress of calculating platform
The degree of task data compression, the negative sense compression index and the negative sense cake compressibility positive correlation, i.e. reverse compression index
Using every reverse compression index as independent variable, increase with the increase of every negative sense compression index.Optionally, it can pass through
Corresponding empirical function (function of such as averaging, weighted sum function, weighted average value function) calculates above-mentioned forward direction
Cake compressibility and negative sense compression index, specific method can refer to the switching method embodiment of calculating platform task data compression above
Middle related content, here is omitted.
The calculation formula of above-mentioned compression switching index can have a variety of, and the present embodiment seeks ratio mode using simplest, will
Ratio between positive cake compressibility and negative sense cake compressibility switches index as compression, and being specifically as follows T=A/B, (A is
Positive cake compressibility, B is reverse compression index), or T=B/A.It should be noted that switching according to the compression
When index judges whether to be compressed calculating platform task data, the compression obtained for different calculation formula switches index,
Set different compressions interval respectively；For example, calculating compression switching index according to T=A/B, then corresponding compression is interval
Be set to [T1, ∞), according to T=B/A calculate compression switching index, then corresponding compression interval be set to (0, T2], tool
Body can refer to related content in the switching method embodiment of calculating platform task data compression above.
The description of embodiment of the method more than, it is apparent to those skilled in the art that the application can be borrowed
Help software to add the mode of required general hardware platform to realize, naturally it is also possible to by hardware, but in many cases the former
It is more preferably embodiment.Understood based on such, the technical scheme of the application is substantially made to prior art in other words
The part of contribution can be embodied in the form of software product, and be stored in a storage medium, by reading and holding
Dependent instruction in the row storage medium allows related smart machine to perform calculating platform described in the application each embodiment
Task data compresses all or part of step of switching method and/or the suitable compression degree evaluation method of calculating platform task data.
And foregoing storage medium can include：Read-only storage (ROM), random access memory (RAM), magnetic disc or
Person's CD etc. is various can be with data storage and the medium of program code.
Corresponding with platform task data calculated above compression switching method, the application also provides a kind of calculating platform task
Data compression switching device.Specifically, the compression switching device that the application is provided can be arranged at the Hive of cluster shown in Fig. 1
In.Fig. 4 is a kind of structured flowchart of the device shown in the exemplary embodiment of the application one.Reference picture 4, the device bag
Include：
Index selection unit U301, supports to press its task data for for the calculating platform, obtaining to characterize
The positive compression index of contracting, and characterize the negative sense compression index for not supporting to be compressed its task data；
Judging unit U302 is compressed, for according to the positive compression index and the negative sense compression index, judging described
Whether calculating platform meets compression switching condition；
Switch execution unit U303, for when the calculating platform meets compression switching condition, compressing calculating platform
Task data, otherwise, the task data of calculating platform is not compressed.
Alternatively, the above-mentioned exponent calculation unit of the application is specifically configured to：For the calculating platform, acquisition is following just
At least one of into compression index：CPU surpluses and internal memory surplus, and obtain in following negative sense compression index at least one
：Disk surplus and network transmission surplus.
It is preferred that, the above-mentioned compression judging unit of the application can specifically include：
Index computing module, for calculating the positive cake compressibility according to the positive compression index, and according to described negative
The negative sense cake compressibility is calculated to compression index；Wherein, the positive cake compressibility and the positive compression index positive
Close, the negative sense cake compressibility and the negative sense compression index positive correlation；
Judge module is compressed, for according to the positive cake compressibility and the reverse compression index, judging that described calculate is put down
Whether platform meets compression switching condition.
In one feasible embodiment of the application, above-mentioned compression judge module is specifically as follows：First compression judges mould
Block；The first compression judge module is used for, according to the positive cake compressibility and the ratio of the reverse compression index, really
The compression switching index of the fixed calculating platform, and the compression switching index is judged whether in default compression is interval, such as
Fruit is then to judge that the calculating platform meets compression switching condition, otherwise judges that the calculating platform does not meet compression switching
Condition.
In the application in another feasible embodiment, above-mentioned compression judge module is specifically as follows：Second compression judges
Module；The second compression judge module is used for, relatively more described positive compression switching index and pre-set forward compression threshold, and
Compare negative sense compression switching index and default reverse compression threshold value, if the positive cake compressibility not less than it is described just
To compression threshold and the reverse compression index is not more than the reverse compression threshold value, then judge that the calculating platform meets pressure
Contracting switching condition, otherwise judges that the calculating platform does not meet compression switching condition.
From above technical scheme, the calculating platform task data compression switching device that the embodiment of the present application is provided passes through
The positive compression index and negative sense compression index of calculating platform are obtained, whether to be fitted under overall merit calculating platform present case
Conjunction is compressed to task data, if be adapted to, that is, meets compression switching condition, then controls calculating platform in the case of this
The task data of generation is compressed, if practical situations change, is no longer complies with switching condition, then control calculates flat
Platform is no longer compressed to task data.It can be seen that, the present embodiment can realize the practical situations reality according to calculating platform
When be compressed control, switching, relative in correlation technique without exception according to parameter preset decide whether compression control mode,
The present embodiment is monitored in real time by the index of correlation to cluster, realizes that what whether task data was compressed cuts automatically
Change, it is to avoid appearance causes tasks carrying efficiency to decline because mass data etc. is to be compressed, or do not pressed largely because storing and transmitting
Contracting data cause the phenomenon that disk and network pressure increase.
In addition, relative to the suitable compression degree evaluation method embodiment of above-mentioned calculating platform task data, present invention also provides
A kind of suitable compression degree evaluating apparatus of calculating platform task data, Fig. 5 is the dress shown in the exemplary embodiment of the application one
A kind of structured flowchart put.As shown in figure 5, the suitable compression degree evaluating apparatus of calculating platform task data includes：
Positive index selection unit U401, supports what the calculating platform task data was compressed for obtaining to characterize
Positive compression index；
Negative sense index selection unit U402, does not support to be compressed the calculating platform task data for obtaining to characterize
Negative sense compression index；
Cake compressibility computing unit U403, for according to the positive compression index and the negative sense compression index, it is determined that
Characterize the compression switching index of the suitable compression degree of calculating platform task data.
Optionally, above-mentioned positive index selection unit is specifically configured to：Obtain the CPU surpluses and internal memory of calculating platform
At least one in surplus.
Optionally, above-mentioned negative sense index selection unit is specifically configured to：Obtain the disk surplus and net of the calculating platform
Network transmits at least one in surplus.
Optionally, above-mentioned cake compressibility computing unit is specifically configured to：
Positive cake compressibility is calculated according to the positive compression index, and reverse compression is calculated according to the reverse compression index
Index；Wherein, the positive cake compressibility and the positive compression index positive correlation, the reverse compression index with it is described
Reverse compression index positive correlation；
According to the positive cake compressibility and the ratio of the reverse compression index, the compression switching of the calculating platform is determined
Index.
From above technical scheme, the suitable compression degree evaluation dress of calculating platform task data that the embodiment of the present application is provided
Put, the degree of calculating platform task data Suitable compression is quantified as compression switching index, compression switching index at least may be used
For judging under present case to be compressed if appropriate for calculating platform task data.If specifically, the compression is cut
Index is changed in default compression is interval, illustrates that the task data in the current situation suitably to calculating platform is compressed, can
To play the calculating platform reading and writing data amount that reduces, the reduction effect such as hard disk and network transmission load；, whereas if the compression
Switch index not in default compression is interval, illustrate to be not suitable in the current situation to press the task data of calculating platform
Contracting, can play raising tasks carrying efficiency, the reduction effect such as CPU and Memory Load.
For convenience of description, it is divided into various units during description apparatus above with function to describe respectively.Certainly, this is being implemented
The function of each unit can be realized in same or multiple softwares and/or hardware during application.In addition, in this specification
Each embodiment is described by the way of progressive, and identical similar part is mutually referring to often between each embodiment
What individual embodiment was stressed is all the difference with other embodiment.For device or system embodiment,
Because it is substantially similar to embodiment of the method, so describing fairly simple, referring to the part of embodiment of the method in place of correlation
Explanation.
Described above is only the embodiment of the application, is made skilled artisans appreciate that or realizing the application.
A variety of modifications to these embodiments will be apparent to one skilled in the art, and as defined herein one
As principle can in other embodiments be realized in the case where not departing from spirit herein or scope.Therefore, this Shen
The embodiments shown herein please be not intended to be limited to, and is to fit to and principles disclosed herein and features of novelty
Consistent most wide scope.
Claims (16)
1. a kind of calculating platform task data compresses switching method, it is characterised in that including：
For the calculating platform, the positive compression index for characterizing and supporting to be compressed to its task data, Yi Jibiao are obtained
Levy the negative sense compression index for not supporting to be compressed its task data；
According to the positive compression index and the negative sense compression index, judge whether the calculating platform meets compression switching
Condition；
If the calculating platform meets compression switching condition, the task data of calculating platform is compressed, otherwise, is not compressed
The task data of calculating platform.
2. according to the method described in claim 1, it is characterised in that for the calculating platform,
Described obtain characterizes the positive compression index that support is compressed to its task data, including：Described calculate is obtained to put down
At least one of in the CPU surpluses and internal memory surplus of platform；
The acquisition characterizes the negative sense compression index for not supporting to be compressed its task data, including：Obtain described calculate
At least one of in the disk surplus and network transmission surplus of platform.
3. method according to claim 1 or 2, it is characterised in that according to the positive compression index and described negative
To compression index, judge whether the calculating platform meets compression switching condition, including：
The positive cake compressibility is calculated according to the positive compression index；Wherein, the positive cake compressibility with it is described just
To compression index positive correlation；
The negative sense cake compressibility is calculated according to the negative sense compression index；Wherein, the negative sense cake compressibility is born with described
To compression index positive correlation；
According to the positive cake compressibility and the reverse compression index, judge whether the calculating platform meets compression switching
Condition.
4. method according to claim 3, it is characterised in that according to the positive cake compressibility and the reverse pressure
Contracting index, judges whether the calculating platform meets compression switching condition, including：
According to the positive cake compressibility and the ratio of the reverse compression index, the compression switching of the calculating platform is determined
Index；
The compression switching index is judged whether in default compression is interval, if it is, judging that the calculating platform meets
Switching condition is compressed, otherwise judges that the calculating platform does not meet compression switching condition.
5. method according to claim 3, it is characterised in that according to the positive cake compressibility and the reverse pressure
Contracting index, judges whether the calculating platform meets compression switching condition, including：
Compare the positive compression switching index and pre-set forward compression threshold, and relatively more described negative sense compression switching index with
Default reverse compression threshold value；
If the positive cake compressibility is not more than described anti-not less than the positive compression threshold and the reverse compression index
To compression threshold, then judge that the calculating platform meets compression switching condition, otherwise judge that the calculating platform is not inconsistent combined pressure
Contracting switching condition.
6. a kind of suitable compression degree evaluation method of calculating platform task data, it is characterised in that including：
Obtain the positive compression index for characterizing and supporting to be compressed to the calculating platform task data；
Obtain the negative sense compression index for characterizing and not supporting to be compressed the calculating platform task data；
According to the positive compression index and the negative sense compression index, preferably pressed it is determined that characterizing the calculating platform task data
The compression switching index of contracting degree.
7. method according to claim 6, it is characterised in that
The positive compression index for obtaining the calculating platform, including：
Obtain at least one in the CPU surpluses and internal memory surplus of calculating platform；
The reverse compression index for obtaining the calculating platform, including：
Obtain at least one in the disk surplus and network transmission surplus of the calculating platform.
8. the method according to claim 6 or 7, it is characterised in that according to the positive compression index and described negative
To compression index, the compression switching index of the calculating platform is determined, including
Positive cake compressibility is calculated according to the positive compression index；Wherein, the positive cake compressibility and the positive pressure
Contracting index positive correlation；
Reverse compression index is calculated according to the reverse compression index；Wherein, the reverse compression index and the reverse pressure
Contracting index positive correlation；
According to the positive cake compressibility and the ratio of the reverse compression index, the compression switching of the calculating platform is determined
Index.
9. a kind of calculating platform task data compresses switching device, it is characterised in that including：
Index selection unit, supports to be compressed just its task data for for the calculating platform, obtaining to characterize
To compression index, and characterize the negative sense compression index for not supporting to be compressed its task data；
Judging unit is compressed, for according to the positive compression index and the negative sense compression index, judging that described calculate is put down
Whether platform meets compression switching condition；
Switch execution unit, for when the calculating platform meets compression switching condition, compressing the number of tasks of calculating platform
According to otherwise, the task data of calculating platform not being compressed.
10. device according to claim 9, it is characterised in that the index selection unit is specifically configured to：
For the calculating platform, at least one in following positive compression index is obtained：CPU surpluses and internal memory surplus,
And obtain in following negative sense compression index at least one of：Disk surplus and network transmission surplus.
11. the device according to claim 9 or 10, it is characterised in that the compression judging unit includes：
Index computing module, for calculating the positive cake compressibility according to the positive compression index, and according to described negative
The negative sense cake compressibility is calculated to compression index；Wherein, the positive cake compressibility and the positive compression index positive
Close, the negative sense cake compressibility and the negative sense compression index positive correlation；
Judge module is compressed, for according to the positive cake compressibility and the reverse compression index, judging that described calculate is put down
Whether platform meets compression switching condition.
12. device according to claim 11, it is characterised in that the compression judge module includes：
First compression judge module, for the ratio according to the positive cake compressibility and the reverse compression index, it is determined that
The compression switching index of the calculating platform, and the compression switching index is judged whether in default compression is interval, if
It is then to judge that the calculating platform meets compression switching condition, otherwise judges that the calculating platform does not meet compression switching bar
Part.
13. device according to claim 11, it is characterised in that the compression judge module includes：
Second compression judge module, for comparing the positive compression switching index and pre-set forward compression threshold, and compares
The negative sense compression switching index and default reverse compression threshold value, if the positive cake compressibility is not less than the positive pressure
The contracting threshold value and reverse compression index is not more than the reverse compression threshold value, then judge that the calculating platform meets compression and cut
Condition is changed, otherwise judges that the calculating platform does not meet compression switching condition.
14. a kind of suitable compression degree evaluating apparatus of calculating platform task data, it is characterised in that including：
Positive index selection unit, the positive pressure for supporting to be compressed the calculating platform task data is characterized for obtaining
Contracting index；
Negative sense index selection unit, the negative sense for not supporting to be compressed the calculating platform task data is characterized for obtaining
Compression index；
Cake compressibility computing unit, for according to the positive compression index and the negative sense compression index, it is determined that characterizing institute
State the compression switching index of the suitable compression degree of calculating platform task data.
15. device according to claim 14, it is characterised in that
The positive index selection unit is specifically configured to：Obtain in the CPU surpluses and internal memory surplus of calculating platform extremely
It is few one；
The negative sense index selection unit is specifically configured to：More than the disk surplus and network transmission for obtaining the calculating platform
At least one in amount.
16. the device according to claims 14 or 15, it is characterised in that the cake compressibility computing unit is specific
It is configured as：
Positive cake compressibility is calculated according to the positive compression index, and reverse compression is calculated according to the reverse compression index
Index；Wherein, the positive cake compressibility and the positive compression index positive correlation, the reverse compression index with it is described
Reverse compression index positive correlation；
According to the positive cake compressibility and the ratio of the reverse compression index, the compression switching of the calculating platform is determined
Index.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610144694.5A CN107193642A (en) | 2016-03-14 | 2016-03-14 | Task data compression switching method, suitable compression degree evaluation method and relevant apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610144694.5A CN107193642A (en) | 2016-03-14 | 2016-03-14 | Task data compression switching method, suitable compression degree evaluation method and relevant apparatus |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107193642A true CN107193642A (en) | 2017-09-22 |
Family
ID=59871231
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610144694.5A Pending CN107193642A (en) | 2016-03-14 | 2016-03-14 | Task data compression switching method, suitable compression degree evaluation method and relevant apparatus |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107193642A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109558085A (en) * | 2018-12-03 | 2019-04-02 | 郑州云海信息技术有限公司 | A kind of compression method, system, equipment and computer readable storage medium |
Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1500311A (en) * | 2001-01-28 | 2004-05-26 | �µ�ͨ��������˾ɳ��Ѷ��·ֹ�˾ | Hands-free device for operating mobile telephones in motor vehicles |
| CN1598811A (en) * | 2003-09-19 | 2005-03-23 | 株式会社Ntt都科摩 | Data compresser,data decompresser and data managing system |
| CN1655536A (en) * | 2004-02-12 | 2005-08-17 | 三星电子株式会社 | Method for resuming header decompression in a multimedia broadcast /multicast service system |
| CN1799032A (en) * | 2002-12-12 | 2006-07-05 | 国际商业机器公司 | Method and apparatus for morphing memory compressed machines |
| CN101159677A (en) * | 2007-10-25 | 2008-04-09 | 华为技术有限公司 | Packet transmission method and network node device |
| CN101204068A (en) * | 2005-06-21 | 2008-06-18 | 艾利森电话股份有限公司 | Dynamic robust header compression |
| CN102111437A (en) * | 2010-12-30 | 2011-06-29 | 浪潮集团山东通用软件有限公司 | Simple object access protocol (SOAP) extension-based WEB service transmission compression method |
| US8122857B2 (en) * | 2009-05-04 | 2012-02-28 | Robert Bosch Gmbh | Control architecture and optimal strategy for switching between 2-stroke and 4-stroke modes of HCCI operation |
| CN102404564A (en) * | 2010-09-03 | 2012-04-04 | Arm有限公司 | Data compression and decompression using relative and absolute increament values |
| CN103188103A (en) * | 2011-12-31 | 2013-07-03 | 成都勤智数码科技股份有限公司 | Self-monitoring method of network management system |
| US8685150B1 (en) * | 2010-01-05 | 2014-04-01 | Joseph Edward Caudle | Temperature pump passive filters and automated devices |
| CN104641638A (en) * | 2012-06-28 | 2015-05-20 | 阿克西斯股份公司 | System and method for encoding video content using virtual intra-frames |
| CN104838631A (en) * | 2012-12-11 | 2015-08-12 | 高通股份有限公司 | Method and apparatus for classifying flows for compression |
| CN105069690A (en) * | 2015-06-11 | 2015-11-18 | 国家电网公司 | Power grid operating data processing method |
| CN105302494A (en) * | 2015-11-19 | 2016-02-03 | 浪潮(北京)电子信息产业有限公司 | Compression strategy selecting method and device |
-
2016
- 2016-03-14 CN CN201610144694.5A patent/CN107193642A/en active Pending
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1500311A (en) * | 2001-01-28 | 2004-05-26 | �µ�ͨ��������˾ɳ��Ѷ��·ֹ�˾ | Hands-free device for operating mobile telephones in motor vehicles |
| CN1799032A (en) * | 2002-12-12 | 2006-07-05 | 国际商业机器公司 | Method and apparatus for morphing memory compressed machines |
| CN1598811A (en) * | 2003-09-19 | 2005-03-23 | 株式会社Ntt都科摩 | Data compresser,data decompresser and data managing system |
| CN1655536A (en) * | 2004-02-12 | 2005-08-17 | 三星电子株式会社 | Method for resuming header decompression in a multimedia broadcast /multicast service system |
| CN101204068A (en) * | 2005-06-21 | 2008-06-18 | 艾利森电话股份有限公司 | Dynamic robust header compression |
| CN101159677A (en) * | 2007-10-25 | 2008-04-09 | 华为技术有限公司 | Packet transmission method and network node device |
| US8122857B2 (en) * | 2009-05-04 | 2012-02-28 | Robert Bosch Gmbh | Control architecture and optimal strategy for switching between 2-stroke and 4-stroke modes of HCCI operation |
| US8685150B1 (en) * | 2010-01-05 | 2014-04-01 | Joseph Edward Caudle | Temperature pump passive filters and automated devices |
| CN102404564A (en) * | 2010-09-03 | 2012-04-04 | Arm有限公司 | Data compression and decompression using relative and absolute increament values |
| CN102111437A (en) * | 2010-12-30 | 2011-06-29 | 浪潮集团山东通用软件有限公司 | Simple object access protocol (SOAP) extension-based WEB service transmission compression method |
| CN103188103A (en) * | 2011-12-31 | 2013-07-03 | 成都勤智数码科技股份有限公司 | Self-monitoring method of network management system |
| CN104641638A (en) * | 2012-06-28 | 2015-05-20 | 阿克西斯股份公司 | System and method for encoding video content using virtual intra-frames |
| CN104838631A (en) * | 2012-12-11 | 2015-08-12 | 高通股份有限公司 | Method and apparatus for classifying flows for compression |
| CN105069690A (en) * | 2015-06-11 | 2015-11-18 | 国家电网公司 | Power grid operating data processing method |
| CN105302494A (en) * | 2015-11-19 | 2016-02-03 | 浪潮(北京)电子信息产业有限公司 | Compression strategy selecting method and device |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109558085A (en) * | 2018-12-03 | 2019-04-02 | 郑州云海信息技术有限公司 | A kind of compression method, system, equipment and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106095363B (en) | A kind of ameliorative way, device and the terminal of terminal Caton | |
| CN104809051B (en) | Method and apparatus for predicting exception and failure in computer application | |
| CN105072191B (en) | Method for determining target communication channel and server | |
| CN105677836A (en) | Big data processing and solving system simultaneously supporting offline data and real-time online data | |
| CN107040578A (en) | Method of data synchronization, device and system | |
| CN111738852A (en) | Service data processing method and device and server | |
| CN109933501B (en) | Capacity evaluation method and device of application system | |
| CN108923996A (en) | A kind of capacity analysis method and device | |
| CN108090678A (en) | Data model monitoring method, system, equipment and computer storage medium | |
| CN109284229B (en) | Dynamic adjustment method based on QPS and related equipment | |
| CN108320112B (en) | Method and device for determining health state of equipment | |
| CN103455555A (en) | Recommendation method and device based on mobile terminal similarity | |
| CN107193642A (en) | Task data compression switching method, suitable compression degree evaluation method and relevant apparatus | |
| CN107341202A (en) | Appraisal procedure, device and the storage medium of business datum table amendment risk factor | |
| CN109978172B (en) | Resource pool utilization rate prediction method and device based on extreme learning machine | |
| CN113689112A (en) | Smart energy station energy efficiency evaluation method and system using cloud computing to improve analytic hierarchy process | |
| CN110311933A (en) | A kind of method, apparatus, equipment and the storage medium of equilibrium service traffics | |
| CN112541595A (en) | Model construction method and device, storage medium and electronic equipment | |
| CN111026624B (en) | Fault prediction method and device of power grid information system | |
| CN109800079B (en) | Node adjusting method in medical insurance system and related device | |
| CN106294445B (en) | The method and device of data storage based on across computer room Hadoop cluster | |
| CN111080037A (en) | Short-term power load prediction method and device based on deep neural network | |
| CN110008880A (en) | A kind of model compression method and device | |
| CN106776623B (en) | User behavior analysis method and device | |
| CN114021833A (en) | Line loss prediction method, system, storage medium and computing device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 1244561 Country of ref document: HK |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170922 |
|
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: WD Ref document number: 1244561 Country of ref document: HK |