CN104484174A - Processing method and processing device for compressed file with RAR (Roshal A Rchive) format - Google Patents
Processing method and processing device for compressed file with RAR (Roshal A Rchive) format Download PDFInfo
- Publication number
- CN104484174A CN104484174A CN201410773628.5A CN201410773628A CN104484174A CN 104484174 A CN104484174 A CN 104484174A CN 201410773628 A CN201410773628 A CN 201410773628A CN 104484174 A CN104484174 A CN 104484174A
- Authority
- CN
- China
- Prior art keywords
- ion
- file
- decompress
- function
- class
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012545 processing Methods 0.000 title claims abstract description 56
- 238000003672 processing method Methods 0.000 title abstract 4
- 238000007405 data analysis Methods 0.000 claims abstract description 47
- 230000006837 decompression Effects 0.000 claims abstract description 27
- 230000006870 function Effects 0.000 claims description 177
- 238000000034 method Methods 0.000 claims description 48
- 230000008569 process Effects 0.000 claims description 42
- 238000004458 analytical method Methods 0.000 claims description 7
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 238000010230 functional analysis Methods 0.000 claims description 2
- 230000000875 corresponding effect Effects 0.000 description 12
- 238000010586 diagram Methods 0.000 description 9
- 238000004364 calculation method Methods 0.000 description 6
- 230000011218 segmentation Effects 0.000 description 5
- 238000013459 approach Methods 0.000 description 4
- 230000006835 compression Effects 0.000 description 4
- 238000007906 compression Methods 0.000 description 4
- 230000002354 daily effect Effects 0.000 description 4
- 239000012634 fragment Substances 0.000 description 4
- 239000012141 concentrate Substances 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a processing method and a processing device for a compressed file with an RAR (Roshal A Rchive) format. The processing method for the compressed file with the RAR format comprises the following steps of determining a to-be-processed compressed file with the RAR format; acquiring a pre-created file loading class function and a file decompression class function; performing decompression on the to-be-processed compressed file with the RAR format by calling the file decompression class function in the file loading class function to obtain a decompressed file; acquiring a storage path of the decompressed file; performing analytical processing on the decompressed file through a data analysis function to obtain a processing result. Through the processing method and the processing device disclosed by the invention, the problem that the compressed file with the RAR format cannot be read or analyzed by Hadoop in the prior art is solved.
Description
Technical field
The present invention relates to data processing field, in particular to a kind of disposal route and device of compressed file of RAR form.
Background technology
Usually need to utilize Hadoop to carry out to the analysis of daily record data in daily reality, wherein, Hadoop is a software frame of increasing income that can carry out distributed treatment to mass data, Hadoop mainly comprises two parts as the computing platform of distributed large data, distributed file system (Hadoop Distributed File System, referred to as HDFS) and Distributed Calculation frame MapReduce.HDFS can create, delete, mobile or Rename file, has the feature such as high fault tolerance, expansibility.MapReduce containment mapping (Map) and merging (Reduce) two parts, data analysis is generally carried out in Map, and analysis result is undertaken merging rear output by Reduce.Utilize the process of Hadoop file reading as shown in Figure 1, wherein, Fig. 1 is the process flow diagram of the Hadoop file reading according to prior art, by input segmentation function InputFormat, the file data be stored in HDFS is split, generate multiple file data fragments Splits, multiple Splits is read by function reading RecordReader, then using reading the input parameter of result as Map, Map carries out analyzing and processing to reading result, data processed result is undertaken merging rear output by Reduce, utilize output function OutputFormat by Output rusults stored in HDFS.
But along with portfolio ground constantly increases, the daily record data amount of server generation every day increases fast.In order to improve the space availability ratio of computer system, usually needing daily record data to be carried out compression and preserving.In prior art, the form of the compressed file that Hadoop can read has gzip, bzip, lzo, snappy etc., but does not support RAR form, and namely Hadoop cannot read the compressed file of RAR form.RAR is a kind of common compressed format, there is compression factor high, the advantages such as compression speed is fast, and the file in HDFS adopts RAR form to carry out the compression of file mostly, in prior art, Hadoop cannot read the compressed file of RAR form, a lot of trouble will be brought to data processing, have a strong impact on data-handling efficiency.
The problem of the compressed file analyzing RAR form cannot be read for Hadoop of the prior art, not yet propose effective solution at present.
Summary of the invention
Fundamental purpose of the present invention is disposal route and the device of the compressed file providing a kind of RAR form, to solve the problem that Hadoop of the prior art cannot read the compressed file analyzing RAR form.
To achieve these goals, according to an aspect of the present invention, a kind of disposal route of compressed file of RAR form is provided.
The disposal route of the compressed file of this RAR form comprises: the compressed file determining pending RAR form; Obtain the files loading class function and file decompress(ion) class function that are pre-created; Carrying out decompress(ion) by calling the compressed file of file decompress(ion) class function to pending RAR form in files loading class function, obtaining decompressing files; The store path of file after acquisition decompress(ion); Perform the analyzing and processing to decompressing files by data analysis function, obtain result.
Further, carry out decompress(ion) comprise by calling the compressed file of file decompress(ion) class function to pending RAR form in files loading class function, obtain decompressing files and comprise: perform in files loading class function and call file decompress(ion) class function; In file decompress(ion) class function, perform the decompression function called in decompress(ion) bag, obtain decompressing files, wherein, in decompress(ion) bag, store the decompression function compressed file of pending RAR form being carried out to decompress(ion).
Further, perform analyzing and processing to decompressing files, obtain result and comprise by data analysis function: the rreturn value obtaining file decompress(ion) class function, wherein, the rreturn value of file decompress(ion) class function is the character string that the store path of decompressing files is corresponding; The rreturn value of file decompress(ion) class function is sent to data analysis function and carries out analyzing and processing, obtain result.
Further, the rreturn value of file decompress(ion) class function is sent to data analysis function and carries out analyzing and processing, obtain result and comprise: the rreturn value of file decompress(ion) class function is converted into class of paths address; The decompressing files that acquisition approach class address place stores; Data analysis function carries out analyzing and processing to decompressing files, obtains result.
Further, carry out analyzing and processing at data analysis function to decompressing files, after obtaining result, method also comprises: delete the decompressing files that class of paths address place stores; Result is stored in address corresponding to default store path.
Further, the disposal route of the compressed file of this RAR form starts multiple process simultaneously, wherein, in each process, data analysis function is to decompressing files execution analysis process, at data analysis function, analyzing and processing is carried out to decompressing files, after obtaining result, the disposal route of the compressed file of this RAR form also comprises: the multiple results obtained after the data analysis Functional Analysis process in multiple process merged, and obtains the result after merging; Export the result after merging.
To achieve these goals, according to a further aspect in the invention, a kind for the treatment of apparatus of compressed file of RAR form is provided.
The treating apparatus of the compressed file of this RAR form comprises: determination module, for determining the compressed file of pending RAR form; First acquisition module, for obtaining the files loading class function and file decompress(ion) class function that are pre-created; Decompression module, for carrying out decompress(ion) by calling the compressed file of file decompress(ion) class function to pending RAR form in files loading class function, obtains decompressing files; Second acquisition module, for obtaining the store path of decompressing files; Processing module, for being performed the analyzing and processing to decompressing files by data analysis function, obtains result.
Further, decompression module comprises: the first calling module, calls file decompress(ion) class function for performing in files loading class function; Second calling module, for performing the decompression function called in decompress(ion) bag in file decompress(ion) class function, obtaining decompressing files, wherein, storing the decompression function compressed file of pending RAR form being carried out to decompress(ion) in decompress(ion) bag.
Further, processing module comprises: second obtains submodule, and for obtaining the rreturn value of file decompress(ion) class function, wherein, the rreturn value of file decompress(ion) class function is the character string that the store path of decompressing files is corresponding; First process submodule, carry out analyzing and processing for the rreturn value of file decompress(ion) class function is sent to data analysis function, obtain result, wherein, first process submodule comprises: conversion module, for the rreturn value of file decompress(ion) class function is converted into class of paths address; 3rd obtains submodule, for the decompressing files that acquisition approach class address place stores; Second process submodule, carries out analyzing and processing for data analysis function to decompressing files, obtains result.
Further, the treating apparatus of the compressed file of this RAR form also comprises: removing module, for deleting the decompressing files that class of paths address place stores; Memory module, for being stored in address corresponding to default store path by result.
By the present invention, adopt the compressed file determining pending RAR form; Obtain the files loading class function and file decompress(ion) class function that are pre-created; Carrying out decompress(ion) by calling the compressed file of file decompress(ion) class function to pending RAR form in files loading class function, obtaining decompressing files; Obtain the store path of decompressing files; Perform the analyzing and processing to decompressing files by data analysis function, obtain result, solve the problem that Hadoop of the prior art cannot read the compressed file analyzing RAR form.This invention creates files loading class function and file decompress(ion) class function on the basis inputting segmentation function and function reading, file decompress(ion) class function is utilized to read the compressed file of the RAR form in HDFS and carried out decompress(ion), obtain decompressing files, then decompressing files is sent in Map and carries out analyzing and processing, obtain result, finally result is stored in HDFS.In this invention, Hadoop can start multiple Map task simultaneously, the corresponding file decompress(ion) class function of each Map, each file decompress(ion) class function reads the compressed file of a RAR form, processes, improve execution efficiency while achieving the compressed file of multiple pending RAR form like this.In addition, this invention executes after analyzing and processing obtains result at Map and is deleted by temporary decompressing files, has saved system space.
Accompanying drawing explanation
The accompanying drawing forming a application's part is used to provide a further understanding of the present invention, and schematic description and description of the present invention, for explaining the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings:
Fig. 1 is the process flow diagram of the Hadoop file reading according to prior art;
Fig. 2 is the process flow diagram of the disposal route of the compressed file of RAR form according to the embodiment of the present invention;
Fig. 3 reads according to the Hadoop of the embodiment of the present invention compressed file process flow diagram analyzing RAR form; And
Fig. 4 is the schematic diagram of the treating apparatus of the compressed file of RAR form according to the embodiment of the present invention.
Embodiment
It should be noted that, when not conflicting, the embodiment in the application and the feature in embodiment can combine mutually.Below with reference to the accompanying drawings and describe the present invention in detail in conjunction with the embodiments.
The application's scheme is understood better in order to make those skilled in the art person, below in conjunction with the accompanying drawing in the embodiment of the present application, technical scheme in the embodiment of the present application is clearly and completely described, obviously, described embodiment is only the embodiment of the application's part, instead of whole embodiments.Based on the embodiment in the application, those of ordinary skill in the art are not making the every other embodiment obtained under creative work prerequisite, all should belong to the scope of the application's protection.
It should be noted that, term " first ", " second " etc. in the instructions of the application and claims and above-mentioned accompanying drawing are for distinguishing similar object, and need not be used for describing specific order or precedence.Should be appreciated that the data used like this can be exchanged, in the appropriate case so that the embodiment of the application described herein.In addition, term " comprises " and " having " and their any distortion, intention is to cover not exclusive comprising, such as, contain those steps or unit that the process of series of steps or unit, method, system, product or equipment is not necessarily limited to clearly list, but can comprise clearly do not list or for intrinsic other step of these processes, method, product or equipment or unit.
The present invention aims to provide a kind of disposal route and device of compressed file of RAR form.
Fig. 2 is the process flow diagram of the disposal route of the compressed file of RAR form according to the embodiment of the present invention.As shown in Figure 2, the disposal route of the compressed file of this RAR form comprises following step S101 to step S105:
Step S101, determines the compressed file of pending RAR form.
The compressed file of the RAR form stored in HDFS has a lot of usually; the disposal route of the compressed file of the RAR form of this embodiment can carry out reading process to the compressed file of a RAR form, also can carry out reading process to the compressed file of multiple RAR form.Determine that the number of the compressed file of pending RAR form can be determined according to concrete analysis demand.Preferably, the disposal route of the compressed file of the RAR form of this embodiment determines that the number of the compressed file of pending RAR form is multiple, process separately relative to after the compressed file reading RAR form one by one, the disposal route of the compressed file of the RAR form of this embodiment drastically increases treatment effeciency.
Preferably, also comprise while the compressed file determining pending RAR form: the store path obtaining the compressed file of pending RAR form, the object obtaining this store path is the compressed file of the pending RAR form of the address place storage that this store path of Obtaining Accurate is corresponding.
Step S102, obtains the files loading class function and file decompress(ion) class function that are pre-created.
The Treatment Analysis that the compressed file of pending RAR form is correlated with is needed by means of class function, such as, the compressed file reading pending RAR form needs to use files loading function, and carrying out decompress(ion) to the compressed file of pending RAR form needs to use file decompression function etc.The disposal route of the compressed file of the RAR form of this embodiment creates the files loading class function RarInputFormat of the compressed file for RAR form on the basis of inheriting the input segmentation function InputFormat for ordinary file in Hadoop framework, and the basis of inheriting the function reading RecordReader for ordinary file in Hadoop framework creates the file decompress(ion) class function RarRecordReader of the compressed file for RAR form.RarInputFormat can read the compressed file of one or more RAR form from HDFS, and the compressed file of this one or more RAR form is carried out Data Segmentation, generates several data file fragments.RarRecordReader reads this data file fragment, and these data file fragments are carried out decompress(ion), creating decompressed file, and obtain and store the store path of decompressing files, using the store path of this storage decompressing files as Parameter transfer to data analysis function Map.Reading to the compressed file of RAR form and decompress(ion) can be realized by these two class functions.
Step S103, carrying out decompress(ion) by calling the compressed file of file decompress(ion) class function to pending RAR form in files loading class function, obtaining decompressing files.
In files loading class function RarInputFormat, call file decompress(ion) class function RarRecordReader decompress(ion) is carried out to the compressed file of RAR form, obtain decompressing files.Wherein, in file decompress(ion) class function RarRecordReader, carry out decompress(ion) to the compressed file of RAR form specifically to comprise: perform in files loading class function RarInputFormat and call file decompress(ion) class function RarRecordReader; In file decompress(ion) class function RarRecordReader, perform the decompression function called in decompress(ion) bag, obtain decompressing files, wherein, in decompress(ion) bag, store the decompression function compressed file of pending RAR form being carried out to decompress(ion).Decompress(ion) bag in this embodiment is preferably java-unrar-0.5.jar bag, and this jar wraps can at https: //clojars.org/org.clojars.bonega/java-unrar downloads.The decompression function called in file decompress(ion) class function RarRecordReader in this jar bag carries out decompress(ion) to the compressed file of RAR form.The disposal route of the compressed file of the RAR form of this embodiment carries out decompress(ion) to the compressed file of RAR form, conveniently reads the content of this file or processes.
Step S104, the store path of file after acquisition decompress(ion).
By calling after the compressed file of file decompress(ion) class function RarRecordReader to pending RAR form carry out decompress(ion) in files loading class function RarInputFormat, obtain decompressing files.Preferably, decompressing files will temporarily be stored in HDFS.The store path of decompressing files in HDFS will be delivered in data analysis function Map as the rreturn value Value of file decompression function RarRecordReader.Using the store path of decompressing files in HDFS as parameters input in data analysis function Map, be conducive to decompressing files corresponding data analysis function Map obtains the compressed file decompress(ion) of RAR form according to this store path after, facilitate data analysis function Map to carry out analyzing and processing to this decompressing files.
Step S105, performs the analyzing and processing to decompressing files by data analysis function, obtains result.
After data analysis function Map receives the rreturn value Value of file decompression function RarRecordReader, this data analysis function can carry out analyzing and processing to decompressing files.Preferably, the disposal route of the compressed file of the RAR form of this embodiment is by the analyzing and processing of data analysis function execution to decompressing files, obtain result specifically can comprise: the rreturn value obtaining file decompress(ion) class function, wherein, the rreturn value of file decompress(ion) class function is the character string that the store path of decompressing files is corresponding; The rreturn value of file decompress(ion) class function is sent to data analysis function and carries out analyzing and processing, obtain result.
Particularly, the rreturn value of file decompress(ion) class function is sent to data analysis function and carries out analyzing and processing, obtaining result can comprise: by the class of paths function Path in Hadoop, the rreturn value of file decompress(ion) class function is converted into class of paths address; The decompressing files that the class of paths address place pointed to by data acquisition function F SDateInputStream acquisition approach class function Path is stored; Data analysis function completes the analyzing and processing to decompressing files by business diagnosis logic, and obtains result.
Preferably, at data analysis function, analyzing and processing is carried out to decompressing files, after obtaining result, the disposal route of the compressed file of the RAR form of this embodiment also comprises: the class of paths address place that deletion class of paths function Path points to temporarily is stored in the decompressing files in HDFS, release disk space; And by output function OutputFormat, result is exported, be stored in the address that default store path is corresponding.The decompressing files be temporarily stored in HDFS is deleted by the disposal route of the compressed file of the RAR form of this embodiment, is conducive to delivery system memory headroom.
Preferably, the disposal route of the compressed file of the RAR form of this embodiment can start multiple process simultaneously, wherein, in each process, data analysis function Map is to decompressing files execution analysis process, at data analysis function Map, analyzing and processing is carried out to decompressing files, after obtaining result, the disposal route of the compressed file of the RAR form of this embodiment can also comprise: the multiple results obtained after the data analysis function Map analyzing and processing in multiple process merged by pooled function Reduce, obtains the result after merging; The result after merging is exported finally by data function OutputFormat.The disposal route of the compressed file of the RAR form of this embodiment starts multiple Map task simultaneously, processes, improve execution efficiency while achieving the compressed file to multiple pending RAR form.Fig. 3 reads according to the Hadoop of the embodiment of the present invention compressed file process flow diagram analyzing RAR form.
The disposal route of the compressed file of the RAR form of this embodiment adopts the compressed file determining pending RAR form; Obtain the files loading class function and file decompress(ion) class function that are pre-created; Carrying out decompress(ion) by calling the compressed file of file decompress(ion) class function to pending RAR form in files loading class function, obtaining decompressing files; The store path of file after acquisition decompress(ion); Perform the analyzing and processing to decompressing files by data analysis function, obtain result, solve the problem that Hadoop of the prior art cannot read the compressed file analyzing RAR form.Meanwhile, the disposal route of the compressed file of the RAR form of this embodiment starts multiple Map task simultaneously, processes, improve execution efficiency while achieving the compressed file to multiple pending RAR form.And the disposal route of the compressed file of the RAR form of this embodiment executes after analyzing and processing obtains result at Map deletes temporary decompressing files, has saved system space.
From above description, can find out, the disposal route of the compressed file of the RAR form of the embodiment of the present invention creates files loading class function and file decompress(ion) class function on the basis inputting segmentation function and function reading, file decompress(ion) class function is utilized to read the compressed file of the RAR form in HDFS and carried out decompress(ion), obtain decompressing files, then decompressing files is sent in Map and carries out analyzing and processing, obtain result, finally result is stored in HDFS, solve the problem that Hadoop of the prior art cannot read the compressed file analyzing RAR form.Simultaneously, in this inventive embodiment, Hadoop can start multiple Map task simultaneously, the corresponding file decompress(ion) class function of each Map, each file decompress(ion) class function reads the compressed file of a RAR form, process while achieving the compressed file of multiple pending RAR form like this, improve execution efficiency.In addition, this inventive embodiment executes after analyzing and processing obtains result at Map and is deleted by temporary decompressing files, has greatly saved system space.
It should be noted that, can perform in the computer system of such as one group of computer executable instructions in the step shown in the process flow diagram of accompanying drawing, and, although show logical order in flow charts, but in some cases, can be different from the step shown or described by order execution herein.
The embodiment of the present invention additionally provides a kind for the treatment of apparatus of compressed file of RAR form.It should be noted that, the treating apparatus of the compressed file of this RAR form may be used for the disposal route of the compressed file of the RAR form performing the embodiment of the present invention.
Fig. 4 is the schematic diagram of the treating apparatus of the compressed file of RAR form according to the embodiment of the present invention.As shown in Figure 4, the treating apparatus of the compressed file of this RAR form comprises: determination module 10, the first acquisition module 20, decompression module 30, the second acquisition module 40 and processing module 50.
Determination module 10, for determining the compressed file of pending RAR form.
First acquisition module 20, for obtaining the files loading class function and file decompress(ion) class function that are pre-created.
Decompression module 30, for carrying out decompress(ion) by calling the compressed file of file decompress(ion) class function to pending RAR form in files loading class function, obtains decompressing files.
Preferably, decompression module 30 comprises: the first calling module, calls file decompress(ion) class function for performing in files loading class function; Second calling module, for performing the decompression function called in decompress(ion) bag in file decompress(ion) class function, obtaining decompressing files, wherein, storing the decompression function compressed file of pending RAR form being carried out to decompress(ion) in decompress(ion) bag.
Second acquisition module 40, for obtaining the store path of decompressing files.
Processing module 50, for being performed the analyzing and processing to decompressing files by data analysis function, obtains result.
Preferably, processing module 50 comprises: second obtains submodule, and for obtaining the rreturn value of file decompress(ion) class function, wherein, the rreturn value of file decompress(ion) class function is the character string that the store path of decompressing files is corresponding; First process submodule, carries out analyzing and processing for the rreturn value of file decompress(ion) class function is sent to data analysis function, obtains result.
Particularly, the first process submodule comprises: conversion module, for the rreturn value of file decompress(ion) class function is converted into class of paths address; 3rd obtains submodule, for the decompressing files that acquisition approach class address place stores; Second process submodule, carries out analyzing and processing for data analysis function to decompressing files, obtains result.
Preferably, the treating apparatus of the compressed file of the RAR form of this embodiment also comprises: removing module, for deleting the decompressing files that class of paths address place stores; Memory module, for being stored in address corresponding to default store path by result.
The treating apparatus of the compressed file of the RAR form of this embodiment comprises determination module 10, the first acquisition module 20, decompression module 30, the second acquisition module 40 and processing module 50.The problem that Hadoop of the prior art cannot read the compressed file analyzing RAR form is solved by the treating apparatus of the compressed file of the RAR form of this embodiment, simultaneously, by reading process while the compressed file to multiple pending RAR form, improve treatment effeciency, by deleting temporary decompressing files, save system space.
Obviously, those skilled in the art should be understood that, above-mentioned of the present invention each module or each step can realize with general calculation element, they can concentrate on single calculation element, or be distributed on network that multiple calculation element forms, alternatively, they can realize with the executable program code of calculation element, thus, they can be stored and be performed by calculation element in the storage device, or they are made into each integrated circuit modules respectively, or the multiple module in them or step are made into single integrated circuit module to realize.Like this, the present invention is not restricted to any specific hardware and software combination.
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for a person skilled in the art, the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (10)
1. a disposal route for the compressed file of RAR form, is characterized in that, comprising:
Determine the compressed file of pending RAR form;
Obtain the files loading class function and file decompress(ion) class function that are pre-created;
Carrying out decompress(ion) by calling the compressed file of described file decompress(ion) class function to described pending RAR form in described files loading class function, obtaining decompressing files;
Obtain the store path of described decompressing files; And
Perform the analyzing and processing to described decompressing files by data analysis function, obtain result.
2. the disposal route of the compressed file of RAR form according to claim 1, it is characterized in that, carrying out decompress(ion) by calling the compressed file of described file decompress(ion) class function to described pending RAR form in described files loading class function, obtaining decompressing files and comprising:
Perform in described files loading class function and call described file decompress(ion) class function; And
In described file decompress(ion) class function, perform the decompression function called in decompress(ion) bag, obtain described decompressing files, wherein, in described decompress(ion) bag, store the decompression function compressed file of described pending RAR form being carried out to decompress(ion).
3. the disposal route of the compressed file of RAR form according to claim 1, is characterized in that, performs the analyzing and processing to described decompressing files, obtain result and comprise by data analysis function:
Obtain the rreturn value of described file decompress(ion) class function, wherein, the rreturn value of described file decompress(ion) class function is the character string that the store path of described decompressing files is corresponding; And
The rreturn value of described file decompress(ion) class function is sent to described data analysis function and carries out analyzing and processing, obtain described result.
4. the disposal route of the compressed file of RAR form according to claim 3, is characterized in that, the rreturn value of described file decompress(ion) class function is sent to described data analysis function and carries out analyzing and processing, obtain described result and comprise:
The rreturn value of described file decompress(ion) class function is converted into class of paths address;
Obtain the described decompressing files that described class of paths address place stores; And
Described data analysis function carries out analyzing and processing to described decompressing files, obtains described result.
5. the disposal route of the compressed file of RAR form according to claim 4, is characterized in that, carries out analyzing and processing at described data analysis function to described decompressing files, and after obtaining described result, described method also comprises:
Delete the described decompressing files that described class of paths address place stores; And
Described result is stored in address corresponding to default store path.
6. the disposal route of the compressed file of RAR form according to claim 5, it is characterized in that, described method starts multiple process simultaneously, wherein, data analysis function described in each process is to described decompressing files execution analysis process, carry out analyzing and processing at described data analysis function to described decompressing files, after obtaining described result, described method also comprises:
The multiple results obtained after described data analysis Functional Analysis process in multiple process are merged, obtains the result after merging; And
Export the result after described merging.
7. a treating apparatus for the compressed file of RAR form, is characterized in that, comprising:
Determination module, for determining the compressed file of pending RAR form;
First acquisition module, for obtaining the files loading class function and file decompress(ion) class function that are pre-created;
Decompression module, for carrying out decompress(ion) by calling the compressed file of described file decompress(ion) class function to described pending RAR form in described files loading class function, obtains decompressing files;
Second acquisition module, for obtaining the store path of described decompressing files; And
Processing module, for being performed the analyzing and processing to described decompressing files by data analysis function, obtains result.
8. the treating apparatus of the compressed file of RAR form according to claim 7, is characterized in that, described decompression module comprises:
First calling module, calls described file decompress(ion) class function for performing in described files loading class function; And
Second calling module, for performing the decompression function called in decompress(ion) bag in described file decompress(ion) class function, obtaining described decompressing files, wherein, storing the decompression function compressed file of described pending RAR form being carried out to decompress(ion) in described decompress(ion) bag.
9. the treating apparatus of the compressed file of RAR form according to claim 7, is characterized in that, described processing module comprises:
Second obtains submodule, and for obtaining the rreturn value of described file decompress(ion) class function, wherein, the rreturn value of described file decompress(ion) class function is the character string that the store path of described decompressing files is corresponding;
First process submodule, carries out analyzing and processing for the rreturn value of described file decompress(ion) class function is sent to described data analysis function, obtains described result,
Wherein, described first process submodule comprises:
Conversion module, for being converted into class of paths address by the rreturn value of described file decompress(ion) class function;
3rd obtains submodule, for obtaining the described decompressing files that described class of paths address place stores; And
Second process submodule, carries out analyzing and processing for described data analysis function to described decompressing files, obtains described result.
10. the treating apparatus of the compressed file of RAR form according to claim 9, is characterized in that, described device also comprises:
Removing module, for deleting the described decompressing files that described class of paths address place stores; And
Memory module, for being stored in address corresponding to default store path by described result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410773628.5A CN104484174B (en) | 2014-12-12 | 2014-12-12 | The treating method and apparatus of the compressed file of RAR forms |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410773628.5A CN104484174B (en) | 2014-12-12 | 2014-12-12 | The treating method and apparatus of the compressed file of RAR forms |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104484174A true CN104484174A (en) | 2015-04-01 |
| CN104484174B CN104484174B (en) | 2018-06-22 |
Family
ID=52758718
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410773628.5A Active CN104484174B (en) | 2014-12-12 | 2014-12-12 | The treating method and apparatus of the compressed file of RAR forms |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104484174B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106406923A (en) * | 2015-07-30 | 2017-02-15 | 腾讯科技（深圳）有限公司 | Processing method and device of dynamic library file |
| CN106844766A (en) * | 2017-02-23 | 2017-06-13 | 郑州云海信息技术有限公司 | The method and device of a kind of compressed file decompression |
| CN108197204A (en) * | 2017-12-28 | 2018-06-22 | 北京安博通科技股份有限公司 | Document handling method and device |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101668018A (en) * | 2009-10-13 | 2010-03-10 | 金蝶软件（中国）有限公司 | Network transmission method and system therefor |
| CN103235829A (en) * | 2013-05-14 | 2013-08-07 | 厦门市美亚柏科信息股份有限公司 | Method and device for uncompressing random address register (RAR) file |
-
2014
- 2014-12-12 CN CN201410773628.5A patent/CN104484174B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101668018A (en) * | 2009-10-13 | 2010-03-10 | 金蝶软件（中国）有限公司 | Network transmission method and system therefor |
| CN103235829A (en) * | 2013-05-14 | 2013-08-07 | 厦门市美亚柏科信息股份有限公司 | Method and device for uncompressing random address register (RAR) file |
Non-Patent Citations (3)
| Title |
|---|
| HADOOP: "《http://www.open-open.com/lib/view/open1413861694325.html》", 21 October 2014 * |
| 朱爱兵: "Linux+Apache+Php环境下实现ZIP、Rar文件解压缩", 《电脑知识与技术》 * |
| 李振: ""跨平台的多压缩格式解压引擎的设计与实现"", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106406923A (en) * | 2015-07-30 | 2017-02-15 | 腾讯科技（深圳）有限公司 | Processing method and device of dynamic library file |
| CN106406923B (en) * | 2015-07-30 | 2020-09-04 | 腾讯科技（深圳）有限公司 | Method and device for processing dynamic library file |
| CN106844766A (en) * | 2017-02-23 | 2017-06-13 | 郑州云海信息技术有限公司 | The method and device of a kind of compressed file decompression |
| CN108197204A (en) * | 2017-12-28 | 2018-06-22 | 北京安博通科技股份有限公司 | Document handling method and device |
| CN108197204B (en) * | 2017-12-28 | 2021-12-21 | 北京安博通科技股份有限公司 | File processing method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104484174B (en) | 2018-06-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107832406B (en) | Method, device, equipment and storage medium for removing duplicate entries of mass log data | |
| CN109739894B (en) | Method, device, equipment and storage medium for supplementing metadata description | |
| US9542461B2 (en) | Enhancing performance of extract, transform, and load (ETL) jobs | |
| CN106778351B (en) | Data desensitization method and device | |
| CN111064712B (en) | Game resource packaging method and system | |
| CN103123588A (en) | Method and system for obtaining difference upgrade patch | |
| CN105824974B (en) | The method and system of Data Analysis Services | |
| CN111241182A (en) | Data processing method and apparatus, storage medium, and electronic apparatus | |
| CN105493095A (en) | Adaptive and recursive filtering for sample submission | |
| CN106407442B (en) | A kind of mass text data processing method and device | |
| CN102609462A (en) | Method for compressed storage of massive SQL (structured query language) by means of extracting SQL models | |
| CN103310443A (en) | Quick processing method and system for high-resolution remote sensing image | |
| EP3963853B1 (en) | Optimizing storage and retrieval of compressed data | |
| CN109471893B (en) | Network data query method, equipment and computer readable storage medium | |
| CN111443901B (en) | Java reflection-based service expansion method and device | |
| CN112035401A (en) | Model data processing method and device, electronic equipment and readable medium | |
| CN104484174A (en) | Processing method and processing device for compressed file with RAR (Roshal A Rchive) format | |
| CN115858322A (en) | Log data processing method and device and computer equipment | |
| CN112559463A (en) | Method and device for processing compressed file | |
| CN108415934A (en) | A kind of Hive tables restorative procedure, device, equipment and computer readable storage medium | |
| CN103810197A (en) | Hadoop-based data processing method and system | |
| CN111107062B (en) | Game resource packaging method and system based on greedy algorithm | |
| CN109947702A (en) | Index structuring method and device, electronic equipment | |
| CN111723063A (en) | Method and device for processing offline log data | |
| CN116775599A (en) | Data migration method, device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: Processing method and processing device for compressed file with RAR (Roshal A Rchive) format Effective date of registration: 20190531 Granted publication date: 20180622 Pledgee: Shenzhen Black Horse World Investment Consulting Co.,Ltd. Pledgor: BEIJING GRIDSUM TECHNOLOGY Co.,Ltd. Registration number: 2019990000503 |
|
| CP02 | Change in the address of a patent holder | ||
| CP02 | Change in the address of a patent holder |
Address after: 100083 No. 401, 4th Floor, Haitai Building, 229 North Fourth Ring Road, Haidian District, Beijing Patentee after: BEIJING GRIDSUM TECHNOLOGY Co.,Ltd. Address before: 100086 Beijing city Haidian District Shuangyushu Area No. 76 Zhichun Road cuigongfandian 8 layer A Patentee before: BEIJING GRIDSUM TECHNOLOGY Co.,Ltd. |
|
| PP01 | Preservation of patent right | ||
| PP01 | Preservation of patent right |
Effective date of registration: 20240604 Granted publication date: 20180622 |