CN105205687A - Mass data acquisition method - Google Patents
Mass data acquisition method Download PDFInfo
- Publication number
- CN105205687A CN105205687A CN201510521135.7A CN201510521135A CN105205687A CN 105205687 A CN105205687 A CN 105205687A CN 201510521135 A CN201510521135 A CN 201510521135A CN 105205687 A CN105205687 A CN 105205687A
- Authority
- CN
- China
- Prior art keywords
- data
- file
- client
- collection
- acquisition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 49
- 230000008569 process Effects 0.000 claims abstract description 26
- 238000012545 processing Methods 0.000 claims abstract description 14
- 238000004891 communication Methods 0.000 claims abstract description 12
- 230000005540 biological transmission Effects 0.000 claims description 23
- 238000013480 data collection Methods 0.000 claims description 22
- 238000012546 transfer Methods 0.000 claims description 11
- 230000008676 import Effects 0.000 claims description 10
- 238000012795 verification Methods 0.000 claims description 4
- 230000009471 action Effects 0.000 claims description 3
- 230000006835 compression Effects 0.000 claims description 3
- 238000007906 compression Methods 0.000 claims description 3
- 238000007689 inspection Methods 0.000 claims description 3
- 230000007246 mechanism Effects 0.000 claims description 3
- 238000012856 packing Methods 0.000 claims description 3
- 238000004458 analytical method Methods 0.000 abstract description 2
- 238000004140 cleaning Methods 0.000 abstract description 2
- 230000002354 daily effect Effects 0.000 description 8
- 238000009826 distribution Methods 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013481 data capture Methods 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a method for acquiring mass data, which comprises the following concrete steps: firstly, installing an acquisition client side in a sub-database, wherein the acquisition client side, a data acquisition web service and a windows service form an asynchronous processing acquisition system; the mother database collects the data of the sub-database through the asynchronous processing collection system and sends the data to the collection client of the sub-database according to the rule. Compared with the prior art, the method for acquiring the mass data can save communication cost, converts the data acquired through the cleaning process into a mode for analysis, improves data quality and safety, and has strong practicability.
Description
Technical field
The present invention relates to the data acquisition technology field of large data, specifically a kind of method of practical, mass data collection.
Background technology
Manufacturing enterprise usually needs to understand production marketing situation by the data that flow to of relevant dealer, or carries out business diagnosis by related data and carry out.Present case is, different manufacturing enterprise is various at the tool kind of that image data of dealer, and the data layout unification not gathered, easily cause the duplication of labour of dealer, expend the communication time, and the data accuracy reported by business personnel also cannot ensure, may impact subsequent analysis.
Based on this, now provide a kind of and solve the problem, the method for mass data collection.After using the data acquisition of this method, can entrust from company and initiate, save and link up cost, client gathers the data of dealer's goods entry, stock and sales automatically, compress to upload to group service device and then data are distributed to group subordinate according to different distribution rules and respectively to produce or in sale enterprise, be converted to through cleaning process for the pattern analyzed, the quality of data and security can be improve by gathering the data of coming up.
Summary of the invention
Technical assignment of the present invention is for above weak point, provides a kind of method of practical, mass data collection.
A method for mass data collection, its specific implementation process is:
First install at subdata base and gather client, this collection client and data acquisition web services, windows serve and form asynchronous process acquisition system;
Female database gathers subdata base data by this asynchronous process acquisition system and regularly issues data to the collection client of subdata base.
The type of database of described collection client support comprises: SQLSERVER, Oracle, Mysql, Sybase.
The computing machine gathering client is installed and is connected to the background server installing female database by database configuration interface, gather client to after data acquisition success, these data are used file processing, here file processing uses the mode of compressed file, a text is all comprised and data describe xml file in each compressed file, wherein text is actual acquired data, and data describe the rule that xml file is data in text; Server is converted to after two files are read parsing together again can usage data.
The background server being provided with female database gathers the concurrent request operation of client by asynchronous queuing mechanism support, under first the file of female database collection terminal to all collection client upload be aggregated into certain file of server, then regular by file update in data handling queues, former packet can be transferred to after data processing in another backup file folder.
Above-mentioned background server adopts asynchronous queuing tupe to carry out data transmission, and this asynchronous process uses following multithreading to complete:
Whether data upload thread, have in the data folder of inspection client and gathered complete data, have, add and upload queue; Call collection upload service and carry out token checking, the file bag then data file bag being resolved into several 24K if the verification passes transmits; In the process of transmission, when running into network problem, carrying out repeatedly transmission attempt, if still failed repeatedly, then continuing to attempt transmission when thread execution next time;
Collecting thread, checks in acquisition tasks queue whether have pending acquisition tasks; Gather action according to the information and executing in acquisition tasks, and the data of collection are carried out compression packing, be put in data folder to be uploaded;
Automatic acquisition time judges thread, the automatic frequency acquisition arranged according to client and time, checks current the need of execution collection automatically; If need to perform data acquisition, then in acquisition tasks queue, increase automatically gathering of task;
With server automatically more new thread, with collection communication for service, download latest data collection definition, report the information comprising client release number and dealer's acquisition time toward server;
Rule daily record thread, when thread starts, creates global buffer object, reads LOG.XML file during structure object, is existed by the dLog object of the inside in _ logList list object; Rule daily record thread checks in a buffer memory, whether daily record list object changes, and changes and just regenerates Log.XML for 10 seconds;
Text daily record thread, when thread starts, create global buffer object, thread 10 circulation primary in second, states a StringBuild, the log information of generation is increased to the inside, writes with in the Txt journal file of date name;
Version self-verifying thread, calls the service of collection, the version of automatic comparison client monofile and the version of service end during execution; When client needs upgrading, then call ROMPaq and download needing the file of upgrading, decompress(ion), covers.
In data acquisition, use AES encryption during transmitting data file, the secret key of encryption is gather 36 GUID character strings of serving and generating each client, makes the secret key of each client all different, ensure the security in data transmission, be specially:
The client account of all needs and server communication, all be assigned with a unique key, all need to use unique key, account, password authentification during each application communication, just file transfer can be carried out by rear, AES dynamic encryption data slot is used in transmitting data file process, and each transfer files size is 24K, after only having the whole transmission success of file, file just can be used.
Background server receives the compressed file gathering client and uploads, and all files transmitted all are kept in transmission catalogue with the suffix of .dat; When file complete upload time, initiate the rename operation of file by client, data acquisition service is modified as .rar file suffixes from .dat, and move to file imports in working directory, circular document import feature simultaneously.
The method of a kind of mass data collection of the present invention, has the following advantages:
The method of a kind of mass data collection of this invention can gather national subordinate dealer goods entry, stock and sales data in enterprise headquarters, and regularly issues data in subordinate branch office.Native system is defined by all kinds of acquisition target safeguarded and scheme, the whole asynchronous process acquisition system formed is served by data-direct connection collection client and data acquisition web services, windows, collection and the distribution of ten million bar group data can be processed every day, thus save communication cost, improve the quality of data and security, practical, applied widely, be easy to promote.
Accompanying drawing explanation
Accompanying drawing 1 is overall realization flow figure of the present invention.
Accompanying drawing 2 is collection client collecting flowchart figure of the present invention.
Accompanying drawing 3 is background server collecting flowchart figure of the present invention.
Embodiment
Below in conjunction with the drawings and specific embodiments, the invention will be further described.
A kind of method providing mass data collection of the present invention, the mode of being carried out mass data collection by data collection client carries out data acquisition.
Its implementation procedure is:
First install at subdata base and gather client, this collection client and data acquisition web services, windows serve and form asynchronous process acquisition system;
Female database gathers subdata base data by this asynchronous process acquisition system and regularly issues data to the collection client of subdata base.
Gather the system that client can support the complicated variety that dealer runs, the type of multitype database can be supported, as SQLSERVER, Oracle, Mysql, Sybase etc.; .
Gather client and support flexible deployment pattern, meet same client can provide requirement from data to many suppliers, support that deployment mode multiple when actual deployment:
Full centralized architecture: the data gathering client concentrated collection dealer, does not distinguish subordinate unit of group, carries out concentrating capturing and data upload.After data centralization to group, then from group's database, carry out the distribution of data.
Part centralized architecture: client distinguishes authorized company when gathering the data of dealer, data carry out concentrating crawl and uploading; Data dissemination is carried out by group's data acquisition service.
Distributing Frame: client distinguishes authorized company when gathering the data of dealer, is uploaded to respectively in different authorized company's servers after data capture.
Data acquisition server is by the large concurrent request operation of asynchronous queuing mechanism supported data direct connection client, improve the availability of the service of collection: first collection service end is aggregated into certain file of server to the file of all client upload under, then regular by file update in data handling queues, former packet can be transferred to after data processing in another backup file folder, impact on data processing threads when reducing large concurrent upload file, ensures stability during data processing.
Client, when carrying out collection and files passe, if made a mistake, then can repeatedly be attempted, and embodies the support of system high fault tolerance.
Data file is when transmitting, and file bag file being divided into multiple 24K size transmits, and file transfer is complete, and Piece file mergence can be become former data file and use by collection service; Transmitting with 24K size is consider the pressure to one-port, sets the impact of the hardware such as enterprise acquisition server CPU, IO.
Data file uses AES encryption in transmitting procedure, and the secret key of encryption is gather 36 GUID character strings of serving and generating each client, makes the secret key of each client all different, further ensures the security in data transmission.
Data acquisition support under group's pattern is issued to enterprise of subordinate accounts according to standard rule (as: client's corresponding relation, product corresponding relation etc.) automated intelligent prefabricated in system, does not need human intervention.
More specifically, as shown in accompanying drawing 1, Fig. 2, Fig. 3,
The computing machine gathering client is installed and is connected to the background server installing female database by database configuration interface, gather client to after data acquisition success, these data are used file processing, here file processing uses the mode of compressed file, a text is all comprised and data describe xml file in each compressed file, wherein text is actual acquired data, and data describe the rule that xml file is data in text; Server is converted to after two files are read parsing together again can usage data, and compressed file greatly reduces the network bandwidth and takies, and greatly strengthens system processing power simultaneously;
Txt file partial code is generated according to special format:
txtbuffer.SaveTxt(String.Format("{0}\0",
onvert.ToDateTime(drResult[k]).ToString("yyyyMMdd")));
XML file and txt file are generated compressed package partial code:
publicstaticstringDataEntryName="data.txt";
publicstaticstringDataFormatEntryName="format.xml";
publicstaticintZipBufferSize=1024*24;
// use the file parameters generation compressed file gathering client and arrange
byte[]buffer=newbyte[DCSZipConfig.ZipBufferSize];
System.Int32sizeRead=0;
while((sizeRead=StreamToZip.Read(buffer,0,buffer.Length))>0)
{
Write(buffer,0,sizeRead);
}
Gather background service system and adopt asynchronous queuing tupe: program uses the asynchronous process of multithreading, the task that different thread process is different, as: image data be compressed into file, files passe, file import database, Data dissemination etc. and all can carry out simultaneously, the level and smooth pressure peak reducing server; ,
Whether data upload thread SendDataThread, have in the data folder of inspection client and gathered complete data, have, add and upload queue; Call collection upload service and carry out token checking, the file bag then data file bag being resolved into several 24K if the verification passes transmits; In the process of transmission, when running into network problem, carrying out repeatedly transmission attempt, if still failed repeatedly, then continuing to attempt transmission when thread execution next time; It performs set of frequency is 3 minutes.
Collecting thread CollectionThread, checks in acquisition tasks queue whether have pending acquisition tasks; Gather action according to the information and executing in acquisition tasks, and the data of collection are carried out compression packing, be put in data folder to be uploaded; It performs set of frequency was 5 seconds.
Automatic acquisition time judges thread CollectDateTimeJudge, the automatic frequency acquisition arranged according to client and time, checks current the need of execution collection automatically; If need to perform data acquisition, then in acquisition tasks queue, increase automatically gathering of task; It performs set of frequency was 10 seconds.
With server automatically more new thread CollectionDownAndUploadInfo, with collection communication for service, download latest data collection definition, report the information comprising client release number and dealer's acquisition time toward server; It performs set of frequency is 12 hours.
Rule daily record thread TableLogBuffer, when thread starts, creates global buffer object B ufferObj, reads LOG.XML file during structure object, is existed by the dLog object of the inside in _ logList list object; Rule daily record thread checks in a buffer memory, whether daily record list object changes, and changes and just regenerates Log.XML for 10 seconds; It performs set of frequency was 10 seconds.
Text daily record thread TxtLogBuffer, when thread starts, create global buffer object B ufferObj, thread 10 circulation primary in second, states a StringBuild, the log information of generation is increased to the inside, writes with in the Txt journal file of date name; It performs set of frequency was 10 seconds.
Version self-verifying thread ThreadUpdate, calls the service of collection, the version of automatic comparison client monofile and the version of service end during execution; When client needs upgrading, then call ROMPaq and download needing the file of upgrading, decompress(ion), covers.It performs set of frequency is 24 hours.
The safety guarantee of local account: the client account of all needs and server communication, all be assigned with a unique key, all need to use unique key, account, password authentification during each application communication, just file transfer can be carried out by rear, AES dynamic encryption data slot is used in transmitting data file process, and each transfer files size is 24K, after only having the whole transmission success of file, file just can be used;
Need each 24K during transmission, and carry out token verification portion code:
byte[]buffer=newbyte[24*1024];//24K
System.Int32sizeRead=0;
AESmyAES=newAES(company.CompanyGuid);
while((sizeRead=StreamToZip.Read(buffer,0,buffer.Length))>0)
{
byte[]mw=myAES.AESEncrypt(buffer,0,sizeRead);
//
company.DataDealProxy.AppendFile(strToken,buffer,buffer.Length,uploadFileTempName);
// transfer 24K byte all will suspend 1 second at every turn, and the maximum network bandwidth of each like this client takies as 24K byte per second
Thread.Sleep(1000);
}
The fault-tolerant support of entire system: in client gatherer process, if there is mistake, thread self of makeing mistakes can constantly be attempted (limiting maximum attempts, the time interval); Increase capturing service and check thread, timing is patrolled and examined, and carries out pointing out for patrolling and examining result, sends out mail or automatically process, as: the situation such as run into server power-off or network is obstructed, when after issue handling, the data automatic identification of failing on schedule to carry out gathering can gather by client automatically;
File passes security and control: transmission of data collection service needs to receive the compressed file gathering client and uploads, and all files transmitted all are kept in transmission catalogue with the suffix of .dat; Upload once file completes, initiate the rename operation of file by client, data acquisition service is modified as .rar file suffixes from .dat, and move imports in working directory to file, and circular document import feature simultaneously.
System is carried out enactment document transmission catalogue by parameter below and is imported working directory:
--transfer files path-->
<addkey="TransPath"value="D:\DCS\DataTrans"/>
--file path of process to be imported-->
<addkey="DataPath"value="D:\DCS\Data\"/>
Data acquisition service is when breaking down, the file to be imported of .rar suffix likely can be omitted in file transfer catalogue, system can make regular check on the file that the .rar suffix in file transfer catalogue terminates, if having, it can be transferred to import in working directory and carry out follow-up importing process.
If made a mistake when file imports, more pending queue code after the some time, can be rejoined:
boolinlist=_beforeDealFileList.ContainsKey(fi.Name)||_dealingFileList.ContainsKey(fi.Name);
if(!inlist)
{
//add increases the process again to abnormal document
if(_errorFileList.ContainsKey(fi.Name))
{
If // this file had imported out mistake in the past, and imported time interval last time and be greater than now 27 minutes, and just rejoined again and import in list
if((DateTime.Now-_errorFileList[fi.Name]).TotalMinutes>27)sinfos.Add(fi.LastWriteTime.ToString("yyyy-MM-ddHH:mm:ss.fff")+fi.Name,fi.Name);
}
else
sinfos.Add(fi.LastWriteTime.ToString("yyyy-MM-ddHH:mm:ss.fff")+fi.Name,fi.Name);
}
The enforcement of acquisition method is mainly divided into server-side environment to build and the deployment of client, and wherein client is green edition, can directly use after decompress(ion);
Above-mentioned embodiment is only concrete case of the present invention; scope of patent protection of the present invention includes but not limited to above-mentioned embodiment; claims of the method for any a kind of mass data collection according to the invention and any person of an ordinary skill in the technical field to its suitable change done or replacement, all should fall into scope of patent protection of the present invention.
Claims (7)
1. a method for mass data collection, is characterized in that, specific implementation process is: first install at subdata base and gather client, this collection client and data acquisition web services, windows serve and form asynchronous process acquisition system; Female database gathers subdata base data by this asynchronous process acquisition system and regularly issues data to the collection client of subdata base.
2. the method for a kind of mass data collection according to claim 1, is characterized in that, the type of database of described collection client support comprises: SQLSERVER, Oracle, Mysql, Sybase.
3. the method for a kind of mass data collection according to claim 1, it is characterized in that, the computing machine gathering client is installed and is connected to the background server installing female database by database configuration interface, gather client to after data acquisition success, these data are used file processing, here file processing uses the mode of compressed file, a text is all comprised and data describe xml file in each compressed file, wherein text is actual acquired data, and data describe the rule that xml file is data in text; Server is converted to after two files are read parsing together again can usage data.
4. the method for a kind of mass data collection according to claim 1, it is characterized in that, the background server being provided with female database gathers the concurrent request operation of client by asynchronous queuing mechanism support, under first the file of female database collection terminal to all collection client upload be aggregated into certain file of server, then regular by file update in data handling queues, former packet can be transferred to after data processing in another backup file folder.
5. the method for a kind of mass data collection according to claim 4, is characterized in that, above-mentioned background server adopts asynchronous queuing tupe to carry out data transmission, and this asynchronous process uses following multithreading to complete:
Whether data upload thread, have in the data folder of inspection client and gathered complete data, have, add and upload queue; Call collection upload service and carry out token checking, the file bag then data file bag being resolved into several 24K if the verification passes transmits; In the process of transmission, when running into network problem, carrying out repeatedly transmission attempt, if still failed repeatedly, then continuing to attempt transmission when thread execution next time;
Collecting thread, checks in acquisition tasks queue whether have pending acquisition tasks; Gather action according to the information and executing in acquisition tasks, and the data of collection are carried out compression packing, be put in data folder to be uploaded;
Automatic acquisition time judges thread, the automatic frequency acquisition arranged according to client and time, checks current the need of execution collection automatically; If need to perform data acquisition, then in acquisition tasks queue, increase automatically gathering of task;
With server automatically more new thread, with collection communication for service, download latest data collection definition, report the information comprising client release number and dealer's acquisition time toward server;
Rule daily record thread, when thread starts, creates global buffer object, reads LOG.XML file during structure object, is existed by the dLog object of the inside in _ logList list object; Rule daily record thread checks in a buffer memory, whether daily record list object changes, and changes and just regenerates Log.XML for 10 seconds;
Text daily record thread, when thread starts, create global buffer object, thread 10 circulation primary in second, states a StringBuild, the log information of generation is increased to the inside, writes with in the Txt journal file of date name;
Version self-verifying thread, calls the service of collection, the version of automatic comparison client monofile and the version of service end during execution; When client needs upgrading, then call ROMPaq and download needing the file of upgrading, decompress(ion), covers.
6. the method for a kind of mass data collection according to claim 5, it is characterized in that, in data acquisition, AES encryption is used during transmitting data file, the secret key of encryption is gather 36 GUID character strings of serving and generating each client, make the secret key of each client all different, ensure the security in data transmission, be specially:
The client account of all needs and server communication, all be assigned with a unique key, all need to use unique key, account, password authentification during each application communication, just file transfer can be carried out by rear, AES dynamic encryption data slot is used in transmitting data file process, and each transfer files size is 24K, after only having the whole transmission success of file, file just can be used.
7. the method for a kind of mass data collection according to claim 5, is characterized in that, background server receives the compressed file gathering client and uploads, and all files transmitted all are kept in transmission catalogue with the suffix of .dat; When file complete upload time, initiate the rename operation of file by client, data acquisition service is modified as .rar file suffixes from .dat, and move to file imports in working directory, circular document import feature simultaneously.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510521135.7A CN105205687A (en) | 2015-08-24 | 2015-08-24 | Mass data acquisition method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510521135.7A CN105205687A (en) | 2015-08-24 | 2015-08-24 | Mass data acquisition method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105205687A true CN105205687A (en) | 2015-12-30 |
Family
ID=54953352
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510521135.7A Pending CN105205687A (en) | 2015-08-24 | 2015-08-24 | Mass data acquisition method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105205687A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105827693A (en) * | 2016-03-11 | 2016-08-03 | 西安联易信息技术有限公司 | Data acquisition system and method for drug administration platform and heterogeneous drug sale system |
| CN106570377A (en) * | 2016-10-28 | 2017-04-19 | 鄢碧珠 | Mobile cloud data storage system |
| CN108062329A (en) * | 2016-11-08 | 2018-05-22 | 北京国双科技有限公司 | A kind of data lead-in method and device |
| CN108139449A (en) * | 2016-01-11 | 2018-06-08 | 特因泰什工业公司 | For the improved quality control testing systems and application method of portable charging apparatus |
| CN108769121A (en) * | 2018-04-24 | 2018-11-06 | 浙江正泰电器股份有限公司 | Intelligent industrial equips the method for uploading of internet of things data acquisition system and gathered data |
| CN109246221A (en) * | 2018-09-21 | 2019-01-18 | 上海勋立信息科技有限公司 | A kind of data sectional high-speed uploading method, client and the server of multifile |
| CN109885359A (en) * | 2019-01-25 | 2019-06-14 | 上海倍通医药科技咨询有限公司 | Drug flow collecting method and its system |
| CN111125004A (en) * | 2019-12-03 | 2020-05-08 | 中盈优创资讯科技有限公司 | File collection method and device |
| CN111506564A (en) * | 2020-04-16 | 2020-08-07 | 深圳市领先数据科技有限公司 | Remote data management method and device based on CS (circuit switched) architecture, computer equipment and storage medium |
| CN111596628A (en) * | 2020-05-29 | 2020-08-28 | 北京赛博云睿智能科技有限公司 | Acquisition method and acquisition system for mass industrial data |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060059234A1 (en) * | 2004-09-02 | 2006-03-16 | Atchison Charles E | Automated messaging tool |
| CN102917020A (en) * | 2011-09-24 | 2013-02-06 | 国网电力科学研究院 | Mobile terminal based on data packet and method for synchronizing business system data |
| US20130191182A1 (en) * | 2010-09-27 | 2013-07-25 | Changi Airport Group (Singapore) Pte. Ltd. | Work and quality management system, device and method |
| CN103235807A (en) * | 2013-04-19 | 2013-08-07 | 浪潮集团山东通用软件有限公司 | Data extracting and processing method supporting high-concurrency large-volume data |
| CN104376237A (en) * | 2013-08-13 | 2015-02-25 | 中国科学院沈阳自动化研究所 | Safety control method and safety control system for information in production procedures |
-
2015
- 2015-08-24 CN CN201510521135.7A patent/CN105205687A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060059234A1 (en) * | 2004-09-02 | 2006-03-16 | Atchison Charles E | Automated messaging tool |
| US20130191182A1 (en) * | 2010-09-27 | 2013-07-25 | Changi Airport Group (Singapore) Pte. Ltd. | Work and quality management system, device and method |
| CN102917020A (en) * | 2011-09-24 | 2013-02-06 | 国网电力科学研究院 | Mobile terminal based on data packet and method for synchronizing business system data |
| CN103235807A (en) * | 2013-04-19 | 2013-08-07 | 浪潮集团山东通用软件有限公司 | Data extracting and processing method supporting high-concurrency large-volume data |
| CN104376237A (en) * | 2013-08-13 | 2015-02-25 | 中国科学院沈阳自动化研究所 | Safety control method and safety control system for information in production procedures |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108139449B (en) * | 2016-01-11 | 2020-08-07 | 特因泰什工业公司 | Improved quality control test system for portable charging devices and method of use |
| CN108139449A (en) * | 2016-01-11 | 2018-06-08 | 特因泰什工业公司 | For the improved quality control testing systems and application method of portable charging apparatus |
| CN105827693A (en) * | 2016-03-11 | 2016-08-03 | 西安联易信息技术有限公司 | Data acquisition system and method for drug administration platform and heterogeneous drug sale system |
| CN105827693B (en) * | 2016-03-11 | 2019-08-02 | 联易软件有限公司 | Drug Administration platform and isomery sell the data collection system and method for medicine system |
| CN106570377A (en) * | 2016-10-28 | 2017-04-19 | 鄢碧珠 | Mobile cloud data storage system |
| CN108062329A (en) * | 2016-11-08 | 2018-05-22 | 北京国双科技有限公司 | A kind of data lead-in method and device |
| CN108769121A (en) * | 2018-04-24 | 2018-11-06 | 浙江正泰电器股份有限公司 | Intelligent industrial equips the method for uploading of internet of things data acquisition system and gathered data |
| CN108769121B (en) * | 2018-04-24 | 2021-11-30 | 浙江正泰电器股份有限公司 | Intelligent industrial equipment Internet of things data acquisition system and acquisition data uploading method |
| CN109246221A (en) * | 2018-09-21 | 2019-01-18 | 上海勋立信息科技有限公司 | A kind of data sectional high-speed uploading method, client and the server of multifile |
| CN109885359A (en) * | 2019-01-25 | 2019-06-14 | 上海倍通医药科技咨询有限公司 | Drug flow collecting method and its system |
| CN109885359B (en) * | 2019-01-25 | 2022-07-12 | 上海倍通医药科技咨询有限公司 | Medicine circulation data acquisition method and system |
| CN111125004A (en) * | 2019-12-03 | 2020-05-08 | 中盈优创资讯科技有限公司 | File collection method and device |
| CN111506564A (en) * | 2020-04-16 | 2020-08-07 | 深圳市领先数据科技有限公司 | Remote data management method and device based on CS (circuit switched) architecture, computer equipment and storage medium |
| CN111596628A (en) * | 2020-05-29 | 2020-08-28 | 北京赛博云睿智能科技有限公司 | Acquisition method and acquisition system for mass industrial data |
| CN111596628B (en) * | 2020-05-29 | 2021-07-30 | 北京赛博云睿智能科技有限公司 | Acquisition method and acquisition system for mass industrial data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105205687A (en) | Mass data acquisition method | |
| CN111209346A (en) | Block chain data archiving method and device and computer readable storage medium | |
| CN103853585B (en) | A kind of implementation method for managing version concentratedly by high in the clouds | |
| CN106991035A (en) | A kind of Host Supervision System based on micro services framework | |
| CN109861842A (en) | O&M method, apparatus, electronic equipment and the storage medium of server cluster | |
| JP2011518278A (en) | Wind turbine configuration management system and its central computer system | |
| CN101252471A (en) | Distributed automatization test system and method | |
| CN104252500A (en) | Method and device for carrying out fault repairing on database management platform | |
| US10891164B2 (en) | Resource setting control device, resource setting control system, resource setting control method, and computer-readable recording medium | |
| CN110046073A (en) | A kind of log collection method and device, equipment, storage medium | |
| CN108737549A (en) | A kind of log analysis method and device of big data quantity | |
| CN103488793A (en) | User behavior monitoring method based on information retrieval | |
| CN110222117A (en) | A kind of data conversion synchronous method, equipment and the storage medium of heterogeneous database | |
| CN108092936A (en) | A kind of Host Supervision System based on plug-in architecture | |
| CN108228755A (en) | The data of MySQL database based on daily record analytic technique to Hadoop platform synchronize clone method | |
| JP5331585B2 (en) | Fault tolerant computer system and method in fault tolerant computer system | |
| CN111782534A (en) | Business process monitoring method, device and system | |
| CN104991849A (en) | Method for monitoring system resource occupation of Linux process through zabbix | |
| CN103235807A (en) | Data extracting and processing method supporting high-concurrency large-volume data | |
| CN111343212A (en) | Message processing method, device, equipment and storage medium | |
| CN114691782B (en) | Database table increment synchronization method, device and storage medium | |
| CN109218401A (en) | Log collection method, system, computer equipment and storage medium | |
| CN108920260A (en) | A kind of exchange method and its device of heterogeneous system | |
| CN102890486A (en) | Center boiler remote monitoring system and control method thereof | |
| WO2001035256A2 (en) | Systems and methods for collecting, storing, and analyzing database statistics |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20151230 |
|
| RJ01 | Rejection of invention patent application after publication |