CN109218435B - Data uploading method and system - Google Patents

Data uploading method and system Download PDF

Info

Publication number
CN109218435B
CN109218435B CN201811165711.9A CN201811165711A CN109218435B CN 109218435 B CN109218435 B CN 109218435B CN 201811165711 A CN201811165711 A CN 201811165711A CN 109218435 B CN109218435 B CN 109218435B
Authority
CN
China
Prior art keywords
data
uploading
cache file
unit
file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201811165711.9A
Other languages
Chinese (zh)
Other versions
CN109218435A (en
Inventor
杨旭
李喻
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuhan Hanyuan Technology Co ltd
Original Assignee
Hubei Hualian Boyuan Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hubei Hualian Boyuan Technology Co ltd filed Critical Hubei Hualian Boyuan Technology Co ltd
Priority to CN201811165711.9A priority Critical patent/CN109218435B/en
Publication of CN109218435A publication Critical patent/CN109218435A/en
Application granted granted Critical
Publication of CN109218435B publication Critical patent/CN109218435B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/568Storing data temporarily at an intermediate stage, e.g. caching
    • H04L67/5683Storage of data provided by user terminals, i.e. reverse caching

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention provides a data uploading method and a system, wherein the method comprises the following steps: the client monitors the running state of the software and records a cache file generated by the software; judging whether the characteristic value of the current cache file is matched with the preset cache file characteristic value every time the cache file is recorded, if so, continuing monitoring and recording the cache file; if not, uploading the cache file to a server, wherein the system comprises: the data uploading method can also enable data which is not transmitted once to be continuously transmitted next time, and avoid the repeated uploading condition caused by the fact that the data is not uploaded once.

Description

Data uploading method and system
Technical Field
The invention relates to the technical field of computers, in particular to a data uploading method and system.
Background
With the improvement of information technology, computer application programs on the internet are more and more popularized, and the user experience requirements on the application programs are higher and higher. The compatibility of the application program as software with hardware and the compatibility with a system are always concerned, and the acquisition of the user use data is an indispensable link for improving and upgrading the application program in time.
At present, a data transmission channel is generally established between a client and a server, and data to be transmitted is transmitted to the server through the transmission channel, so that the transmission process is slow, and the data transmission amount is long.
Disclosure of Invention
In view of this, the present invention provides a data uploading method and system with higher transmission efficiency.
The technical scheme of the invention is realized as follows: the invention provides a data uploading method, which comprises the following steps:
the client monitors the running state of the software and records a cache file generated by the software;
judging whether the characteristic value of the current cache file is matched with the preset cache file characteristic value every time the cache file is recorded, if so, continuing monitoring and recording the cache file;
and if not, uploading the cache file to the server.
On the basis of the above technical solution, preferably, before the client uploads the cache file to the server, the method further includes:
judging whether other uploading tasks for uploading the same cache file are uploaded completely or not;
if yes, sending a message that the uploading of the cache file is finished to the client;
if not, the cache file is continuously uploaded to the server.
On the basis of the above technical solution, preferably, before the client sends the data upload request, the method further includes:
the characteristic value of the cache file is sent to a server, the server judges whether other uploading tasks upload the cache file with the same characteristic value or not according to the characteristic value comparison of the cache file, if so, the server firstly traverses the cache file with the characteristic value, and simultaneously the server sends traversal result information to a client;
if not, the server sends execution uploading information to the client, and the client continues to upload the cache file.
On the basis of the above technical solution, preferably, the traversal result information includes data offset information of an uploaded part of the cache file and upload execution information.
Further preferably, the method further comprises the steps of acquiring data of each parameter in the software running process while recording the cache file generated by the software;
and when the data of the parameters are not in the corresponding standard data error range, acquiring the data of the parameters, and uploading the data of the parameters to a server as a cache file.
A data upload system comprising:
an operation monitoring module, a file judging module, a task judging module and a file transmission module,
the operation monitoring module is used for monitoring the software operation state of the client, including monitoring the cache file generated by the software and the operation parameters of the software;
the file judgment module is used for judging whether the cache file generated by the software and various parameters of the software operation are normal or not;
the task judging module is used for judging whether data transmitted between the client and the server are repeatedly uploaded or not and generating judging information to the file transmission module;
the file transmission module is used for transmitting files between the client and the server.
On the basis of the above technical solution, preferably, the operation monitoring module includes a data capture unit and a data simulation unit, the data capture unit is configured to capture a file generated in the software operation process and obtain various parameters, and the data simulation unit is configured to provide a preset cache file and various parameters generated by normal operation of the software.
On the basis of the above technical solution, preferably, the file judgment module includes a judgment unit, a determination unit and an output unit, the judgment unit is configured to compare the captured file and the captured parameter with the simulated file and the captured parameter, the determination unit outputs a judgment result according to the comparison result of the judgment unit, and the output unit sends the judgment result to the task judgment module.
On the basis of the above technical solution, preferably, the task determination module includes a feature value calculation unit, a feature value comparison unit and a transmission unit, the feature value calculation unit is configured to calculate feature values of the cache files on the client and the server, the feature value comparison unit is configured to compare the feature values of the cache files on the client and the server, and send a comparison result to the transmission unit, and the transmission unit summarizes whether the cache file and the parameter of the client need to be transmitted according to the comparison result and a determination result from the output unit, and sends the summary result to the transmission module.
On the basis of the above technical solution, preferably, the file transmission module includes an uploading unit, a downloading unit, and a command receiving unit, the command receiving unit receives the summary result from the task determining module, and executes uploading and downloading according to the summary result, the uploading unit is configured to upload client data to the server, and the downloading unit is configured to download data of the server to the client.
Compared with the prior art, the data uploading method and the data uploading system have the following beneficial effects:
the data uploading method and the data uploading system can enable the data to be uploaded more timely, can effectively avoid repeated uploading of the data, can avoid repeated uploading even if the data is uploaded at the same time, can enable the data which is not transmitted for one time to be continuously transmitted for the next time, and avoid repeated uploading caused by the fact that the data is not uploaded for one time.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a flow chart of a data uploading method according to the present invention;
FIG. 2 is a flow chart of a data uploading method according to the present invention;
fig. 3 is a block diagram of a data uploading system according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, are within the scope of the present invention.
As shown in fig. 1 and in combination with fig. 2, the data uploading method of the present invention includes the following specific steps:
the client monitors the running state of the software and records a cache file generated by the software;
judging whether the characteristic value of the current cache file is matched with the preset cache file characteristic value every time the cache file is recorded, if so, continuing monitoring and recording the cache file;
and if not, uploading the cache file to the server.
In a specific embodiment, before uploading the cached file to the server, the client further includes:
judging whether other uploading tasks for uploading the same cache file are uploaded completely or not;
if yes, sending a message that the uploading of the cache file is finished to the client;
if not, the cache file is continuously uploaded to the server.
In a specific embodiment, before sending the data upload request, the client further includes:
the characteristic value of the cache file is sent to a server, the server judges whether other uploading tasks upload the cache file with the same characteristic value or not according to the characteristic value comparison of the cache file, if so, the server firstly traverses the cache file with the characteristic value, and simultaneously the server sends traversal result information to a client;
if not, the server sends execution uploading information to the client, and the client continues to upload the cache file.
In a specific embodiment, the traversal result information includes data offset information of an uploaded part of the cache file and upload execution information.
In a specific implementation mode, the method further comprises the steps of recording a cache file generated by the software, and simultaneously acquiring data of each parameter in the software operation process;
and when the data of the parameters are not in the corresponding standard data error range, acquiring the data of the parameters, and uploading the data of the parameters to a server as a cache file.
As shown in fig. 3, a data upload system includes:
the system comprises an operation monitoring module, a file judging module, a task judging module and a file transmission module;
the operation monitoring module is used for monitoring the software operation state of the client, including monitoring the cache file generated by the software and the operation parameters of the software;
the file judgment module is used for judging whether the cache file generated by the software and various parameters of the software operation are normal or not;
the task judging module is used for judging whether data transmitted between the client and the server are repeatedly uploaded or not and generating judging information to the file transmission module;
the file transmission module is used for transmitting files between the client and the server.
In a specific embodiment, the operation monitoring module includes a data capture unit and a data simulation unit, the data capture unit is configured to capture a file generated in the software operation process and obtain various parameters, and the data simulation unit is configured to provide a preset cache file and various parameters generated by normal operation of the software.
In a specific embodiment, the file judgment module includes a determination judgment unit and an output unit, the judgment unit is configured to compare the captured file and the captured parameter with the simulated file and the simulated parameter, the determination unit outputs a judgment result according to the comparison result of the judgment unit, and the output unit sends the judgment result to the task judgment module.
In a specific embodiment, the task determination module includes a feature value calculation unit, a feature value comparison unit, and a transmission unit, where the feature value calculation unit is configured to calculate feature values of cache files on the client and the server, the feature value comparison unit is configured to compare the feature values of the cache files on the client and the server, and send a comparison result to the transmission unit, and the transmission unit summarizes whether to transmit the cache file and the parameter of the client according to the comparison result and a determination result from the output unit, and sends the summary result to the transmission module.
In a specific embodiment, the file transmission module includes an uploading unit, a downloading unit, and a command receiving module, the command receiving module receives the summary result from the task determining module, and executes uploading and downloading according to the summary result, the uploading unit is configured to upload client data to the server, and the downloading unit is configured to download data of the server to the client.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

Claims (7)

1. A data uploading method is characterized by comprising the following steps:
the client monitors the running state of the software and records a cache file generated by the software;
judging whether the characteristic value of the current cache file is matched with the preset cache file characteristic value every time the cache file is recorded, if so, continuing monitoring and recording the cache file;
if not, uploading the cache file to a server;
before uploading the cache file to the server, the client further comprises:
judging whether other uploading tasks for uploading the same cache file are uploaded completely or not;
if yes, sending a message that the uploading of the cache file is finished to the client;
if not, continuing to upload the cache file to the server;
before the client sends the data uploading request, the method further comprises the following steps:
the characteristic value of the cache file is sent to a server, the server judges whether other uploading tasks upload the cache file with the same characteristic value according to the characteristic value comparison of the cache file, if so, the server firstly traverses the cache file with the characteristic value, and simultaneously, the server sends traversal result information to a client, wherein the traversal result information comprises data offset information of an uploaded part of the cache file and uploading execution information;
if not, the server sends execution uploading information to the client, and the client continues to upload the cache file.
2. The data uploading method of claim 1, further comprising, while recording a cache file generated by software, acquiring data of each parameter in the software running process;
and when the data of the parameters are not in the corresponding standard data error range, acquiring the data of the parameters, and uploading the data of the parameters to a server as a cache file.
3. A system using the data uploading method of claim 1, comprising:
an operation monitoring module, a file judging module, a task judging module and a file transmission module,
the operation monitoring module is used for monitoring the software operation state of the client, including monitoring the cache file generated by the software and the operation parameters of the software;
the file judgment module is used for judging whether the cache file generated by the software and various parameters of the software operation are normal or not;
the task judging module is used for judging whether data transmitted between the client and the server are repeatedly uploaded or not and generating judging information to the file transmission module;
the file transmission module is used for transmitting files between the client and the server.
4. The data uploading system of claim 3, wherein the operation monitoring module comprises a data capture unit and a data simulation unit, the data capture unit is used for capturing files generated in the software operation process and obtaining parameters, and the data simulation unit is used for providing preset cache files and parameters generated in normal operation of the software.
5. The data uploading system of claim 4, wherein the file judgment module comprises a judgment unit for comparing the captured file and parameters with the simulated file and parameters, a determination unit for outputting a judgment result according to the comparison result of the judgment unit, and an output unit for sending the judgment result to the task judgment module.
6. The data uploading system of claim 5, wherein the task determining module comprises a feature value calculating unit, a feature value comparing unit and a transmitting unit, the feature value calculating unit is configured to calculate feature values of the cache files on the client and the server, the feature value comparing unit is configured to compare the feature values of the cache files on the client and the server and transmit the comparison result to the transmitting unit, and the transmitting unit summarizes whether the cache files and parameters of the client need to be transmitted according to the comparison result and the determination result from the output unit and transmits the summarized result to the transmitting module.
7. The data uploading system of claim 6, wherein the file transmission module comprises an uploading unit, a downloading unit and a command receiving unit, the command receiving unit receives the summary result from the task judging module and performs uploading and downloading according to the summary result, the uploading unit is configured to upload client data to the server, and the downloading unit is configured to download server data to the client.
CN201811165711.9A 2018-09-30 2018-09-30 Data uploading method and system Expired - Fee Related CN109218435B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811165711.9A CN109218435B (en) 2018-09-30 2018-09-30 Data uploading method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811165711.9A CN109218435B (en) 2018-09-30 2018-09-30 Data uploading method and system

Publications (2)

Publication Number Publication Date
CN109218435A CN109218435A (en) 2019-01-15
CN109218435B true CN109218435B (en) 2021-07-23

Family

ID=64983127

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811165711.9A Expired - Fee Related CN109218435B (en) 2018-09-30 2018-09-30 Data uploading method and system

Country Status (1)

Country Link
CN (1) CN109218435B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110300151B (en) * 2019-05-22 2022-02-11 深圳壹账通智能科技有限公司 Data file uploading method and system
CN115250269B (en) * 2022-07-26 2024-02-02 中银金融科技有限公司 File distribution method and device, storage medium and electronic equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102096590A (en) * 2011-02-22 2011-06-15 宇龙计算机通信科技(深圳)有限公司 Upgrading method for application program in mobile terminal, mobile terminal and server
CN103685332A (en) * 2012-08-31 2014-03-26 腾讯科技(深圳)有限公司 File transfer method, client, server and system
CN103856537A (en) * 2012-12-05 2014-06-11 中国移动通信集团公司 Method, platform and system for obtaining operation state of application program on terminal
CN108173889A (en) * 2016-12-07 2018-06-15 北大方正集团有限公司 User data processing method and user data processing unit
CN108345524A (en) * 2017-01-22 2018-07-31 腾讯科技(深圳)有限公司 Method for monitoring application program and Application Monitoring device

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130132523A1 (en) * 2011-05-23 2013-05-23 Thomas Love Systems for the integrated design, operation and modification of databases and associated web applications
CN105376193B (en) * 2014-08-15 2019-06-04 中国电信股份有限公司 The intelligent association analysis method and device of security incident
CN107948924B (en) * 2017-10-10 2019-07-16 深圳数位传媒科技有限公司 Calibration method, system, server and the medium of wireless signal finger print information

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102096590A (en) * 2011-02-22 2011-06-15 宇龙计算机通信科技(深圳)有限公司 Upgrading method for application program in mobile terminal, mobile terminal and server
CN103685332A (en) * 2012-08-31 2014-03-26 腾讯科技(深圳)有限公司 File transfer method, client, server and system
CN103856537A (en) * 2012-12-05 2014-06-11 中国移动通信集团公司 Method, platform and system for obtaining operation state of application program on terminal
CN108173889A (en) * 2016-12-07 2018-06-15 北大方正集团有限公司 User data processing method and user data processing unit
CN108345524A (en) * 2017-01-22 2018-07-31 腾讯科技(深圳)有限公司 Method for monitoring application program and Application Monitoring device

Also Published As

Publication number Publication date
CN109218435A (en) 2019-01-15

Similar Documents

Publication Publication Date Title
US10666522B2 (en) Server side content delivery network quality of service
CN103248651B (en) A kind of method and system of performance monitoring and client and server
CN110807128B (en) Video preloading method, device, equipment and storage medium
CN109218435B (en) Data uploading method and system
CN107566477B (en) Method and device for acquiring files in distributed file system cluster
EP2767039A2 (en) Quality of user experience testing for video transmissions
CN109002424B (en) File format conversion method and device, computer equipment and storage medium
WO2013071747A1 (en) Method and apparatus for obtaining file
CN107146623B (en) Speech recognition method, device and system based on artificial intelligence
CN111211934B (en) Cluster remote communication test method and system
EP2951954B1 (en) Network server system, client device, computer program product and computer-implemented method
TWI694332B (en) Data backup system and data backup method
CN109194706B (en) Network resource dial testing method and terminal
CN104539478A (en) Pressure test device and method for instant communication system
CN107846609B (en) Real-time transmission method, device and system for control room data
CN107315672B (en) Method and device for monitoring server
CN111158577B (en) Remote operation processing method and device
WO2017185632A1 (en) Data transmission method and electronic device
KR20170052269A (en) Method and apparatus for providing data in multimedia system
CN103731736A (en) Control method and device for upgrading of smart television
CN114461485A (en) Resource loading monitoring method, device, equipment and storage medium
WO2017036308A1 (en) File uploading method, access method, device and apparatus
CN116596065B (en) Gradient calculation method and device, storage medium, product and electronic equipment
CN111352992B (en) Data consistency detection method, device and server
CN111131814A (en) Data feedback method and device and set top box

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20211202

Address after: 430074 1502-5, building 1, SBI Chuangye street, Dongxin Road, Donghu New Technology Development Zone, Wuhan City, Hubei Province (one site with multiple photos)

Patentee after: Wuhan Hanyuan Technology Co.,Ltd.

Address before: 430074 room 211, Optics Valley venture coffee, 1st floor, Optics Valley capital building, No.1 Minzu Avenue, Donghu New Technology Development Zone, Wuhan City, Hubei Province

Patentee before: HUBEI HUALIAN BOYUAN TECHNOLOGY Co.,Ltd.

TR01 Transfer of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20210723

Termination date: 20210930

CF01 Termination of patent right due to non-payment of annual fee