CN112822289A - Data uploading and reading method, system, equipment and storage medium - Google Patents
Data uploading and reading method, system, equipment and storage medium Download PDFInfo
- Publication number
- CN112822289A CN112822289A CN202110134610.0A CN202110134610A CN112822289A CN 112822289 A CN112822289 A CN 112822289A CN 202110134610 A CN202110134610 A CN 202110134610A CN 112822289 A CN112822289 A CN 112822289A
- Authority
- CN
- China
- Prior art keywords
- data
- target data
- resource
- address
- identifier
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/10—Active monitoring, e.g. heartbeat, ping or trace-route
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/16—Threshold monitoring
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Cardiology (AREA)
- General Health & Medical Sciences (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention relates to the field of cloud databases, and discloses a data uploading and reading method, a system, equipment and a storage medium. The method comprises the following steps: the resource uploading system receives an uploading instruction of target data; capturing target data in the local storage address, and sending the target data to a server address; the cloud service system receives the target data and sends a cloud storage address of the target data to the resource reading system; the resource reading system receives a cloud storage address; accessing target data in the cloud storage address to obtain a data identifier of the target data; matching the data identifier with a preset resource identifier table, and judging whether the data identifier exists in the resource identifier table or not; if the local data exists, marking the resource identifier matched with the data identifier in the resource identifier table, accessing the local storage path corresponding to the resource identifier, capturing the local data in the local storage path, and displaying the local data.
Description
Technical Field
The invention relates to the field of cloud databases, in particular to a data uploading and reading method, a data uploading and reading system, data uploading and reading equipment and a storage medium.
Background
With the rapid development of computer networks and applications, industries and products related to multimedia are more and more, and are more and more popular nowadays. Most multimedia and social applications involve uploading and downloading of resources to spread and share information.
After the resource is uploaded, most users choose to view and preview the content published by themselves once or more, and traffic consumption is caused in the meantime. Some software can do resource caching, and the software is not loaded after previewing, but the caching has the defect that the first previewing cannot be solved. Because the cache can be completed only when the content needs to be downloaded, a method for previewing the self-issued cloud content for the first time without flow needs to be found on the basis, so that the cloud flow and the client flow cost can be saved, and the preview experience technology can be improved.
Disclosure of Invention
The invention mainly aims to solve the technical problem of excessive consumption of the first preview flow.
The first aspect of the present invention provides a data uploading and reading method, which is applied to a data uploading and reading system, where the data uploading and reading system includes: the data uploading and reading method comprises the following steps of:
the resource uploading system receives an uploading instruction of target data, wherein the uploading instruction comprises: a local storage address of the target data and a server address of the cloud service system;
capturing the target data in the local storage address, and sending the target data to the server address;
the cloud service system receives the target data and sends a cloud storage address of the target data to the resource reading system;
the resource reading system receives the cloud storage address;
receiving a reading instruction of target data, accessing the target data in the cloud storage address, and acquiring a data identifier of the target data;
matching the data identifier with a preset resource identifier table, and judging whether the data identifier exists in the resource identifier table or not;
if the target data does not exist, downloading the target data from the cloud service system, and displaying the target data;
if the local data exists, marking the resource identifier matched with the data identifier in the resource identifier table, accessing a local storage path corresponding to the resource identifier, capturing the local data in the local storage path, and displaying the local data.
Optionally, in a first implementation manner of the first aspect of the present invention, the fetching the target data from the local storage address, and sending the target data to the server address includes:
capturing the target data in the local storage address;
judging whether the data size of the target data exceeds a preset storage threshold value or not;
if the target data size exceeds the storage threshold, based on the storage threshold, performing fragmentation processing on the target data to obtain N target data fragments, and sending the N target data fragments to the server address, wherein N is a positive integer, and the data sizes of the target data fragments are all smaller than the storage threshold;
and if the current address does not exceed the preset address, capturing the target data in the local storage address, and sending the target data to the server address.
Optionally, in a second implementation manner of the first aspect of the present invention, the downloading the target data from the cloud service system and displaying the target data includes:
reading a ping value of a downloading network, and judging whether the ping value exceeds a preset downloading threshold value;
if the network ping value exceeds the download threshold value, replacing a preset network transmission path, and judging whether the new network ping value exceeds the download threshold value;
and if the target data is not exceeded, downloading the target data from the cloud service system, and displaying the target data.
Optionally, in a third implementation manner of the first aspect of the present invention, after marking a resource identifier in the resource identifier table, which matches the data identifier, accessing a local storage path corresponding to the resource identifier, capturing local data in the local storage path, and displaying the local data, the method further includes:
and increasing the marking times corresponding to the resource identifiers by 1.
Optionally, in a fourth implementation manner of the first aspect of the present invention, after increasing the number of times of marking corresponding to the resource identifier by 1, the method further includes:
traversing and reading the marking times of the resource identifiers in the resource identifier table within preset time;
judging whether the marking times are smaller than a preset deleting threshold value or not;
if the resource identifier is smaller than the preset value, deleting the local storage path and the local data corresponding to the resource identifier, and removing the resource identifier from the resource identifier table.
Optionally, in a fifth implementation manner of the first aspect of the present invention, the receiving the target data and sending the cloud storage address of the target data to the resource reading system includes:
receiving the target data and judging whether the target data belongs to audio data or not;
if the target data belongs to the audio data, storing the target data in a first resource integration address, determining the first resource integration address as a cloud storage address, and sending the cloud storage address to the resource reading system;
if the target data does not belong to the audio data, judging whether the target data belongs to the video data;
if the video data belong to the video data, storing the target data in a second resource integration address, determining the second resource integration address as a cloud storage address, and sending the cloud storage address to the resource reading system;
if the video data does not belong to the video data, the target data is stored in a public resource address, the public resource is determined as a cloud storage address, and the cloud storage address is sent to the resource reading system.
Optionally, in a sixth implementation manner of the first aspect of the present invention, the matching the data identifier with a preset resource identifier table, and determining whether the data identifier exists in the resource identifier table includes:
determining the data identifier as a key value based on the query function of the SQL database, and querying in a preset resource identifier table to obtain a value;
it is determined whether the value is equal to 1.
A second aspect of the present invention provides a data uploading and reading system, including:
the system comprises a resource uploading system, a cloud service system and a resource reading system;
the resource uploading system is used for receiving an uploading instruction of target data, wherein the uploading instruction comprises: a local storage address of the target data and a server address of the cloud service system; capturing the target data in the local storage address, and sending the target data to the server address;
the cloud service system is used for receiving the target data and sending a cloud storage address of the target data to the resource reading system;
the resource reading system is used for receiving the cloud storage address; receiving a reading instruction of target data, accessing the target data in the cloud storage address, and acquiring a data identifier of the target data; matching the data identifier with a preset resource identifier table, and judging whether the data identifier exists in the resource identifier table or not; if the target data does not exist, downloading the target data from the cloud service system, and displaying the target data; if the local data exists, marking the resource identifier matched with the data identifier in the resource identifier table, accessing a local storage path corresponding to the resource identifier, capturing the local data in the local storage path, and displaying the local data.
A third aspect of the present invention provides a data uploading and reading apparatus, including: a memory having instructions stored therein and at least one processor, the memory and the at least one processor interconnected by a line; the at least one processor calls the instructions in the memory to enable the data uploading and reading device to execute the data uploading and reading method.
A fourth aspect of the present invention provides a computer-readable storage medium, which stores instructions that, when executed on a computer, cause the computer to execute the above data uploading and reading method.
Drawings
Fig. 1 is a schematic diagram of a first embodiment of a data uploading and reading method in an embodiment of the present invention;
FIG. 2 is a diagram of a second embodiment of a data uploading and reading method according to an embodiment of the present invention;
fig. 3 is a schematic diagram of a third embodiment of a data uploading and reading method in an embodiment of the present invention;
FIG. 4 is a schematic diagram of an embodiment of a data uploading and reading system in an embodiment of the present invention;
fig. 5 is a schematic diagram of another embodiment of a data uploading and reading system in an embodiment of the present invention;
fig. 6 is a schematic diagram of an embodiment of a data uploading and reading device in an embodiment of the present invention.
Detailed Description
The embodiment of the invention provides a data uploading and reading method, a data uploading and reading system, data uploading and reading equipment and a storage medium.
The terms "first," "second," "third," "fourth," and the like in the description and in the claims, as well as in the drawings, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that the embodiments described herein may be practiced otherwise than as specifically illustrated or described herein. Furthermore, the terms "comprises," "comprising," or "having," and any variations thereof, are intended to cover non-exclusive inclusions, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
For convenience of understanding, a specific flow of the embodiment of the present invention is described below, and referring to fig. 1, a first embodiment of a data uploading reading method in the embodiment of the present invention includes:
101. the resource uploading system receives an uploading instruction of target data, wherein the uploading instruction comprises: a local storage address of the target data and a server address of the cloud service system;
102. capturing target data in the local storage address, and sending the target data to a server address;
in the embodiment of 101-102, the upload instruction is sent by the smart terminal mobile phone, and the upload instruction is accompanied by an address or a storage path of the target data stored locally, and also accompanied by a server address of the cloud server to be uploaded. After the uploading instruction is obtained, target data needing to be uploaded is found in a mobile phone of the intelligent terminal mobile phone, and the target data can be an independent file or a folder. And if the target data is a folder, compressing the folder, and uploading a compressed file to a cloud server during uploading.
103. The cloud service system receives the target data and sends a cloud storage address of the target data to the resource reading system;
in this embodiment, the cloud server performs wireless transmission through a TCP/IP protocol to obtain target data, reads the type of the target data, stores the target data in a first resource integration address if the target data is video data, stores the target data in a second resource integration address if the target data is audio data, and stores the target data in a third resource integration address if the target data is not video data and audio data. If the storage address positions are different, different cloud storage data addresses can be generated, and the sending cloud data addresses are different.
104. The resource reading system receives a cloud storage address;
105. receiving a reading instruction of target data, accessing the target data in the cloud storage address, and acquiring a data identifier of the target data;
106. matching the data identifier with a preset resource identifier table, and judging whether the data identifier exists in the resource identifier table or not;
107. if the target data does not exist, downloading the target data from the cloud service system, and displaying the target data;
108. if the local data exists, marking the resource identifier matched with the data identifier in the resource identifier table, accessing the local storage path corresponding to the resource identifier, capturing the local data in the local storage path, and displaying the local data.
In the embodiment of 104-108, the resource reading system specifically handles the content of the data, and the resource reading system receives the cloud storage address, and forms a mapping with the target data. When a reading instruction of target data is received, whether the same data exists in a local storage disk is judged in need. The resource reading system and the resource uploading system can share one set of storage medium, the resource reading system and the resource uploading system can be distributed, and the same data can be captured if the respective storage media are matched. During matching, the self-set encoding rule can be used, or the hash value algorithm can be used for calculating the hash value of each datum, and the hash value is used for matching. The data stored in the resource reading system all have corresponding hash values and are collected in a resource identifier table. Based on the regular rule or the numerical comparison, the identifier of the target data is matched with the resource identifier table, and the identifier of the target data can be queried by adopting a query means of an SQL database. When the identifier of the target data exists in the resource identification table, the storage medium in the resource reading system is indicated to store the target data, the storage path matched with the successful resource identifier is read, and the target data is captured and displayed according to the storage path. And if the matching is unsuccessful, downloading the target data from the cloud storage address of the target data, and displaying the target data.
In the embodiment of the invention, the identifier comparison is carried out on the uploaded data, whether the data needing to be previewed in the cloud database is stored locally is analyzed, when the target data is stored locally, the local data can be called and read, the flow downloading is reduced, and the problem of flow consumption of the first previewed data is solved.
Referring to fig. 2, a second embodiment of a data uploading and reading method according to the embodiment of the present invention includes:
201. the resource uploading system receives an uploading instruction of target data, wherein the uploading instruction comprises: a local storage address of the target data and a server address of the cloud service system;
this embodiment is similar to the first embodiment, and reference may be made to the first embodiment, which is not described herein again.
202. Capturing target data in a local storage address;
203. judging whether the data size of the target data exceeds a preset storage threshold value or not;
204. if the target data size exceeds the storage threshold, performing fragmentation processing on the target data based on the storage threshold to obtain N target data fragments, and sending the N target data fragments to a server address, wherein N is a positive integer, and the data size of each target data fragment is smaller than the storage threshold;
205. if the local storage address does not exceed the local storage address, target data are captured in the local storage address, and the target data are sent to the server address;
in the embodiment of 202-. If the storage threshold is 5G, the target data 2.5G is directly uploaded to the cloud database without any processing if the storage threshold is not exceeded.
206. The cloud service system receives the target data and sends a cloud storage address of the target data to the resource reading system;
207. the resource reading system receives a cloud storage address;
208. receiving a reading instruction of target data, accessing the target data in the cloud storage address, and acquiring a data identifier of the target data;
209. matching the data identifier with a preset resource identifier table, and judging whether the data identifier exists in the resource identifier table or not;
the embodiment 206-209 is similar to the first embodiment, and can refer to the first embodiment, which is not described herein.
210. If not, reading the ping value of the download network, and judging whether the ping value exceeds a preset download threshold value;
211. if the network ping value exceeds the download threshold value, replacing a preset network transmission path, and judging whether the new network ping value exceeds the download threshold value;
212. if the current data exceeds the preset threshold value, downloading the target data from the cloud service system and displaying the target data;
in the embodiment 210-212, various network topologies are adopted during downloading, different network topologies generate different network transmission speeds, the downloading threshold is set to 120ms, and when the network ping value is greater than 120ms, it indicates that the network is not smooth, the network transmission path is adjusted. And if the network ping value is less than 120ms, downloading the target data based on the current network topology.
213. If the local data exists, marking the resource identifier matched with the data identifier in the resource identifier table, accessing a local storage path corresponding to the resource identifier, capturing the local data in the local storage path, and displaying the local data;
this embodiment is similar to the first embodiment, and reference may be made to the first embodiment, which is not described herein again.
214. Increasing the marking times corresponding to the resource identifier by 1;
in this embodiment, a resource identifier counter is set, and the value of the counter is increased after each time the resource identifier counter is marked, for example, the current count of m identifiers is 8, and the counter becomes 9 after being queried for marking.
215. Traversing and reading the marking times of the resource identifiers in the resource identifier table within preset time;
216. judging whether the marking times are smaller than a preset deleting threshold value or not;
217. if the resource identifier is smaller than the preset value, deleting the local storage path and the local data corresponding to the resource identifier, and removing the resource identifier from the resource identifier table.
215-217 embodiment, each time a computation marker is made, a marker timestamp is formed. Setting the time zone to be 6 months, then calculating 6 months based on the current time, reading the marking times of each identifier in 6 months, deleting 3 times by using the threshold value, deleting the data corresponding to the identifier based on the data storage address, wherein the identifier is smaller than the corresponding data storage address of 3 times.
In the embodiment of the invention, the identifier comparison is carried out on the uploaded data, whether the data needing to be previewed in the cloud database is stored locally is analyzed, when the target data is stored locally, the local data can be called and read, the flow downloading is reduced, and the problem of flow consumption of the first previewed data is solved.
Referring to fig. 3, a third embodiment of the data uploading reading method according to the embodiment of the present invention includes:
301. the resource uploading system receives an uploading instruction of target data, wherein the uploading instruction comprises: a local storage address of the target data and a server address of the cloud service system;
302. capturing target data in the local storage address, and sending the target data to a server address;
303. the cloud service system receives the target data and sends a cloud storage address of the target data to the resource reading system;
304. the resource reading system receives a cloud storage address;
the embodiments 301-304 are similar to the first embodiment, and reference may be made to the first embodiment, which is not described herein again.
305. Receiving target data and judging whether the target data belongs to audio data or not;
306. if the audio data belong to the audio data, storing the target data in a first resource integration address, determining the first resource integration address as a cloud storage address, and sending the cloud storage address to a resource reading system;
307. if the target data does not belong to the audio data, judging whether the target data belongs to the video data;
308. if the video data belong to the video data, storing the target data in a second resource integration address, determining the second resource integration address as a cloud storage address, and sending the cloud storage address to a resource reading system;
309. if the video data does not belong to the video data, storing the target data in a public resource address, determining the public resource as a cloud storage address, and sending the cloud storage address to a resource reading system;
in the embodiment 305-309, the format of the target data is determined, and it is first determined whether the target data belongs to the audio format, and if the target data belongs to the audio format, the target data is stored in the first resource integration address. If the target data is not in the audio format, whether the target data belongs to the video format is judged, and if the target data belongs to the video format, the target data is stored in the second resource integration address. And if the target data is not in the video format, storing the target data in a third resource integration address to solve the problem of storing the whole target data. The storage address can be used as a cloud storage address.
310. Determining the data identifier as a key value based on the query function of the SQL database, and querying in a preset resource identifier table to obtain a value;
311. judging whether the value is equal to 1;
in the embodiment 310-311, based on the SQL database, the data identifier is used as an input value of a query function, and the resource identifier table is used as a query object, so as to perform query judgment, thereby obtaining a returned value. The Value has two kinds of values, 0 and 1, where 0 indicates that the matching is not successful, and 1 indicates that the matching is successful, that is, the identification data of the target data exists in the resource identifier table.
312. If not, downloading the target data from the cloud service system and displaying the target data;
313. if the local data is equal to the data identifier, marking the resource identifier matched with the data identifier in the resource identifier table, accessing the local storage path corresponding to the resource identifier, capturing the local data in the local storage path, and displaying the local data.
The 312-313 embodiment is similar to the first embodiment, and reference may be made to the first embodiment, which is not described herein.
In the embodiment of the invention, the identifier comparison is carried out on the uploaded data, whether the data needing to be previewed in the cloud database is stored locally is analyzed, when the target data is stored locally, the local data can be called and read, the flow downloading is reduced, and the problem of flow consumption of the first previewed data is solved.
With reference to fig. 4, the data uploading reading method in the embodiment of the present invention is described above, and a data uploading reading system in the embodiment of the present invention is described below, where the data uploading reading system in the embodiment of the present invention includes:
a resource uploading system 401, a cloud service system 402, and a resource reading system 403;
the resource uploading system 401 is configured to receive an uploading instruction of target data, where the uploading instruction includes: a local storage address of the target data and a server address of the cloud service system; capturing the target data in the local storage address, and sending the target data to the server address;
the cloud service system 402 is configured to receive the target data, and send a cloud storage address of the target data to the resource reading system;
the resource reading system 403 is configured to receive the cloud storage address; receiving a reading instruction of target data, accessing the target data in the cloud storage address, and acquiring a data identifier of the target data; matching the data identifier with a preset resource identifier table, and judging whether the data identifier exists in the resource identifier table or not; if the target data does not exist, downloading the target data from the cloud service system, and displaying the target data; if the local data exists, marking the resource identifier matched with the data identifier in the resource identifier table, accessing a local storage path corresponding to the resource identifier, capturing the local data in the local storage path, and displaying the local data.
In the embodiment of the invention, the identifier comparison is carried out on the uploaded data, whether the data needing to be previewed in the cloud database is stored locally is analyzed, when the target data is stored locally, the local data can be called and read, the flow downloading is reduced, and the problem of flow consumption of the first previewed data is solved.
Referring to fig. 5, in another embodiment of the data uploading reading system according to the embodiment of the present invention, the data uploading reading system includes:
a resource uploading system 401, a cloud service system 402, and a resource reading system 403;
the resource uploading system 401 is configured to receive an uploading instruction of target data, where the uploading instruction includes: a local storage address of the target data and a server address of the cloud service system; capturing the target data in the local storage address, and sending the target data to the server address;
the cloud service system 402 is configured to receive the target data, and send a cloud storage address of the target data to the resource reading system;
the resource reading system 403 is configured to receive the cloud storage address; receiving a reading instruction of target data, accessing the target data in the cloud storage address, and acquiring a data identifier of the target data; matching the data identifier with a preset resource identifier table, and judging whether the data identifier exists in the resource identifier table or not; if the target data does not exist, downloading the target data from the cloud service system, and displaying the target data; if the local data exists, marking the resource identifier matched with the data identifier in the resource identifier table, accessing a local storage path corresponding to the resource identifier, capturing the local data in the local storage path, and displaying the local data.
The resource uploading system 401 may further specifically be configured to:
capturing the target data in the local storage address;
judging whether the data size of the target data exceeds a preset storage threshold value or not;
if the target data size exceeds the storage threshold, based on the storage threshold, performing fragmentation processing on the target data to obtain N target data fragments, and sending the N target data fragments to the server address, wherein N is a positive integer, and the data sizes of the target data fragments are all smaller than the storage threshold;
and if the current address does not exceed the preset address, capturing the target data in the local storage address, and sending the target data to the server address.
The resource reading system 403 may be further specifically configured to:
reading a ping value of a downloading network, and judging whether the ping value exceeds a preset downloading threshold value;
if the network ping value exceeds the download threshold value, replacing a preset network transmission path, and judging whether the new network ping value exceeds the download threshold value;
and if the target data is not exceeded, downloading the target data from the cloud service system, and displaying the target data.
The data uploading and reading system further includes a counting module 404, where the counting module 404 is specifically configured to:
and increasing the marking times corresponding to the resource identifiers by 1.
The data uploading and reading system further includes a deletion module 405, and the deletion module 405 is specifically configured to:
traversing and reading the marking times of the resource identifiers in the resource identifier table within preset time;
judging whether the marking times are smaller than a preset deleting threshold value or not;
if the resource identifier is smaller than the preset value, deleting the local storage path and the local data corresponding to the resource identifier, and removing the resource identifier from the resource identifier table.
The cloud service system 402 may be further specifically configured to:
receiving the target data and judging whether the target data belongs to audio data or not;
if the target data belongs to the audio data, storing the target data in a first resource integration address, determining the first resource integration address as a cloud storage address, and sending the cloud storage address to the resource reading system;
if the target data does not belong to the audio data, judging whether the target data belongs to the video data;
if the video data belong to the video data, storing the target data in a second resource integration address, determining the second resource integration address as a cloud storage address, and sending the cloud storage address to the resource reading system;
if the video data does not belong to the video data, the target data is stored in a public resource address, the public resource is determined as a cloud storage address, and the cloud storage address is sent to the resource reading system.
The resource reading system 403 may be further specifically configured to:
determining the data identifier as a key value based on the query function of the SQL database, and querying in a preset resource identifier table to obtain a value;
it is determined whether the value is equal to 1.
In the embodiment of the invention, the identifier comparison is carried out on the uploaded data, whether the data needing to be previewed in the cloud database is stored locally is analyzed, when the target data is stored locally, the local data can be called and read, the flow downloading is reduced, and the problem of flow consumption of the first previewed data is solved.
Fig. 4 and 5 describe the data upload read system in the embodiment of the present invention in detail from the perspective of the modular functional entity, and the data upload read device in the embodiment of the present invention is described in detail from the perspective of hardware processing.
Fig. 6 is a schematic structural diagram of a data uploading and reading device according to an embodiment of the present invention, where the data uploading and reading device 600 may have a relatively large difference due to different configurations or performances, and may include one or more processors (CPUs) 610 (e.g., one or more processors) and a memory 620, and one or more storage media 630 (e.g., one or more mass storage devices) storing applications 633 or data 632. Memory 620 and storage medium 630 may be, among other things, transient or persistent storage. The program stored in the storage medium 630 may include one or more modules (not shown), and each module may include a series of instruction operations in the data upload read apparatus 600. Further, the processor 610 may be configured to communicate with the storage medium 630 and execute a series of instruction operations in the storage medium 630 on the data upload read device 600.
The data-based upload read device 600 may also include one or more power supplies 640, one or more wired or wireless network interfaces 550, one or more input-output interfaces 660, and/or one or more operating systems 631, such as Windows Server, Mac OS X, Unix, Linux, FreeBSD, and the like. Those skilled in the art will appreciate that the data upload read device configuration shown in fig. 6 does not constitute a limitation of a data upload read device and may include more or less components than those shown, or some components in combination, or a different arrangement of components.
The present invention also provides a computer-readable storage medium, which may be a non-volatile computer-readable storage medium, and may also be a volatile computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the instructions are executed on a computer, the instructions cause the computer to execute the steps of the data uploading and reading method.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described system or system and unit may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A data uploading and reading method is characterized in that the data uploading and reading method is applied to a data uploading and reading system, and the data uploading and reading system comprises: the data uploading and reading method comprises the following steps of:
the resource uploading system receives an uploading instruction of target data, wherein the uploading instruction comprises: a local storage address of the target data and a server address of the cloud service system;
capturing the target data in the local storage address, and sending the target data to the server address;
the cloud service system receives the target data and sends a cloud storage address of the target data to the resource reading system;
the resource reading system receives the cloud storage address;
receiving a reading instruction of target data, accessing the target data in the cloud storage address, and acquiring a data identifier of the target data;
matching the data identifier with a preset resource identifier table, and judging whether the data identifier exists in the resource identifier table or not;
if the target data does not exist, downloading the target data from the cloud service system, and displaying the target data;
if the local data exists, marking the resource identifier matched with the data identifier in the resource identifier table, accessing a local storage path corresponding to the resource identifier, capturing the local data in the local storage path, and displaying the local data.
2. The data uploading and reading method according to claim 1, wherein the capturing the target data in the local storage address and sending the target data to the server address comprises:
capturing the target data in the local storage address;
judging whether the data size of the target data exceeds a preset storage threshold value or not;
if the target data size exceeds the storage threshold, based on the storage threshold, performing fragmentation processing on the target data to obtain N target data fragments, and sending the N target data fragments to the server address, wherein N is a positive integer, and the data sizes of the target data fragments are all smaller than the storage threshold;
and if the current address does not exceed the preset address, capturing the target data in the local storage address, and sending the target data to the server address.
3. The data uploading and reading method according to claim 1, wherein the downloading the target data from the cloud service system and the displaying the target data comprise:
reading a ping value of a downloading network, and judging whether the ping value exceeds a preset downloading threshold value;
if the network ping value exceeds the download threshold value, replacing a preset network transmission path, and judging whether the new network ping value exceeds the download threshold value;
and if the target data is not exceeded, downloading the target data from the cloud service system, and displaying the target data.
4. The data uploading and reading method according to claim 1, wherein after the marking the resource identifier matching the data identifier in the resource identifier table, accessing a local storage path corresponding to the resource identifier, capturing local data in the local storage path, and displaying the local data, further comprising:
and increasing the marking times corresponding to the resource identifiers by 1.
5. The data uploading and reading method according to claim 4, wherein after the increasing the number of times of marking corresponding to the resource identifier by 1, further comprising:
traversing and reading the marking times of the resource identifiers in the resource identifier table within preset time;
judging whether the marking times are smaller than a preset deleting threshold value or not;
if the resource identifier is smaller than the preset value, deleting the local storage path and the local data corresponding to the resource identifier, and removing the resource identifier from the resource identifier table.
6. The data uploading and reading method according to claim 1, wherein the receiving the target data and sending a cloud storage address of the target data to the resource reading system includes:
receiving the target data and judging whether the target data belongs to audio data or not;
if the target data belongs to the audio data, storing the target data in a first resource integration address, determining the first resource integration address as a cloud storage address, and sending the cloud storage address to the resource reading system;
if the target data does not belong to the audio data, judging whether the target data belongs to the video data;
if the video data belong to the video data, storing the target data in a second resource integration address, determining the second resource integration address as a cloud storage address, and sending the cloud storage address to the resource reading system;
if the video data does not belong to the video data, the target data is stored in a public resource address, the public resource is determined as a cloud storage address, and the cloud storage address is sent to the resource reading system.
7. The data uploading and reading method according to claim 1, wherein the matching the data identifier with a preset resource identifier table, and the determining whether the data identifier exists in the resource identifier table comprises:
determining the data identifier as a key value based on the query function of the SQL database, and querying in a preset resource identifier table to obtain a value;
it is determined whether the value is equal to 1.
8. A data upload read system, comprising:
the system comprises a resource uploading system, a cloud service system and a resource reading system;
the resource uploading system is used for receiving an uploading instruction of target data, wherein the uploading instruction comprises: a local storage address of the target data and a server address of the cloud service system; capturing the target data in the local storage address, and sending the target data to the server address;
the cloud service system is used for receiving the target data and sending a cloud storage address of the target data to the resource reading system;
the resource reading system is used for receiving the cloud storage address; receiving a reading instruction of target data, accessing the target data in the cloud storage address, and acquiring a data identifier of the target data; matching the data identifier with a preset resource identifier table, and judging whether the data identifier exists in the resource identifier table or not; if the target data does not exist, downloading the target data from the cloud service system, and displaying the target data; if the local data exists, marking the resource identifier matched with the data identifier in the resource identifier table, accessing a local storage path corresponding to the resource identifier, capturing the local data in the local storage path, and displaying the local data.
9. A data upload read device, characterized in that the data upload read device comprises: a memory having instructions stored therein and at least one processor, the memory and the at least one processor interconnected by a line;
the at least one processor invokes the instructions in the memory to cause the data upload read device to perform the data upload read method of any of claims 1-7.
10. A computer-readable storage medium, on which a computer program is stored, wherein the computer program, when executed by a processor, implements the data uploading reading method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110134610.0A CN112822289A (en) | 2021-01-29 | 2021-01-29 | Data uploading and reading method, system, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110134610.0A CN112822289A (en) | 2021-01-29 | 2021-01-29 | Data uploading and reading method, system, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112822289A true CN112822289A (en) | 2021-05-18 |
Family
ID=75860966
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110134610.0A Pending CN112822289A (en) | 2021-01-29 | 2021-01-29 | Data uploading and reading method, system, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112822289A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114528005A (en) * | 2021-11-29 | 2022-05-24 | 深圳市千源互联网科技服务有限公司 | Grab tag updating method, device, equipment and storage medium |
| CN114598712A (en) * | 2022-03-11 | 2022-06-07 | 上海凯翔信息科技有限公司 | Data transmission system based on cloud NAS |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101924785A (en) * | 2010-04-28 | 2010-12-22 | 华为技术有限公司 | Data uploading and downloading methods and system |
| CN106294844A (en) * | 2016-08-19 | 2017-01-04 | 乐视控股（北京）有限公司 | Browsing device net page loading processing method and device |
| CN108153849A (en) * | 2017-12-20 | 2018-06-12 | 杭州登虹科技有限公司 | A kind of database table cutting method, device, system and medium |
| CN108234639A (en) * | 2017-12-29 | 2018-06-29 | 北京奇虎科技有限公司 | A kind of data access method and device based on content distributing network CDN |
| CN109634876A (en) * | 2018-12-11 | 2019-04-16 | 广东省新代通信与网络创新研究院 | File access method, device and computer readable storage medium |
| CN110109676A (en) * | 2019-04-30 | 2019-08-09 | 努比亚技术有限公司 | Compilation Method, terminal and computer readable storage medium |
| CN110347651A (en) * | 2019-06-11 | 2019-10-18 | 平安科技（深圳）有限公司 | Method of data synchronization, device, equipment and storage medium based on cloud storage |
| CN110727890A (en) * | 2019-08-22 | 2020-01-24 | 中国平安财产保险股份有限公司 | Page loading method and device, computer equipment and storage medium |
| CN111459658A (en) * | 2020-03-10 | 2020-07-28 | 中国平安人寿保险股份有限公司 | Resource data acquisition method and related equipment |
| US20200380172A1 (en) * | 2019-05-30 | 2020-12-03 | Google Llc | Data integrity |
| CN112104905A (en) * | 2020-07-06 | 2020-12-18 | 聚好看科技股份有限公司 | Server, display equipment and data transmission method |
-
2021
- 2021-01-29 CN CN202110134610.0A patent/CN112822289A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101924785A (en) * | 2010-04-28 | 2010-12-22 | 华为技术有限公司 | Data uploading and downloading methods and system |
| CN106294844A (en) * | 2016-08-19 | 2017-01-04 | 乐视控股（北京）有限公司 | Browsing device net page loading processing method and device |
| CN108153849A (en) * | 2017-12-20 | 2018-06-12 | 杭州登虹科技有限公司 | A kind of database table cutting method, device, system and medium |
| CN108234639A (en) * | 2017-12-29 | 2018-06-29 | 北京奇虎科技有限公司 | A kind of data access method and device based on content distributing network CDN |
| CN109634876A (en) * | 2018-12-11 | 2019-04-16 | 广东省新代通信与网络创新研究院 | File access method, device and computer readable storage medium |
| CN110109676A (en) * | 2019-04-30 | 2019-08-09 | 努比亚技术有限公司 | Compilation Method, terminal and computer readable storage medium |
| US20200380172A1 (en) * | 2019-05-30 | 2020-12-03 | Google Llc | Data integrity |
| CN110347651A (en) * | 2019-06-11 | 2019-10-18 | 平安科技（深圳）有限公司 | Method of data synchronization, device, equipment and storage medium based on cloud storage |
| CN110727890A (en) * | 2019-08-22 | 2020-01-24 | 中国平安财产保险股份有限公司 | Page loading method and device, computer equipment and storage medium |
| CN111459658A (en) * | 2020-03-10 | 2020-07-28 | 中国平安人寿保险股份有限公司 | Resource data acquisition method and related equipment |
| CN112104905A (en) * | 2020-07-06 | 2020-12-18 | 聚好看科技股份有限公司 | Server, display equipment and data transmission method |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114528005A (en) * | 2021-11-29 | 2022-05-24 | 深圳市千源互联网科技服务有限公司 | Grab tag updating method, device, equipment and storage medium |
| CN114528005B (en) * | 2021-11-29 | 2023-06-23 | 深圳市千源互联网科技服务有限公司 | Grabbing label updating method, grabbing label updating device, grabbing label updating equipment and storage medium |
| CN114598712A (en) * | 2022-03-11 | 2022-06-07 | 上海凯翔信息科技有限公司 | Data transmission system based on cloud NAS |
| CN114598712B (en) * | 2022-03-11 | 2023-12-22 | 上海凯翔信息科技有限公司 | Cloud NAS-based data transmission system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109271391B (en) | Data storage method, server, storage medium and device | |
| CN109167840B (en) | Task pushing method, node autonomous server and edge cache server | |
| CN111970315A (en) | Method, device and system for pushing message | |
| CN108600414B (en) | Equipment fingerprint construction method and device, storage medium and terminal | |
| CN106161633B (en) | Transmission method and system for packed files based on cloud computing environment | |
| JP2004172917A (en) | Packet retrieving device, packet process retrieving method, and program | |
| CN112822289A (en) | Data uploading and reading method, system, equipment and storage medium | |
| CN108063685B (en) | Log analysis method and device | |
| CN108345643A (en) | A kind of data processing method and device | |
| CN111859127A (en) | Subscription method and device of consumption data and storage medium | |
| CN108989101B (en) | Log output system and method and electronic equipment | |
| CN114528231A (en) | Data dynamic storage method and device, electronic equipment and storage medium | |
| CN115442439A (en) | Distributed cache cluster management method, system, terminal and storage medium | |
| CN110198227B (en) | Log file processing method and device, storage medium and electronic device | |
| CN111159131A (en) | Performance optimization method, device, equipment and computer readable storage medium | |
| CN112148676A (en) | File access request processing method and device and server | |
| CN107690057B (en) | Conference video data interaction method and device | |
| CN110825947A (en) | URL duplicate removal method, device, equipment and computer readable storage medium | |
| CN103428231B (en) | Offline download method and system | |
| CN107070987B (en) | Data acquisition method and system for distributed object storage system | |
| CN113516503B (en) | Advertisement delivery region calibration method and related equipment | |
| CN113407541B (en) | Data acquisition method, data acquisition equipment, storage medium and device | |
| CN106649678B (en) | Data processing method and system | |
| CN113411364B (en) | Resource acquisition method and device and server | |
| CN111061719B (en) | Data collection method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210518 |