CN116319718B - Cloud data storage processing method, system, equipment and medium - Google Patents
Cloud data storage processing method, system, equipment and medium Download PDFInfo
- Publication number
- CN116319718B CN116319718B CN202310263543.1A CN202310263543A CN116319718B CN 116319718 B CN116319718 B CN 116319718B CN 202310263543 A CN202310263543 A CN 202310263543A CN 116319718 B CN116319718 B CN 116319718B
- Authority
- CN
- China
- Prior art keywords
- data
- networking
- cloud
- data information
- uploading
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000013500 data storage Methods 0.000 title claims abstract description 31
- 238000003672 processing method Methods 0.000 title claims abstract description 17
- 230000006855 networking Effects 0.000 claims abstract description 110
- 238000000034 method Methods 0.000 claims abstract description 30
- 230000008569 process Effects 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims description 5
- 238000004458 analytical method Methods 0.000 claims description 3
- 238000004891 communication Methods 0.000 claims description 3
- 230000007246 mechanism Effects 0.000 claims description 3
- 230000001360 synchronised effect Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/166—Editing, e.g. inserting or deleting
- G06F40/177—Editing, e.g. inserting or deleting of tables; using ruled lines
- G06F40/18—Editing, e.g. inserting or deleting of tables; using ruled lines of spreadsheets
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Signal Processing (AREA)
- General Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The application provides a cloud data storage processing method, a cloud data storage processing system, cloud data storage processing equipment and a cloud data storage processing medium, and relates to the field of data processing. The method comprises the following steps: judging whether the data to be uploaded are networked or not, if not, storing the data locally, and if so, carrying out networking treatment on the data; then judging whether a form to be stored exists in the cloud or not, if not, creating a new form; judging whether the storage limit of the corresponding table is exceeded, if not, storing the networking data information into the corresponding table, otherwise, creating a continuation table, and storing the corresponding networking data information into the newly created continuation table; judging whether a field to be stored exists in the table, if not, creating a new field; and uploading the data based on the networking processing according to an API interface of a preset cloud. The method can automatically upload data to the cloud document, saves manpower and material resources, and can greatly improve the efficiency and reliability of data uploading for business scenes needing to upload a large amount of data.
Description
Technical Field
The application relates to the field of data processing, in particular to a cloud data storage processing method, a cloud data storage processing system, cloud data storage processing equipment and a cloud data storage processing medium.
Background
In the prior art, cloud document technologies can be broadly divided into two categories: the method is that the documents are stored in the cloud, and users can access and edit the documents through the network at any time and any place; another type is to use collaborative editing techniques that can support multiple users to edit the same document at the same time. These cloud documents allow users to access and edit documents anywhere and anytime without worrying about version management problems, and multiple users can easily perform collaborative editing.
However, in the prior art, data can only be manually added and filled, automatic addition cannot be achieved, and when the uploading data volume is large, the efficiency and reliability of data uploading are seriously affected.
Disclosure of Invention
The application aims to provide a cloud data storage processing method, a cloud data storage processing system, cloud data storage processing equipment and a cloud data storage processing medium, which can automatically upload data into a cloud document, save manpower and material resources, and greatly improve the efficiency and the reliability of data uploading for business scenes needing to upload a large amount of data.
The application is realized in the following way:
in a first aspect, an embodiment of the present application provides a cloud data storage processing method, including the following steps:
step S101: judging whether the uploaded original data is networked or not based on the obtained original data, and if not, storing the uploaded original data into a preset local document; step S102: networking processing is carried out based on the obtained original data, so that networking data information is obtained; step S103: judging whether a table to be stored exists in the preset cloud based on the networking data information, and if the table to be stored does not exist in the preset cloud, creating a corresponding table in the preset cloud; step S104: judging whether the storage limit of the corresponding table is exceeded based on the networking data information, if not, storing the networking data information into the corresponding table, otherwise, creating a continuation table, and storing the corresponding networking data information into the newly created continuation table; step S105: judging whether a field to be stored exists in the corresponding table or the continuous table based on the networking data information, if not, newly establishing the corresponding field; step S106: and uploading data according to the API interface of the preset cloud based on the networking data information.
In some embodiments of the application, after uploading the networking data information based on determining whether the storage limit of the corresponding table is exceeded, the method further comprises: whether the predetermined local document storage space includes local data is judged, and if so, the process goes to step S101.
In some embodiments of the present application, the processing of uploading data based on the networking data information according to the API interface of the preset cloud includes:
converting the networking data information into a corresponding character string in the JSON format to obtain a first character string; constructing a request URL, and designating a target position of uploading data and corresponding uploading attribute parameters; and sending a POST request to the constructed uploading URL based on the HTTP protocol, and simultaneously sending the first character string as a request body.
In some embodiments of the application, further comprising:
and analyzing the uploading POST request, and constructing a judging mechanism based on the analysis result to control whether the networking data information is uploaded again or the uploading is ended.
In some embodiments of the present application, before the uploading step S101, the method further includes:
newly establishing a corresponding thread request based on the acquired original data, and storing the data request in a request queue; judging whether a thread in execution exists or not, if not, creating a new thread, and taking out the original data from the data request queue to enter the next step.
In a second aspect, an embodiment of the present application provides a cloud data storage processing system, including:
the networking judging module is used for judging whether the uploaded original data is networked or not based on the obtained original data, and if not, storing the uploaded original data into a preset local document; the data networking module is used for carrying out networking processing based on the acquired original data to obtain networking data information; the form judging module is used for judging whether a form to be stored exists in the preset cloud based on the networking data information, and if the form to be stored does not exist in the preset cloud, a corresponding form is newly built in the preset cloud; the limit judging module is used for judging whether the storage limit of the corresponding table is exceeded or not based on the networking data information, if not, the networking data information is stored in the corresponding table, otherwise, a new continuation table is built, and the corresponding networking data information is stored in the new continuation table; the field processing module is used for judging whether a field to be stored exists in the corresponding table or the continuous table based on the networking data information, and if the field to be stored does not exist, the corresponding field is newly built; and the data uploading module is used for carrying out data uploading processing according to the API interface of the preset cloud based on the networking data information.
In a third aspect, an embodiment of the present application provides an electronic device comprising at least one processor, at least one memory, and a data bus; wherein: the processor and the memory complete communication with each other through the data bus; the memory stores program instructions for execution by the processor, the processor invoking the program instructions to perform the method of any of the first aspects.
In a fourth aspect, an embodiment of the present application provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements a method as described in any of the first aspects above.
Compared with the prior art, the embodiment of the application has at least the following advantages or beneficial effects:
the embodiment of the application provides a cloud data storage processing method, which comprises the following steps: judging whether the data to be uploaded are networked or not, if not, storing the data locally, and if so, carrying out networking treatment on the data; then judging whether a form to be stored exists in the cloud or not, if not, creating a new form; judging whether the storage limit of the corresponding table is exceeded, if not, storing the networking data information into the corresponding table, otherwise, creating a continuation table, and storing the corresponding networking data information into the newly created continuation table; judging whether a field to be stored exists in the table, if not, creating a new field; and uploading the data based on the networking processing according to an API interface of a preset cloud. The method can automatically upload data to the cloud document, saves manpower and material resources, and can greatly improve the efficiency and reliability of data uploading for business scenes needing to upload a large amount of data.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments will be briefly described below, it being understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and other related drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flowchart of an embodiment of a cloud data storage processing method according to the present application;
FIG. 2 is a schematic diagram of an overall flow of synchronous thread upload in an embodiment of the present application;
FIG. 3 is a flowchart illustrating an overall process of synchronous thread upload according to another embodiment of the present application;
FIG. 4 is a flow chart of field checking in an embodiment of the application;
fig. 5 is a specific flowchart of a data uploading process step according to an API interface of a preset cloud based on networking data information in an embodiment of the present application;
FIG. 6 is a flow chart of an asynchronous thread uploading data according to an embodiment of the application;
FIG. 7 is a block diagram illustrating an embodiment of a cloud data storage processing system according to the present application;
fig. 8 is a block diagram of an electronic device according to an embodiment of the present application.
Icon: 1. the networking judging module; 2. a data networking module; 3. a form judgment module; 4. a limit judgment module; 5. a field processing module; 6. a data uploading module; 7. a processor; 8. a memory; 9. a data bus.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments of the present application. The components of the embodiments of the present application generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations.
Some embodiments of the present application are described in detail below with reference to the accompanying drawings. The various embodiments and features of the embodiments described below may be combined with one another without conflict.
Example 1
The embodiment of the application provides a cloud data storage processing method, which can automatically upload data into a cloud document, saves manpower and material resources, and can greatly improve the efficiency and reliability of data uploading for business scenes needing to upload a large amount of data. Referring to fig. 1-2, the cloud data storage processing method includes the following steps:
step S101: and judging whether the original data are networked or not based on the obtained original data, and if not, storing the original data into a preset local document.
Step S102: and carrying out networking processing based on the acquired original data to obtain networking data information.
In the above steps, when the original data is acquired, the corresponding original data may be placed at the target position, and then the original data is automatically acquired through a computer program. For example, a DLL, namely a dataplay, may be adopted when the program is called, and the dataplay calls an API corresponding to the cloud to automatically upload corresponding data according to whether the data is in a dictionary format or an object format and according to different formats, and further, the acquisition of the original data may be performed through an adddata () function, so that the synchronous thread uploading of the original data is conveniently performed, that is, the corresponding data is transmitted to the server, and the next operation is continued after waiting for the response of the server. In addition, the original data is uploaded to the cloud for storage, but the network is not connected currently, so that the uploading fails. Therefore, in the above steps, for the obtained original data, it is first determined whether it is networked, then the non-networked original data can be stored in a predetermined local document, and further processing is performed when the subsequent networking is restored. In the case that some data uploading anomalies possibly occur in the subsequent uploading processing process, the data with the anomalies can be written into the local document, and the integrity of the data is ensured.
Step S103: judging whether a table to be stored exists in the preset cloud based on the networking data information, and if the table to be stored does not exist in the preset cloud, creating a corresponding table in the preset cloud.
After networking operation is performed on the original data to obtain networking data information, further processing can be started. Since the preset cloud may not include the table to be stored in the networking data information, a corresponding table may be newly built in the preset cloud at this time to be ready for subsequent data uploading. The newly built table can be a blank table, or a corresponding keyword is generated according to the name of the table to be stored in the networking data information, and then a corresponding template table is preferentially acquired from a plurality of original modules according to different keywords.
Step S104: judging whether the storage limit of the corresponding table is exceeded based on the networking data information, if not, storing the networking data information into the corresponding table, otherwise, creating a continuation table, and storing the corresponding networking data information into the newly created continuation table.
Considering that although the preset cloud exists a form to be stored, the upper storage limit of the preset cloud may exceed the data memory included in the networking data information, or although a form is newly built when the preset cloud does not exist the form to be stored, the storage limit of the newly built form may still not completely meet the storage requirement of the networking data information. Therefore, at this time, a new continuation table can be created, and the corresponding networking data information is stored in the new continuation table, so that the larger data storage requirement of the new continuation table is met. It should be noted that, at this time, the corresponding networking data information may be stored in the newly-built continuation table, after a part of the data is stored in the original table, the remaining data may be stored in the newly-built continuation table, or all the data may be directly stored in the continuation table with sufficient storage limit, and the method may be selectively applied according to the needs of the user when the method is implemented.
Referring to fig. 1 and 3, in some embodiments of the present application, after determining whether the storage limit of the corresponding table is exceeded based on the networking data information, the method further includes:
whether the predetermined local document storage space includes local data is judged, and if so, the process goes to step S101.
In the above steps, before the formal automatic uploading process is performed on the networking data information, the originally non-networking condition is eliminated, so that the original data which is temporarily stored in the local document when the networking is not performed can be reprocessed, and the accuracy and the effectiveness of the data uploading can be ensured.
With continued reference to fig. 1, step S105: and judging whether a field to be stored exists in the corresponding table or the continuous table based on the networking data information, and if the field does not exist, newly establishing the corresponding field.
In the step, the field checking process is added before the formal data uploading is carried out with the preset cloud, the field is newly added when the field is not available, the phenomenon of field errors in the subsequent formal data uploading is avoided, and the uploaded data is prevented from being scrambled. As shown in fig. 4, when performing the field inspection processing, after the cloud token is acquired, the corresponding field stored in the cloud may be acquired, so as to obtain corresponding cloud platform data, and then the corresponding cloud platform data is compared with the networking data information, and then a corresponding operation may be performed according to the comparison result, for example, the coverage field or the newly added field may be processed. Wherein the field array in fig. 4 may be a field array that is temporarily stored by writing to the local document.
Step S106: and uploading data according to the API interface of the preset cloud based on the networking data information.
After a series of judgment is carried out on the original data, the networking data information obtained through networking processing can be subjected to data uploading processing according to an API interface of a preset cloud, and automatic uploading processing of cloud document data is achieved. Therefore, the data operation is not needed to be manually added and filled, and manpower and material resources can be saved. Particularly, when uploading a large amount of original data, the efficiency and reliability of data uploading can be greatly improved (uploading is extremely easy to make mistakes by manually carrying out a large amount of cluttering processing).
Specifically, referring to fig. 4 and fig. 5, in some embodiments of the present application, the processing of uploading data based on the networking data information according to the API interface of the preset cloud includes:
step S201: converting the networking data information into a corresponding character string in the JSON format to obtain a first character string;
step S202: constructing a request URL, and designating a target position of uploading data and corresponding uploading attribute parameters;
step S203: and sending a POST request to the constructed URL based on the HTTP protocol, and simultaneously sending the first character string as a request body.
In the above steps, the networking data information is converted into the corresponding character string in the JSON format, and then the API corresponding to the cloud is called for uploading, so that the function of uploading and storing the networking data information in the cloud can be realized, and convenience and simplicity are realized.
In some embodiments of the application, further comprising: and analyzing the POST request, and constructing a judging mechanism based on an analysis result to control whether the networking data information is uploaded again or the uploading is ended.
In the above steps, by analyzing the POST request, whether the data is successfully uploaded to the corresponding cloud document can be judged, so that the networking data information can be controlled to be uploaded again when an uploading error occurs, and the corresponding uploading process is finished after the successful uploading, so that the phenomenon of data uploading loss is avoided.
Referring to fig. 6, in some embodiments of the present application, before the step S101, the method further includes:
newly establishing a corresponding thread request based on the acquired original data, and storing the data request in a request queue;
judging whether a thread in execution exists or not, if not, creating a new thread, and taking out the original data from the data request queue to enter the next step.
In practical application, the corresponding data is directly transmitted to the server by only adopting the process of uploading the synchronous threads in the steps S101-S106, so that the current thread blocking situation can occur, and particularly, the situation that the uploaded original data is larger is easier to occur. Therefore, in the steps, by utilizing the idea of asynchronous thread uploading, data is submitted to a task queue first, so that a server is enabled to process in a background mode, the execution of the current thread is not blocked, and the data processing performance in the process of uploading a large amount of data can be improved. It should be noted that, the new thread shown in fig. 6 fetches data from the request queue and executes the adddata () interface in the above steps: and newly creating a thread, and taking out the original data from the data request queue to enter the next step. That is, it performs corresponding processing when asynchronous thread uploading is possible, and adopts the above-mentioned synchronous thread uploading when not suitable (i.e. proceeds to step S101 to perform subsequent processing), so that it can select whether to perform synchronous thread uploading or asynchronous thread uploading according to actual situation needs.
Example 2
Referring to fig. 7, an embodiment of the present application provides a cloud data storage processing system, which includes:
the networking judging module 1 is used for judging whether the original data are networked or not based on the obtained original data, and if the original data are not networked, the original data are stored in a preset local document; the data networking module 2 is used for carrying out networking processing based on the acquired original data to obtain networking data information; the form judging module 3 is used for judging whether a form to be stored exists in the preset cloud based on the networking data information, and if the form to be stored does not exist in the preset cloud, a corresponding form is newly built in the preset cloud; the limit judgment module 4 is used for judging whether the storage limit of the corresponding table is exceeded or not based on the networking data information, if not, the networking data information is stored in the corresponding table, otherwise, a new continuation table is built, and the corresponding networking data information is stored in the new continuation table; the field processing module 5 is configured to determine whether a field to be stored exists in the corresponding table or the continuation table based on the networking data information, and if the field to be stored does not exist, the corresponding field is newly built; and the data uploading module 6 is used for carrying out data uploading processing according to the API interface of the preset cloud based on the networking data information.
The specific implementation process of the above system refers to a cloud data storage processing method provided in embodiment 1, and is not described herein again.
Example 3
Referring to fig. 8, an embodiment of the present application provides an electronic device comprising at least one processor 7, at least one memory 8 and a data bus 9; wherein: the processor 7 and the memory 8 complete the communication with each other through the data bus 9; the memory 8 stores program instructions executable by the processor 7, and the processor 7 calls the program instructions to perform a cloud data storage processing method. For example, implementation:
step S101: judging whether the original data are networked or not based on the obtained original data, and if not, storing the original data into a preset local document; step S102: networking processing is carried out based on the obtained original data, so that networking data information is obtained; step S103: judging whether a table to be stored exists in the preset cloud based on the networking data information, and if the table to be stored does not exist in the preset cloud, creating a corresponding table in the preset cloud; step S104: judging whether the storage limit of the corresponding table is exceeded based on the networking data information, if not, storing the networking data information into the corresponding table, otherwise, creating a continuation table, and storing the corresponding networking data information into the newly created continuation table; step S105: judging whether a field to be stored exists in the corresponding table or the continuous table based on the networking data information, if not, newly establishing the corresponding field; step S106: and uploading data according to the API interface of the preset cloud based on the networking data information.
The Memory 8 may be, but is not limited to, a random access Memory (Random Access Memory, RAM), a Read Only Memory (ROM), a programmable Read Only Memory (Programmable Read-Only Memory, PROM), an erasable Read Only Memory (Erasable Programmable Read-Only Memory, EPROM), an electrically erasable Read Only Memory (Electric Erasable Programmable Read-Only Memory, EEPROM), etc.
The processor 7 may be an integrated circuit chip with signal processing capabilities. The processor 7 may be a general-purpose processor including a central processing unit (Central Processing Unit, CPU), a network processor (Network Processor, NP), etc.; but also digital signal processors (Digital Signal Processing, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), field programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.
It will be appreciated that the configuration shown in fig. 8 is merely illustrative, and that the electronic device may also include more or fewer components than shown in fig. 8, or have a different configuration than shown in fig. 8. The components shown in fig. 8 may be implemented in hardware, software, or a combination thereof.
Example 4
The present application provides a computer-readable storage medium on which a computer program is stored, which when executed by a processor 7 implements a cloud data storage processing method. For example, implementation:
step S101: judging whether the original data are networked or not based on the obtained original data, and if not, storing the original data into a preset local document; step S102: networking processing is carried out based on the obtained original data, so that networking data information is obtained; step S103: judging whether a table to be stored exists in the preset cloud based on the networking data information, and if the table to be stored does not exist in the preset cloud, creating a corresponding table in the preset cloud; step S104: judging whether the storage limit of the corresponding table is exceeded based on the networking data information, if not, storing the networking data information into the corresponding table, otherwise, creating a continuation table, and storing the corresponding networking data information into the newly created continuation table; step S105: judging whether a field to be stored exists in the corresponding table or the continuous table based on the networking data information, if not, newly establishing the corresponding field; step S106: and uploading data according to the API interface of the preset cloud based on the networking data information.
The above functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on this understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
It will be evident to those skilled in the art that the application is not limited to the details of the foregoing illustrative embodiments, and that the present application may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. The present embodiments are, therefore, to be considered in all respects as illustrative and not restrictive, the scope of the application being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned.
Claims (7)
1. The cloud data storage processing method is characterized by comprising the following steps of:
step S101: judging whether the original data are networked or not based on the obtained original data, and if not, storing the original data into a preset local document;
step S102: networking processing is carried out based on the obtained original data, so that networking data information is obtained;
step S103: judging whether a table to be stored exists in the preset cloud based on the networking data information, and if the table to be stored does not exist in the preset cloud, creating a corresponding table in the preset cloud;
step S104: judging whether the storage limit of the corresponding table is exceeded based on the networking data information, if not, storing the networking data information into the corresponding table, otherwise, creating a continuation table, and storing the corresponding networking data information into the newly created continuation table;
step S105: judging whether a field to be stored exists in the corresponding table or the continuous table based on the networking data information, if not, newly establishing the corresponding field;
step S106: carrying out data uploading processing according to an API interface of a preset cloud based on networking data information, wherein the data uploading processing comprises the following steps: converting the networking data information into a corresponding character string in the JSON format to obtain a first character string; constructing a request URL, and designating a target position of uploading data and corresponding uploading attribute parameters; and sending a POST request to the constructed URL based on the HTTP protocol, and simultaneously sending the first character string as a request body.
2. The cloud data storage processing method of claim 1, wherein after said determining whether a storage limit of a corresponding table is exceeded based on networking data information, the method further comprises:
whether the predetermined local document storage space includes local data is judged, and if so, the process goes to step S101.
3. The cloud data storage processing method of claim 1, further comprising:
and analyzing the POST request, and constructing a judging mechanism based on an analysis result to control whether the networking data information is uploaded again or the uploading is ended.
4. The cloud data storage processing method according to claim 1, further comprising, before said step S101:
newly establishing a corresponding thread request based on the acquired original data, and storing the data request in a request queue;
judging whether a thread in execution exists or not, if not, creating a new thread, and taking out the original data from the data request queue to enter the next step.
5. A cloud data storage processing system, comprising:
the networking judging module is used for judging whether the original data are networked or not based on the obtained original data, and if the original data are not networked, the original data are stored in a preset local document;
the data networking module is used for carrying out networking processing based on the acquired original data to obtain networking data information;
the form judging module is used for judging whether a form to be stored exists in the preset cloud based on the networking data information, and if the form to be stored does not exist in the preset cloud, a corresponding form is newly built in the preset cloud;
the limit judging module is used for judging whether the storage limit of the corresponding table is exceeded or not based on the networking data information, if not, the networking data information is stored in the corresponding table, otherwise, a new continuation table is built, and the corresponding networking data information is stored in the new continuation table;
the field processing module is used for judging whether a field to be stored exists in the corresponding table or the continuous table based on the networking data information, and if the field to be stored does not exist, the corresponding field is newly built;
and the data uploading module is used for carrying out data uploading processing according to the API interface of the preset cloud based on the networking data information.
6. An electronic device comprising at least one processor, at least one memory, and a data bus; wherein: the processor and the memory complete communication with each other through the data bus; the memory stores program instructions for execution by the processor, the processor invoking the program instructions to perform the method of any of claims 1-4.
7. A computer readable storage medium, on which a computer program is stored, which computer program, when being executed by a processor, implements the method according to any of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310263543.1A CN116319718B (en) | 2023-03-10 | 2023-03-10 | Cloud data storage processing method, system, equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310263543.1A CN116319718B (en) | 2023-03-10 | 2023-03-10 | Cloud data storage processing method, system, equipment and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116319718A CN116319718A (en) | 2023-06-23 |
| CN116319718B true CN116319718B (en) | 2023-12-12 |
Family
ID=86801037
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310263543.1A Active CN116319718B (en) | 2023-03-10 | 2023-03-10 | Cloud data storage processing method, system, equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116319718B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105117378A (en) * | 2015-08-05 | 2015-12-02 | 联动优势电子商务有限公司 | Method and apparatus for converting JSON file into EXCEL file |
| CN109241074A (en) * | 2018-09-28 | 2019-01-18 | 中国平安财产保险股份有限公司 | Check data automatic processing method, device, computer equipment and storage medium |
| CN114373555A (en) * | 2021-12-27 | 2022-04-19 | 深圳融昕医疗科技有限公司 | Multi-terminal data fusion analysis method and system and computer equipment |
| CN114979120A (en) * | 2022-05-24 | 2022-08-30 | 中国平安财产保险股份有限公司 | Data uploading method, device, equipment and storage medium |
| CN115034192A (en) * | 2022-06-30 | 2022-09-09 | 广东电网有限责任公司 | Data table generation and verification method, device, equipment and medium |
| CN115563002A (en) * | 2022-10-26 | 2023-01-03 | 唯品会(广州)软件有限公司 | Data importing method and device, storage medium and computer equipment |
| CN115576905A (en) * | 2022-11-02 | 2023-01-06 | 航天信息股份有限公司 | Archive file management method and device, electronic equipment and storage medium |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11356345B2 (en) * | 2020-10-14 | 2022-06-07 | Gigasheet, Inc. | Networking data analysis in a visual spreadsheet |
-
2023
- 2023-03-10 CN CN202310263543.1A patent/CN116319718B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105117378A (en) * | 2015-08-05 | 2015-12-02 | 联动优势电子商务有限公司 | Method and apparatus for converting JSON file into EXCEL file |
| CN109241074A (en) * | 2018-09-28 | 2019-01-18 | 中国平安财产保险股份有限公司 | Check data automatic processing method, device, computer equipment and storage medium |
| CN114373555A (en) * | 2021-12-27 | 2022-04-19 | 深圳融昕医疗科技有限公司 | Multi-terminal data fusion analysis method and system and computer equipment |
| CN114979120A (en) * | 2022-05-24 | 2022-08-30 | 中国平安财产保险股份有限公司 | Data uploading method, device, equipment and storage medium |
| CN115034192A (en) * | 2022-06-30 | 2022-09-09 | 广东电网有限责任公司 | Data table generation and verification method, device, equipment and medium |
| CN115563002A (en) * | 2022-10-26 | 2023-01-03 | 唯品会(广州)软件有限公司 | Data importing method and device, storage medium and computer equipment |
| CN115576905A (en) * | 2022-11-02 | 2023-01-06 | 航天信息股份有限公司 | Archive file management method and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116319718A (en) | 2023-06-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108491475B (en) | Data rapid batch import method, electronic device and computer readable storage medium | |
| CN109450708B (en) | Nginx dynamic configuration method and system | |
| CN110673923A (en) | XWIKI system configuration method, system and computer equipment | |
| CN111400246B (en) | Asynchronous file import method, device, computer equipment and storage medium | |
| CN108427639B (en) | Automated testing method, application server and computer readable storage medium | |
| CN113382083A (en) | Webpage screenshot method and device | |
| CN113448862A (en) | Software version testing method and device and computer equipment | |
| EP3974960B1 (en) | Method and system for automated testing of web service apis | |
| CN112860412B (en) | Service data processing method and device, electronic equipment and storage medium | |
| CN112052157B (en) | Method, device and system for constructing test message | |
| CN116319718B (en) | Cloud data storage processing method, system, equipment and medium | |
| CN111597020B (en) | Application programming interface API debugging method and debugging terminal | |
| CN111078529B (en) | Client writing module testing method and device and electronic equipment | |
| CN113282347B (en) | Plug-in operation method, device, equipment and storage medium | |
| CN112395194B (en) | Method and device for accessing test platform | |
| CN114996151A (en) | Interface testing method and device, electronic equipment and readable storage medium | |
| CN110928860B (en) | Data migration method and device | |
| CN108604226A (en) | For the cross-platform system and method for keeping the comment to electronic document synchronous | |
| CN112199529A (en) | Picture processing method and device, electronic equipment and storage medium | |
| CN113535338A (en) | Interaction method, system, storage medium and electronic device for data access | |
| CN111881112A (en) | Database configuration method and device and related equipment | |
| CN111475760A (en) | Method for serializing DOM (document object model) nodes and rendering method and device of DOM nodes | |
| CN111427870B (en) | Resource management method, device and equipment | |
| CN113568682B (en) | Rule data verification method, device, computer equipment and storage medium | |
| CN110213314B (en) | Method, device and server for determining storage node |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |