CN115878576A - Data storage processing method and device - Google Patents
Data storage processing method and device Download PDFInfo
- Publication number
- CN115878576A CN115878576A CN202211689000.8A CN202211689000A CN115878576A CN 115878576 A CN115878576 A CN 115878576A CN 202211689000 A CN202211689000 A CN 202211689000A CN 115878576 A CN115878576 A CN 115878576A
- Authority
- CN
- China
- Prior art keywords
- data
- file
- storage
- file data
- directory
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The embodiment of the application provides a data storage processing method and device, and relates to the technical field of data security. The data storage processing method comprises the following steps: generating file data to be stored; acquiring reporting configuration information of the file data according to preset format data of the file data; acquiring storage directory information according to the reported configuration information, wherein the storage directory information comprises an appointed storage directory; judging whether the file storage quantity of the specified storage directory exceeds a limit threshold value or not according to the storage directory information; if not, transferring the file data to the specified storage directory; if yes, a new appointed storage directory is created in a superior directory of the appointed storage directory, and the file data are transferred to the new appointed storage directory. The data storage processing method can achieve the technical effect of improving the data storage performance.
Description
Technical Field
The present application relates to the field of data security technologies, and in particular, to a method and an apparatus for processing data storage.
Background
At present, with the development of network technology, internet data is increasingly huge, people have higher and higher requirements on data storage, and data transmission through files is most reliable when application program data transfer is carried out. Meanwhile, the reliability of the file is highlighted when cross-device data migration is carried out. In general, file storage is only a single file storage, or is directly transferred to another device, and a general file transfer mode does not exist; and the flexibility is lacked, and a corresponding storage strategy is not required to be made according to different storage requirements of different applications in the system, so that the diversified storage requirements of users cannot be met, and the requirement of subsequent service function expansion is inconvenient. At this time, a general file storage transfer mode is needed to transfer data to another application program or another device.
In the prior art, one method is to adopt a cloud and local mixed storage support, and adopt a differentiated storage mode to effectively meet the diversified storage requirements of users by combining the requirements of different applications on different use scenes; however, the technical scheme mainly includes that the file storage configuration information is obtained by interacting with the cloud server, but the storage condition of the storage position cannot be obtained, and when the obtained file storage position exceeds the equipment limit, the problems of file storage failure and the like are caused; in addition, the technical scheme only considers the file transfer and does not consider the situation that the file starts to be transferred when being generated;
the other is that when the target shared file storage can be migrated and the back-end storage of the target file storage type is available, the access control state of the target shared file storage is set to be read-only; creating a file storage corresponding to the storage type of the target file; copying files of the target shared file storage into the created file storage; setting the created file storage permission to be consistent with the permission of the target shared file storage; however, in the technical scheme, the shared file storage is migrated on the cloud platform level, and migration and storage of the file are realized through authority control, but when the file modification judgment is wrong, file redundancy may be caused, and the file storage resource is not judged, so that the storage resource is wasted.
Disclosure of Invention
An object of the embodiments of the present application is to provide a data storage processing method and apparatus, an electronic device, and a computer-readable storage medium, which can achieve a technical effect of improving data storage performance.
In a first aspect, an embodiment of the present application provides a data storage processing method, including:
generating file data to be stored;
acquiring reporting configuration information of the file data according to preset format data of the file data;
acquiring storage directory information according to the reported configuration information, wherein the storage directory information comprises an appointed storage directory;
judging whether the file storage quantity of the specified storage directory exceeds a limit threshold value or not according to the storage directory information;
if not, transferring the file data to the specified storage directory;
if so, creating a new appointed storage directory in the superior directory of the appointed storage directory, and transferring the file data to the new appointed storage directory.
In the implementation process, the processing method for data storage obtains data in a preset format by analyzing file data to be stored, obtains reporting configuration information according to the data in the preset format, then transfers and stores the file data according to the reporting configuration information, and stores a new directory when the file storage quantity of a specified storage directory exceeds a limit; therefore, the data storage processing method decouples data storage and interaction, realizes complete decoupling of data storage, data transmission and data analysis, ensures that all processes are not interfered with each other, and can improve the data acquisition capacity; therefore, the data storage processing method does not affect the data acquisition while considering the resource tone, ensures the integrity of the data and the data acquisition performance, can achieve the load balance of the data capture system by matching with a plurality of devices, achieves the data acquisition by one device, analyzes and processes the data by the plurality of devices, avoids the problem of slow reading or even failure reading caused by excessive accumulation of the number of files, ensures the integrity of data transmission of different application processes, solves the problem of insufficient resources in a folder, is flexible and universal, and can realize the technical effect of improving the data storage performance.
Further, the step of generating the file data to be stored includes:
acquiring a file to be stored;
and adding data in a preset format at the tail end of the file to be stored to generate file data to be stored.
In the implementation process, when the file data is generated, adding data in a preset format at the tail end of the file data; therefore, other application processes can judge whether the file data needs to be transferred and stored or not by analyzing the preset format data, so that the generation, storage and interaction of the data are decoupled, the generation and storage of the data can be realized by different application processes, and the processes are not interfered with each other.
Further, after the step of obtaining the reporting configuration information of the file data according to the preset format data, the method further includes:
and acquiring a reporting address of the file data according to the reporting configuration information, wherein the reporting address comprises a local address and/or a remote server address.
In the implementation process, the file reporting configuration is obtained according to the reporting configuration information, so that whether the file is reported to the local server or the remote server or both the local server and the remote server receive the file report is judged.
Further, if the reporting address includes an address of a remote server, before the step of obtaining the storage directory information according to the reporting configuration information, the method includes:
obtaining IP information and port information of a remote server according to the remote server address;
and sending the file data to be stored to the remote server through a transmission control protocol according to the IP information and the port information.
Further, after the step of transferring the file data to the designated storage directory or transferring the file data to the new designated storage directory, the method further comprises:
obtaining storage feedback information returned by the remote server;
and judging whether the file data is successfully stored according to the storage feedback information, and if not, sending the file data to be stored to the remote server through a transmission control protocol according to the IP information and the port information again.
In the implementation process, whether the file data is successfully stored is judged through the storage feedback information, and the transmission state of the file data is monitored; when the data transmission fails, the data transmission is carried out again until the data transmission is successful, so that the consistency of the data at two sides is ensured.
Further, after the step of generating the file data to be stored, the method further includes:
acquiring the generation time of the file data;
and when the tail end of the file data is detected to have no preset format data and the generation time exceeds a preset time threshold, discarding the file data.
In the implementation process, when the file data is lack of the preset format data and is generated for a period of time, the file data is judged to be generated with a problem, and the file data is deleted, so that file redundancy is avoided.
In a second aspect, an embodiment of the present application provides a data storage processing apparatus, including:
the file generating module is used for generating file data to be stored;
the reporting configuration module is used for acquiring reporting configuration information of the file data according to preset format data of the file data;
the storage directory module is used for acquiring storage directory information according to the reported configuration information, wherein the storage directory information comprises an appointed storage directory;
the judging module is used for judging whether the file storage quantity of the specified storage directory exceeds a limit threshold value or not according to the storage directory information; if not, transferring the file data to the specified storage directory; if yes, a new appointed storage directory is created in a superior directory of the appointed storage directory, and the file data are transferred to the new appointed storage directory.
Further, the file generation module includes:
the acquisition unit is used for acquiring a file to be stored;
and the file generating unit is used for adding data in a preset format at the tail end of the file to be stored to generate the file data to be stored.
Further, the data storage processing device further comprises:
and the reporting address module is used for obtaining a reporting address of the file data according to the reporting configuration information, wherein the reporting address comprises a local address and/or a remote server address.
Further, the data storage processing device further comprises:
the IP and port module is used for acquiring the IP information and the port information of the remote server according to the address of the remote server;
and the sending module is used for sending the file data to be stored to the remote server through a transmission control protocol according to the IP information and the port information.
Further, the processing device for data storage further comprises:
a return acquisition module, configured to acquire storage feedback information returned by the remote server;
the sending module is further configured to: and judging whether the file data is successfully stored according to the storage feedback information, and if not, sending the file data to be stored to the remote server through a transmission control protocol according to the IP information and the port information again.
Further, the data storage processing device further comprises:
the time detection module is used for acquiring the generation time of the file data; and when the tail end of the file data is detected to have no preset format data and the generation time exceeds a preset time threshold, discarding the file data.
In a third aspect, an electronic device provided in an embodiment of the present application includes: memory, a processor and a computer program stored in the memory and executable on the processor, the processor implementing the steps of the method according to any of the first aspect when executing the computer program.
In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having instructions stored thereon, which, when executed on a computer, cause the computer to perform the method according to any one of the first aspect.
In a fifth aspect, embodiments of the present application provide a computer program product, which when run on a computer, causes the computer to perform the method according to any one of the first aspect.
Additional features and advantages of the disclosure will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the above-described technology disclosed herein.
In order to make the aforementioned objects, features and advantages of the present application comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.
Fig. 1 is a schematic flowchart of a data storage processing method according to an embodiment of the present application;
fig. 2 is a schematic flowchart of another data storage processing method according to an embodiment of the present application;
fig. 3 is a schematic flowchart of a file data upload remote server according to an embodiment of the present application;
fig. 4 is a block diagram of a data storage processing apparatus according to an embodiment of the present application;
fig. 5 is a block diagram of an electronic device according to an embodiment of the present disclosure.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined or explained in subsequent figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not to be construed as indicating or implying relative importance.
The embodiment of the application provides a data storage processing method, a data storage processing device, electronic equipment and a computer-readable storage medium, which can be applied to a file transfer and storage process, such as transfer to a local folder or a remote server; the processing method for data storage obtains preset format data by analyzing file data to be stored, obtains reporting configuration information according to the preset format data, then carries out transfer storage processing on the file data according to the reporting configuration information, and creates a new directory for file storage when the file storage quantity of a specified storage directory exceeds a limit; therefore, the data storage processing method decouples data storage and interaction, realizes complete decoupling of data storage, data transmission and data analysis, ensures that all processes are not interfered with each other, and can improve the data acquisition capacity; therefore, the data storage processing method does not affect the data acquisition while considering the resource tone, ensures the integrity of the data and the data acquisition performance, can achieve the load balance of the data capture system by matching with a plurality of devices, achieves the data acquisition by one device, analyzes and processes the data by the plurality of devices, avoids the problem of slow reading or even failure reading caused by excessive accumulation of the number of files, ensures the integrity of data transmission of different application processes, solves the problem of insufficient resources in a folder, is flexible and universal, and can realize the technical effect of improving the data storage performance.
Referring to fig. 1, fig. 1 is a schematic flow chart of a data storage processing method according to an embodiment of the present application, where the data storage processing method includes the following steps:
s100: generating file data to be stored;
s200: and acquiring reporting configuration information of the file data according to the preset format data of the file data.
Optionally, when the file data is generated, a specific format data (preset format data) is added at the end of the file number; therefore, when another application program acquires file data, the file data can be transferred and stored only by reading the content with the specific format, so that data storage and interaction decoupling, namely complete decoupling of data storage, data transmission and data analysis is realized, and processes are not interfered with each other.
Illustratively, the generation of the file data, the transfer storage, may be implemented by different application processes.
S300: acquiring storage directory information according to the reported configuration information, wherein the storage directory information comprises an appointed storage directory;
s400: judging whether the file storage quantity of the specified storage directory exceeds a limit threshold value or not according to the storage directory information;
s410: if not, transferring the file data to a specified storage directory;
s420: if yes, a new appointed storage directory is created in the upper-level directory of the appointed storage directory, and the file data are transferred to the new appointed storage directory.
In some embodiments, when the storage quantity of the files in the designated storage directory exceeds the limit, the files are transferred to the directory by newly building a folder with the same name and a suffix under the upper-level directory (namely, the newly designated storage directory); therefore, the problem that the files in the directory are too many to cause slow reading or even no reading is avoided.
Exemplarily, the processing method for data storage obtains data in a preset format by analyzing file data to be stored, obtains reporting configuration information according to the data in the preset format, then performs transfer storage processing on the file data according to the reporting configuration information, and performs file storage by newly creating a directory when the file storage quantity of a specified storage directory exceeds a limit; therefore, the data storage processing method decouples data storage and interaction, realizes complete decoupling of data storage, data transmission and data analysis, ensures that all processes are not interfered with each other, and can improve the data acquisition capacity; therefore, the data storage processing method considers resource adjustment and does not influence data acquisition, ensures data integrity and data acquisition performance, can achieve load balance of a data capture system by matching with multiple devices, achieves data acquisition by one device and analysis and processing by multiple devices, avoids the problem of slow reading or even reading failure caused by excessive accumulation of file quantity, ensures the integrity of data transmission of different application processes, solves the problem of insufficient resources in a folder, is flexible and universal, and can realize the technical effect of improving the data storage performance.
Referring to fig. 2, fig. 2 is a schematic flow chart of another data storage processing method according to an embodiment of the present application.
Exemplarily, S100: the step of generating file data to be stored includes:
s110: acquiring a file to be stored;
s120: and adding data in a preset format at the tail end of the file to be stored to generate file data to be stored.
Illustratively, when the file data is generated, a preset format data is added at the end of the file data; therefore, other application processes can judge whether the file data needs to be transferred and stored through analyzing the preset format data, so that the generation, storage and interaction of the data are decoupled, the generation and storage of the data can be realized by different application processes, and the processes are not interfered with each other.
Illustratively, at S200: after the step of obtaining the reporting configuration information of the file data according to the preset format data, the method further comprises:
s210: and acquiring a reporting address of the file data according to the reporting configuration information, wherein the reporting address comprises a local address and/or a remote server address.
Illustratively, the file reporting configuration is obtained according to the reporting configuration information, so as to determine whether to report the file to the local, to report the file to the remote server, or to receive the file report from both servers.
Optionally, whether uploading to the local or remote server, the storage process of the file data may be performed according to the method flows of S300 to S420.
Referring to fig. 3, fig. 3 is a schematic flowchart of a process of uploading file data to a remote server according to an embodiment of the present application.
Exemplarily, if the reported address includes the remote server address, at S200: before the step of obtaining the storage directory information according to the reported configuration information, the method comprises the following steps:
s201: obtaining IP information and port information of the remote server according to the address of the remote server;
s202: and sending the file data to be stored to a remote server through a transmission control protocol according to the IP information and the port information.
Illustratively, after the step of transferring the file data to the specified storage directory or transferring the file data to the newly specified storage directory, the method further comprises:
s430: acquiring storage feedback information returned by a remote server;
s440: judging whether the file data is successfully stored according to the storage feedback information;
if not, returning to S202;
s450: if yes, the file storage process is ended.
Illustratively, whether the file data is successfully stored is judged by storing the feedback information, and the transmission state of the file data is monitored; when the data transmission fails, the data transmission is carried out again until the data transmission is successful, so that the consistency of the data at two sides is ensured.
Exemplarily, S100: after the step of generating file data to be stored, the method further comprises:
s130: acquiring the generation time of file data;
s140: and when the tail end of the file data is detected to have no preset format data and the generation time exceeds a preset time threshold, discarding the file data.
Illustratively, when the file data lacks preset format data and is generated for more than a certain time, the file data is judged to have a problem in generation, and the file data is deleted, so that file redundancy is avoided.
Exemplarily, with reference to fig. 1 to fig. 3, a specific flow step of the processing method for data storage provided in the embodiment of the present application is as follows:
1) When the file data is generated, adding a specific format data (preset format data) at the end of the file data; when another application program process acquires the file data, the file data can be transferred only when the data in the specific format of the file data is read;
2) Reading the content end of the file data, analyzing whether the file data contains the specific format data, and if so, transferring the file: reading the reporting configuration information of the file data so as to judge whether the file is reported to the local, the remote server or both the local and the remote servers receive the file report;
3) If the file number is reported to the local, checking whether the file number in a target folder (a specified storage directory) exceeds a limit, and if not, normally transferring;
if the number exceeds the limit, a folder with the same name and suffix is newly built under the upper-level directory through the program process, and the files are transferred under the directory, so that the problems that the files in the directory are too many, the reading is slow or even the files cannot be read are solved;
4) When the file is reported to the remote server, the report state returned can be used for judging whether the file is reported successfully or not, and whether the file needs to be transferred again or not is judged according to the report state;
in the process of transferring the file data to the remote server, the local transfer mode can be universal on the remote server; when the file data configuration is reported to the remote server, reading the configuration and transmitting the file data to the remote server through a Transmission Control Protocol (TCP); after the file data is reported to the remote server, whether the tail of the file data has the preset format data or not can be read, and if so, the resource in the folder is obtained; when the resources in the folder exceed the limit, a folder with a suffix of the same name is newly created under the upper-level directory, and then the file is transferred to the directory. Then, subsequent data analysis, transmission and other operations are carried out;
the data storage processing method provided by the embodiment of the application ensures the integrity of data transmission of different application processes, solves the problem of insufficient resources in the folder, is flexible and universal, flexibly aims at file storage of different configurations, and is universal in that the method can be suitable for various situations needing file storage or data transmission among different application programs.
In some implementation scenarios, the processing method for data storage provided by the embodiment of the present application can be applied to design of an event module of a network data leakage prevention system; based on the network data leakage-proof system, the file storage method for flexibly storing the files is explained, the data transmission capability of the system is improved, and therefore the event display speed is improved. According to the method in the detailed description of the present application, a specific flow example is as follows:
1. and after the security data acquiring process acquires the data and writes the event information data into the file, writing a specific content into the file at last.
2. The file storage process reads the configuration and reports locally or uploads to a remote server or both.
3. The following process is common at the remote server and locally.
3.1, whether the number of files under the specified directory exceeds the limit or not is read.
3.2, files are transferred normally without exceeding the limit.
And 3.3, if the result exceeds the preset threshold, a file folder with a suffix of the same name band is newly built under the upper-level directory, and the file is transferred to the directory.
To sum up, the processing method for data storage provided by the embodiment of the present application at least includes the following steps
Has the beneficial effects that:
1) Data storage and interactive decoupling are performed, storage, transmission and analysis are completely decoupled, processes are not interfered with each other, and data acquisition capacity is improved; the three types of processes are not interfered with each other, and because the data acquisition needs to acquire real-time flow, the performance requirement is high, so that all modules are separated and not interfered with each other, and the performance of respective functions is improved;
2) The resource adjustment is taken into consideration, but the data acquisition is not influenced, and the integrity of the data and the performance of the data acquisition are ensured. The load balance of the data capture system can be achieved by matching with multiple devices, one device acquires data, and the multiple devices analyze and process the data.
When the file is generated, a specific content is added at the end of the content of the file, so that the analysis of the content of the file is not influenced under the condition of ensuring the integrity of the file. And the transmission is carried out in sequence, so that the sequentiality of the data is ensured. And monitoring the transmission state, and when the data transmission fails, retransmitting the data until the data transmission is successful, so as to ensure the consistency of the data on two sides.
Referring to fig. 4, fig. 4 is a block diagram of a data storage processing apparatus according to an embodiment of the present disclosure, where the data storage processing apparatus includes:
a file generating module 100, configured to generate file data to be stored;
a reporting configuration module 200, configured to obtain reporting configuration information of the file data according to preset format data of the file data;
the storage directory module 300 is configured to obtain storage directory information according to the reported configuration information, where the storage directory information includes a specified storage directory;
a judging module 400, configured to judge, according to the storage directory information, whether a file storage quantity of the specified storage directory exceeds a limit threshold; if not, transferring the file data to a specified storage directory; if yes, a new appointed storage directory is created in the upper-level directory of the appointed storage directory, and the file data are transferred to the new appointed storage directory.
Illustratively, the file generation module 100 includes:
the acquisition unit is used for acquiring a file to be stored;
and the file generating unit is used for adding data in a preset format at the tail end of the file to be stored to generate the file data to be stored.
Illustratively, the data storage processing apparatus further comprises:
and the reporting address module is used for acquiring a reporting address of the file data according to the reporting configuration information, wherein the reporting address comprises a local address and/or a remote server address.
Exemplarily, the processing apparatus for data storage further comprises:
the IP and port module is used for acquiring the IP information and the port information of the remote server according to the address of the remote server;
and the sending module is used for sending the file data to be stored to the remote server through a transmission control protocol according to the IP information and the port information.
Illustratively, the data storage processing apparatus further comprises:
the return acquisition module is used for acquiring the storage feedback information returned by the remote server;
the sending module is further configured to: and judging whether the file data is successfully stored according to the storage feedback information, and if not, sending the file data to be stored to a remote server through a transmission control protocol according to the IP information and the port information.
Illustratively, the data storage processing apparatus further comprises:
the time detection module is used for acquiring the generation time of the file data; and when the tail end of the file data is detected to have no preset format data and the generation time exceeds a preset time threshold, discarding the file data.
It should be noted that the data storage processing apparatus provided in the embodiment of the present application corresponds to the method embodiments shown in fig. 1 to fig. 3, and is not repeated herein to avoid repetition.
Fig. 5 shows a block diagram of an electronic device according to an embodiment of the present disclosure, where fig. 5 is a block diagram of the electronic device. The electronic device may include a processor 510, a communication interface 520, a memory 530, and at least one communication bus 540. Wherein the communication bus 540 is used for realizing direct connection communication of these components. In this embodiment, the communication interface 520 of the electronic device is used for performing signaling or data communication with other node devices. Processor 510 may be an integrated circuit chip having signal processing capabilities.
The Processor 510 may be a general-purpose Processor including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components. The various methods, steps, and logic blocks disclosed in the embodiments of the present application may be implemented or performed. A general purpose processor may be a microprocessor or the processor 510 may be any conventional processor or the like.
The Memory 530 may be, but is not limited to, a Random Access Memory (RAM), a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Read Only Memory (EPROM), an electrically Erasable Read Only Memory (EEPROM), and the like. The memory 530 stores computer readable instructions, and when the computer readable instructions are executed by the processor 510, the electronic device may perform the steps related to the method embodiments of fig. 1 to 3.
Optionally, the electronic device may further include a memory controller, an input output unit.
The memory 530, the memory controller, the processor 510, the peripheral interface, and the input/output unit are electrically connected to each other directly or indirectly, so as to implement data transmission or interaction. For example, these elements may be electrically coupled to each other via one or more communication buses 540. The processor 510 is used to execute executable modules stored in the memory 530, such as software functional modules or computer programs included in the electronic device.
The input and output unit is used for providing a task for a user to create and start an optional time period or preset execution time for the task creation so as to realize the interaction between the user and the server. The input/output unit may be, but is not limited to, a mouse, a keyboard, and the like.
It will be appreciated that the configuration shown in fig. 5 is merely illustrative and that the electronic device may include more or fewer components than shown in fig. 5 or may have a different configuration than shown in fig. 5. The components shown in fig. 5 may be implemented in hardware, software, or a combination thereof.
The embodiment of the present application further provides a storage medium, where the storage medium stores instructions, and when the instructions are run on a computer, when the computer program is executed by a processor, the method in the method embodiment is implemented, and in order to avoid repetition, details are not repeated here.
The present application also provides a computer program product which, when run on a computer, causes the computer to perform the method of the method embodiments.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and methods,
it may also be implemented in other ways. The device embodiments described above are merely illustrative, 5 for example, the flowcharts and block diagrams in the figures illustrate devices, methods, and so forth according to various embodiments of the present application
Architecture, functionality, and operation of possible implementations of methods and computer program products. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more instructions for implementing the specified logical function(s)
May be provided. It should also be noted that, in some alternative implementations, the functions noted in the block with 0 may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based computer systems that perform the specified functions or acts
A hardware-based system, or may be implemented using a combination of special purpose hardware and computer instructions. In addition, the functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
If the functions are implemented in the form of software functional modules and sold or made as separate products
And may be stored in a computer readable storage medium. With this understanding, the technical solution of the present application 0, which is essentially or partly contributed to by the prior art, may be embodied in a software product stored in a storage medium, and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to perform all or part of the steps of the method according to the embodiments of the present application
And (5) carrying out the steps. And the aforementioned storage medium includes: a U-disk, a portable hard disk, a Read-Only5Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk, and various media capable of storing program codes.
The above description is only an example of the present application and is not intended to limit the scope of the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present application shall be included in the protection scope of the present application. It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising a," "8230," "8230," or "comprising" does not exclude the presence of additional like elements in a process, method, article, or apparatus that comprises the element.
Claims (10)
1. A method for processing data storage, comprising:
generating file data to be stored;
acquiring reporting configuration information of the file data according to preset format data of the file data;
acquiring storage directory information according to the reported configuration information, wherein the storage directory information comprises an appointed storage directory;
judging whether the file storage quantity of the specified storage directory exceeds a limit threshold value or not according to the storage directory information;
if not, transferring the file data to the specified storage directory;
if so, creating a new appointed storage directory in the superior directory of the appointed storage directory, and transferring the file data to the new appointed storage directory.
2. The method for processing data storage according to claim 1, wherein the step of generating the file data to be stored comprises:
acquiring a file to be stored;
and adding data in a preset format at the tail end of the file to be stored to generate file data to be stored.
3. The method according to claim 1, wherein after the step of obtaining the reporting configuration information of the file data according to the preset format data, the method further comprises:
and acquiring a reporting address of the file data according to the reporting configuration information, wherein the reporting address comprises a local address and/or a remote server address.
4. The method for processing data storage according to claim 3, wherein if the reporting address includes a remote server address, before the step of obtaining storage directory information according to the reporting configuration information, the method includes:
obtaining IP information and port information of a remote server according to the remote server address;
and sending the file data to be stored to the remote server through a transmission control protocol according to the IP information and the port information.
5. The method of claim 4, wherein after the step of transferring the file data to the designated storage directory or transferring the file data to the new designated storage directory, the method further comprises:
obtaining storage feedback information returned by the remote server;
and judging whether the file data is successfully stored according to the storage feedback information, if not, sending the file data to be stored to the remote server through a transmission control protocol according to the IP information and the port information again.
6. The method of processing a data store of claim 1, wherein after the step of generating file data to be stored, the method further comprises:
acquiring the generation time of the file data;
and when the tail end of the file data is detected to have no preset format data and the generation time exceeds a preset time threshold, discarding the file data.
7. A data storage processing apparatus, comprising:
the file generating module is used for generating file data to be stored;
the reporting configuration module is used for acquiring reporting configuration information of the file data according to preset format data of the file data;
the storage directory module is used for acquiring storage directory information according to the reported configuration information, wherein the storage directory information comprises an appointed storage directory;
the judging module is used for judging whether the file storage quantity of the specified storage directory exceeds a limit threshold value or not according to the storage directory information; if not, transferring the file data to the specified storage directory; if so, creating a new appointed storage directory in the superior directory of the appointed storage directory, and transferring the file data to the new appointed storage directory.
8. The data storage processing apparatus of claim 7, wherein the file generation module comprises:
the acquisition unit is used for acquiring a file to be stored;
and the file generating unit is used for adding data in a preset format at the tail end of the file to be stored to generate the file data to be stored.
9. An electronic device, comprising: memory, processor and computer program stored in the memory and executable on the processor, the processor implementing the steps of the method of processing of data storage according to any one of claims 1 to 6 when executing the computer program.
10. A computer-readable storage medium having stored thereon instructions which, when run on a computer, cause the computer to perform the method of processing a data store of any of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211689000.8A CN115878576A (en) | 2022-12-27 | 2022-12-27 | Data storage processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211689000.8A CN115878576A (en) | 2022-12-27 | 2022-12-27 | Data storage processing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115878576A true CN115878576A (en) | 2023-03-31 |
Family
ID=85754796
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211689000.8A Pending CN115878576A (en) | 2022-12-27 | 2022-12-27 | Data storage processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115878576A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117389998A (en) * | 2023-12-13 | 2024-01-12 | 北京汉勃科技有限公司 | Data storage method and device based on large model |
-
2022
- 2022-12-27 CN CN202211689000.8A patent/CN115878576A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117389998A (en) * | 2023-12-13 | 2024-01-12 | 北京汉勃科技有限公司 | Data storage method and device based on large model |
| CN117389998B (en) * | 2023-12-13 | 2024-03-12 | 北京汉勃科技有限公司 | Data storage method and device based on large model |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103001856B (en) | A kind of information sharing method and system, instant communication client and server | |
| CN111028902A (en) | Request processing method, device, equipment and medium based on node switching | |
| CN110554930B (en) | Data storage method and related equipment | |
| CN108347476B (en) | Cross-machine-room data synchronization method and device and server | |
| CN112988683A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN104182294A (en) | Method and device for backing up and recovering file | |
| CN111338893A (en) | Process log processing method and device, computer equipment and storage medium | |
| CN115878576A (en) | Data storage processing method and device | |
| CN111507439A (en) | User information checking method and system based on information code | |
| CN110781132A (en) | Method and device for realizing file storage and computer equipment | |
| CN114925644A (en) | Method for verifying logic system design in edge system and edge system | |
| CN111680104A (en) | Data synchronization method and device, computer equipment and readable storage medium | |
| CN112261114A (en) | Data backup system and method | |
| CN111327680B (en) | Authentication data synchronization method, device, system, computer equipment and storage medium | |
| CN111722994A (en) | Task request response method and device | |
| EP3051457A1 (en) | Method for performing file synchronization control, and associated apparatus | |
| CN107800754B (en) | Data transmission task processing method and device, and data transmission task monitoring method and device | |
| CN109409090B (en) | Website background detection method and device and server | |
| CN114285839A (en) | File transmission method and device, computer storage medium and electronic equipment | |
| CN109324931B (en) | Method for realizing vmware mount recovery in data de-duplication system | |
| CN111858498A (en) | Storage type conversion method, system, device and equipment | |
| CN108880994B (en) | Method and device for retransmitting mails | |
| CN111625402A (en) | Data recovery method and device, electronic equipment and computer readable storage medium | |
| JP5919934B2 (en) | Asset management apparatus, asset management method, and program | |
| JP7119582B2 (en) | Information processing system and management server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |