CN110413978B - Data paging export method, device, computer equipment and storage medium - Google Patents

Data paging export method, device, computer equipment and storage medium Download PDF

Info

Publication number
CN110413978B
CN110413978B CN201910710933.2A CN201910710933A CN110413978B CN 110413978 B CN110413978 B CN 110413978B CN 201910710933 A CN201910710933 A CN 201910710933A CN 110413978 B CN110413978 B CN 110413978B
Authority
CN
China
Prior art keywords
memory
paging
preset
export
expected
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910710933.2A
Other languages
Chinese (zh)
Other versions
CN110413978A (en
Inventor
侯海波
施生燊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Industrial and Commercial Bank of China Ltd ICBC
Original Assignee
Industrial and Commercial Bank of China Ltd ICBC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Industrial and Commercial Bank of China Ltd ICBC filed Critical Industrial and Commercial Bank of China Ltd ICBC
Priority to CN201910710933.2A priority Critical patent/CN110413978B/en
Publication of CN110413978A publication Critical patent/CN110413978A/en
Application granted granted Critical
Publication of CN110413978B publication Critical patent/CN110413978B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/258—Data format conversion from or to a database

Abstract

The application provides a data paging export method, a device, computer equipment and a storage medium, wherein the method comprises the following steps: receiving a data export request, wherein the data export request carries export conditions; responding to a data export request, and inquiring a plurality of target records meeting export conditions; acquiring the number of preset derivative, the current used memory of the system and the total memory of the system; determining paging export of the memory expected to occupy according to the number of preset export bars; determining the number of the paging exporting strips according to the preset number of the exporting strips, the expected memory to be occupied by the paging exporting, the current used memory of the system and the total memory of the system; the target records of the number of the paging derivative pieces are derived from the plurality of target records and stored in the target file. The method can effectively avoid the overflow of the system memory, maximize the utilization of system resources, and finally improve the export efficiency and the user experience.

Description

Data paging export method, device, computer equipment and storage medium
Technical Field
The present application relates to the field of computer data export processing technologies, and in particular, to a data paging export method, apparatus, computer device, and storage medium.
Background
At present, various application software systems are used in daily work and life. In general, a system generally provides a function of data export or downloading on a page, and export forms are various. The most common export form is exported in the form of a two-dimensional table, such as exporting an excel table data. For data export, users use the data very frequently, and the data export brings convenience to users of the system and becomes an integral part of daily necessities.
However, the data exporting function consumes the memory of the virtual machine, if the control is improper, the memory overflow event is easy to be caused, so that the system is crashed, and the analysis and the investigation are difficult. In order to prevent the data export function from causing memory overflow, conventional evading measures are usually adopted in the design of the export function, for example, a threshold is set to limit the maximum date interval or the number of exports, limit the concurrency of export processes, control the number of people who use the export function at the same time, or adopt various modes of submitting asynchronous export tasks for later inquiry and downloading. However, these conventional avoidance measures have poor effects, and have problems such as poor usability, poor service experience, and insufficient use of software and hardware resources.
In view of the above problems, no effective solution has been proposed at present.
Disclosure of Invention
The embodiment of the application provides a data paging export method, a data paging export device, computer equipment and a storage medium, which are used for solving the problem that the data export method in the prior art cannot effectively prevent a memory overflow event.
The embodiment of the application provides a data paging export method, which comprises the following steps: receiving a data export request, wherein the data export request carries export conditions; responding to a data export request, and inquiring a plurality of target records meeting export conditions; acquiring the number of preset derivative, the current used memory of the system and the total memory of the system; determining paging export of the memory expected to occupy according to the number of preset export bars; determining the number of the paging exporting strips according to the preset number of the exporting strips, the expected memory to be occupied by the paging exporting, the current used memory of the system and the total memory of the system; the target records of the number of the paging derivative pieces are derived from the plurality of target records and stored in the target file.
In one embodiment, determining the number of page exports based on the preset number of exports, the expected memory to be occupied by the page exports, the current used memory of the system and the total memory of the system includes: determining whether the sum of the memory expected to be occupied by paging derivation and the memory currently used by the system is less than a first preset percentage of the total memory of the system; and determining the preset export number as the paging export number under the condition that the sum of the memory expected to be occupied by the paging export and the memory currently used by the system is less than the first preset percentage in the total memory of the system.
In one embodiment, after determining whether the sum of the memory expected to be occupied by the paging derivation and the memory currently used by the system is less than a first predetermined percentage of the total memory of the system, the method further comprises: and under the condition that the sum of the memory expected to be occupied by the paging derivation and the memory currently used by the system is not less than the first preset percentage, determining the paging derivation number according to the first preset percentage, the preset derivation number, the memory expected to be occupied by the paging derivation, the memory currently used by the system and the total memory of the system.
In one embodiment, determining the number of page-out stripes based on a first predetermined percentage, a predetermined number of stripes, a memory expected to be occupied by page-out, a current used memory of the system, and a total memory of the system, includes: the number of page-deriving stripes is determined according to the following formula:
；
wherein,N 1 the number of pieces is derived for the page,N 0 in order to preset the number of the derived bars,FMfor a first predetermined percentage of the total number of the components,M2 is the memory that the system has currently used,M1 derives the memory expected to be occupied for a page,MAis the total memory of the system.
In one embodiment, after deriving the target record of the number of page-derived entries from the plurality of target records and storing the target record in the target file, the method further comprises: repeating the following steps until the total number of the exported target records is not less than the total number of the inquired target records: determining the total number of the exported target records; determining whether the total number of the exported target records is smaller than the total number of the inquired plurality of target records; under the condition that the total number of the exported target records is smaller than the total number of the inquired target records, acquiring the current used memory of the system; determining the memory expected to be occupied by the paging export of the round according to the number of the paging export of the previous round; determining the number of the paging exports of the round according to the currently used memory of the system, the expected memory to be occupied by the paging exports of the round and the total memory of the system; the target records of the number of the paging derivative of the round are derived from a plurality of target records and stored in a target file.
In one embodiment, determining the memory that the current round of page export is expected to occupy based on the number of previous rounds of page exports includes: acquiring the memory which is actually used and is exported in the previous round of paging; determining whether the percentage of the memory actually used in the last round of paging derivation is smaller than a second preset percentage; determining whether the ratio of the number of the paging exporting strips of the previous round to the number of the preset maximum exporting strips is smaller than a preset ratio under the condition that the percentage of the actually used memory of the previous round of paging exporting is smaller than a second preset percentage; under the condition that the ratio of the number of the last round of paging exporting strips to the preset maximum number of the paging exporting strips is smaller than the preset ratio, calculating the memory expected to occupy when the number of the last round of paging exporting strips divided by the preset ratio is exported, and determining the calculated memory as the memory expected to occupy when the number of the last round of paging exporting strips is exported.
In one embodiment, determining the number of current round of page exports based on the current used memory of the system, the expected memory to be occupied by the current round of page exports, and the total memory of the system, includes: determining whether the sum of the memory expected to be occupied by the paging derivation of the round and the memory currently used by the system accounts for less than a first preset percentage of the total memory of the system, wherein the first preset percentage is greater than a second preset percentage; and under the condition that the sum of the memory expected to be occupied by the paging derivation of the round and the memory currently used by the system is smaller than the first preset percentage, determining the number obtained by dividing the number of the paging derivation of the previous round by the preset ratio as the number of the paging derivation of the round.
In one embodiment, after determining whether the sum of the memory expected to be occupied by the current round of paging derivation and the memory currently used by the system is less than a first predetermined percentage of the total memory of the system, the method further comprises: under the condition that the sum of the memory expected to be occupied by the paging derivation of the round and the memory currently used by the system is not less than the first preset percentage, determining the number of the paging derivation of the round according to the following formula:
；
wherein,N i the number of the pages is derived for the current round,N i-1 the number of pages is derived for the previous round of paging,kin order to set the ratio value of the materials,FMfor a first predetermined percentage of the total number of the components,M2for the system to be currently using memory,M1the memory expected to be occupied is exported for this round of paging,MAis the total memory of the system, wherein,iis an integer greater than 1.
In one embodiment, after determining whether the percentage of the memory actually used by the previous page derivation is less than a second predetermined percentage, the method further comprises: under the condition that the percentage of the memory actually used in the previous round of paging export is not less than a second preset percentage, calculating the memory expected to be occupied when the paging export is carried out according to the number of the previous round of paging exports, and determining the calculated memory as the memory expected to be occupied in the current round of paging export.
In one embodiment, after determining whether the ratio of the number of the paging derivative pieces to the preset maximum number of the derivative pieces in the previous round is smaller than the preset ratio, the method further includes: under the condition that the ratio of the number of the last round of paging exporting strips to the preset maximum number of the paging exporting strips is not smaller than the preset ratio, calculating the memory expected to occupy when the number of the last round of paging exporting strips is exported, and determining the calculated memory as the memory expected to occupy when the number of the last round of paging exporting strips is exported.
The embodiment of the application also provides a data paging exporting device, which comprises: the receiving module is used for receiving a data export request, wherein the data export request carries export conditions; the query module is used for responding to the data export request and querying a plurality of target records conforming to the export conditions; the acquisition module is used for acquiring the preset number of the educts, the current used memory of the system and the total memory of the system; the first determining module is used for determining paging export of the memory expected to occupy according to the preset export number; the second determining module is used for determining the number of the paging exporting strips according to the preset number of the exporting strips, the expected memory to be occupied by the paging exporting, the current used memory of the system and the total memory of the system; and the export module is used for exporting the target records of the paging export number from the target records and storing the target records into the target file.
The embodiment of the application also provides a computer device, which comprises a processor and a memory for storing instructions executable by the processor, wherein the steps of the data paging export method in any embodiment are realized when the processor executes the instructions.
The embodiment of the present application also provides a computer readable storage medium, on which computer instructions are stored, where the instructions are executed to implement the steps of the data paging derivation method described in any of the above embodiments.
In the embodiment of the application, after receiving a data export request, a plurality of target records conforming to export conditions are queried, a preset export number, a current used memory of a system and a total memory of the system are obtained, a memory expected to be occupied by paging export is determined according to the preset export number, the memory expected to be occupied by paging export, the current used memory of the system and the total memory of the system are determined according to the preset export number, the current used memory of the system and the total memory of the system, and target records of the paging export number are exported from the queried plurality of target records and stored in a target file. According to the scheme, the memory expected to be occupied is determined according to the preset number of the exports, and the final number of the paging exports is determined by combining the preset number of the exports, the memory expected to be occupied, the used memory of the system and the total memory of the system, so that the number of records exported by the pages based on the available memory is dynamically adjusted, the overflow of the system memory can be effectively avoided, the utilization rate of system resources can be maximized, the efficiency of data export is greatly improved, and the user experience is effectively improved. The technical problem that the data export method in the prior art cannot effectively prevent the memory overflow event is solved, and the technical effects of effectively avoiding the memory overflow of the system, maximally utilizing the system resources, improving the export efficiency and improving the user experience are achieved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this specification, illustrate and together with the description serve to explain the application. In the drawings:
fig. 1 is a schematic diagram illustrating an application scenario of a data paging derivation method according to an embodiment of the present application;
FIG. 2 is a flow chart of a data page exporting method in an embodiment of the present application;
FIG. 3 is a flow chart illustrating a method for determining the number of page-out stripes in a data page-out method according to an embodiment of the present application;
FIG. 4 is a flow chart illustrating a data page exporting method in one embodiment of the present application;
FIG. 5 is a schematic diagram of a data paging derivation device according to an embodiment of the present application;
FIG. 6 shows a schematic diagram of a computer device in an embodiment of the application.
Detailed Description
The principles and spirit of the present application will be described below with reference to several exemplary embodiments. It should be understood that these embodiments are presented merely to enable those skilled in the art to better understand and practice the application and are not intended to limit the scope of the application in any way. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
Those skilled in the art will appreciate that embodiments of the application may be implemented as a system, apparatus device, method, or computer program product. Accordingly, the present disclosure may be embodied in the following forms, namely: complete hardware, complete software (including firmware, resident software, micro-code, etc.), or a combination of hardware and software.
Considering that the existing data export method can not effectively prevent the memory overflow event, through research discovers that the memory overflow of the system can be effectively avoided by dynamically adjusting the number of records exported by paging based on the available memory, and meanwhile, the utilization rate of system resources is improved, so that the data export efficiency is improved, and the user experience is improved.
Based on the above, the embodiment of the application provides a data paging exporting method. Fig. 1 is a schematic diagram of an application scenario of a data paging derivation method according to an embodiment of the present application. As shown in fig. 1, a user sends a data export request to a server through a user side. Wherein the data export request carries export conditions. The server queries, in response to the data export request, the target record that meets the export condition. The server dynamically adjusts the number of page-out entries per round based on available memory. And the server performs data paging export according to the determined number of the paging exports, and stores the exported target records into the target file of the user side until all the target records meeting the conditions are exported.
The user side may be a desktop computer, a notebook computer, a mobile phone terminal, a PDA, or the like, as long as the user side is a device capable of displaying content and receiving operation instructions to a user or a business person, and the present application is not limited to the presentation formation of the user side. The servers may be a single server, a server cluster, or a cloud server, and the specific composition forms no limitation of the present application.
Referring to fig. 2, fig. 2 is a flowchart illustrating a data page exporting method according to an embodiment of the present application. Although the application provides a method operation or apparatus structure as shown in the following examples or figures, more or fewer operation steps or module units may be included in the method or apparatus based on routine or non-inventive labor. In the steps or structures where there is no necessary causal relationship logically, the execution order of the steps or the module structure of the apparatus is not limited to the execution order or the module structure shown in the drawings and the description of the embodiments of the present application. The described methods or module structures may be implemented sequentially or in parallel (e.g., in a parallel processor or multithreaded environment, or even in a distributed processing environment) in accordance with the embodiments or the method or module structure connection illustrated in the figures when implemented in a practical device or end product application.
Specifically, as shown in fig. 2, the data paging exporting method provided in one embodiment of the present application may include the following steps:
in step S201, a data export request is received, where the data export request carries an export condition.
Step S202, in response to the data export request, a plurality of target records meeting export conditions are queried.
And receiving a data export request initiated by a user, wherein the data export request carries export conditions. For example, the user may send a data export request by clicking an export button. The export conditions are set by a user according to actual requirements. Upon receiving a data export request, a plurality of target records meeting export conditions are queried from a database in response to the request. After the multi-entry mark record meeting the export condition is queried, the total number of the multi-entry mark record can be recorded.
Step S203, obtaining the preset number of exports, the current used memory of the system and the total memory of the system.
In step S204, the memory expected to be occupied is determined to be paged and exported according to the preset number of exported items.
The preset number of exporting entries may be a default number of paging exporting entries. And determining the memory expected to be occupied by paging export according to the preset export number, namely calculating the memory expected to be occupied when the paging export is carried out according to the preset export number.
In step S205, the number of page exports is determined according to the preset number of export, the expected memory to be occupied by the page exports, the current used memory of the system and the total memory of the system.
In step S206, the target records of the number of pages are exported from the target records and stored in the target file.
After determining the memory expected to be occupied by the page export, the number of page exports may be determined based on the preset number of exports in combination with the expected memory to be occupied by the page export, the current used memory of the system, and the total memory of the system, such that the number of page exports is determined based on the available memory of the system. After the number of the paging exporting entries is determined, the target records of the number of the paging exporting entries are exported from the queried target directories, and the exported target records are stored in the target file.
According to the scheme, the memory expected to be occupied is determined according to the preset number of the exports, and the final number of the paging exports is determined by combining the preset number of the exports, the memory expected to be occupied, the used memory of the system and the total memory of the system, so that the number of records exported by the pages based on the available memory is dynamically adjusted, the overflow of the system memory can be effectively avoided, the utilization rate of system resources can be maximized, the efficiency of data export is greatly improved, and the user experience is effectively improved. The technical problem that the data export method in the prior art cannot effectively prevent the memory overflow event is solved, and the technical effects of effectively avoiding the memory overflow of the system, maximally utilizing the system resources, improving the export efficiency and improving the user experience are achieved.
In some embodiments of the present application, determining the number of page exporting entries according to the preset number of page exporting entries, the memory expected to be occupied by the page exporting, the current used memory of the system and the total memory of the system may include: determining whether the sum of the memory expected to be occupied by paging derivation and the memory currently used by the system is less than a first preset percentage of the total memory of the system; and determining the preset export number as the paging export number under the condition that the sum of the memory expected to be occupied by the paging export and the memory currently used by the system is less than the first preset percentage in the total memory of the system.
The first preset percentage can be set according to actual requirements and system performance. For example, the first preset percentage may be 70%, 75%, 80%, etc. After determining the memory that the page export is expected to occupy, the percentage of the sum of the memory that the page export is expected to occupy and the memory that the system is currently using may be calculated as a percentage of the system memory. Then, it is determined whether the calculated percentage is less than a first preset percentage. If the calculated percentage is smaller than the first preset percentage, the condition that memory overflow does not occur when paging export is performed according to the preset export number is indicated. Therefore, the preset number of exporting entries may be determined as the number of paging exporting entries. The number of the paging derivative is determined through the method, so that memory overflow of the system can be effectively prevented, and the utilization rate of system resources is increased.
Further, in some embodiments of the present application, after determining whether the sum of the memory expected to be occupied by the paging derivation and the memory currently used by the system is less than the first predetermined percentage, the method may further include: and under the condition that the sum of the memory expected to be occupied by the paging derivation and the memory currently used by the system is not less than the first preset percentage, determining the paging derivation number according to the first preset percentage, the preset derivation number, the memory expected to be occupied by the paging derivation, the memory currently used by the system and the total memory of the system.
It will be appreciated that in the event that it is determined that the sum of the memory expected to be occupied by the page derivation and the memory currently being used by the system is not less than a first predetermined percentage of the total memory of the system, a risk of memory overflow of the system is indicated. Thus, the number of page-out entries may be determined based on the first predetermined percentage, the predetermined number of page-out entries, the memory expected to be occupied by the page-out, the memory currently used by the system, and the total memory of the system. By the method, memory overflow caused by data export can be further prevented.
Further, in some embodiments of the present application, determining the number of page-out entries according to the first predetermined percentage, the predetermined number of page-out entries, the memory expected to be occupied by the page-out, the memory currently used by the system, and the total memory of the system may include: the number of page-deriving stripes is determined according to the following formula:
；
Wherein,N 1 the number of pieces is derived for the page,N 0 in order to preset the number of the derived bars,FMfor a first predetermined percentage of the total number of the components,M2 is the memory that the system has currently used,M1 derives the memory expected to be occupied for a page,MAis the total memory of the system. By the method, the number of the paging export can be quantitatively determined according to the preset export number, the first preset percentage, the current used memory of the system, the expected memory to be occupied by the paging export and the total memory of the system, and the memory overflow event of the system is effectively prevented.
Referring to fig. 3, fig. 3 is a flowchart illustrating determining the number of page-out entries according to a predetermined number of out entries, a total memory of the system, a currently used memory of the system, and a memory expected to be occupied by page-out. As shown in fig. 3, determining the number of page-out stripes may include the steps of:
step 1, obtaining a preset derived number N 0 ；
Step 2, calculating the number of the paging derivative bars as N 0 Memory M1 that is expected to be occupied at that time;
step 3, acquiring a current used memory M2 of the system and a total memory MA of the system;
step 4, calculating the sum of the memory size M1 expected to be used singly and the memory M2 used by the system to account for the percentage F of the total memory MA of the system;
step 5, determining whether the percentage F is smaller than a first preset percentage FM, if yes, executing step 6, otherwise, executing step 7;
Step 6, presetting a derived number N 0 Determining the number of the paging derivative strips;
step 7, calculating N 1 =N 0 X (FM-M2/MA). Times.MA/M1, and N 1 The number of page-out stripes is determined.
The method for determining the number of the paging derivative in the embodiment can dynamically adjust the number of the paging derivative based on the available memory, can effectively prevent the memory overflow event from happening in the system, improves the utilization rate of system resources and improves the user experience.
In some embodiments of the present application, after the target record of the number of paging derivative pieces is derived from the plurality of target records and stored in the target file, the method may further include: repeating the following steps until the total number of the exported target records is not less than the total number of the inquired target records: determining the total number of the exported target records; determining whether the total number of the exported target records is smaller than the total number of the inquired plurality of target records; under the condition that the total number of the exported target records is smaller than the total number of the inquired target records, acquiring the current used memory of the system; determining the memory expected to be occupied by the paging export of the round according to the number of the paging export of the previous round; determining the number of the paging exports of the round according to the currently used memory of the system, the expected memory to be occupied by the paging exports of the round and the total memory of the system; the target records of the number of the paging derivative of the round are derived from a plurality of target records and stored in a target file.
Typically, the queried multi-entry tag records may be exported by multiple page exports. After the target records of the number of the paging export records are exported from the target records and stored in the target file, it is required to determine whether to conduct the next round of paging export until the total number of the exported target records is greater than or equal to the total number of the queried target records. In the next round of page export, the total number of target records that have been exported is first determined. For example, for the second round of page exporting, the total number of exported target records is the number of page exporting entries determined during the first round of page exporting; for the third round of page exporting, the total number of exported target records is the number of page exporting strips determined in the second round of page exporting process plus the number of page exporting strips determined in the first round of page exporting process; and so on. After determining the total number of exported target records, it is determined whether the total number of exported target records is less than the total number of queried target records. If yes, acquiring the used memory of the system at the current moment, namely the current used memory of the system; otherwise, the present round of export is ended. Under the condition that the current round of paging export is determined to be needed, the number of the last round of paging export is obtained, and the memory expected to be occupied by the current round of paging export is determined according to the number of the last round of paging export. And then, determining the number of the current round of paging exporting strips according to the current used memory of the system, the expected memory to be occupied by the current round of paging exporting and the total memory of the system. And finally, sequentially exporting the target records of the number of the paging exporting rounds from the target records and storing the target records into the target file, thereby completing the paging exporting rounds. Compared with the method for determining the number of the current round of paging exporting based on the default preset exporting number of the system and the available memory, the method for determining the number of the current round of paging exporting based on the default preset exporting number of the system and the available memory can determine the number of the current round of paging exporting based on the number of the current round of paging exporting and the available memory, and because the current round of paging exporting is closer to the current round of paging exporting in time and the situation of the available memory is closer, the determination efficiency can be improved based on the number of the current round of paging exporting, and meanwhile, the utilization rate of system resources can also be improved.
In some embodiments of the present application, determining the memory that is expected to be occupied by the current round of page export according to the number of previous round of page exports may include: and calculating the memory expected to be occupied by paging and exporting according to the number of the paging and exporting of the last round.
In other embodiments of the present application, determining the memory that is expected to be occupied by the current round of page export according to the number of previous round of page exports may include: acquiring the memory which is actually used and is exported in the previous round of paging; determining whether the percentage of the memory actually used in the last round of paging derivation is smaller than a second preset percentage; determining whether the ratio of the number of the paging exporting strips of the previous round to the number of the preset maximum exporting strips is smaller than a preset ratio under the condition that the percentage of the actually used memory of the previous round of paging exporting is smaller than a second preset percentage; under the condition that the ratio of the number of the last round of paging exporting strips to the preset maximum number of the paging exporting strips is smaller than the preset ratio, calculating the memory expected to occupy when the number of the last round of paging exporting strips divided by the preset ratio is exported, and determining the calculated memory as the memory expected to occupy when the number of the last round of paging exporting strips is exported.
Specifically, the actual used memory is obtained from the previous round of paging derivation, and the percentage of the actual used memory in the previous round of paging derivation in the total memory of the system is calculated. Determining whether the calculated percentage is less than a second predetermined percentage. The second preset percentage can be determined according to actual requirements and system performance. For example, the second preset percentage may be set to 10%, 20%, 30%, or the like. If the calculated percentage is determined to be less than the second predetermined percentage, indicating that the system resources are more adequate, increasing the number of page-deriving stripes may be considered. And then determining whether the ratio of the number of the paging derivative strips in the previous round to the preset maximum number of the derivative strips is smaller than a preset ratio. Wherein, the preset ratio can be set to 1/2, 1/3 or 2/5, etc. The above values are merely exemplary, and specific values of the preset ratio may be set according to actual requirements, which is not limited in the present application. Under the condition that the ratio of the number of the last round of paging exporting strips to the preset maximum number of the paging exporting strips is smaller than the preset ratio, calculating the memory expected to occupy when the number of the last round of paging exporting strips divided by the preset ratio is exported, and determining the calculated memory as the memory expected to occupy when the number of the last round of paging exporting strips is exported. For example, when the preset ratio is 1/2, the memory expected to be occupied when the page export is performed according to twice the number of the previous page exports can be calculated, and the calculated memory is determined as the memory expected to be occupied when the page export is performed in the current round. By adopting the mode, when the memory used in the previous round of paging export and the number of the previous round of paging export simultaneously meet the conditions, the number of the paging export can be properly increased, so that the utilization rate of system resources is further improved while the memory is prevented from overflowing.
Further, in some embodiments of the present application, determining the number of the current round of paging exporting strips according to the current used memory of the system, the memory expected to be occupied by the current round of paging exporting and the total memory of the system may include: determining whether the sum of the memory expected to be occupied by the paging derivation of the round and the memory currently used by the system accounts for less than a first preset percentage of the total memory of the system, wherein the first preset percentage is greater than a second preset percentage; and under the condition that the sum of the memory expected to be occupied by the paging derivation of the round and the memory currently used by the system is smaller than the first preset percentage, determining the number obtained by dividing the number of the paging derivation of the previous round by the preset ratio as the number of the paging derivation of the round.
After calculating the expected occupied memory when the number of the paging exports is divided by the preset ratio according to the number of the paging exports in the previous round, determining the calculated memory as the expected memory to be occupied by the paging exports in the current round, and determining whether the sum of the expected memory to be occupied by the paging exports in the current round and the current used memory of the system accounts for less than a first preset percentage. The first preset percentage can be set according to actual requirements and system performance. For example, the first preset percentage may be 70%, 75%, 80%, etc. And under the condition that the determined percentage is smaller than the first preset percentage, indicating that memory overflow cannot occur when the paging export is performed according to the number obtained by dividing the last round of paging export by the preset ratio. Therefore, the number of the page-out pieces obtained by dividing the number of the page-out pieces of the previous round by the preset ratio can be determined as the page-out pieces. For example, in the case where the preset ratio is 1/2, twice the number of the page-out pieces of the previous round is determined as the number of the page-out pieces. The number of the paging derivative is determined by the method, so that the utilization rate of system resources can be further improved under the condition that the memory overflow of the system is effectively prevented.
Further, in some embodiments of the present application, after determining whether the sum of the memory expected to be occupied by the current round of paging derivation and the memory currently used by the system is less than a first predetermined percentage, the method may further include: under the condition that the sum of the memory expected to be occupied by the paging derivation of the round and the memory currently used by the system is not less than the first preset percentage, determining the number of the paging derivation of the round according to the following formula:
；
wherein,N i the number of the pages is derived for the current round,N i-1 the number of pages is derived for the previous round of paging,kin order to set the ratio value of the materials,FMfor a first predetermined percentage of the total number of the components,M2for the system to be currently using memory,M1the memory expected to be occupied is exported for this round of paging,MAis the total memory of the system, wherein,iis an integer greater than 1. Wherein,kmay be set to 1/2, 1/3, 2/5, etc. By the method, the number of the paging derivative bars of the round can be quantitatively determined.
Further, in some embodiments of the present application, after determining whether the percentage of the memory actually used by the previous page derivation is less than a second predetermined percentage, the method may further include: under the condition that the percentage of the memory actually used in the previous round of paging export is not less than a second preset percentage, calculating the memory expected to be occupied when the paging export is carried out according to the number of the previous round of paging exports, and determining the calculated memory as the memory expected to be occupied in the current round of paging export. By the method, when the memory used in the previous round of paging derivation does not meet the preset condition, the number of paging derivation is not increased, and memory overflow can be effectively prevented.
Further, in some embodiments of the present application, after determining whether the ratio of the number of paging derivative bars in the previous round to the preset maximum number of derivative bars is smaller than the preset ratio, the method further includes: under the condition that the ratio of the number of the last round of paging exporting strips to the preset maximum number of the paging exporting strips is not smaller than the preset ratio, calculating the memory expected to occupy when the number of the last round of paging exporting strips is exported, and determining the calculated memory as the memory expected to occupy when the number of the last round of paging exporting strips is exported. By the method, when the number of the paging exports in the previous round does not meet the preset condition, the number of the paging exports is not increased, and memory overflow can be effectively prevented.
The above method is described below in connection with a specific embodiment, however, it should be noted that this specific embodiment is only for better illustrating the present application and is not meant to be a undue limitation on the present application.
Referring to FIG. 4, a flow chart of a data page exporting method according to an embodiment of the present application is shown. As shown in fig. 4, the method comprises the steps of:
step 1, acquiring a data export request, wherein the data export request carries export conditions;
step 2, inquiring a plurality of target records which are consistent with the export conditions and are exported, and acquiring the total number T of the plurality of target records;
Step 3, reading the default paging output number and the single maximum output number L of the system;
step 4, determining the default paging export count of the system as an initial export count N;
step 5, calculating the memory M1 expected to occupy when paging export is carried out according to the initial export number N;
step 6, acquiring a current used memory M2 of the system and a total memory MA of the system;
step 7, calculating the percentage F of the sum of the memory M1 and the memory M2 to the total memory MA;
step 8, judging whether the percentage F is smaller than a first preset percentage FM, if yes, executing step 9, otherwise, executing step 10;
step 9, determining the initial export number N as the export number NE of the round, and jumping to step 11;
step 10, calculating N '=n× (FM-M2/MA) ×ma/M1, and determining N' as the number of the present round of derivative NE;
step 11, paging export is carried out according to the number NE of the export of the round, and the exported target record is stored in a target file;
step 12, determining the total number P of the target records which are exported at present;
step 13, judging whether the total number P is smaller than the total number T of the target records to be exported, if so, executing step 14, otherwise, jumping to step 18;
step 14, obtaining the actual used memory of the paging derivation of the round;
Step 15, judging whether the actual used memory of the current round of paging derivation accounts for less than 20% of the total memory MA of the system at the same time, and if yes, executing step 16, otherwise, executing step 17, wherein the number of the current round of paging derivation is less than half of the number L of the single maximum derivation;
step 16, determining twice of the paging export count NE of the present round as the initial export count N, and returning to the step 5;
step 17, determining the number NE of the paging exporting of the present round as an initial export number N, and returning to the step 5;
and step 18, ending.
According to the paging exporting method in the embodiment, before each round of paging exporting, the number of the paging exporting strips of the round is dynamically adjusted according to the available memory of the system, so that memory overflow caused by data exporting can be effectively prevented, meanwhile, when the second round of paging exporting is started, the number of the paging exporting strips of each round of paging exporting is determined according to the number of the paging exporting strips of the round and the memory actually used by the paging exporting of the round, and under the condition that the number of the paging exporting strips of the round is small and the used memory is low, the number of the paging exporting strips of the round is properly adjusted, so that the utilization rate of system resources is effectively improved, the data exporting efficiency is improved, and user experience when a user performs data exporting is improved.
Based on the same inventive concept, the embodiment of the application also provides a data paging deriving device, as described in the following embodiment. Since the principle of solving the problem of the data paging exporting device is similar to that of the data paging exporting method, the implementation of the data paging exporting device can refer to the implementation of the data paging exporting method, and the repetition is omitted. As used below, the term "unit" or "module" may be a combination of software and/or hardware that implements the intended function. While the means described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware, is also possible and contemplated. FIG. 5 is a block diagram illustrating a data paging deriving apparatus according to an embodiment of the present application, as shown in FIG. 5, including: the structure is described below, and the receiving module 501, the querying module 502, the obtaining module 503, the first determining module 504, the second determining module 505, and the deriving module 506 are described below.
The receiving module 501 is configured to receive a data export request, where the data export request carries an export condition;
the query module 502 is configured to query, in response to a data export request, a plurality of target records that meet export conditions;
The obtaining module 503 is configured to obtain a preset number of derived memories, a current used memory of the system, and a total memory of the system;
the first determining module 504 is configured to determine, according to a preset number of export entries, that paging exports a memory that is expected to be occupied;
the second determining module 505 is configured to determine the number of page exporting entries according to the preset number of page exporting entries, the memory expected to be occupied by the page exporting, the current used memory of the system and the total memory of the system;
the export module 506 is configured to export the target record of the number of paged exported tracks from the plurality of target records and store the target record in the target file.
In some embodiments of the present application, the second determining module may be specifically configured to: determining whether the sum of the memory expected to be occupied by paging derivation and the memory currently used by the system is less than a first preset percentage of the total memory of the system; and determining the preset export number as the paging export number under the condition that the sum of the memory expected to be occupied by the paging export and the memory currently used by the system is less than the first preset percentage in the total memory of the system.
In some embodiments of the present application, after determining whether the sum of the memory expected to be occupied by the paging derivation and the memory currently used by the system is less than a first predetermined percentage of the total memory of the system, the method may further include: and under the condition that the sum of the memory expected to be occupied by the paging derivation and the memory currently used by the system is not less than the first preset percentage, determining the paging derivation number according to the first preset percentage, the preset derivation number, the memory expected to be occupied by the paging derivation, the memory currently used by the system and the total memory of the system.
In some embodiments of the present application, determining the number of page-out entries according to a first predetermined percentage, a predetermined number of page-out entries, a memory expected to be occupied by page-out, a current used memory of the system, and a total memory of the system may include: the number of page-deriving stripes is determined according to the following formula:
；
wherein,N 1 the number of pieces is derived for the page,N 0 in order to preset the number of the derived bars,FMfor a first predetermined percentage of the total number of the components,M2 is the memory that the system has currently used,M1 derives the memory expected to be occupied for a page,MAis the total memory of the system.
In some embodiments of the present application, after the target record of the number of paging derivative pieces is derived from the plurality of target records and stored in the target file, the method may further include: repeating the following steps until the total number of the exported target records is not less than the total number of the inquired target records: determining the total number of the exported target records; determining whether the total number of the exported target records is smaller than the total number of the inquired plurality of target records; under the condition that the total number of the exported target records is smaller than the total number of the inquired target records, acquiring the current used memory of the system; determining the memory expected to be occupied by the paging export of the round according to the number of the paging export of the previous round; determining the number of the paging exports of the round according to the currently used memory of the system, the expected memory to be occupied by the paging exports of the round and the total memory of the system; the target records of the number of the paging derivative of the round are derived from a plurality of target records and stored in a target file.
In some embodiments of the present application, determining the memory that is expected to be occupied by the current round of page export according to the number of previous round of page export may include: acquiring the memory which is actually used and is exported in the previous round of paging; determining whether the percentage of the memory actually used in the last round of paging derivation is smaller than a second preset percentage; determining whether the ratio of the number of the paging exporting strips of the previous round to the number of the preset maximum exporting strips is smaller than a preset ratio under the condition that the percentage of the actually used memory of the previous round of paging exporting is smaller than a second preset percentage; under the condition that the ratio of the number of the last round of paging exporting strips to the preset maximum number of the paging exporting strips is smaller than the preset ratio, calculating the memory expected to occupy when the number of the last round of paging exporting strips divided by the preset ratio is exported, and determining the calculated memory as the memory expected to occupy when the number of the last round of paging exporting strips is exported.
In some embodiments of the present application, determining the number of the current round of paging exports according to the current used memory of the system, the memory expected to be occupied by the current round of paging exports, and the total memory of the system may include: determining whether the sum of the memory expected to be occupied by the paging derivation of the round and the memory currently used by the system accounts for less than a first preset percentage of the total memory of the system, wherein the first preset percentage is greater than a second preset percentage; and under the condition that the sum of the memory expected to be occupied by the paging derivation of the round and the memory currently used by the system is smaller than the first preset percentage, determining the number obtained by dividing the number of the paging derivation of the previous round by the preset ratio as the number of the paging derivation of the round.
In some embodiments of the present application, after determining whether the sum of the memory expected to be occupied by the current round of paging derivation and the memory currently used by the system is less than a first predetermined percentage, the method may further include: under the condition that the sum of the memory expected to be occupied by the paging derivation of the round and the memory currently used by the system is not less than the first preset percentage, determining the number of the paging derivation of the round according to the following formula:
；
wherein,N i the number of the pages is derived for the current round,N i-1 the number of pages is derived for the previous round of paging,kin order to set the ratio value of the materials,FMfor a first predetermined percentage of the total number of the components,M2for the system to be currently using memory,M1the memory expected to be occupied is exported for this round of paging,MAis the total memory of the system, wherein,iis an integer greater than 1.
In some embodiments of the present application, after determining whether the percentage of the memory actually used in the previous round of paging derivation is less than a second preset percentage, the method may further include: under the condition that the percentage of the memory actually used in the previous round of paging export is not less than a second preset percentage, calculating the memory expected to be occupied when the paging export is carried out according to the number of the previous round of paging exports, and determining the calculated memory as the memory expected to be occupied in the current round of paging export.
In some embodiments of the present application, after determining whether the ratio of the number of paging derivative pieces to the preset maximum number of derivative pieces in the previous round is smaller than the preset ratio, the method may further include: under the condition that the ratio of the number of the last round of paging exporting strips to the preset maximum number of the paging exporting strips is not smaller than the preset ratio, calculating the memory expected to occupy when the number of the last round of paging exporting strips is exported, and determining the calculated memory as the memory expected to occupy when the number of the last round of paging exporting strips is exported.
From the above description, it can be seen that the following technical effects are achieved in the embodiments of the present application: according to the scheme, the memory expected to be occupied is determined according to the preset number of the exports, and the final number of the paging exports is determined by combining the preset number of the exports, the memory expected to be occupied, the used memory of the system and the total memory of the system, so that the number of records exported by the pages based on the available memory is dynamically adjusted, the overflow of the system memory can be effectively avoided, the utilization rate of system resources can be maximized, the efficiency of data export is greatly improved, and the user experience is effectively improved. The technical problem that the data export method in the prior art cannot effectively prevent the memory overflow event is solved, and the technical effects of effectively avoiding the memory overflow of the system, maximally utilizing the system resources, improving the export efficiency and improving the user experience are achieved.
The embodiment of the present application further provides a computer device, and in particular, referring to fig. 6, the schematic structural diagram of the computer device according to the data paging derivation method provided by the embodiment of the present application may specifically include an input device 61, a processor 62, and a memory 63. Wherein the memory 63 is configured to store processor-executable instructions. The processor 62, when executing the instructions, implements the steps of the data page exporting method described in any of the embodiments above.
In this embodiment, the input device may specifically be one of the main apparatuses for exchanging information between the user and the computer system. The input device may include a keyboard, mouse, camera, scanner, light pen, handwriting input board, voice input device, etc.; the input device is used to input raw data and a program for processing these numbers into the computer. The input device may also acquire and receive data transmitted from other modules, units, and devices. The processor may be implemented in any suitable manner. For example, the processor may take the form of, for example, a microprocessor or processor, and a computer-readable medium storing computer-readable program code (e.g., software or firmware) executable by the (micro) processor, logic gates, switches, an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a programmable logic controller, and an embedded microcontroller, among others. The memory may in particular be a memory device for storing information in modern information technology. The memory may comprise a plurality of levels, and in a digital system, may be memory as long as binary data can be stored; in an integrated circuit, a circuit with a memory function without a physical form is also called a memory, such as a RAM, a FIFO, etc.; in the system, the storage device in physical form is also called a memory, such as a memory bank, a TF card, and the like.
In this embodiment, the specific functions and effects of the computer device may be explained in comparison with other embodiments, and will not be described herein.
The embodiment of the application also provides a computer storage medium based on the data paging export method, wherein the computer storage medium stores computer program instructions, and the steps of the data paging export method in any embodiment are realized when the computer program instructions are executed.
In the present embodiment, the storage medium includes, but is not limited to, a random access Memory (Random Access Memory, RAM), a Read-Only Memory (ROM), a Cache (Cache), a Hard Disk (HDD), or a Memory Card (Memory Card). The memory may be used to store computer program instructions. The network communication unit may be an interface for performing network connection communication, which is set in accordance with a standard prescribed by a communication protocol.
In this embodiment, the functions and effects of the program instructions stored in the computer storage medium may be explained in comparison with other embodiments, and are not described herein.
It will be apparent to those skilled in the art that the modules or steps of the embodiments of the application described above may be implemented in a general purpose computing device, they may be concentrated on a single computing device, or distributed across a network of computing devices, they may alternatively be implemented in program code executable by computing devices, so that they may be stored in a storage device for execution by computing devices, and in some cases, the steps shown or described may be performed in a different order than what is shown or described, or they may be separately fabricated into individual integrated circuit modules, or a plurality of modules or steps in them may be fabricated into a single integrated circuit module. Thus, embodiments of the application are not limited to any specific combination of hardware and software.
It is to be understood that the above description is intended to be illustrative, and not restrictive. Many embodiments and many applications other than the examples provided will be apparent to those of skill in the art upon reading the above description.
The above description is only of the preferred embodiments of the present application and is not intended to limit the present application, and various modifications and variations can be made to the embodiments of the present application by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims (12)

1. A method for dynamically adjusting data paging exporting based on available JVM memory, comprising:
receiving a data export request, wherein the data export request carries export conditions;
querying a plurality of target records meeting the export condition in response to the data export request;
acquiring the number of preset derivative, the current used memory of the system and the total memory of the system;
determining paging export of the memory expected to occupy according to the preset export number;
determining the number of the paging exporting strips according to the preset number of the exporting strips, the memory expected to be occupied by the paging exporting, the memory currently used by the system and the total memory of the system;
Deriving the target records of the paging derivation number from the target records and storing the target records in a target file;
the determining the number of the paging exporting strips according to the preset number of the exporting strips, the memory expected to be occupied by the paging exporting, the memory currently used by the system and the total memory of the system comprises the following steps:
determining whether the sum of the memory expected to be occupied by the paging derivation and the memory currently used by the system is less than a first preset percentage of the total memory of the system;
and under the condition that the sum of the memory expected to be occupied by the paging derivation and the memory currently used by the system is not smaller than the first preset percentage, determining the paging derivation number according to the first preset percentage, the preset derivation number, the memory expected to be occupied by the paging derivation, the memory currently used by the system and the total memory of the system.
2. The method of claim 1, wherein determining the number of page exports based on the preset number of exports, the expected memory to be occupied by the page exports, the current used memory of the system, and the total memory of the system, further comprises:
And determining the preset export number as the paging export number under the condition that the sum of the memory expected to be occupied by the paging export and the memory currently used by the system is less than the first preset percentage in the total memory of the system.
3. The method of claim 1, wherein determining the number of page-derived stripes based on the first predetermined percentage, the number of pre-derived stripes, the memory expected to be occupied by the page-derived stripes, the memory currently used by the system, and the total memory of the system, comprises:
the number of page-deriving stripes is determined according to the following formula:
wherein N is 1 Deriving the number of pieces, N, for the page 0 And for the preset number of exports, FM is the first preset percentage, M2 is the current used memory of the system, M1 is the memory expected to occupy for paging exports, and MA is the total memory of the system.
4. The method of claim 1, further comprising, after deriving the number of paged out target records from the plurality of target records and storing in a target file:
repeating the following steps until the total number of the exported target records is not less than the total number of the inquired target records:
Determining the total number of the exported target records;
determining whether the total number of the exported target records is smaller than the total number of the queried target records;
under the condition that the total number of the exported target records is smaller than the total number of the inquired target records, acquiring the current used memory of the system;
determining the memory expected to be occupied by the paging export of the round according to the number of the paging export of the previous round;
determining the number of the current round of paging exporting strips according to the current used memory of the system, the memory expected to be occupied by the current round of paging exporting and the total memory of the system;
and the target records of the number of the paging derivative of the current round are derived from the target records and stored in a target file.
5. The method of claim 4, wherein determining the memory that is expected to be occupied by the current round of page exporting based on the number of previous rounds of page exporting comprises:
acquiring the memory which is actually used and is exported in the previous round of paging;
determining whether the percentage of the actually used memory in the last round of paging derivation is smaller than a second preset percentage;
determining whether the ratio of the number of the last round of paging exporting strips to the number of the preset maximum exporting strips is smaller than a preset ratio under the condition that the percentage of the actually used memory of the last round of paging exporting is smaller than the second preset percentage;
And under the condition that the ratio of the number of the last round of paging exporting strips to the preset maximum number of the paging exporting strips is smaller than the preset ratio, calculating the memory expected to occupy when the number of the last round of paging exporting strips divided by the preset ratio is exported, and determining the calculated memory as the memory expected to occupy when the number of the last round of paging exporting strips is exported.
6. The method of claim 5, wherein determining the number of current round of page exports based on the current used memory of the system, the current round of page exports expected to occupy memory, and the total memory of the system comprises:
determining whether the sum of the memory expected to be occupied by the paging derivation of the present round and the memory currently used by the system accounts for less than a first preset percentage of the total memory of the system, wherein the first preset percentage is greater than the second preset percentage;
and under the condition that the sum of the memory expected to be occupied by the current round of paging derivation and the memory currently used by the system is smaller than the first preset percentage, determining the number obtained by dividing the number of the last round of paging derivation by the preset ratio as the number of the current round of paging derivation.
7. The method of claim 6, further comprising, after determining whether the sum of the expected memory to be consumed and the current used memory of the system for the current round of paging derives is less than a first predetermined percentage of the total memory of the system:
and under the condition that the sum of the memory expected to be occupied by the current round of paging derivation and the memory currently used by the system is not less than the first preset percentage, determining the number of the round of paging derivation according to the following formula:
wherein N is i Deriving the number of pages for the current round，N i-1 And (3) deriving the number of pages for the previous round, wherein k is the preset ratio, FM is the first preset percentage, M2 is the current used memory of the system, M1 is the memory expected to occupy for the current round of paging derivation, and MA is the total memory of the system, wherein i is an integer greater than 1.
8. The method of claim 5, further comprising, after determining whether the percentage of memory actually used by the previous page derivation is less than a second predetermined percentage of the total memory of the system:
and under the condition that the percentage of the memory actually used by the last round of paging export is not less than a second preset percentage, calculating the memory expected to be occupied when the paging export is carried out according to the number of the last round of paging exports, and determining the calculated memory as the memory expected to be occupied by the current round of paging export.
9. The method of claim 5, further comprising, after determining whether the ratio of the number of previous rounds of page entries to the number of preset maximum entries is less than a preset ratio:
under the condition that the ratio of the number of the last round of paging exporting strips to the preset maximum number of the paging exporting strips is not smaller than the preset ratio, calculating the memory expected to occupy when the number of the last round of paging exporting strips is exported, and determining the calculated memory as the memory expected to occupy when the number of the last round of paging exporting strips is exported.
10. A data paging derivation apparatus, comprising:
the receiving module is used for receiving a data export request, wherein the data export request carries export conditions;
the query module is used for responding to the data export request and querying a plurality of target records conforming to the export condition;
the acquisition module is used for acquiring the preset number of the educts, the current used memory of the system and the total memory of the system;
the first determining module is used for determining paging export of the memory expected to occupy according to the preset export number;
the second determining module is used for determining the number of the paging deriving strips according to the preset number of the deriving strips, the memory expected to occupy by the paging deriving, the memory currently used by the system and the total memory of the system;
The export module is used for exporting the target records of the paging export number from the target records and storing the target records into a target file;
the second determining module is specifically configured to:
determining whether the sum of the memory expected to be occupied by the paging derivation and the memory currently used by the system is less than a first preset percentage of the total memory of the system;
and under the condition that the sum of the memory expected to be occupied by the paging derivation and the memory currently used by the system is not smaller than the first preset percentage, determining the paging derivation number according to the first preset percentage, the preset derivation number, the memory expected to be occupied by the paging derivation, the memory currently used by the system and the total memory of the system.
11. A computer device comprising a processor and a memory for storing processor-executable instructions which when executed by the processor implement the steps of the method of any one of claims 1 to 9.
12. A computer readable storage medium having stored thereon computer instructions, which when executed, implement the steps of the method of any of claims 1 to 9.
CN201910710933.2A 2019-08-02 2019-08-02 Data paging export method, device, computer equipment and storage medium Active CN110413978B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910710933.2A CN110413978B (en) 2019-08-02 2019-08-02 Data paging export method, device, computer equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910710933.2A CN110413978B (en) 2019-08-02 2019-08-02 Data paging export method, device, computer equipment and storage medium

Publications (2)

Publication Number Publication Date
CN110413978A CN110413978A (en) 2019-11-05
CN110413978B true CN110413978B (en) 2023-12-12

Family

ID=68365424

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910710933.2A Active CN110413978B (en) 2019-08-02 2019-08-02 Data paging export method, device, computer equipment and storage medium

Country Status (1)

Country Link
CN (1) CN110413978B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111143462B (en) * 2019-12-31 2024-04-09 广州酷旅旅行社有限公司 Method, apparatus, computer device and storage medium for data export
CN111460021B (en) * 2020-04-03 2024-01-19 中国建设银行股份有限公司 Data export method and device
CN113779122B (en) * 2021-02-19 2023-11-03 北京京东振世信息技术有限公司 Method and device for exporting data
CN114217748A (en) * 2021-12-17 2022-03-22 中国建设银行股份有限公司 Data export method, device, equipment, medium and product

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102486772A (en) * 2009-12-29 2012-06-06 北京方正阿帕比技术有限公司 Method and device for exporting data
CN104765760A (en) * 2015-01-04 2015-07-08 北京可思云海科技有限公司 Page generating and display method based on JSON (java script object notation) format
CN107562705A (en) * 2017-07-25 2018-01-09 努比亚技术有限公司 A kind of data export method, service end and computer-readable recording medium
CN110019437A (en) * 2017-07-18 2019-07-16 北京京东尚科信息技术有限公司 A kind of method and system exporting data

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105786717B (en) * 2016-03-22 2018-11-16 华中科技大学 The DRAM-NVM stratification isomery memory pool access method and system of software-hardware synergism management

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102486772A (en) * 2009-12-29 2012-06-06 北京方正阿帕比技术有限公司 Method and device for exporting data
CN104765760A (en) * 2015-01-04 2015-07-08 北京可思云海科技有限公司 Page generating and display method based on JSON (java script object notation) format
CN110019437A (en) * 2017-07-18 2019-07-16 北京京东尚科信息技术有限公司 A kind of method and system exporting data
CN107562705A (en) * 2017-07-25 2018-01-09 努比亚技术有限公司 A kind of data export method, service end and computer-readable recording medium

Also Published As

Publication number Publication date
CN110413978A (en) 2019-11-05

Similar Documents

Publication Publication Date Title
CN110413978B (en) Data paging export method, device, computer equipment and storage medium
US9575984B2 (en) Similarity analysis method, apparatus, and system
CN108376118B (en) Service distribution system, method, device and storage medium
CN106933854B (en) Short link processing method and device and server
CN106911780B (en) Service ID generation method, device and system
US9348840B2 (en) Adaptive data striping and replication across multiple storage clouds for high availability and performance
CN110909025A (en) Database query method, query device and terminal
CN108228341B (en) Memory recovery method and device, terminal equipment and computer readable storage medium
CN112866136B (en) Service data processing method and device
WO2020220646A1 (en) Data storage method based on distributed storage system, and storage node and medium
CN111277640B (en) User request processing method, device, system, computer equipment and storage medium
CN110740164A (en) Server determination method, regulation and control method, device, equipment and storage medium
WO2021057623A1 (en) Memory recovery method and apparatus, electronic device and storage medium
CN112559386A (en) Method and device for improving SSD performance, computer equipment and storage medium
CN111949681A (en) Data aggregation processing device and method and storage medium
CN111930305A (en) Data storage method and device, storage medium and electronic device
CN109710679B (en) Data extraction method and device
CN111159131A (en) Performance optimization method, device, equipment and computer readable storage medium
CN114640706B (en) Data transmission method, electronic device and computer readable storage medium
EP2940587A1 (en) Computer, control device for computer system, and recording medium
CN108228342B (en) Terminal device control method and device, terminal device and computer readable storage medium
CN113010334A (en) Request processing method, device and equipment
CN116089477B (en) Distributed training method and system
CN110222046B (en) List data processing method, device, server and storage medium
CN108228340B (en) Terminal control method and device, terminal equipment and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant