CN112905550A - Data export method and device - Google Patents
Data export method and device Download PDFInfo
- Publication number
- CN112905550A CN112905550A CN202110321559.4A CN202110321559A CN112905550A CN 112905550 A CN112905550 A CN 112905550A CN 202110321559 A CN202110321559 A CN 202110321559A CN 112905550 A CN112905550 A CN 112905550A
- Authority
- CN
- China
- Prior art keywords
- data
- export
- file
- target
- exported
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 54
- 230000008859 change Effects 0.000 claims abstract description 37
- 238000004891 communication Methods 0.000 claims abstract description 24
- 238000012544 monitoring process Methods 0.000 claims abstract description 6
- 238000004590 computer program Methods 0.000 claims description 14
- 238000009795 derivation Methods 0.000 claims description 10
- 230000001360 synchronised effect Effects 0.000 claims description 7
- 238000012545 processing Methods 0.000 claims description 3
- 230000008569 process Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 10
- 230000009286 beneficial effect Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000012423 maintenance Methods 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- ZLIBICFPKPWGIZ-UHFFFAOYSA-N pyrimethanil Chemical compound CC1=CC(C)=NC(NC=2C=CC=CC=2)=N1 ZLIBICFPKPWGIZ-UHFFFAOYSA-N 0.000 description 2
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000013467 fragmentation Methods 0.000 description 1
- 238000006062 fragmentation reaction Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/172—Caching, prefetching or hoarding of files
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The embodiment of the application provides a data export method and a device, which relate to the technical field of computers, and the data export method comprises the following steps: when monitoring that a preset task synchronization message system has data change, acquiring newly-added export task information of a target user according to the data change; then acquiring data query conditions and user information according to the newly added export task information; acquiring a file to be exported according to the data query condition and the user information; and finally, sending the file storage address corresponding to the file to be exported to the communication address of the target user, so that the target user can acquire the file to be exported through the file storage address, the data export operation can be rapidly carried out, the reliability is good, the data export efficiency is favorably improved, and the user experience is further improved.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a data export method and apparatus.
Background
With the rapid development of computer networks, users can access data of remote servers through the network and export the data in the form of files. In the existing data export method, corresponding data to be exported are generally obtained according to an export request, a data file is generated according to the data to be exported, and then the data file is stored in an intermediate server; and finally, the client downloads the complete file from the intermediate server. However, in practice, it is found that in the existing data export method, after a user sends an export request, if an exception occurs in the system during data export, the export task may be abnormally exited, and the user may not receive the export data finally. Therefore, the existing data export method is poor in reliability, and further the data export efficiency is low.
Disclosure of Invention
An object of the embodiments of the present application is to provide a data export method and apparatus, which can perform data export operation quickly, have good reliability, and are beneficial to improving data export efficiency, thereby improving user experience.
A first aspect of an embodiment of the present application provides a data export method, including:
when monitoring that a preset task synchronization message system has data change, acquiring newly-added export task information of a target user according to the data change;
acquiring data query conditions and user information according to the newly added export task information;
acquiring a file to be exported according to the data query condition and the user information;
and sending the file storage address corresponding to the file to be exported to the communication address of the target user, so that the target user can acquire the file to be exported through the file storage address.
In the implementation process, when monitoring that a preset task synchronization message system has data change, acquiring newly-added export task information of a target user according to the data change; then acquiring data query conditions and user information according to the newly added export task information; acquiring a file to be exported according to the data query condition and the user information; and finally, sending the file storage address corresponding to the file to be exported to the communication address of the target user, so that the target user can acquire the file to be exported through the file storage address, the data export operation can be rapidly carried out, the reliability is good, the data export efficiency is favorably improved, and the user experience is further improved.
Further, the method further comprises:
when a data export request input by a target user is received, acquiring a data query condition of the target user and user information of the target user according to the data export request;
generating a target export task according to the data query condition and the user information;
and storing the target export task into a preset database, synchronizing the target export task to a preset task synchronous message system so as to enable the preset task synchronous message system to generate data change, and executing the newly added export task information of the target user according to the data change.
In the implementation process, after a data export request of a target user is received, a target export task is generated according to the data query condition and the user information, and the target export task can be stored in a preset database, so that the target export task cannot be lost, and the export operation reliability is high.
Further, the obtaining a file to be exported according to the data query condition and the user information includes:
acquiring target data matched with the data query condition and the user information;
and generating a file to be exported according to the target data, and storing the file to be exported into a preset storage server.
In the implementation process, the matched target data is inquired according to the data inquiry condition and the user information, then the file to be exported is generated according to the target data, and the file to be exported is stored in the preset storage server, so that the target user can conveniently download and obtain the file subsequently.
Further, the sending the file storage address corresponding to the file to be exported to the communication address of the target user includes:
acquiring a file storage address of the file to be exported in the storage server;
and sending the file storage address to the communication address of the target user.
In the implementation process, when data is exported, the file storage address of the file to be exported is sent to the communication address of the target user instead of directly sending the file to be exported, so that the problems of long file sending time, file sending failure and the like caused by overlarge file to be exported can be avoided, the stability of data export is further improved, and meanwhile, the response time of a data export request is shortened.
Further, after sending the file storage address corresponding to the file to be exported to the communication address of the target user, the method further includes:
acquiring all export tasks in the preset database according to a preset time interval;
and generating an export task report according to all the export tasks.
In the implementation process, the export task report is generated according to the preset time interval, the relevant data information of the export task can be displayed, and the management and maintenance of a data manager are facilitated.
A second aspect of embodiments of the present application provides a data export apparatus, including:
the device comprises a first acquisition unit, a second acquisition unit and a processing unit, wherein the first acquisition unit is used for acquiring newly-added export task information of a target user according to data change when the data change of a preset task synchronization message system is monitored;
the second acquisition unit is used for acquiring data query conditions and user information according to the newly added export task information;
a third obtaining unit, configured to obtain a file to be exported according to the data query condition and the user information;
and the sending unit is used for sending the file storage address corresponding to the file to be exported to the communication address of the target user so that the target user can acquire the file to be exported through the file storage address.
In the implementation process, when monitoring that a preset task synchronization message system has data change, a first acquisition unit acquires newly-added export task information of a target user according to the data change; then a second acquisition unit acquires data query conditions and user information according to the newly added export task information; the third acquisition unit acquires a file to be exported according to the data query condition and the user information; and finally, the sending unit sends the file storage address corresponding to the file to be exported to the communication address of the target user, so that the target user can acquire the file to be exported through the file storage address, the data export operation can be rapidly carried out, the reliability is good, the data export efficiency is favorably improved, and the user experience is further improved.
Further, the data exporting apparatus further comprises:
the fourth acquisition unit is used for acquiring the data query condition of the target user and the user information of the target user according to the data export request when receiving the data export request input by the target user;
the generating unit is used for generating a target export task according to the data query condition and the user information;
the storage unit is used for storing the target export task into a preset database;
and the synchronization unit is used for synchronizing the target export task to a preset task synchronization message system so as to enable the preset task synchronization message system to generate data change, and triggering the first acquisition unit to acquire the newly added export task information of the target user according to the data change.
In the implementation process, after the data export request of the target user is received, the generation unit can generate the target export task according to the data query condition and the user information, and then the storage unit stores the target export task into the preset database, so that the target export task cannot be lost, and the export operation reliability is high.
Further, the second acquisition unit includes:
the acquisition subunit is used for acquiring target data matched with the data query condition and the user information;
the generating subunit is used for generating a file to be exported according to the target data;
and the storage subunit is used for storing the file to be exported into a preset storage server.
In the implementation process, the obtaining subunit firstly queries the matched target data according to the data query condition and the user information, then the generating subunit generates the file to be exported according to the target data, and finally the storing subunit stores the file to be exported into a preset storage server, so that the target user can conveniently download and obtain the file subsequently.
A third aspect of embodiments of the present application provides an electronic device, including a memory and a processor, where the memory is used to store a computer program, and the processor runs the computer program to make the electronic device execute the data export method described in any one of the first aspect of embodiments of the present application.
A fourth aspect of the embodiments of the present application provides a computer-readable storage medium, which stores computer program instructions, and when the computer program instructions are read and executed by a processor, the computer program instructions perform the data export method according to any one of the first aspect of the embodiments of the present application.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.
Fig. 1 is a schematic flowchart of a data export method according to an embodiment of the present application;
fig. 2 is a schematic flowchart of another data export method according to an embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of a data export apparatus according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of another data deriving device according to an embodiment of the present application;
fig. 5 is a schematic system architecture diagram of a data export system according to an embodiment of the present application.
The figure is as follows: 500-client, 600-server, 700-database, 800-mail system, 900-message system.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not to be construed as indicating or implying relative importance.
Referring to fig. 1, fig. 1 is a schematic flowchart illustrating a data export method according to an embodiment of the present disclosure. The data export method comprises the following steps:
s101, when monitoring that the data of the preset task synchronization message system is changed, acquiring newly-added export task information of a target user according to the data change.
In the embodiment of the present application, the method is applied to a data export scenario, and is particularly applied to an export scenario of user query data.
In the embodiment of the present application, the execution subject of the method may be a computing device such as a computer and a server, and is not limited in this embodiment.
In this embodiment, an execution subject of the method may also be an intelligent device such as a smart phone and a tablet computer, which is not limited in this embodiment.
In this embodiment of the present application, the preset task synchronization message system may specifically be a KAFKA message system, and this embodiment of the present application is not limited thereto.
In the embodiment of the application, the KAFKA message system is a distributed message system, is written by using a Scala language, and has the characteristics of high-level extension and high throughput. Parallelism can be increased by fragmentation and reliability can be increased by duplication. The Scala language is a multi-modal programming language, is similar to a java programming language, and has various characteristics of language scalability and integration of object-oriented programming and functional programming.
In the embodiment of the application, in actual use, an execution main body of the method is set as a server, when a target user needs to export data, a data export request can be sent to the server through a client, then when the server receives the data export request, corresponding data query conditions and user information are obtained according to the data export request, a data export table is generated according to the data query conditions and the user information, the data export table is stored, and meanwhile, the data export table is synchronized into the preset task synchronization message system, at the moment, the server can detect that the preset task synchronization message system has data change, and can determine that the data export request input by the target user is received.
In the embodiment of the application, when the data change occurs in the preset task synchronization message system, it indicates that data export operation is required, and the corresponding newly added export task information can be obtained according to the data change.
And S102, acquiring data query conditions and user information according to the newly added export task information.
In the embodiment of the present application, the data change of the preset task synchronization message system includes newly added export task information, where the newly added export task information includes a data query condition, user information, and the like, and the embodiment of the present application is not limited thereto.
And S103, acquiring the file to be exported according to the data query condition and the user information.
In the embodiment of the application, data meeting the conditions can be inquired from a pre-configured database according to the data inquiry conditions and the user information, and then the file to be exported is obtained.
In this embodiment of the present application, the preconfigured database may specifically be an MYSQL database, a data storage device, and the like, and this embodiment of the present application is not limited thereto.
And S104, sending the file storage address corresponding to the file to be exported to the communication address of the target user so that the target user can obtain the file to be exported through the file storage address.
In this embodiment, the communication address may specifically be an IP address, a mail receiving address, a short message receiving address, a social account, and the like, which is not limited in this embodiment.
In the embodiment of the application, the file storage address may be sent to the target user in the form of a network link (e.g., a data download link), and then the target user may obtain the corresponding file to be exported through the network link.
Of course, the file storage address may also be sent to the target user in the form of a two-dimensional code, a barcode, or the like, which is not limited in any way.
As an alternative implementation manner, the file storage address of the file to be exported may be sent to the user mailbox of the target user through the mail service, and then the target user may obtain the file to be exported through the file storage address.
Therefore, by implementing the data export method described in fig. 1, data export operation can be performed quickly, reliability is good, and data export efficiency is improved, so that user experience is improved.
Referring to fig. 2, fig. 2 is a schematic flow chart of another data export method according to an embodiment of the present application. As shown in fig. 2, wherein the data deriving method includes:
s201, when a data export request input by a target user is received, acquiring a data query condition of the target user and user information of the target user according to the data export request.
As an alternative embodiment, the target user may send a data export request through the client.
As an alternative implementation, the client used by the target user may specifically run on a smart device such as a smart phone, a tablet computer, a wearable device, or a computer.
And S202, generating a target export task according to the data query condition and the user information.
As an optional implementation manner, after receiving a data export request of a target user, a target export task may be generated according to the data query condition and the user information, and the target export task is stored in an export task table in the MYSQL database.
In the above embodiment, after the target export task is stored in the MYSQL database, the target export task is not lost, and the export operation reliability is high.
It should be noted that the formats and contents of the target export task and the export task information may be the same or different, for example, the export task information includes the target export task and other attribute information, such as the expected export time, file size, and export address of the target export task, which is not described herein again.
As an optional implementation manner, after the target export task is obtained, the task state corresponding to the target export task in the export task table may be marked as an incomplete state, so that a manager can manage and maintain the target export task conveniently.
S203, storing the target export task into a preset database, synchronizing the target export task to a preset task synchronization message system so as to enable the preset task synchronization message system to generate data change, and executing the step S204.
As an alternative implementation, when the preset task synchronization message system is the KAFKA message system, the information of the target export task can be synchronized in real time to the KAFKA message system through other middleware systems, and the data change of the KAFKA message system is monitored.
As an optional implementation manner, when multiple target users send data export requests at the same time, a corresponding target export task may be generated according to the data query condition and the user information in each data export request at the same time, further, the target export task may be stored in an export task table in the MYSQL database at the same time, and then, when synchronizing data to the KAFKA message system, only the export task table may be synchronized, thereby implementing one-key synchronization of multiple target export tasks, which is beneficial to reducing the processing amount, reducing the queuing waiting time, and further beneficial to improving the data export efficiency.
After step S203, the following steps are also included:
and S204, acquiring newly added export task information of the target user according to the data change.
In the embodiment of the application, when the data change of the preset task synchronization message system is monitored, a newly added export task is indicated, and corresponding newly added export task information can be obtained according to the data change.
And S205, acquiring data query conditions and user information according to the newly added export task information.
After step S205, the following steps are also included:
s206, acquiring target data matched with the data query conditions and the user information.
As an alternative implementation, the target data meeting the condition may be queried from a pre-configured database according to the data query condition and the user information.
And S207, generating a file to be exported according to the target data, and storing the file to be exported into a preset storage server.
As an optional implementation manner, after the target data is matched, the target data may be completely written into a file according to a preset file generation script to obtain a file to be exported, and then the file to be exported is uploaded to a preset storage server for storage.
In the embodiment of the present application, by implementing the steps S206 to S207, the file to be exported can be obtained according to the data query condition and the user information.
After step S207, the following steps are also included:
and S208, acquiring a file storage address of the file to be exported in the storage server.
S209, the file storage address is sent to the communication address of the target user, so that the target user can obtain the file to be exported through the file storage address.
As an alternative implementation manner, the file storage address of the file to be exported may be sent to the user mailbox of the target user through the mail service, and then the target user may obtain the file to be exported through the file storage address.
As an optional implementation manner, after the file storage address is sent to the communication address of the target user, the task state corresponding to the target export task in the export task table may be marked as a completed state, so that management and maintenance of the target export task by a manager are facilitated.
In some possible embodiments, after the task state corresponding to the target export task in the export task table is marked as the completed state, the corresponding file storage address may be emptied or the data stored in the corresponding file storage address may be moved to another backup space, so as to ensure that there is enough storage space for storing the subsequent file to be exported, which is not described in detail herein.
In some possible embodiments, a download validity period may also be set for the file storage address corresponding to the exported file, and for a download request exceeding the validity period, a new address may be provided or the file cannot be downloaded, so as to ensure the security of the exported file. The new address may be stored in a mapping table of new and old addresses in the database, which is not limited herein.
In this embodiment of the application, by implementing the steps S206 to S207, the file storage address corresponding to the file to be exported can be sent to the communication address of the target user, so that the target user can obtain the file to be exported through the file storage address.
Referring to fig. 5, fig. 5 is a schematic diagram of a system architecture of a data export system according to an embodiment of the present disclosure. As shown in fig. 5, the data export system includes a client 500, a server 600, a database 700, a mail system 800, and a message system 900, where a target user may send a data export request including a data query condition and user information to the server 600 through the client 500, then the server 600 may generate a target export task according to the data export request, store the target export task in the database 700, synchronize the target export task in the message system 900, then the server 600 may monitor that data change occurs in the message system 900, may obtain a corresponding data query condition and user information, obtain a corresponding file to be exported according to the data query condition and the user information, and finally send a file storage address of the file to be exported to the client 500 through the mail system 800.
The file to be exported may be stored in the database 700 shown in fig. 5, which is not limited in this embodiment of the present application.
As an optional implementation manner, after sending the file storage address corresponding to the file to be exported to the communication address of the target user, the method may further include the following steps:
acquiring all export tasks in a preset database according to a preset time interval;
and generating an export task report according to all export tasks.
In the foregoing embodiment, the export task report may include a data query condition, user information, a data export permission corresponding to the user information, a task state, and the like, which is not limited to this embodiment of the present application.
In the above embodiment, the export task report can show the user who has performed data export, query conditions, the status of whether the task is completed, and the like, which is convenient for a data administrator to manage and maintain.
Therefore, by implementing the data export method described in fig. 2, data export operation can be performed quickly, reliability is good, and data export efficiency is improved, so that user experience is improved.
Please refer to fig. 3, fig. 3 is a schematic structural diagram of a data deriving apparatus according to an embodiment of the present application. As shown in fig. 3, the data deriving means includes:
the first obtaining unit 310 is configured to, when it is monitored that a data change occurs in the preset task synchronization message system, obtain newly-added derived task information of the target user according to the data change.
A second obtaining unit 320, configured to obtain the data query condition and the user information according to the new derived task information.
A third obtaining unit 330, configured to obtain the file to be exported according to the data query condition and the user information.
The sending unit 340 is configured to send a file storage address corresponding to the file to be exported to a communication address of the target user, so that the target user obtains the file to be exported through the file storage address.
Therefore, the data export device described in fig. 3 can be implemented to rapidly export data, has good reliability, and is beneficial to improving the data export efficiency and further improving the user experience.
Referring to fig. 4, fig. 4 is a schematic structural diagram of another data deriving device according to an embodiment of the present disclosure. The data derivation apparatus shown in fig. 4 is optimized by the data derivation apparatus shown in fig. 3. As shown in fig. 4, the data deriving apparatus further includes:
a fourth obtaining unit 350, configured to, when receiving a data export request input by a target user, obtain a data query condition of the target user and user information of the target user according to the data export request.
And a generating unit 360, configured to generate a target export task according to the data query condition and the user information.
The storage unit 370 is configured to store the target export task in a preset database.
The synchronization unit 380 is configured to synchronize the target export task with the preset task synchronization message system, so that the preset task synchronization message system generates data change, and triggers the first obtaining unit to obtain new export task information of the target user according to the data change.
As an optional implementation, the second obtaining unit 320 includes:
an acquisition subunit 321 configured to acquire target data that matches the data query condition and the user information;
a generating subunit 322, configured to generate a file to be exported according to the target data;
and the storage subunit 323 is configured to store the file to be exported in a preset storage server.
As an optional implementation, the sending unit 340 includes:
the address obtaining subunit 341 is configured to obtain a file storage address of the file to be exported in the storage server.
The sending subunit 342 is configured to send the file storage address to the communication address of the target user.
As an optional implementation, the data exporting apparatus further comprises:
a report generating unit 390, configured to obtain all export tasks in a preset database according to a preset time interval after sending a file storage address corresponding to a file to be exported to a communication address of a target user; and generating an export task report according to all export tasks.
In the above embodiment, after the sending unit 340 sends the file storage address corresponding to the file to be exported to the communication address of the target user, the report generating unit 390 may be further triggered to obtain all export tasks in the preset database according to the preset time interval.
Therefore, the data export device described in fig. 4 can be implemented to rapidly conduct data export operation, is good in reliability, and is beneficial to improving data export efficiency, and further improves user experience.
The embodiment of the application provides an electronic device, which comprises a memory and a processor, wherein the memory is used for storing a computer program, and the processor runs the computer program to enable the electronic device to execute the data export method described in the embodiment of the application.
Embodiments of the present application provide a computer-readable storage medium, which stores computer program instructions, and when the computer program instructions are read and executed by a processor, the computer program instructions execute the data export method described in the embodiments of the present application.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented in other ways. The apparatus embodiments described above are merely illustrative, and for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above description is only an example of the present application and is not intended to limit the scope of the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application. It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Claims (10)
1. A method of data derivation, comprising:
when monitoring that a preset task synchronization message system has data change, acquiring newly-added export task information of a target user according to the data change;
acquiring data query conditions and user information according to the newly added export task information;
acquiring a file to be exported according to the data query condition and the user information;
and sending the file storage address corresponding to the file to be exported to the communication address of the target user, so that the target user can acquire the file to be exported through the file storage address.
2. The data derivation method of claim 1, further comprising:
when a data export request input by a target user is received, acquiring a data query condition of the target user and user information of the target user according to the data export request;
generating a target export task according to the data query condition and the user information;
and storing the target export task into a preset database, synchronizing the target export task to a preset task synchronous message system so as to enable the preset task synchronous message system to generate data change, and executing the newly added export task information of the target user according to the data change.
3. The data export method according to claim 1, wherein the obtaining the file to be exported according to the data query condition and the user information comprises:
acquiring target data matched with the data query condition and the user information;
and generating a file to be exported according to the target data, and storing the file to be exported into a preset storage server.
4. The data export method according to claim 3, wherein the sending the file storage address corresponding to the file to be exported to the communication address of the target user comprises:
acquiring a file storage address of the file to be exported in the storage server;
and sending the file storage address to the communication address of the target user.
5. The data export method according to claim 2, wherein after sending the file storage address corresponding to the file to be exported to the communication address of the target user, the method further comprises:
acquiring all export tasks in the preset database according to a preset time interval;
and generating an export task report according to all the export tasks.
6. A data derivation apparatus, characterized in that the data derivation apparatus comprises:
the device comprises a first acquisition unit, a second acquisition unit and a processing unit, wherein the first acquisition unit is used for acquiring newly-added export task information of a target user according to data change when the data change of a preset task synchronization message system is monitored;
the second acquisition unit is used for acquiring data query conditions and user information according to the newly added export task information;
a third obtaining unit, configured to obtain a file to be exported according to the data query condition and the user information;
and the sending unit is used for sending the file storage address corresponding to the file to be exported to the communication address of the target user so that the target user can acquire the file to be exported through the file storage address.
7. The data derivation apparatus according to claim 6, wherein the data derivation apparatus further comprises:
the fourth acquisition unit is used for acquiring the data query condition of the target user and the user information of the target user according to the data export request when receiving the data export request input by the target user;
the generating unit is used for generating a target export task according to the data query condition and the user information;
the storage unit is used for storing the target export task into a preset database;
and the synchronization unit is used for synchronizing the target export task to a preset task synchronization message system so as to enable the preset task synchronization message system to generate data change, and triggering the first acquisition unit to acquire the newly added export task information of the target user according to the data change.
8. The data derivation apparatus according to claim 6, wherein the second acquisition unit comprises:
the acquisition subunit is used for acquiring target data matched with the data query condition and the user information;
the generating subunit is used for generating a file to be exported according to the target data;
and the storage subunit is used for storing the file to be exported into a preset storage server.
9. An electronic device, characterized in that the electronic device comprises a memory for storing a computer program and a processor for executing the computer program to cause the electronic device to perform the data derivation method of any of claims 1 to 5.
10. A readable storage medium having stored therein computer program instructions which, when read and executed by a processor, perform the data export method of any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110321559.4A CN112905550A (en) | 2021-03-25 | 2021-03-25 | Data export method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110321559.4A CN112905550A (en) | 2021-03-25 | 2021-03-25 | Data export method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112905550A true CN112905550A (en) | 2021-06-04 |
Family
ID=76106489
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110321559.4A Pending CN112905550A (en) | 2021-03-25 | 2021-03-25 | Data export method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112905550A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005293478A (en) * | 2004-04-05 | 2005-10-20 | Hitachi Ltd | Storage control system, channel controller equipped with the same system and data transferring device |
| CN101272354A (en) * | 2007-03-20 | 2008-09-24 | 重庆优腾信息技术有限公司 | File transfer method, device and system |
| CN108667895A (en) * | 2018-03-16 | 2018-10-16 | 南方科技大学 | File sharing method, server based on Quick Response Code and terminal device |
| CN110555068A (en) * | 2018-05-14 | 2019-12-10 | 北京京东尚科信息技术有限公司 | Data export method and device |
| CN111104448A (en) * | 2019-12-17 | 2020-05-05 | 深圳前海环融联易信息科技服务有限公司 | Method and device for exporting large-data-volume Excel file, computer equipment and storage medium |
| CN111143462A (en) * | 2019-12-31 | 2020-05-12 | 广州酷旅旅行社有限公司 | Data export method and device, computer equipment and storage medium |
-
2021
- 2021-03-25 CN CN202110321559.4A patent/CN112905550A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005293478A (en) * | 2004-04-05 | 2005-10-20 | Hitachi Ltd | Storage control system, channel controller equipped with the same system and data transferring device |
| CN101272354A (en) * | 2007-03-20 | 2008-09-24 | 重庆优腾信息技术有限公司 | File transfer method, device and system |
| CN108667895A (en) * | 2018-03-16 | 2018-10-16 | 南方科技大学 | File sharing method, server based on Quick Response Code and terminal device |
| CN110555068A (en) * | 2018-05-14 | 2019-12-10 | 北京京东尚科信息技术有限公司 | Data export method and device |
| CN111104448A (en) * | 2019-12-17 | 2020-05-05 | 深圳前海环融联易信息科技服务有限公司 | Method and device for exporting large-data-volume Excel file, computer equipment and storage medium |
| CN111143462A (en) * | 2019-12-31 | 2020-05-12 | 广州酷旅旅行社有限公司 | Data export method and device, computer equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106933854B (en) | Short link processing method and device and server | |
| CN108228814B (en) | Data synchronization method and device | |
| US20140365523A1 (en) | Push subscriptions | |
| CN107770229B (en) | Cloud file sharing method and system and cloud server | |
| CN112052247A (en) | Index updating system, method and device of search engine, electronic equipment and storage medium | |
| WO2015101320A1 (en) | Account number generation method, terminal and background server | |
| CN107733662B (en) | Group recovery method and device | |
| US11226982B2 (en) | Synchronization of offline instances | |
| US20080270520A1 (en) | Provision of Personal Data in a Data Communications Network | |
| CN111884843B (en) | Message processing method and device, electronic equipment and storage medium | |
| CN113077259A (en) | Block chain-based evidence storing method and device and electronic equipment | |
| CN114328029B (en) | Backup method and device of application resources, electronic equipment and storage medium | |
| KR102114532B1 (en) | Information operation | |
| CN103269302A (en) | Shared file management method and system for instant messaging | |
| CN111930753B (en) | Data retrieving method and device, electronic equipment and storage medium | |
| CN111818025B (en) | User terminal detection method and device | |
| CN112865927B (en) | Message delivery verification method, device, computer equipment and storage medium | |
| CN109213955B (en) | Data processing method and related equipment | |
| CN112905550A (en) | Data export method and device | |
| CN107563942B (en) | Logistics data batch processing method, logistics processing system and processing device | |
| CN109525649B (en) | Data processing method and device for zookeeper client | |
| CN105791350B (en) | Project data processing method and system | |
| WO2017092661A1 (en) | Subscription service for monitoring changes in remote content | |
| CN110944037B (en) | Method, computer device and storage medium for client cache change configuration | |
| CN108491448B (en) | Data pushing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210604 |
|
| RJ01 | Rejection of invention patent application after publication |