CN114116656B - Data processing method and related device - Google Patents

Data processing method and related device Download PDF

Info

Publication number
CN114116656B
CN114116656B CN202210084036.7A CN202210084036A CN114116656B CN 114116656 B CN114116656 B CN 114116656B CN 202210084036 A CN202210084036 A CN 202210084036A CN 114116656 B CN114116656 B CN 114116656B
Authority
CN
China
Prior art keywords
file
target
target format
size
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210084036.7A
Other languages
Chinese (zh)
Other versions
CN114116656A (en
Inventor
李双飞
徐欢
叶振东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Xishima Data Technology Co ltd
Original Assignee
Shenzhen Xishima Data Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Xishima Data Technology Co ltd filed Critical Shenzhen Xishima Data Technology Co ltd
Priority to CN202210084036.7A priority Critical patent/CN114116656B/en
Publication of CN114116656A publication Critical patent/CN114116656A/en
Application granted granted Critical
Publication of CN114116656B publication Critical patent/CN114116656B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/182Distributed file systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2282Tablespace storage structures; Management thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/10Text processing
    • G06F40/166Editing, e.g. inserting or deleting
    • G06F40/177Editing, e.g. inserting or deleting of tables; using ruled lines
    • G06F40/18Editing, e.g. inserting or deleting of tables; using ruled lines of spreadsheets

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The application provides a data processing method and a related device, which are applied to terminal equipment, wherein the terminal equipment is in communication connection with a server, and the method comprises the following steps: sending a target data file to the server, wherein the target data file is used for indicating a target format file; acquiring target path information from the server; sending a data request message to a fast distributed file system FastDFS according to the target path information to obtain the target format file; and generating chart data according to the target format file. By the method, the process of chart display is automatically completed by the terminal equipment, so that the pressure of the server is effectively relieved, the system breakdown is avoided, and the user experience is improved.

Description

Data processing method and related device
Technical Field
The application belongs to the technical field of general data processing in the Internet industry, and particularly relates to a data processing method and a related device.
Background
At present, the table data in the Excel file is subjected to chart display by analyzing the Excel into a form of a database table through a server and storing the table data, and then the chart display is completed by inquiring the database, so that not only a large amount of memory of the server is occupied, but also the system response speed is slowed down or even crashed under the scene of concurrent access, and the user experience is influenced.
Disclosure of Invention
The application provides a data processing method and a related device, which are used for relieving the pressure of a server and improving the user experience.
In a first aspect, an embodiment of the present application provides a data processing method, where the method is applied to a terminal device, and the terminal device is in communication connection with a server, and the method includes:
sending a target data file to the server, wherein the target data file is used for indicating a target format file, the target data file comprises Excel file type table data, and the target format file is formed by storing the Excel file type table data in a Json format;
acquiring target path information from the server, wherein the target path information is used for indicating the target format file;
sending a data request message to a fast distributed file system FastDFS according to the target path information to obtain the target format file;
generating graph data according to the target format file, wherein the graph data is used for representing the data in the target format file in a graph form.
In a second aspect, an embodiment of the present application provides a data processing method, where the method is applied to a server, and the server is in communication connection with a terminal device, and the method includes:
receiving a target data file from the terminal equipment, wherein the target data file comprises Excel file type table data;
generating a target format file according to the target data file, wherein the target format file is a file formed by storing Excel file type table data in a Json format;
and uploading the target format file to a fast distributed file system FastDFS to obtain target path information, wherein the target path information is used for indicating the target format file, the target format file is used for indicating graph data, and the graph data is used for representing data in the target format file in a graph form.
In a third aspect, an embodiment of the present application provides a data processing apparatus, where the apparatus is applied to a terminal device, and the terminal device is in communication connection with a server, and the apparatus includes:
the system comprises a first sending unit, a second sending unit and a third sending unit, wherein the first sending unit is used for sending a target data file to the server, the target data file is used for indicating a target format file, the target data file comprises Excel file type table data, and the target format file is formed by storing the Excel file type table data in a Json format; an obtaining unit, configured to obtain target path information from the server, where the target path information is used to indicate the target format file; a second sending unit, configured to send a data request message to a fast distributed file system FastDFS according to the target path information, to obtain the target format file; and the generating unit is used for generating chart data according to the target format file, and the chart data is used for representing the data in the target format file in a chart form.
In a fourth aspect, an embodiment of the present application provides a data processing apparatus, where the apparatus is applied to a server, and the server is in communication connection with a terminal device, and the apparatus includes:
the receiving unit is used for receiving a target data file from the terminal equipment, wherein the target data file comprises Excel file type table data; the generating unit is used for generating a target format file according to the target data file, wherein the target format file is formed by storing the target data file in a Json format; and the uploading unit is used for uploading the target format file to a fast distributed file system FastDFS to obtain target path information, the target path information is used for indicating the target format file, the target format file is used for indicating graph data, and the graph data is used for representing the data in the target format file in a graph form.
In a fifth aspect, embodiments of the present application provide an electronic device, including a processor, a memory, a communication interface, and one or more programs stored in the memory and configured to be executed by the processor, the programs including instructions for performing the steps in the first or second aspects of embodiments of the present application. The electronic device may be the terminal device and/or the server.
In a sixth aspect, embodiments of the present application provide a computer storage medium for storing a computer program for electronic data exchange, wherein the computer program enables a computer to perform some or all of the steps described in the first aspect or the second aspect of the present embodiment.
In a seventh aspect, this application embodiment provides a computer program product, where the computer program product includes a non-transitory computer-readable storage medium storing a computer program, where the computer program is operable to cause a computer to perform some or all of the steps as described in the first aspect or the second aspect of this application embodiment. The computer program product may be a software installation package.
It can be seen that, in the embodiment of the present application, a target data file is first sent to a server, where the target data file is used to indicate a target format file, the target data file includes Excel file type table data, the target format file is a file formed by storing the Excel file type table data in a Json format, target path information is then obtained from the server, a data request message is then sent to a fast distributed file system FastDFS according to the target path information, so as to obtain the target format file, and finally, graph data is generated according to the target format file. Therefore, the process of chart display is automatically completed by the terminal equipment, the pressure of the server is effectively relieved, the system breakdown is avoided, and the user experience is improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a system architecture diagram according to an embodiment of the present application;
fig. 2 is a schematic flowchart of a data processing method according to an embodiment of the present application;
FIG. 3 is a graph data of a clustered column graph according to an embodiment of the present application;
fig. 4 is a flowchart of interaction between a terminal device and FastDFS according to an embodiment of the present disclosure;
FIG. 5 is a schematic flow chart diagram of another data processing method provided in the embodiments of the present application;
FIG. 6 is a flowchart illustrating interaction between a server and a FastDFS according to an embodiment of the present application;
FIG. 7a is a block diagram illustrating functional units of a data processing apparatus according to an embodiment of the present disclosure;
FIG. 7b is a block diagram illustrating functional units of another data processing apparatus according to an embodiment of the present disclosure;
FIG. 8a is a block diagram illustrating functional units of a data processing apparatus according to an embodiment of the present disclosure;
FIG. 8b is a block diagram illustrating functional units of another data processing apparatus according to an embodiment of the present disclosure;
fig. 9 is a block diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In order to make the technical solutions of the present application better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms "first," "second," and the like in the description and claims of the present application and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements but may alternatively include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
The following description will be given of terms related to the present application.
Fast Distributed File System (fastdistributed File System, FastDFS): mainly manages files, and the functions comprise: file storage, file synchronization, file access (file upload, file download), etc., solving the problems of large-capacity storage and load balancing. The FastDFS server has two roles: trackers (tracker) and storage nodes (storage). The tracker mainly does scheduling work, plays a role in load balancing on access, and the storage nodes store files to complete all functions of file management. Both the tracker and the storage node may be constituted by one or more servers. Servers in both the tracker and storage nodes can be added or removed from the line at any time without affecting the online service. Where all servers in the tracker are peer-to-peer, they may increase or decrease at any time depending on the server's stress.
Json (JavaScript Object notification): is a lightweight data exchange format. It stores and represents data in a text format that is completely independent of the programming language, based on a subset of ECMAScript (js specification set by the european computer association). The compact and clear hierarchy makes JSON an ideal data exchange language. The method is easy for human reading and writing, and is also easy for machine analysis and generation, and the network transmission efficiency is effectively improved.
Concurrent access: the method refers to that a plurality of terminal devices simultaneously request to process data and display charts.
At present, chart display of table data in an Excel file is performed by analyzing Excel into a form of a database table through a server, storing the table data, and querying the database to complete chart display. With the increase of uploaded files, tables of a database are increased, so that a server occupies too much memory and hard disk space, and each data request needs to access the database, so that the system performance is inversely proportional to the number of data requests accessed concurrently, and even under some overload conditions, the system is crashed, and the user experience is influenced.
In order to solve the above problem, an embodiment of the present application provides a data processing method, which is applied to a terminal device used by a user. The effect of relieving the pressure of the server is achieved by acquiring the target path information, pulling the required data from the FastDFS according to the target path information, and processing and displaying the data by the terminal equipment. The method provided by the embodiment of the application can be applied to computer systems of enterprises, for example, when each terminal device in an enterprise displays the table data in an Excel file in a graph, the method can be adopted, so that the pressure of an enterprise server cluster can be effectively relieved, the company cost is saved, and the business experience is improved. The method and the device for displaying the table data in the Excel file can be suitable for various scenes needing to perform diagram display on the table data in the Excel file, and include but are not limited to the application scenes.
The following describes a system architecture according to an embodiment of the present application.
Referring to fig. 1, fig. 1 is a schematic diagram of a system architecture according to an embodiment of the present disclosure. As shown in fig. 1, the system architecture 10 includes a terminal device 11, a server 12, and a fast distributed file system FastDFS13, wherein the terminal device 11 is communicatively connected to the server 12 and the fast distributed file system FastDFS13, respectively, and the server 12 is also communicatively connected to the fast distributed file system FastDFS 13; the terminal device 11 is configured to send a target data file to the server 12, obtain target path information from the server 12, send a data request message to the FastDFS13 according to the target path information to obtain a target format file, and finally generate graph data according to the target format file; the server 12 is configured to receive a target data file from the terminal device 11, parse the target data file to generate a target format file, upload the target format file to the FastDFS13 to obtain target path information, and finally send the target path information to the terminal device 11; the FastDFS13 is for receiving the target-format file from the server 12 and transmitting the target path information to the server 12, and for receiving the data request message from the terminal device 11 and transmitting the target-format file to the terminal device 11. The terminal device 11 may be a mobile phone terminal, a tablet computer, a notebook computer, a vehicle-mounted terminal, and the like, and the server 12 may be a server, a server cluster composed of a plurality of servers, or a cloud computing service center.
A data processing method provided in the embodiment of the present application is described below.
Referring to fig. 2, fig. 2 is a schematic flowchart of a data processing method provided in an embodiment of the present application, where the data processing method is applied to a terminal device, and the terminal device is in communication connection with a server, as shown in the figure, the data processing method includes:
step 201, sending a target data file to the server, where the target data file is used to indicate a target format file.
The target data file comprises Excel file type table data, and the target format file is formed by storing the Excel file type table data in a Json format; exemplarily, a user needs to display table data in an Excel file with a file name of "achievement list" in a terminal device in a graph manner, where the table data in the Excel file is shown in table 1:
mathematics, knowledge and knowledge Chinese language English language
Zhang San
95 80 70
Li Si 90 88 87
Wang Wu 70 75 80
Zhao liu xi 94 79 66
TABLE 1 tabular data in the "transcript sheet" Excel File
In this step, the user needs to send the Excel file to the server through the terminal device, and the Excel file is processed by the server to generate the target format file.
Step 202, obtaining target path information from the server.
The target path information is used for indicating the target format file, namely the target format file corresponds to the target path information one by one, and the terminal equipment can find the only target format file through the target path information.
Step 203, sending a data request message to the fast distributed file system FastDFS according to the target path information to obtain the target format file.
After the fast distributed file system FastDFS is interacted with the server, the target format file and a channel for searching the target format file are stored inside the fast distributed file system FastDFS, the channel can be opened by identifying target path information, and therefore the terminal device can obtain the target format file.
And step 204, generating chart data according to the target format file.
The chart data is used for representing the data in the target format file in a chart form, and the chart data can be in various forms, such as a clustered column chart, a line chart and the like, which is not limited in this embodiment; exemplarily, as shown in fig. 3, fig. 3 is a graph presentation form of table data in an Excel file with a file name of "achievement list", that is, the graph data, provided by an embodiment of the present application.
As can be seen, in this example, a target data file is first sent to a server, where the target data file is used to indicate a target format file, the target data file includes Excel file type table data, the target format file is a file formed by storing the Excel file type table data in a Json format, target path information is then obtained from the server, a data request message is then sent to a fast distributed file system FastDFS according to the target path information, the target format file is obtained, and finally, graph data is generated according to the target format file. Therefore, the process of chart display is automatically completed by the terminal equipment, the pressure of the server is effectively relieved, the system breakdown is avoided, and the user experience is improved.
In one possible example, the obtaining target path information from the server includes: sending target parameters corresponding to the target data files one to the server, wherein the target parameters carry a request instruction for acquiring the target path information; receiving the target path information from the server based on the request instruction.
The target parameters are automatically generated when the Excel file is created by the terminal equipment, and are equivalent to an identification tag, the target parameters carry request instructions for requesting to acquire the target path information, and after the server responds to the request instructions, the target path information corresponding to the target parameters one by one is returned to the terminal equipment.
Illustratively, when the terminal device creates the Excel file with the file name of "achievement list", a target parameter is automatically generated and marked as X, wherein the target parameter X carries a request instruction for acquiring the target path information. When the server receives the target parameter X, the target parameter X is analyzed based on the existing algorithm to obtain a request instruction, and the target path information is sent to the terminal equipment according to the request instruction.
Therefore, in this example, the server is accessed by the target parameter carrying the request instruction to obtain the target path information, and due to the existence of the corresponding relationship, the situation that data corresponds to errors when the program runs can be avoided, and the overall reliability of the scheme is improved.
In one possible example, the FastDFS includes a tracker and a plurality of storage nodes, and the sending a data request message to a FastDFS according to the target path information to obtain the target format file includes: sending the data request message to the tracker, wherein the data request message is used for indicating a storage node for storing the target format file and the address of the storage node for storing the target format file; and reading the storage node according to the address of the storage node to obtain the target format file.
Referring to fig. 4, fig. 4 is a flowchart illustrating an interaction flow between a terminal device and FastDFS according to an embodiment of the present disclosure, as shown in fig. 4, the interaction flow includes a terminal device 40, a tracker 41, and a storage node 42, and the specific interaction flow includes:
step 401, the terminal device 40 sends a data request message to the tracker 41;
step 402, after receiving the data request message, the tracker 41 searches for the storage node 42 storing the target format file;
step 403, the tracker 41 sends the address of the storage node 42 storing the target format file to the terminal device 40;
step 404, the terminal device 40 accesses the storage node 42 to read data by carrying the address of the storage node 42;
in step 405, the storage node 42 sends the object format file to the terminal device 40.
Wherein, in step 401, the data request message includes the target path information; specifically, in step 402, after receiving the data request message, the tracker 41 automatically parses the target path information to obtain information such as a storage node, a size, and a creation time of the target format file, and then selects a corresponding storage node to provide to the terminal device 40.
As can be seen, in this example, the interaction between the terminal device and the FastDFS enables the terminal device to obtain the target format file according to the target path information, thereby optimizing the data processing process.
In one possible example, when in an application scenario of concurrent access, the FastDFS selects to execute a preset policy according to the number of concurrent accesses and the size of the target format file requested to be obtained:
if the quantity of concurrent access does not reach a preset value, returning a first indication message, wherein the first indication message is used for indicating each terminal device to directly access the server to obtain the target format file;
if the quantity of concurrent access reaches a preset value, the file size of part of the target format files requested to be acquired is larger than a preset size, and the file size of part of the target format files requested to be acquired is smaller than the preset size, detecting the size relation between the access quantity that the file size of the part of the target format files requested to be acquired is larger than the preset size and the access quantity that the file size of the part of the target format files requested to be acquired is smaller than the preset size and the preset value:
if the file size of the partial target format file requested to be acquired is larger than the preset size and the access number of the partial target format file requested to be acquired is smaller than the preset size, returning a second indication message, wherein the second indication message is used for indicating that each terminal device requesting to acquire the target format file has the file size smaller than the preset size and directly accesses a server to acquire the target format file and indicating that each terminal device requesting to acquire the target format file has the file size larger than the preset size and accesses a FastDFS to acquire the target format file;
if the file size of the target format file requested to be acquired is smaller than the preset size and the access number of the target format file requested to be acquired is larger than the preset value, and the file size of the target format file requested to be acquired is larger than the preset size and the access number of the target format file requested to be acquired is smaller than the preset value, returning a third indication message, wherein the third indication message is used for indicating each terminal device which requests to acquire the target format file and has the file size larger than the preset size to directly access a server to acquire the target format file, and indicating each terminal device which requests to acquire the target format file and has the file size smaller than the preset size to access a FastDFS to acquire the target format file;
if the file size of the target format file partially requested to be acquired is larger than the access number of the preset size and the file size of the target format file partially requested to be acquired is smaller than the access number of the preset size, returning a fourth indication message, wherein the fourth indication message is used for indicating each terminal device to access the FastDFS to acquire the target format file;
and if the file size of the target format file requested to be acquired is larger than the access number of the preset size and the file size of the target format file requested to be acquired is smaller than the access number of the preset size, returning a fifth indication message, wherein the fifth indication message is used for indicating each terminal device which requests to acquire the target format file and has the file size larger than the preset size to directly access the server to acquire the target format file and indicating each terminal device which requests to acquire the target format file and has the file size smaller than the preset size to access the FastDFS to acquire the target format file.
Illustratively, if the preset value is 100, the preset size is 500MB, the number of accesses of the file size of the partial request-to-acquire object-format file greater than 500MB is x (i.e. corresponding to x terminal devices), and the number of accesses of the file size of the partial request-to-acquire object-format file less than 500MB is y (i.e. corresponding to y terminal devices), then:
if x + y is less than 100, returning a first indication message, wherein the first indication message is used for indicating all (x + y) terminal equipment to directly access the server to acquire the target format file;
if x + y >100, x >100 and y <100, returning a second indication message, wherein the second indication message is used for indicating the y terminal devices to directly access the server to acquire the target format file and indicating the x terminal devices to access the FastDFS to acquire the target format file;
if x + y >100 and x <100, y >100, returning a third indication message, wherein the third indication message is used for indicating the x terminal devices to directly access the server to obtain the target format file and indicating the y terminal devices to access the FastDFS to obtain the target format file;
if x + y >100 and x >100, y >100, returning a fourth indication message, wherein the fourth indication message is used for indicating all (x + y) terminal devices to access the FastDFS to acquire the target format file;
and if x + y >100 and x <100 and y <100, returning a fifth indication message, wherein the fifth indication message is used for indicating the x terminal devices to directly access the server to acquire the target format file and indicating the y terminal devices to access the FastDFS to acquire the target format file.
As can be seen, in this example, through the dynamic push policy of the FastDFS, different schemes are executed according to different situations in a concurrent access scenario, the time for completing the graph display is shortened to the shortest, the server is not in an overload state, and the user experience is greatly improved.
In a possible example, sending a data request message to a fast distributed file system FastDFS according to the target path information to obtain the target format file, specifically: sending a data request message carrying the target path information to a fast distributed file system FastDFS, and receiving a first message sent by the fast DFS in response to the data request message, wherein the first message comprises the target format file; the first message is generated when the FastDFS queries the target format file according to the target path information and detects that the file size of the target format file is greater than or equal to a preset size.
Further, the method further comprises: sending a data request message carrying the target path information to a fast distributed file system FastDFS, and receiving a second message sent by the fast DFS in response to the data request message, wherein the second message comprises graph data corresponding to the target format file; the second message is generated when the FastDFS queries the target format file according to the target path information and detects that the file size of the target format file is smaller than the preset size.
When the FastDFS detects that the file size of the target format file is smaller than the preset size, the target format file is processed in the local server to obtain the graph data, so that the terminal device can directly display the graph data after receiving the second message.
As can be seen, in this example, different schemes are selected and executed by detecting the file sizes of files in different target formats through FastDFS, so that the time for presenting the chart display result on the terminal device is reduced, and the user experience is improved.
In one possible example, the generating of chart data from the target format file includes: analyzing the target format file to obtain data information in the target data file; processing the data information based on a preset algorithm to obtain the chart data; and displaying the chart data.
The analysis of the target format file (Json format file) can be completed by using the existing algorithm, and the processing of the data information to obtain the chart data can also be realized by using the existing algorithm, which is not limited in the embodiment of the present application. Illustratively, the existing algorithms can be fused to form a code combination or an execution program, so that the terminal device can independently complete the process of chart data presentation according to the obtained data information.
Therefore, in the example, the existing algorithm is integrated into the terminal device, so that the terminal device can finish chart data display by itself, the pressure of the server is relieved, and the user experience is improved.
Referring to fig. 5, fig. 5 is a schematic flowchart of another data processing method provided in an embodiment of the present application, where the data processing method is applied to a server, and the server is in communication connection with a terminal device, as shown in the figure, the data processing method includes:
step 501, receiving a target data file from the terminal device.
The target data file includes Excel file type table data, which may be specifically referred to as an example in step 201, and is not described herein again.
Step 502, generating a target format file according to the target data file.
The target format file is a file formed by storing Excel file type table data in a Json format; illustratively, the table data in the Excel file can be processed according to the existing algorithm, stored in the Json format and stored, so that the subsequent interaction process with the FastDFS is more convenient.
Step 503, uploading the target format file to a fast distributed file system FastDFS to obtain target path information.
The target path information is used for indicating the target format file, the target format file is used for indicating chart data, and the chart data is used for representing data in the target format file in a chart form.
As can be seen, in this example, the target data file from the terminal device is received first, then the target data file is processed to obtain a target format file, and finally the target format file is uploaded to FastDFS to obtain target path information. By the method, the table data is stored in a Json format so as to be convenient for subsequent FastDFS and terminal equipment to store and read files, and after the target path information is obtained, the terminal equipment acquires the target path information according to the interaction with the terminal equipment so as to finish chart data display. Therefore, the operation of frequently creating and reading a database table in the prior art is abandoned, the pressure of the server is relieved, and in the scene of concurrent access, the server only needs to analyze the target data file once, so that the consumption of the system can be effectively reduced, the system crash is avoided, and the user experience is improved.
In one possible example, the FastDFS includes a tracker and a plurality of storage nodes, and the uploading the target format file to a fast distributed file system FastDFS to obtain target path information includes: sending a first response request to the tracker, the first response request being used to check whether there is a usable storage node; if the usable storage node exists, sending the target format file and a second response request to the usable storage node, wherein the second response request is used for storing the target format file, generating the target path information and sending the target path information to the server; and storing the target path information.
The storage system comprises one or more groups, files among the groups are independent, the file capacity accumulation of all the groups is the file capacity of the whole storage system, one group can comprise one or more storage servers, the files in the storage servers under one group are the same, and a plurality of storage servers in the group play roles of redundant backup and load balancing.
Referring to fig. 6, fig. 6 is a flowchart illustrating an interaction between a server and a FastDFS according to an embodiment of the present disclosure, as shown in fig. 6, the interaction includes a server 60, a tracker 61, and a storage node 62, and the specific interaction includes:
step 601, the server 60 sends a first response request to the tracker 61;
step 602, after receiving the first response request, the tracker 61 checks whether there is a usable storage node 62;
step 603, if there is a storage node 62 available, returning the address of the storage node 62 to the server 60;
step 604, the server 60 sends the object format file and the second response request to the storage node 62 according to the address of the storage node 62;
step 605, after receiving the target format file, the storage node 62 stores the target format file, and after receiving the second response request, generates target path information corresponding to the target format file one to one;
in step 606, the storage node 62 sends the target path information to the server 60.
Before step 601, automatically connecting a tracker after the storage system is started, informing information of each group, and keeping a periodic heartbeat to indicate that the storage system is in a working state; specifically, in step 601, when there is more than one tracker in the FastDFS, the server 60 can select any one tracker to interact with because the relationship between the various trackers is peer-to-peer; specifically, in step 603, when the tracker 61 checks that there are available storage nodes 62, it selects one of the storage nodes 62 to assign to the server 60, and returns an address; specifically, in step 605, after the storage node 62 receives the object-format file and the second response request, a data storage directory is automatically generated, a file _ id is generated, and the object-format file is written to a disk for storage, where the file _ id is the object path information, and the file _ id includes a storage path of the object-format file and a file name of the object-format file in the storage node 62.
When the storage node 62 writes the target format file into the disk, the writing is considered to be successful as long as the file is written into one of the storage servers, and after the writing of the storage server is completed, the file is synchronized to other storage servers in the storage node 62 by the FastDFS background thread, so that the file synchronization is realized.
Illustratively, if the group number of the storage node 62 in the storage system is 1, that is, group1, the storage disk is M00, the directory is 00, the file name is chengjidan, and the file suffix name is json, then the file _ id (target path information) returned to the server 60 may be: group1/M00/00/chengjidan.
As can be seen, in this example, the target format file is stored in the FastDFS through the interaction between the server and the FastDFS, and the server obtains the target path information, so that the data processing process is optimized.
In one possible example, after the storing the target path information, the method further comprises: acquiring target parameters corresponding to the target data files one by one from the terminal equipment, wherein the target parameters carry a request instruction for acquiring the target path information; analyzing the target parameter to obtain the request instruction; and sending the target path information to the terminal equipment according to the request instruction.
The target parameters are automatically generated when the terminal equipment creates an Excel file and are equivalent to an identification label, when the server receives the target parameters, a request instruction carried by the target parameters is obtained through analysis of the existing algorithm, and target path information corresponding to the target parameters one to one is sent to the terminal equipment according to the request instruction.
Exemplarily, when the terminal device creates an Excel file with the file name of "achievement list", a target parameter is automatically generated and marked as X, where the target parameter X carries a request instruction for acquiring the target path information. When the server receives the target parameter X, the server analyzes the target parameter X based on the existing algorithm to obtain a request instruction in the target parameter X, and sends the target path information to the terminal equipment according to the request instruction.
As can be seen, in this example, the request instruction is obtained by receiving and analyzing the target parameter from the terminal device, and the target path information is sent to the terminal device based on the request instruction, and because of the correspondence, a situation that a data correspondence error occurs during program operation can be avoided, and the overall reliability of the scheme is improved.
In accordance with the above-described embodiment, please refer to fig. 7a, fig. 7a is a block diagram of functional units of a data processing apparatus provided in an embodiment of the present application, the apparatus is applied to a terminal device, the terminal device is communicatively connected to a server, and as shown in fig. 7a, the data processing apparatus 70 includes: a first sending unit 701, configured to send a target data file to the server, where the target data file is used to indicate a target format file, the target data file includes Excel file type table data, and the target format file is a file formed by storing the Excel file type table data in a Json format; an obtaining unit 702, configured to obtain target path information from the server, where the target path information is used to indicate the target format file; a second sending unit 703, configured to send a data request message to a fast distributed file system FastDFS according to the target path information, to obtain the target format file; a generating unit 704, configured to generate graph data according to the target format file, where the graph data is used to represent data in the target format file in a graph form.
In one possible example, in the aspect of obtaining the target path information from the server, the obtaining unit 702 is specifically configured to: sending target parameters corresponding to the target data files one to the server, wherein the target parameters carry a request instruction for acquiring the target path information; receiving the target path information from the server based on the request instruction.
In a possible example, the FastDFS includes a tracker and a plurality of storage nodes, and in terms of sending a data request message to the FastDFS according to the target path information to obtain the target format file, the second sending unit 703 is specifically configured to: sending the data request message to the tracker, wherein the data request message is used for indicating a storage node for storing the target format file and the address of the storage node for storing the target format file; and reading the storage node according to the address of the storage node to obtain the target format file.
In a possible example, in the aspect of generating chart data according to the target format file, the generating unit 704 is specifically configured to: analyzing the target format file to obtain data information in the target data file; processing the data information based on a preset algorithm to obtain the chart data; and displaying the chart data.
It can be understood that, since the method embodiment and the apparatus embodiment are different presentation forms of the same technical concept, the content of the method embodiment portion in the present application should be synchronously adapted to the apparatus embodiment portion, and is not described herein again.
In the case of using an integrated unit, as shown in fig. 7b, fig. 7b is a block diagram of a functional unit of another data processing apparatus provided in an embodiment of the present application. In fig. 7b, the data processing device 71 comprises: a processing module 712 and a communication module 711. The processing module 712 is used for controlling and managing the actions of the data processing apparatus, for example, executing the steps of the first sending unit 701, the obtaining unit 702, the second sending unit 703 and the generating unit 704, and/or other processes for executing the techniques described herein. The communication module 711 is used to support interaction between the data processing apparatus and other devices. As shown in fig. 7b, the data processing apparatus may further comprise a memory module 713, the memory module 713 being configured to store program codes and data of the data processing apparatus.
The Processing module 712 may be a processor or a controller, such as a Central Processing Unit (CPU), a general purpose processor, a Digital Signal Processor (DSP), an ASIC, an FPGA or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof. Which may implement or perform the various illustrative logical blocks, modules, and circuits described in connection with the disclosure. The processor may also be a combination of computing functions, e.g., comprising one or more microprocessors, DSPs, and microprocessors, among others. The communication module 711 may be a transceiver, an RF circuit or communication interface, etc. The memory module 713 may be a memory.
All relevant contents of each scene related to the method embodiment may be referred to the functional description of the corresponding functional module, and are not described herein again. The data processing device 71 can perform the data processing method shown in fig. 2.
In accordance with the above-described embodiment, please refer to fig. 8a, fig. 8a is a block diagram of functional units of a data processing apparatus provided in an embodiment of the present application, the apparatus is applied to a server, the server is communicatively connected to a terminal device, as shown in fig. 8a, the data processing apparatus 80 includes: a receiving unit 801, configured to receive a target data file from the terminal device, where the target data file includes Excel file type table data; a generating unit 802, configured to generate a target format file according to the target data file, where the target format file is a file formed by storing the target data file in a Json format; an uploading unit 803, configured to upload the target format file to a fast distributed file system FastDFS, to obtain target path information, where the target path information is used to indicate the target format file, the target format file is used to indicate graph data, and the graph data is used to represent data in the target format file in a graph form.
In a possible example, the FastDFS includes a tracker and a plurality of storage nodes, and in terms of uploading the target format file to the FastDFS to obtain target path information, the uploading unit 803 is specifically configured to: sending a first response request to the tracker, the first response request being used to check whether there is a usable storage node; if the usable storage node exists, sending the target format file and a second response request to the usable storage node, wherein the second response request is used for storing the target format file, generating the target path information and sending the target path information to the server; and storing the target path information.
In one possible example, after said storing the target path information, the data processing apparatus 80 is further configured to: acquiring target parameters corresponding to the target data files one by one from the terminal equipment, wherein the target parameters carry a request instruction for acquiring the target path information; analyzing the target parameter to obtain the request instruction; and sending the target path information to the terminal equipment according to the request instruction.
It can be understood that, since the method embodiment and the apparatus embodiment are different presentation forms of the same technical concept, the content of the method embodiment portion in the present application should be synchronously adapted to the apparatus embodiment portion, and is not described herein again.
In the case of using an integrated unit, as shown in fig. 8b, fig. 8b is a block diagram of a functional unit of another data processing apparatus provided in an embodiment of the present application. In fig. 8b, the data processing device 81 comprises: a processing module 812 and a communication module 811. The processing module 812 is used for controlling and managing actions of the data processing apparatus, for example, executing steps of the receiving unit 801, the generating unit 802, and the uploading unit 803, and/or other processes for performing the techniques described herein. The communication module 811 is used to support interaction between the data processing apparatus and other devices. As shown in fig. 8b, the data processing apparatus may further comprise a storage module 813, the storage module 813 being used for storing program codes and data of the data processing apparatus.
The Processing module 812 may be a processor or a controller, such as a Central Processing Unit (CPU), a general-purpose processor, a Digital Signal Processor (DSP), an ASIC, an FPGA or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof. Which may implement or perform the various illustrative logical blocks, modules, and circuits described in connection with the disclosure. The processor may also be a combination of computing functions, e.g., comprising one or more microprocessors, DSPs, and microprocessors, among others. The communication module 811 may be a transceiver, an RF circuit or a communication interface, etc. The storage module 813 may be a memory.
All relevant contents of each scene related to the method embodiment may be referred to the functional description of the corresponding functional module, and are not described herein again. The data processing apparatus 81 can perform the data processing method shown in fig. 5.
The above embodiments may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, the above-described embodiments may be implemented in whole or in part in the form of a computer program product. The computer program product comprises one or more computer instructions or computer programs. The procedures or functions according to the embodiments of the present application are wholly or partially generated when the computer instructions or the computer program are loaded or executed on a computer. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire or wirelessly. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains one or more collections of available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium. The semiconductor medium may be a solid state disk.
Fig. 9 is a block diagram of an electronic device according to an embodiment of the present application. As shown in fig. 9, electronic device 900 may include one or more of the following components: a processor 901, a memory 902 coupled to the processor 901, wherein the memory 902 may store one or more computer programs that may be configured to implement the methods described in the embodiments above when executed by the one or more processors 901. The electronic device 900 may be the terminal device and/or the server described above.
Processor 901 may include one or more processing cores. The processor 901 interfaces with various parts throughout the electronic device 900 using various interfaces and lines to perform various functions of the electronic device 900 and process data by executing or performing instructions, programs, code sets, or instruction sets stored in the memory 902 and invoking data stored in the memory 902. Alternatively, the processor 901 may be implemented in hardware using at least one of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 901 may integrate one or a combination of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing display content; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 901, but may be implemented by a communication chip.
The Memory 902 may include a Random Access Memory (RAM) or a Read-Only Memory (ROM). The memory 902 may be used to store instructions, programs, code, sets of codes, or sets of instructions. The memory 902 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing the various method embodiments described above, and the like. The stored data area may also store data created during use of the electronic device 900, and the like.
It is understood that the electronic device 900 may include more or less structural elements than those shown in the above structural block diagrams, for example, a power module, a physical button, a WiFi (Wireless Fidelity) module, a speaker, a bluetooth module, a sensor, etc., and is not limited thereto.
Embodiments of the present application also provide a computer storage medium, where the computer storage medium stores a computer program for electronic data exchange, and the computer program enables a computer to execute part or all of the steps of any one of the methods described in the above method embodiments, and the computer includes a terminal device and/or a server.
Embodiments of the present application also provide a computer program product comprising a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps of any of the methods as described in the above method embodiments. The computer program product may be a software installation package, the computer comprising a terminal device and/or a server.
It should be understood that, in the various embodiments of the present application, the sequence numbers of the above-mentioned processes do not mean the execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.
In the several embodiments provided in the present application, it should be understood that the disclosed method, apparatus and system may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative; for example, the division of the unit is only a logic function division, and there may be another division manner in actual implementation; for example, various elements or components may be combined or may be integrated in another system or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately and physically included, or two or more units may be integrated into one unit. The integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
The integrated unit implemented in the form of a software functional unit may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute some steps of the methods according to the embodiments of the present invention. And the aforementioned storage medium includes: u disk, removable hard disk, magnetic disk, optical disk, volatile memory or non-volatile memory. The non-volatile memory may be a read-only memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an electrically Erasable EPROM (EEPROM), or a flash memory. Volatile memory can be Random Access Memory (RAM), which acts as external cache memory. By way of example and not limitation, many forms of Random Access Memory (RAM) are available, such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), synchronous SDRAM (SLDRAM), and direct bus RAM (DR RAM) among various media that can store program code.
Although the present invention is disclosed above, the present invention is not limited thereto. Various changes and modifications can be easily made by those skilled in the art without departing from the spirit and scope of the present invention, and it is within the scope of the present invention to include different functions, combination of implementation steps, software and hardware implementations.

Claims (11)

1. A data processing method is applied to a terminal device, the terminal device is in communication connection with a server, and the method comprises the following steps:
sending a target data file to the server, wherein the target data file is used for indicating a target format file, the target data file comprises Excel file type table data, and the target format file is formed by storing the Excel file type table data in a Json format;
acquiring target path information from the server, wherein the target path information is used for indicating the target format file;
if the quantity of concurrent access does not reach a preset value, accessing the server to acquire the target format file according to a first indication message;
if the number of concurrent accesses reaches the preset value, the file size of part of the target format files requested to be acquired is larger than the preset size, and the file size of part of the target format files requested to be acquired is smaller than the preset size, detecting the size relationship between the number of accesses of the part of the target format files requested to be acquired, which is larger than the preset size, and the number of accesses of the part of the target format files requested to be acquired, which is smaller than the preset size, and the preset value:
if the file size of the partial target format file requested to be acquired is larger than the preset value and the file size of the partial target format file requested to be acquired is smaller than the preset value, each terminal device requested to be acquired accesses the server to acquire the target format file according to a second indication message and each terminal device requested to be acquired has the file size larger than the preset size and sends a data request message to a fast distributed file system FastDFS according to the second indication message and the target path information to acquire the target format file;
if the file size of the target format file requested to be acquired is smaller than the preset value and the access number of the target format file requested to be acquired is larger than the preset value, and the file size of the target format file requested to be acquired is larger than the preset value and is smaller than the preset value, each terminal device requested to be acquired accesses the server to acquire the target format file according to a third indication message and each terminal device requested to acquire the target format file according to the target path information and sends a data request message to a fast distributed file system FastDFS according to the third indication message and the target path information to acquire the target format file;
if the file size of the target format file partially requested to be acquired is larger than the access number of the preset size and the file size of the target format file partially requested to be acquired is smaller than the access number of the preset size, the data request message is sent to a fast distributed file system FastDFS according to a fourth indication message and the target path information to obtain the target format file;
if the file size of the part of target format files requested to be acquired is larger than the access number of the preset size, and the file size of the part of target format files requested to be acquired is smaller than the access number of the preset size, all the terminal devices access the server to acquire the target format files according to a fifth indication message, and all the terminal devices request the file size of the acquired target format files to be smaller than the preset size send data request messages to a fast distributed file system FastDFS according to the fifth indication message and the target path information to acquire the target format files;
generating graph data according to the target format file, wherein the graph data is used for representing the data in the target format file in a graph form.
2. The method of claim 1, wherein the obtaining the target path information from the server comprises:
sending target parameters corresponding to the target data files one to the server, wherein the target parameters carry a request instruction for acquiring the target path information;
receiving the target path information from the server based on the request instruction.
3. The method according to claim 1, wherein the FastDFS comprises a tracker and a plurality of storage nodes, and the sending a data request message to the FastDFS according to the target path information to obtain the target format file comprises:
sending the data request message to the tracker, wherein the data request message is used for indicating a storage node for storing the target format file and the address of the storage node for storing the target format file;
and reading the storage node according to the address of the storage node to obtain the target format file.
4. The method of claim 1, wherein generating graph data from the object format file comprises:
analyzing the target format file to obtain data information in the target data file;
processing the data information based on a preset algorithm to obtain the chart data;
and displaying the chart data.
5. A data processing method is applied to a server which is in communication connection with a terminal device, and comprises the following steps:
receiving a target data file from the terminal equipment, wherein the target data file comprises Excel file type table data;
generating a target format file according to the target data file, wherein the target format file is a file formed by storing Excel file type table data in a Json format;
uploading the target format file to a fast distributed file system (FastDFS) to obtain target path information, wherein the target path information is used for indicating the target format file, the target format file is used for indicating graph data, and the graph data is used for representing data in the target format file in a graph form;
if the quantity of the concurrent access does not reach a preset value, the target format file is sent to the terminal equipment;
if the number of concurrent accesses reaches the preset value, the number of accesses of the target format file with the size larger than the preset size is larger than the preset value, and the number of accesses of the target format file with the size smaller than the preset size is smaller than the preset value, the target format file is sent to the terminal equipment with the size smaller than the preset size;
if the number of concurrent accesses reaches the preset value, the number of accesses of the target format file with the size smaller than the preset size is larger than the preset value, and the number of accesses of the target format file with the size larger than the preset size is smaller than the preset value, the target format file is sent to the terminal equipment with the size larger than the preset size;
and if the number of concurrent accesses reaches the preset value, and the number of accesses of the part of the target format files requested to be acquired is larger than the preset number, and the number of accesses of the part of the target format files requested to be acquired is smaller than the preset number, the target format files are sent to the terminal equipment of which the file sizes of the part of the target format files requested to be acquired are larger than the preset size.
6. The method according to claim 5, wherein the FastDFS comprises a tracker and a plurality of storage nodes, and wherein uploading the target format file into the fast distributed file system FastDFS to obtain target path information comprises:
sending a first response request to the tracker, the first response request being used to check whether there is a usable storage node;
if the usable storage node exists, sending the target format file and a second response request to the usable storage node, wherein the second response request is used for storing the target format file, generating the target path information and sending the target path information to the server;
and storing the target path information.
7. The method of claim 6, wherein after said storing said target path information, said method further comprises:
acquiring target parameters corresponding to the target data files one by one from the terminal equipment, wherein the target parameters carry a request instruction for acquiring the target path information;
analyzing the target parameter to obtain the request instruction;
and sending the target path information to the terminal equipment according to the request instruction.
8. A data processing device is applied to a terminal device, the terminal device is in communication connection with a server, and the device comprises:
the system comprises a first sending unit, a second sending unit and a third sending unit, wherein the first sending unit is used for sending a target data file to the server, the target data file is used for indicating a target format file, the target data file comprises Excel file type table data, and the target format file is formed by storing the Excel file type table data in a Json format;
an obtaining unit, configured to obtain target path information from the server, where the target path information is used to indicate the target format file;
the second sending unit is used for accessing the server to acquire the target format file according to the first indication message if the quantity of concurrent access does not reach a preset value; if the number of concurrent accesses reaches the preset value, the file size of part of the target format files requested to be acquired is larger than the preset size, and the file size of part of the target format files requested to be acquired is smaller than the preset size, detecting the size relationship between the number of accesses of the part of the target format files requested to be acquired, which is larger than the preset size, and the number of accesses of the part of the target format files requested to be acquired, which is smaller than the preset size, and the preset value: if the file size of the partial target format file requested to be acquired is larger than the preset value and the file size of the partial target format file requested to be acquired is smaller than the preset value, each terminal device requested to be acquired accesses the server to acquire the target format file according to a second indication message and each terminal device requested to be acquired has the file size larger than the preset size and sends a data request message to a fast distributed file system FastDFS according to the second indication message and the target path information to acquire the target format file; if the file size of the target format file requested to be acquired is smaller than the preset value and the access number of the target format file requested to be acquired is larger than the preset value, and the file size of the target format file requested to be acquired is larger than the preset value and is smaller than the preset value, each terminal device requested to be acquired accesses the server to acquire the target format file according to a third indication message and each terminal device requested to acquire the target format file according to the target path information and sends a data request message to a fast distributed file system FastDFS according to the third indication message and the target path information to acquire the target format file; if the file size of the target format file partially requested to be acquired is larger than the access number of the preset size and the file size of the target format file partially requested to be acquired is smaller than the access number of the preset size, the data request message is sent to a fast distributed file system FastDFS according to a fourth indication message and the target path information to obtain the target format file; if the file size of the target format file requested to be acquired in part is larger than the access number of the preset size and the file size of the target format file requested to be acquired in part is smaller than the access number of the preset size, all the terminal devices requesting to acquire the target format file access to the server according to a fifth indication message and all the terminal devices requesting to acquire the target format file and the file size of the target format file smaller than the preset size send data request messages to a fast distributed file system FastDFS according to the fifth indication message and the target path information to acquire the target format file;
and the generating unit is used for generating chart data according to the target format file, and the chart data is used for representing the data in the target format file in a chart form.
9. A data processing apparatus, applied to a server, the server being in communication connection with a terminal device, the apparatus comprising:
the receiving unit is used for receiving a target data file from the terminal equipment, wherein the target data file comprises Excel file type table data;
the generating unit is used for generating a target format file according to the target data file, wherein the target format file is formed by storing the target data file in a Json format;
the uploading unit is used for uploading the target format file to a fast distributed file system FastDFS to obtain target path information, wherein the target path information is used for indicating the target format file, the target format file is used for indicating graph data, the graph data is used for representing data in the target format file in a graph form and is used for sending the target format file to the terminal equipment if the number of concurrent accesses does not reach a preset value; if the number of concurrent accesses reaches the preset value, the number of accesses of the target format file with the size larger than the preset size is larger than the preset value, and the number of accesses of the target format file with the size smaller than the preset size is smaller than the preset value, the target format file is sent to the terminal equipment with the size smaller than the preset size; if the number of concurrent accesses reaches the preset value, the number of accesses of the target format file with the size smaller than the preset size is larger than the preset value, and the number of accesses of the target format file with the size larger than the preset size is smaller than the preset value, the target format file is sent to the terminal equipment with the size larger than the preset size; and if the number of concurrent accesses reaches the preset value, the number of accesses of the target format file with the size larger than the preset size in part of the requests and the number of accesses of the target format file with the size smaller than the preset size in part of the requests are both smaller than the preset value, the target format file is sent to the terminal equipment with the size larger than the preset size in part of the requests.
10. An electronic device comprising a processor, memory, a communication interface, and one or more programs stored in the memory and configured to be executed by the processor, the programs including instructions for performing the steps in the method of any of claims 1-4 or 5-7.
11. A computer-readable storage medium, characterized in that a computer program for electronic data exchange is stored, wherein the computer program causes a computer to perform the method according to any of the claims 1-4 or claims 5-7.
CN202210084036.7A 2022-01-25 2022-01-25 Data processing method and related device Active CN114116656B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210084036.7A CN114116656B (en) 2022-01-25 2022-01-25 Data processing method and related device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210084036.7A CN114116656B (en) 2022-01-25 2022-01-25 Data processing method and related device

Publications (2)

Publication Number Publication Date
CN114116656A CN114116656A (en) 2022-03-01
CN114116656B true CN114116656B (en) 2022-06-21

Family

ID=80360986

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210084036.7A Active CN114116656B (en) 2022-01-25 2022-01-25 Data processing method and related device

Country Status (1)

Country Link
CN (1) CN114116656B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116894014B (en) * 2023-09-08 2024-02-27 荣耀终端有限公司 Cache updating method, server, terminal equipment and chip system

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103646016A (en) * 2013-12-30 2014-03-19 金蝶软件(中国)有限公司 Implementation method of user-defined financial statement and server
KR20180004632A (en) * 2016-07-04 2018-01-12 한다시스템 주식회사 Method and computer program for integrating spread sheet with database

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10380778B2 (en) * 2016-12-09 2019-08-13 Dropbox, Inc. Automated chart generation within a document generation application using heuristic model with predefined data types
CN112632165A (en) * 2020-12-22 2021-04-09 平安普惠企业管理有限公司 Page form export EXCEL method and device, computer equipment and storage medium

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103646016A (en) * 2013-12-30 2014-03-19 金蝶软件(中国)有限公司 Implementation method of user-defined financial statement and server
KR20180004632A (en) * 2016-07-04 2018-01-12 한다시스템 주식회사 Method and computer program for integrating spread sheet with database

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于分布式文件系统FastDFS的图片服务器件设计与应用;郭建国;《中国优秀博硕士学位论文全文数据库(硕士) 信息科技辑》;20160315;第I139-575页 *

Also Published As

Publication number Publication date
CN114116656A (en) 2022-03-01

Similar Documents

Publication Publication Date Title
CN105740330B (en) Method and device for displaying data in paging mode
CN107153644B (en) Data synchronization method and device
US12001450B2 (en) Distributed table storage processing method, device and system
US20170153909A1 (en) Methods and Devices for Acquiring Data Using Virtual Machine and Host Machine
US20200204688A1 (en) Picture book sharing method and apparatus and system using the same
CN115964319A (en) Data processing method for remote direct memory access and related product
CN114116656B (en) Data processing method and related device
CN110737856A (en) page acquisition method, device and system
CN111783005B (en) Method, device and system for displaying web page, computer system and medium
CN110795920B (en) Document generation method and device
CN113297267A (en) Data caching and task processing method, device, equipment and storage medium
US20140331117A1 (en) Application-based dependency graph
US9787755B2 (en) Method and device for browsing network data, and storage medium
CN110837499B (en) Data access processing method, device, electronic equipment and storage medium
CN111783010A (en) Webpage blank page monitoring method, device, terminal and storage medium
CN105144073A (en) Removable storage device identity and configuration information
EP4390646A1 (en) Data processing method in distributed system, and related system
CN112783548B (en) Access method and device of network system
CN108846141B (en) Offline cache loading method and device
CN115794806A (en) Gridding processing system, method and device for financial data and computing equipment
CN111680014A (en) Shared file acquisition method and device, electronic equipment and storage medium
US20240220334A1 (en) Data processing method in distributed system, and related system
CN113986134B (en) Method for storing data, method and device for reading data
WO2021189253A1 (en) Data transmission method and apparatus
CN116775510B (en) Data access method, device, server and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant