CN115174691A - Big data loading method, device, equipment and medium based on page request - Google Patents
Big data loading method, device, equipment and medium based on page request Download PDFInfo
- Publication number
- CN115174691A CN115174691A CN202210715257.XA CN202210715257A CN115174691A CN 115174691 A CN115174691 A CN 115174691A CN 202210715257 A CN202210715257 A CN 202210715257A CN 115174691 A CN115174691 A CN 115174691A
- Authority
- CN
- China
- Prior art keywords
- data
- big data
- request
- preset
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/957—Browsing optimisation, e.g. caching or content distillation
- G06F16/9574—Browsing optimisation, e.g. caching or content distillation of access to content, e.g. by caching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/141—Setup of application sessions
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention relates to a data processing technology, and discloses a big data loading method based on a page request, which comprises the following steps: monitoring a big data selection request initiated by a client user; screening a preset server side meeting preset conditions to process the big data request, receiving target data returned by the screened server side, and caching the target data; creating a long link between the client and the server; when a big data viewing request initiated by the client user is monitored, acquiring related data display interface information according to the big data viewing request; and sending the data display interface information to the server by using the long link, and receiving and displaying the data after the server assembles the target data according to the data display interface information. The invention also provides a device, equipment and a medium for loading the big data based on the page request. The invention can improve the efficiency of loading big data based on the page request.
Description
Technical Field
The invention relates to the technical field of data processing, in particular to a big data loading method and device based on a page request, electronic equipment and a computer readable storage medium.
Background
With the rapid development of economy and science and technology, the application of data reports is very common. At present, besides the common PC data report display, more and more users choose to view the data report through mobile terminals such as mobile phones and ipads.
With the continuous expansion or iteration of the business data, the business data becomes more and more huge, and the corresponding business data report is more and more complex, for example, one report display page may contain data of a chart module, data of a pie chart module, or data of a histogram module. For the situation of the big data service report, a data loading request is initiated by a client such as a PC end or a mobile end conventionally, and the server can not meet the timeliness requirement of big data loading in a manner that the server directly obtains data from a database according to the data loading request and returns the data to the client.
Disclosure of Invention
The invention provides a big data loading method and device based on a page request, electronic equipment and a computer readable storage medium, and mainly aims to improve the big data loading efficiency based on the page request.
In order to achieve the above object, the big data loading method based on page request provided by the present invention includes:
monitoring a big data selection request initiated by a client user;
screening a preset server side meeting preset conditions to process the big data request, receiving target data returned by the server side meeting the preset conditions, and storing the target data in a preset cache region;
creating a long link between the client and the server;
when a big data viewing request initiated by the client user is monitored, acquiring related data display interface information according to the big data viewing request;
and sending the data display interface information to the server side meeting the preset condition by using the long link, and receiving and displaying the data assembled by the server side according to the data display interface information.
Optionally, the monitoring a big data selection request initiated by a client user includes:
intercepting all requests initiated by the client user;
sequentially analyzing a request identifier contained in each request;
and taking the request corresponding to the request identification matched with the preset big data request identification as the big data selection request.
Optionally, the screening a preset server that meets a preset condition to process the big data request includes:
acquiring a weight value corresponding to each preset server;
sequencing all the preset server sides according to the weight values;
polling corresponding server ends in sequence according to the sequence to obtain the server ends meeting the preset conditions;
and sending the big data selection request to a server end meeting the preset condition to load related service data.
Optionally, the storing the target data in a preset buffer area includes:
acquiring address information of the target data;
and storing the address information into the preset cache region.
Optionally, the obtaining, according to the big data viewing request, related data display interface information includes:
analyzing the big data viewing request to obtain a corresponding data display interface ID;
dividing the calling priority corresponding to each data display interface ID according to a preset interface calling relation table;
and forming the data display interface information by the calling priority and the corresponding data display interface ID.
Optionally, the dividing, according to a preset interface call relation table, the call priority corresponding to each data display interface ID includes:
sequentially selecting one data display interface ID as a vertex, and constructing an interface binary tree corresponding to the vertex according to the preset interface calling relation table;
converting all the interface binary trees into interface forests;
and taking the depth of each node in the interface forest as the calling priority of the interface ID of the corresponding node.
Optionally, after the creating of the long connection between the client and the server, the method further includes:
one end of the client or the server is selected randomly at regular time as a sender, and the other end of the client or the server is selected as a receiver;
sending a pre-constructed heartbeat packet from the sender to the receiver;
and monitoring a response message returned by the receiver to the sender.
In order to solve the above problem, the present invention further provides a device for loading big data based on a page request, where the device includes:
the big data selection request acquisition module is used for monitoring a big data selection request initiated by a client user;
the server screening module is used for screening a preset server side meeting preset conditions to process the big data request, receiving target data returned by the server side meeting the preset conditions, and storing the target data in a preset cache region;
the long link establishing module is used for establishing a long link between the client and the server;
the data display interface acquisition module is used for acquiring related data display interface information according to a big data viewing request initiated by the client user when the big data viewing request is monitored;
and the assembly data acquisition module is used for sending the data display interface information to the server side meeting the preset condition by using the long link, and receiving and displaying the data after the server side assembles the target data according to the data display interface information.
In order to solve the above problem, the present invention also provides an electronic device, including:
a memory storing at least one computer program; and
and the processor executes the program stored in the memory to realize the big data loading method based on the page request.
In order to solve the above problem, the present invention further provides a computer-readable storage medium, in which at least one computer program is stored, and the at least one computer program is executed by a processor in an electronic device to implement the above big data loading method based on page requests.
The embodiment of the invention can ensure the processing timeliness of the big data request by screening the big data request initiated by the server end processing client end user meeting the preset condition, meanwhile, the obtained target data is cached for subsequent processing and use, so that frequent data access operation can be reduced, furthermore, a long link between the client end and the server end is established, data display interface information is sent to the server end by using the long link, the data assembled by the server end according to the data display interface information is received and displayed, the long-term effective communication connection between the client end and the server end can be ensured by the long link, the communication link between the client end and the server end is frequently established when the big data viewing request is not required to be processed each time, the system overhead is reduced, and the big data loading efficiency is improved.
Drawings
Fig. 1 is a schematic flowchart of a big data loading method based on a page request according to an embodiment of the present invention;
fig. 2 is a schematic detailed implementation flowchart of one step in the big data loading method based on the page request according to an embodiment of the present invention;
fig. 3 is a schematic detailed implementation flowchart of one step in a big data loading method based on a page request according to an embodiment of the present invention;
fig. 4 is a schematic detailed implementation flowchart of one step in the big data loading method based on the page request according to an embodiment of the present invention;
FIG. 5 is a functional block diagram of a big data loading apparatus based on page requests according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of an electronic device for implementing the big data loading method based on the page request according to an embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The embodiment of the application provides a big data loading method based on a page request. The execution subject of the big data loading method based on the page request includes but is not limited to at least one of electronic devices such as a server and a terminal which can be configured to execute the method provided by the embodiment of the application. In other words, the big data loading method based on page requests may be performed by software or hardware installed in a terminal device or a server device, and the software may be a block chain platform. The server side can be an independent server, and can also be a cloud server providing basic cloud computing services such as cloud service, a cloud database, cloud computing, cloud functions, cloud storage, network service, cloud communication, middleware service, domain name service, security service, content Delivery Network (CDN), big data and an artificial intelligence platform.
Fig. 1 is a schematic flowchart of a big data loading method based on a page request according to an embodiment of the present invention. In this embodiment, the method for loading big data based on a page request includes:
s1, monitoring a big data selection request initiated by a client user;
in the embodiment of the invention, the client can be a mobile client such as a mobile phone and a tablet, and can also be a client such as a computer. The user can select to install the related service APP at the client side, and view the related service report information through the service APP. When a user needs to check report information in a certain service field, a page of a service APP can be opened, a specified node or button is clicked, and the big data selection request is sent.
In the embodiment of the invention, a user may generate various types of data requests, such as a login request, a page access request, a data download request, and the like, in the process of using the service APP. Therefore, it is necessary to quickly identify which requests are big data selection requests from among many requests initiated by users.
In detail, the monitoring a big data selection request initiated by a client user includes: intercepting all requests initiated by the client user; sequentially analyzing a request identifier contained in each request; and taking the request corresponding to the request identifier matched with the preset big data request identifier as the big data selection request.
In the embodiment of the invention, the request identifier can be set in a relevant manner according to the request type provided by the actual service, each request type corresponds to a unique request identifier, and the preset big data request identifier is one type.
In another alternative embodiment of the present invention, a mapping relationship between each request identifier and the corresponding request type may be defined by using a data table.
In an optional embodiment of the present invention, the big data request identifier may be set to a specified node, data module, or button in a certain page of the service APP, and when a user clicks the node, data module, or button, a corresponding big data request identifier is obtained and added to a corresponding request message.
S2, screening a preset server side meeting preset conditions to process the big data request, receiving target data returned by the server side meeting the preset conditions, and storing the target data in a preset cache region;
in the embodiment of the present invention, the preset server side refers to a server side providing public capability services such as process scheduling and database management for the business APP, as compared with the client side.
In the embodiment of the invention, in order to further improve the efficiency of big data acquisition, related preset server-side loading service data can be called based on the principle of load balancing.
In detail, referring to fig. 2, the screening a preset server that meets a preset condition to process the big data request includes:
s21, obtaining a weight value corresponding to each preset server side;
s22, sorting all the preset server sides according to the weight values;
s23, polling corresponding server ends in sequence according to the sequence to obtain the server ends meeting the preset conditions;
and S24, sending the big data selection request to a server side meeting the preset condition to load related service data.
In the embodiment of the present invention, the weight value corresponding to each preset server side may be set according to the processing capability of each server side, and the stronger the processing capability, the higher the corresponding weight value is. The processing capacity of each server is usually related to the specific software and hardware configuration condition and the condition of average service request quantity.
In the embodiment of the present invention, the preset condition may be set according to actual service needs, and may be that the daily average service request amount of the server end is not less than a preset daily service request amount threshold, or that the CPU utilization rate of the server end is not greater than a preset CPU utilization rate threshold.
In the embodiment of the invention, the preset server side is polled according to the high and low sequence of the weight value, so that the server with strong processing capability can be preferentially ensured to preferentially process the corresponding big data selection request when meeting the preset condition, and the big data processing efficiency is improved.
It can be understood that, generally, the target data amount corresponding to the big data selection request is larger, and if there are more big data selection requests, the correspondingly required buffer space is also larger, which may cause buffer pressure and occupy the memory space, therefore, preferably, a mode of only storing the address corresponding to the target data may be adopted instead of a mode of directly storing data.
In detail, the storing the target data into a preset buffer area includes: acquiring address information of the target data; and storing the address information into the preset cache region.
According to the embodiment of the invention, the target data corresponding to the big data selection request or the address information of the target data is stored in the cache region in advance, so that the method and the device can be used for subsequent related big data processing operation, frequent access or big data acquisition is not needed, and the system overhead is reduced.
S3, establishing a long link between the client and the server;
in the embodiment of the present invention, the long link is referred to as a short link, and the long link refers to that after the link is established between the client and the server, the link is not closed immediately after the link is used, but the link is kept in an available state, and if the client needs to communicate with the server next time, the long link is immediately started for data communication.
In the embodiment of the present invention, a long link between the client and the server may be created by using a socket technology.
In the embodiment of the present invention, in order to keep the state of the long link as the available state all the time, the state of the long link needs to be monitored periodically.
In detail, after the creating of the long link between the client and the server, the method may further include: one end of the client or the server is selected as a sender at regular time and randomly, and the other end of the client or the server is selected as a receiver; sending a pre-constructed heartbeat packet from the sender to the receiver; and monitoring a response message returned to the sender by the receiver.
In the embodiment of the present invention, if the response message is not monitored within a preset time period, it indicates that the long link has failed, and the long link needs to be reestablished.
In the embodiment of the invention, the long-chain connection between the client and the server is established, so that a special long-acting link between the client and the server can be formed, and the link between the client and the server does not need to be established frequently every time the communication between the client and the server is carried out, thereby improving the data communication efficiency between the client and the server.
S4, when a big data viewing request initiated by the client user is monitored, acquiring related data display interface information according to the big data viewing request;
in the embodiment of the invention, when a user accesses a certain data display page of the service APP on the client, the user can click a corresponding data viewing mode to initiate the big data viewing request according to a page prompt, wherein the data viewing mode includes but is not limited to a histogram mode, a pie chart mode, a chart mode and the like.
In detail, referring to fig. 3, the obtaining of the related data display interface information according to the big data viewing request includes:
s41, analyzing the big data viewing request to obtain a corresponding data display interface ID;
s42, dividing the calling priority corresponding to each data display interface ID according to a preset interface calling relation table;
s43, the calling priority and the corresponding data display interface ID form the data display interface information.
In the embodiment of the present invention, the preset interface call relationship table refers to a call and called relationship between data display interfaces defined according to a business actual condition, and a call priority of each data display interface can be determined according to the call and called relationship, for example, an interface a is called by an interface B, and an interface C can realize a business effect only by calling the interface B, so that in a call chain among the interface a, the interface B, and the interface C, the call priority of the interface a is the highest, the call priority of the interface B is the next, and the call priority of the interface C is the lowest.
In an optional embodiment of the present invention, a binary tree of the call relationship of each data display interface may be constructed according to the preset interface call relationship table, and then the call priority of each data display interface is determined by using the binary tree.
In detail, referring to fig. 4, the dividing the call priority corresponding to each data presentation interface ID according to a preset interface call relation table includes:
s421, sequentially selecting one data display interface ID as a vertex, and constructing an interface binary tree corresponding to the vertex according to the preset interface calling relation table;
s422, converting all the interface binary trees into interface forests;
and S423, taking the depth of each node in the interface forest as the calling priority of the interface ID of the corresponding node.
In the embodiment of the invention, in the interface forest, the greater the depth of the node is, the higher the calling priority of the interface ID corresponding to the corresponding node is.
In the embodiment of the invention, the data display interface information can be utilized to realize the organization and the encapsulation of the target data so as to meet the requirements of the client user.
And S5, sending the data display interface information to the server side meeting the preset condition by using the long link, and receiving and displaying the data assembled by the server side according to the data display interface information.
In the embodiment of the invention, the communication between the client and the server can be realized by using the long link, and the server assembles the target data pre-stored in the cache region according to the data display interface information.
Preferably, the server side can call the priority according to the interface carried in the data display interface information, and preferentially assemble the target data according to the data display interface with the highest priority, so that the rationality of data processing is guaranteed.
According to the embodiment of the invention, the big data request initiated by the client-side user is processed by screening the server-side meeting the preset conditions, so that the processing timeliness of the big data request can be ensured, the obtained target data is cached for subsequent processing and use, frequent data access operation can be reduced, furthermore, a long link between the client-side and the server-side is established, the long link is used for sending data display interface information to the server-side, the data assembled by the server-side according to the data display interface information is received and displayed, the long-term effective communication connection between the client-side and the server-side can be ensured through the long link, the communication link between the client-side and the server-side is not required to be established frequently when the big data viewing request is not processed each time, the system overhead is reduced, and the big data loading efficiency is improved.
Fig. 5 is a functional block diagram of a big data loading apparatus based on page requests according to an embodiment of the present invention.
The big data loading device 100 based on the page request of the invention can be installed in an electronic device. According to the implemented functions, the big data loading device 100 based on the page request may include a big data selection request obtaining module 101, a server screening module 102, a long link creating module 103, a data display interface obtaining module 104, and an assembly data obtaining module 105. The module of the present invention, which may also be referred to as a unit, refers to a series of computer program segments that can be executed by a processor of an electronic device and that can perform a fixed function, and that are stored in a memory of the electronic device.
In the present embodiment, the functions of the respective modules/units are as follows:
the big data selection request acquisition module 101 is configured to monitor a big data selection request initiated by a client user;
the server screening module 102 is configured to screen a preset server side meeting a preset condition to process the big data request, receive target data returned by the server side meeting the preset condition, and store the target data in a preset cache region;
the long link creation module 103 is configured to create a long link between the client and the server;
the data display interface obtaining module 104 is configured to, when a big data viewing request initiated by the client user is monitored, obtain relevant data display interface information according to the big data viewing request;
the assembly data obtaining module 105 is configured to send the data display interface information to the server side meeting the preset condition by using the long link, and receive and display data obtained by assembling the target data by the server side according to the data display interface information.
In detail, when used, each module in the big data loading apparatus 100 based on a page request in the embodiment of the present invention adopts the same technical means as the big data loading method based on a page request described in fig. 1 to fig. 4, and can produce the same technical effect, which is not described herein again.
Fig. 6 is a schematic structural diagram of an electronic device for implementing a big data loading method based on a page request according to an embodiment of the present invention.
The electronic device 1 may comprise a processor 10, a memory 11 and a bus, and may further comprise a computer program, such as a big data loader based on page requests, stored in the memory 11 and executable on the processor 10.
The memory 11 includes at least one type of readable storage medium, which includes flash memory, removable hard disk, multimedia card, card-type memory (e.g., SD or DX memory, etc.), magnetic memory, magnetic disk, optical disk, etc. The memory 11 may in some embodiments be an internal storage unit of the electronic device 1, such as a removable hard disk of the electronic device 1. The memory 11 may also be an external storage device of the electronic device 1 in other embodiments, such as a plug-in mobile hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, provided on the electronic device 1. Further, the memory 11 may also include both an internal storage unit and an external storage device of the electronic device 1. The memory 11 may be used not only to store application software installed in the electronic device 1 and various types of data, such as code of a big data loader based on a page request, etc., but also to temporarily store data that has been output or is to be output.
The processor 10 may be formed of an integrated circuit in some embodiments, for example, a single packaged integrated circuit, or may be formed of a plurality of integrated circuits packaged with the same function or different functions, including one or more Central Processing Units (CPUs), microprocessors, digital Processing chips, graphics processors, and combinations of various control chips. The processor 10 is a Control Unit (Control Unit) of the electronic device, connects various components of the electronic device by using various interfaces and lines, and executes various functions and processes data of the electronic device 1 by running or executing programs or modules (e.g., a big data loader based on a page request, etc.) stored in the memory 11 and calling data stored in the memory 11.
The bus may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. The bus is arranged to enable connection communication between the memory 11 and at least one processor 10 or the like.
Fig. 6 only shows an electronic device with components, and it will be understood by a person skilled in the art that the structure shown in fig. 6 does not constitute a limitation of the electronic device 1, and may comprise fewer or more components than shown, or a combination of certain components, or a different arrangement of components.
For example, although not shown, the electronic device 1 may further include a power supply (such as a battery) for supplying power to each component, and preferably, the power supply may be logically connected to the at least one processor 10 through a power management device, so as to implement functions of charge management, discharge management, power consumption management, and the like through the power management device. The power supply may also include any component of one or more dc or ac power sources, recharging devices, power failure detection circuitry, power converters or inverters, power status indicators, and the like. The electronic device 1 may further include various sensors, a bluetooth module, a Wi-Fi module, and the like, which are not described herein again.
Further, the electronic device 1 may further include a network interface, and optionally, the network interface may include a wired interface and/or a wireless interface (such as a WI-FI interface, a bluetooth interface, etc.), which are generally used to establish a communication connection between the electronic device 1 and another electronic device.
Optionally, the electronic device 1 may further comprise a user interface, which may be a Display (Display), an input unit (such as a Keyboard), and optionally a standard wired interface, a wireless interface. Alternatively, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch device, or the like. The display, which may also be referred to as a display screen or display unit, is suitable for displaying information processed in the electronic device 1 and for displaying a visualized user interface, among other things.
It is to be understood that the described embodiments are for purposes of illustration only and that the scope of the appended claims is not limited to such structures.
The large data loader based on page request stored in the memory 11 of the electronic device 1 is a combination of a plurality of instructions, and when running in the processor 10, can realize that:
monitoring a big data selection request initiated by a client user;
screening a preset server side meeting preset conditions to process the big data request, receiving target data returned by the server side meeting the preset conditions, and storing the target data in a preset cache region;
creating a long link between the client and the server;
when a big data viewing request initiated by the client user is monitored, acquiring related data display interface information according to the big data viewing request;
and sending the data display interface information to the server side meeting the preset condition by using the long link, and receiving and displaying the data after the server side assembles the target data according to the data display interface information.
Further, the integrated modules/units of the electronic device 1, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. The computer readable storage medium may be volatile or non-volatile. For example, the computer-readable medium may include: any entity or device capable of carrying said computer program code, recording medium, U-disk, removable hard disk, magnetic disk, optical disk, computer Memory, read-Only Memory (ROM).
The present invention also provides a computer-readable storage medium, storing a computer program which, when executed by a processor of an electronic device, may implement:
monitoring a big data selection request initiated by a client user;
screening a preset server side meeting preset conditions to process the big data request, receiving target data returned by the server side meeting the preset conditions, and storing the target data in a preset cache region;
creating a long link between the client and the server;
when a big data viewing request initiated by the client user is monitored, acquiring related data display interface information according to the big data viewing request;
and sending the data display interface information to the server side meeting the preset condition by using the long link, and receiving and displaying the data assembled by the server side according to the data display interface information.
In addition, functional modules in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional module.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof.
The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference signs in the claims shall not be construed as limiting the claim concerned.
The block chain is a novel application mode of computer technologies such as distributed data storage, point-to-point transmission, a consensus mechanism, an encryption algorithm and the like. A block chain (Blockchain), which is essentially a decentralized database, is a string of data blocks associated by using a cryptographic method, and each data block contains information of a batch of network transactions, which is used for verifying the validity (anti-counterfeiting) of the information and generating a next block. The blockchain may include a blockchain underlying platform, a platform product service layer, an application service layer, and the like.
The embodiment of the application can acquire and process related data based on a data processing technology. Among them, artificial Intelligence (AI) is a theory, method, technique and application system that simulates, extends and expands human Intelligence using a digital computer or a machine controlled by a digital computer, senses the environment, acquires knowledge and uses the knowledge to obtain the best result.
Furthermore, it is obvious that the word "comprising" does not exclude other elements or steps, and the singular does not exclude the plural. A plurality of units or means recited in the system claims may also be implemented by one unit or means in software or hardware. The terms second, etc. are used to denote names, but not any particular order.
Finally, it should be noted that the above embodiments are only for illustrating the technical solutions of the present invention and not for limiting, and although the present invention is described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications or equivalent substitutions may be made on the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention.
Claims (10)
1. A big data loading method based on page requests is characterized by comprising the following steps:
monitoring a big data selection request initiated by a client user;
screening a preset server side meeting preset conditions to process the big data request, receiving target data returned by the server side meeting the preset conditions, and storing the target data in a preset cache region;
creating a long link between the client and the server;
when a big data viewing request initiated by the client user is monitored, acquiring related data display interface information according to the big data viewing request;
and sending the data display interface information to the server side meeting the preset condition by using the long link, and receiving and displaying the data after the server side assembles the target data according to the data display interface information.
2. The big data loading method based on page request according to claim 1, wherein the listening of the big data selection request initiated by the client user comprises:
intercepting all requests initiated by the client user;
sequentially analyzing a request identifier contained in each request;
and taking the request corresponding to the request identification matched with the preset big data request identification as the big data selection request.
3. The big data loading method based on the page request according to claim 1, wherein the screening of the preset server side meeting the preset condition to process the big data request comprises:
acquiring a weight value corresponding to each preset server;
sorting all the preset server sides according to the weight values;
polling corresponding server ends in sequence according to the sequence to obtain the server ends meeting the preset conditions;
and sending the big data selection request to a server side meeting the preset condition to load related service data.
4. The big data loading method based on page request as claimed in claim 1, wherein said storing said target data to a preset buffer area comprises:
acquiring address information of the target data;
and storing the address information into the preset cache region.
5. The big data loading method based on page request according to claim 1, wherein said obtaining the relevant data display interface information according to the big data viewing request comprises:
analyzing the big data viewing request to obtain a corresponding data display interface ID;
dividing the calling priority corresponding to each data display interface ID according to a preset interface calling relation table;
and forming the data display interface information by the calling priority and the corresponding data display interface ID.
6. The big data loading method based on page request according to claim 5, wherein said dividing the call priority corresponding to each said data presentation interface ID according to a preset interface call relation table comprises:
sequentially selecting one data display interface ID as a vertex, and constructing an interface binary tree corresponding to the vertex according to the preset interface calling relation table;
converting all the interface binary trees into interface forests;
and taking the depth of each node in the interface forest as the calling priority of the interface ID of the corresponding node.
7. The big data loading method based on page request according to claim 1, wherein after the creating of the long link between the client and the server, the method further comprises:
one end of the client or the server is selected randomly at regular time as a sender, and the other end of the client or the server is selected as a receiver;
sending a pre-constructed heartbeat packet from the sender to the receiver;
and monitoring a response message returned to the sender by the receiver.
8. An apparatus for loading big data based on page request, the apparatus comprising:
the big data selection request acquisition module is used for monitoring a big data selection request initiated by a client user;
the server screening module is used for screening a preset server side meeting preset conditions to process the big data request, receiving target data returned by the server side meeting the preset conditions, and storing the target data in a preset cache region;
the long link establishing module is used for establishing a long link between the client and the server;
the data display interface acquisition module is used for acquiring related data display interface information according to a big data viewing request initiated by the client user when the big data viewing request is monitored;
and the assembly data acquisition module is used for sending the data display interface information to the server side meeting the preset condition by using the long link, and receiving and displaying the data after the server side assembles the target data according to the data display interface information.
9. An electronic device, characterized in that the electronic device comprises:
at least one processor; and (c) a second step of,
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores a computer program executable by the at least one processor, the instructions being executable by the at least one processor to enable the at least one processor to perform a page request based big data loading method according to any of claims 1 to 7.
10. A computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the page request-based big data loading method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210715257.XA CN115174691B (en) | 2022-06-22 | 2022-06-22 | Big data loading method, device, equipment and medium based on page request |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210715257.XA CN115174691B (en) | 2022-06-22 | 2022-06-22 | Big data loading method, device, equipment and medium based on page request |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115174691A true CN115174691A (en) | 2022-10-11 |
| CN115174691B CN115174691B (en) | 2023-09-05 |
Family
ID=83486971
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210715257.XA Active CN115174691B (en) | 2022-06-22 | 2022-06-22 | Big data loading method, device, equipment and medium based on page request |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115174691B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101599982A (en) * | 2008-06-06 | 2009-12-09 | 广东宇天信通通信科技有限公司 | Cellphone information browsing apparatus, system and implementation method |
| CN111176843A (en) * | 2019-12-23 | 2020-05-19 | 中国平安财产保险股份有限公司 | Multi-dimension-based load balancing method and device and related equipment |
| CN112434237A (en) * | 2020-11-25 | 2021-03-02 | 平安普惠企业管理有限公司 | Page loading method and device, electronic equipment and storage medium |
| CN112788076A (en) * | 2019-11-07 | 2021-05-11 | 北京京东尚科信息技术有限公司 | Method and device for deploying multi-service load |
| CN113727134A (en) * | 2021-08-31 | 2021-11-30 | 康键信息技术（深圳）有限公司 | Live chat information distribution method and system |
| WO2022002209A1 (en) * | 2020-07-01 | 2022-01-06 | 中兴通讯股份有限公司 | Data transmission method, proxy server, storage medium, and electronic device |
| CN114611046A (en) * | 2022-03-22 | 2022-06-10 | 深圳壹账通智能科技有限公司 | Data loading method, device, equipment and medium |
-
2022
- 2022-06-22 CN CN202210715257.XA patent/CN115174691B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101599982A (en) * | 2008-06-06 | 2009-12-09 | 广东宇天信通通信科技有限公司 | Cellphone information browsing apparatus, system and implementation method |
| CN112788076A (en) * | 2019-11-07 | 2021-05-11 | 北京京东尚科信息技术有限公司 | Method and device for deploying multi-service load |
| CN111176843A (en) * | 2019-12-23 | 2020-05-19 | 中国平安财产保险股份有限公司 | Multi-dimension-based load balancing method and device and related equipment |
| WO2022002209A1 (en) * | 2020-07-01 | 2022-01-06 | 中兴通讯股份有限公司 | Data transmission method, proxy server, storage medium, and electronic device |
| CN112434237A (en) * | 2020-11-25 | 2021-03-02 | 平安普惠企业管理有限公司 | Page loading method and device, electronic equipment and storage medium |
| CN113727134A (en) * | 2021-08-31 | 2021-11-30 | 康键信息技术（深圳）有限公司 | Live chat information distribution method and system |
| CN114611046A (en) * | 2022-03-22 | 2022-06-10 | 深圳壹账通智能科技有限公司 | Data loading method, device, equipment and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115174691B (en) | 2023-09-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112015815B (en) | Data synchronization method, device and computer readable storage medium | |
| CN114124968B (en) | Load balancing method, device, equipment and medium based on market data | |
| CN113890712A (en) | Data transmission method and device, electronic equipment and readable storage medium | |
| CN114827161B (en) | Service call request sending method and device, electronic equipment and readable storage medium | |
| CN109788251B (en) | Video processing method, device and storage medium | |
| CN115002011B (en) | Flow bidirectional test method and device, electronic equipment and storage medium | |
| CN115174691B (en) | Big data loading method, device, equipment and medium based on page request | |
| CN114124878B (en) | Market data issuing method, device, system, equipment and medium | |
| CN114125024B (en) | Audio transmission method, electronic device and readable storage medium | |
| CN112540839B (en) | Information changing method, device, electronic equipment and storage medium | |
| CN114185502A (en) | Log printing method, device, equipment and medium based on production line environment | |
| CN114124835A (en) | Interface-based data transmission method, device, equipment and medium | |
| CN113918305A (en) | Node scheduling method and device, electronic equipment and readable storage medium | |
| CN114389988B (en) | Remote procedure call method, device, equipment and medium based on network architecture | |
| CN113452785B (en) | Service access method and device based on offline resources, electronic equipment and medium | |
| CN114640666B (en) | File sharing downloading method, electronic equipment and readable storage medium | |
| CN114389988A (en) | Remote procedure call method, device, equipment and medium based on network architecture | |
| CN115225458A (en) | Alarm notification method, alarm notification device, electronic equipment and storage medium | |
| CN112528332A (en) | Data acquisition method and device, electronic equipment and computer storage medium | |
| CN116610465A (en) | Event notification-based message sending method and device, electronic equipment and medium | |
| CN117851506A (en) | GIT-based cross-library synchronization method and device, electronic equipment and storage medium | |
| CN117632538A (en) | Service calling method, device, equipment and storage medium of self-adaptive structure | |
| CN115080894A (en) | Method, device, equipment and storage medium for calling and updating data of H5 page | |
| CN114915483A (en) | Application service calling method, device, equipment and storage medium | |
| CN114253525A (en) | Lightweight component bus implementation method and device, electronic equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20230811 Address after: Room 1408, 14th Floor, No. 345 Changzhi Road, Xuefu Park, Taiyuan Comprehensive Reform Demonstration Zone, Taiyuan City, Shanxi Province, 030000 Applicant after: Shanxi Digital Government Construction and Operation Co.,Ltd. Address before: 518000 Room 202, block B, aerospace micromotor building, No.7, Langshan No.2 Road, Xili street, Nanshan District, Shenzhen City, Guangdong Province Applicant before: Shenzhen LIAN intellectual property service center Effective date of registration: 20230811 Address after: 518000 Room 202, block B, aerospace micromotor building, No.7, Langshan No.2 Road, Xili street, Nanshan District, Shenzhen City, Guangdong Province Applicant after: Shenzhen LIAN intellectual property service center Address before: 518000 Room 201, building A, 1 front Bay Road, Shenzhen Qianhai cooperation zone, Shenzhen, Guangdong Applicant before: PING AN PUHUI ENTERPRISE MANAGEMENT Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |