CN116431944A - Optimization processing method, device, equipment and medium for high concurrency data request - Google Patents
Optimization processing method, device, equipment and medium for high concurrency data request Download PDFInfo
- Publication number
- CN116431944A CN116431944A CN202310230785.0A CN202310230785A CN116431944A CN 116431944 A CN116431944 A CN 116431944A CN 202310230785 A CN202310230785 A CN 202310230785A CN 116431944 A CN116431944 A CN 116431944A
- Authority
- CN
- China
- Prior art keywords
- data
- request
- question
- local database
- transcoding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 9
- 238000005457 optimization Methods 0.000 title claims description 10
- 238000012360 testing method Methods 0.000 claims abstract description 47
- 238000011068 loading method Methods 0.000 claims abstract description 46
- 238000000034 method Methods 0.000 claims abstract description 35
- 238000012545 processing Methods 0.000 claims description 23
- 238000013500 data storage Methods 0.000 claims description 7
- 238000007781 pre-processing Methods 0.000 claims description 4
- 238000004590 computer program Methods 0.000 claims description 2
- 230000000903 blocking effect Effects 0.000 abstract description 13
- 230000005540 biological transmission Effects 0.000 description 11
- 230000004044 response Effects 0.000 description 8
- 238000012549 training Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000004088 simulation Methods 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/957—Browsing optimisation, e.g. caching or content distillation
- G06F16/9574—Browsing optimisation, e.g. caching or content distillation of access to content, e.g. by caching
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/951—Indexing; Web crawling techniques
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention belongs to the technical field of optimizing network requests, and particularly provides an optimizing processing method, device, equipment and medium of a high concurrence data request, wherein the method comprises the following steps of sending an asynchronous network request, and setting a token and a time stamp in an interface Body of a request question; after the data request is successful, json data transcoding is obtained, and the Json data transcoding is written into a local database; when data is loaded, judging whether the test question id exists in a local cache; when the test question id exists, loading data from a local database; when the test question id does not exist, executing the steps of: when network request data is sent, a token and a time stamp are set in an interface Body of a request question. The mobile terminal is enabled to be smoother in user experience, the trouble of blocking and flashing back caused by network instant request and data loading is avoided, and the operation efficiency is improved.
Description
Technical Field
The invention relates to the technical field of optimizing network requests, in particular to an optimization processing method, device, equipment and medium for high-concurrency data requests.
Background
While mobile-end training facilitates on-site training and mobile learning, some problems also appear successively over time. Because a large amount of examination question data exist in the learning center, the user experience is improved in the application process, the bearing capacity of the client is increased, the instantaneous request quantity of the project is increased rapidly, and the phenomena of partial unsmooth and blocking occur.
The existing mobile training end examination data request and loading method mainly has the following defects: firstly, the number of the users is excessive or the requests are sent too frequently, and the transmission is interrupted due to the network; secondly, when the test (simulation test) is clicked halfway to return to reentry, data can be re-requested, and quick and effective loading and displaying cannot be ensured; thirdly, when the number of test questions is too large, the interface is enabled to be loaded with clamping, data conversion and display are slow, and user experience is affected; fourth, when the title is loaded, the main thread is simultaneously used for performing operations such as multi-title transcoding, loading and the like, which can cause rapid memory growth and instantaneous CPU load lifting.
In summary, the prior art cannot meet the requirements of examination question request, transcoding and loading. Therefore, in view of the foregoing drawbacks of the prior art, it is highly desirable to provide an optimized processing method, apparatus, device, and medium for high concurrency data requests.
Disclosure of Invention
The prior art can not meet the requirements of examination questions request, transcoding and loading, and the problem of data transmission of an internal network and an external network combined with mobile training is solved, so that the mobile terminal is smoother in user experience, the trouble of blocking and flashing back caused by network instant request and data loading is avoided, the operation efficiency is improved, the release process of a mobile phone operation memory is directly accelerated, the network request and data loading efficiency is improved to the maximum extent, and the service scene requirement is met.
In a first aspect, the present invention provides a method for optimizing and processing a high concurrency data request, including the following steps:
sending an asynchronous network request, and setting a token and a time stamp in an interface Body of a request question;
after the data request is successful, json data transcoding is obtained, and the Json data transcoding is written into a local database;
when data is loaded, judging whether the test question id exists in a local cache;
when the test question id exists, loading data from a local database;
when the test question id does not exist, executing the steps of: when network request data is sent, a token and a time stamp are set in an interface Body of a request question.
The network transmission of data is easy to generate instant request surge of a large amount of data, so that the time and the labor are consumed when the client runs and the server responds, the user experience is affected, and in severe cases, the memory overflow of the client can be even caused, and the crash phenomenon occurs. The method solves the problem of thread blocking caused by instantaneous transmission and loading of a large amount of data, reduces the utilization rate of the running memory of the client and the feedback time of the server response, thereby greatly improving the high concurrency resistance of the client and increasing the user experience.
As a further limitation of the technical solution of the present invention, after the success of the data request, the step of obtaining the Json data transcoding and writing into the local database includes:
after the data request is successful, json data transcoding is obtained;
judging whether a local database exists or not;
if yes, transcoding the acquired Json data, and writing the Json data into a local database;
if not, a local database is created, and the steps are executed: and transcoding the acquired Json data and writing the Json data into a local database.
As a further limitation of the technical solution of the present invention, the step of loading data from the local database comprises:
and obtaining cache data from the local cache pool, obtaining data corresponding to different test question ids, obtaining a chunk corresponding to each table, converting the chunk into binary Json data, and displaying the binary Json data on a page after assignment is completed according to a unique identifier UUID of each question.
As a further limitation of the technical scheme of the invention, the step of sending an asynchronous network request and setting a token and a time stamp in an interface Body of the request question comprises the following steps:
setting different databases according to different request types to store data;
and setting a plurality of servers for data storage.
As a further limitation of the technical solution of the present invention, the method further comprises:
each request is assigned a Go coroutine as an executable.
In a second aspect, the present invention further provides an optimization processing device for high concurrency data requests, including a first processing module, a cache module, a first judging module and a loading module;
the first processing module is used for sending an asynchronous network request and setting a token and a time stamp in an interface Body of a request question;
the caching module is used for acquiring Json data transcoding after the data request is successful and writing the Json data transcoding into the local database;
the second judging module is used for judging whether the test question id exists in the local cache or not when the data is loaded;
and the loading module is used for loading data from the local database when the test question id exists.
The method solves the problem of thread blocking caused by instantaneous transmission and loading of a large amount of data, reduces the utilization rate of the running memory of the client and the feedback time of the server response, thereby greatly improving the high concurrency resistance of the client and increasing the user experience.
As a further limitation of the technical scheme of the invention, the device also comprises a second judging module and a database creating module;
the second judging module is used for judging whether the local database exists or not;
and the database creation module is used for creating the local database when the second judgment module judges that the local database does not exist.
As a further limitation of the technical scheme of the present invention, the loading module is specifically configured to obtain cache data from the local cache pool, obtain data corresponding to different test question ids, obtain a chunk corresponding to each table, convert the chunk into binary Json data, and display the binary Json data on a page after assignment is completed according to a unique identifier UUID of each question.
As a further limitation of the technical scheme of the invention, the device also comprises a preprocessing module, which is used for setting different databases according to different request types to store data; and setting a plurality of servers for data storage.
As a further limitation of the technical solution of the present invention, the apparatus further includes a request setting module, configured to allocate a Go coroutine as an executing body to each request.
In a third aspect, the present invention further provides an electronic device, where the electronic device includes:
at least one processor; the method comprises the steps of,
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores computer program instructions executable by the at least one processor to enable the at least one processor to perform the method of optimizing processing of highly concurrent data requests as described in the first aspect.
In a fourth aspect, the present disclosure further provides a non-transitory computer readable storage medium, where the non-transitory computer readable storage medium stores computer instructions, where the computer instructions cause the computer to execute the method for optimizing processing of high concurrency data requests according to the first aspect.
From the above technical scheme, the invention has the following advantages: the mobile terminal is enabled to be smoother in user experience, the trouble of blocking and flashing back caused by network instant request and data loading is avoided, the operation efficiency is improved, the release process of the mobile phone operation memory is directly accelerated, the network request and data loading efficiency is improved to the greatest extent, and the service scene requirements are met.
In addition, the invention has reliable design principle, simple structure and very wide application prospect.
It can be seen that the present invention has outstanding substantial features and significant advances over the prior art, as well as its practical advantages.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are required to be used in the description of the embodiments or the prior art will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.
FIG. 1 is a schematic flow chart of a method of one embodiment of the invention.
Fig. 2 is a schematic block diagram of an apparatus of one embodiment of the invention.
Detailed Description
The existing mobile training end examination data request and loading method mainly has the following defects: firstly, the number of the users is excessive or the requests are sent too frequently, and the transmission is interrupted due to the network; secondly, when the test (simulation test) is clicked halfway to return to reentry, data can be re-requested, and quick and effective loading and displaying cannot be ensured; thirdly, when the number of test questions is too large, the interface is enabled to be loaded with clamping, data conversion and display are slow, and user experience is affected; fourth, when the title is loaded, the main thread is simultaneously used for performing operations such as multi-title transcoding, loading and the like, which can cause rapid memory growth and instantaneous CPU load lifting.
In summary, the prior art cannot meet the requirements of examination question request, transcoding and loading. The invention ensures that the mobile terminal is smoother in user experience, does not have trouble of blocking and flashing back phenomena caused by instant network request and data loading, improves the operation efficiency, directly accelerates the release process of the mobile phone operation memory, furthest improves the network request and data loading efficiency, and meets the service scene requirements. In order to make the technical solution of the present invention better understood by those skilled in the art, the technical solution of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.
As shown in fig. 1, an embodiment of the present invention provides an optimization processing method for a high concurrency data request, including the following steps:
step 1: sending an asynchronous network request, and setting a token and a time stamp in an interface Body of a request question;
step 2: after the data request is successful, json data transcoding is obtained, and the Json data transcoding is written into a local database;
step 3: when data is loaded, judging whether the test question id exists in a local cache;
when the test question id exists, executing the step 4; when the test question id does not exist, executing the step 1;
step 4: loading data from a local database;
the network transmission of data is easy to generate instant request surge of a large amount of data, so that the time and the labor are consumed when the client runs and the server responds, the user experience is affected, and in severe cases, the memory overflow of the client can be even caused, and the crash phenomenon occurs. The method solves the problem of thread blocking caused by instantaneous transmission and loading of a large amount of data, reduces the utilization rate of the running memory of the client and the feedback time of the server response, thereby greatly improving the high concurrency resistance of the client and increasing the user experience.
The embodiment of the invention provides an optimization processing method for high concurrency data requests, which comprises the following steps:
s1: sending an asynchronous network request, and setting a token and a time stamp in an interface Body of a request question;
s2: after the data request is successful, json data transcoding is obtained;
s3: judging whether a local database exists or not;
if yes, executing the step S4, and if not, executing the step S5;
s4: transcoding the acquired Json data and writing the Json data into a local database;
s5: creating a local database and executing step S4;
s6: when data is loaded, judging whether the test question id exists in a local cache;
when the test question id exists, executing a step S7; when the test question id does not exist, executing the step S1;
s7: loading data from a local database;
the method specifically comprises the following steps: and obtaining cache data from the local cache pool, obtaining data corresponding to different test question ids, obtaining a chunk corresponding to each table, converting the chunk into binary Json data, and displaying the binary Json data on a page after assignment is completed according to a unique identifier UUID of each question.
It should be noted that, in the present application, after receiving a network request, a server performs asynchronous processing on the network request, and the specific process is as follows: the creation thread receives a network request sent by a client, creates a task for the network request, and adds the task into a task queue; extracting the task from a task queue through an execution thread, and executing the task; when the task execution is completed, the execution result of the task, namely, the data requested by the client is sent to the client through the execution thread. Here, any execution thread in an idle state in the execution thread pool is called, and a task is extracted from the task queue by the called execution thread. The method can also orderly process when a large number of network requests are received, is not easy to cause blockage, and does not influence execution of tasks by the execution thread even if the blockage is caused.
The embodiment of the invention provides an optimization processing method for high concurrency data requests, which comprises the following steps:
s01: setting different databases according to different request types to store data;
s02: setting a plurality of servers to store data;
s1: sending an asynchronous network request, and setting a token and a time stamp in an interface Body of a request question;
s2: after the data request is successful, json data transcoding is obtained;
s3: judging whether a local database exists or not;
if yes, executing the step S4, and if not, executing the step S5;
s4: transcoding the acquired Json data and writing the Json data into a local database;
s5: creating a local database and executing step S4;
s6: when data is loaded, judging whether the test question id exists in a local cache;
when the test question id exists, executing a step S7; when the test question id does not exist, executing the step S1;
s7: loading data from a local database;
the method specifically comprises the following steps: and obtaining cache data from the local cache pool, obtaining data corresponding to different test question ids, obtaining a chunk corresponding to each table, converting the chunk into binary Json data, and displaying the binary Json data on a page after assignment is completed according to a unique identifier UUID of each question.
In the embodiment of the invention, the horizontal expansion is divided into a reverse proxy layer horizontal expansion, a site layer horizontal expansion, a service layer horizontal expansion and a data layer horizontal expansion, wherein the reverse proxy layer expansion used in the embodiment is to split one system into a plurality of subsystems, and then each system is connected with one database, so that only one database is originally split into a plurality of databases; the other data layer expansion is to split the data (buffer memory, database) originally stored in one server to different servers horizontally under the condition of large data volume, so as to achieve the purpose of expanding the system performance, thereby accelerating the response time of network request data, reducing the network response time, optimizing the network request QPS and achieving the high concurrency resisting effect.
The vertical expansion is to improve the processing capacity of a single machine, increase the performance of a single machine architecture, reduce the blocking time of I/O, improve the utilization efficiency of a CPU, and allocate a Go coroutine as an execution body for each request for an http standard library, namely, allocate a gooout for each request to reduce the blocking time of the I/O, and the gooout is a lighter execution body (relative to threads and processes), so that the efficiency of the CPU is improved, and the time of context switching is far longer than the time of the gooout because of thread/process scheduling.
And carrying out buffer processing on test question contents which are loaded for the first time and successfully resolved, when the first time loading is completed, the system defaults to obtain buffer Data from a local buffer pool, obtains Data corresponding to different test question IDs, obtains a chunk storage block corresponding to each table, converts the Data into binary JsonData, and completes assignment according to a unique identifier UUID of each question, thereby displaying the Data on a page.
When the client sends the request, an asynchronous network request is sent, and when the network request is simultaneously sent to the background, the operation of a main thread is not influenced, and the use experience of a user is increased.
As shown in fig. 2, the embodiment of the invention further provides an optimization processing device for high concurrency data requests, which comprises a first processing module, a cache module, a first judging module and a loading module;
the first processing module is used for sending an asynchronous network request and setting a token and a time stamp in an interface Body of a request question;
the caching module is used for acquiring Json data transcoding after the data request is successful, writing the Json data transcoding into the local number second judging module and judging whether the test question id exists in the local cache or not when the data is loaded;
and the loading module is used for loading data from the local database when the test question id exists.
The method solves the problem of thread blocking caused by instantaneous transmission and loading of a large amount of data, reduces the utilization rate of the running memory of the client and the feedback time of the server response, thereby greatly improving the high concurrency resistance of the client and increasing the user experience.
The embodiment of the invention also provides an optimization processing device for the high concurrency data request, which comprises a first processing module, a cache module, a first judging module and a loading module;
the first processing module is used for sending an asynchronous network request and setting a token and a time stamp in an interface Body of a request question;
the caching module is used for acquiring Json data transcoding after the data request is successful and writing the Json data transcoding into the local database;
the second judging module is used for judging whether the test question id exists in the local cache or not when the data is loaded;
and the loading module is used for loading data from the local database when the test question id exists.
The device also comprises a second judging module and a database creating module;
the second judging module is used for judging whether the local database exists or not;
and the database creation module is used for creating the local database when the second judgment module judges that the local database does not exist.
The loading module is specifically configured to obtain cache data from the local cache pool, obtain data corresponding to different test question ids, obtain a chunk storage block corresponding to each table, convert the chunk storage block into binary Json data, and display the binary Json data on a page after assignment is completed according to a unique identifier UUID of each question.
The device also comprises a preprocessing module, a data storage module and a data storage module, wherein the preprocessing module is used for setting different databases according to different request types; and setting a plurality of servers for data storage.
The apparatus further includes a request setup module configured to allocate a Go coroutine as an executable for each request.
The embodiment of the invention also provides electronic equipment, which comprises: the device comprises a processor, a communication interface, a memory and a bus, wherein the processor, the communication interface and the memory are in communication with each other through the bus. The bus may be used for information transfer between the electronic device and the sensor. The processor may call logic instructions in memory to perform the following method: s1: sending an asynchronous network request, and setting a token and a time stamp in an interface Body of a request question; s2: after the data request is successful, json data transcoding is obtained; s3: judging whether a local database exists or not; if yes, executing the step S4, and if not, executing the step S5; s4: transcoding the acquired Json data and writing the Json data into a local database; s5: creating a local database and executing step S4; s6: when data is loaded, judging whether the test question id exists in a local cache; when the test question id exists, executing a step S7; when the test question id does not exist, executing the step S1; s7: data is loaded from a local database.
The method solves the problem of thread blocking caused by instantaneous transmission and loading of a large amount of data, reduces the utilization rate of the running memory of the client and the feedback time of the server response, thereby greatly improving the high concurrency resistance of the client and increasing the user experience.
Further, the logic instructions in the memory described above may be implemented in the form of software functional units and stored in a computer-readable storage medium when sold or used as a stand-alone product. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
Embodiments of the present invention provide a non-transitory computer readable storage medium storing computer instructions that cause a computer to perform the methods provided by the method embodiments described above, for example, including: s1: sending an asynchronous network request, and setting a token and a time stamp in an interface Body of a request question; s2: after the data request is successful, json data transcoding is obtained; s3: judging whether a local database exists or not; if yes, executing the step S4, and if not, executing the step S5; s4: transcoding the acquired Json data and writing the Json data into a local database; s5: creating a local database and executing step S4; s6: when data is loaded, judging whether the test question id exists in a local cache; when the test question id exists, executing a step S7; when the test question id does not exist, executing the step S1; s7: data is loaded from a local database.
The method solves the problem of thread blocking caused by instantaneous transmission and loading of a large amount of data, reduces the utilization rate of the running memory of the client and the feedback time of the server response, thereby greatly improving the high concurrency resistance of the client and increasing the user experience.
Although the present invention has been described in detail by way of preferred embodiments with reference to the accompanying drawings, the present invention is not limited thereto. Various equivalent modifications and substitutions may be made in the embodiments of the present invention by those skilled in the art without departing from the spirit and scope of the present invention, and it is intended that all such modifications and substitutions be within the scope of the present invention/be within the scope of the present invention as defined by the appended claims. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. An optimization processing method for high concurrency data requests is characterized by comprising the following steps:
sending an asynchronous network request, and setting a token and a time stamp in an interface Body of a request question;
after the data request is successful, json data transcoding is obtained, and the Json data transcoding is written into a local database;
when data is loaded, judging whether the test question id exists in a local cache;
when the test question id exists, loading data from a local database;
when the test question id does not exist, executing the steps of: when network request data is sent, a token and a time stamp are set in an interface Body of a request question.
2. The method for optimizing processing of high concurrency data requests according to claim 1, wherein after the data requests succeed, the step of obtaining Json data transcoding and writing the Json data transcoding into the local database comprises:
after the data request is successful, json data transcoding is obtained;
judging whether a local database exists or not;
if yes, transcoding the acquired Json data, and writing the Json data into a local database;
if not, a local database is created, and the steps are executed: and transcoding the acquired Json data and writing the Json data into a local database.
3. The method for optimizing processing of high concurrency data requests of claim 2, wherein the step of loading data from the local database comprises:
and obtaining cache data from the local cache pool, obtaining data corresponding to different test question ids, obtaining a chunk corresponding to each table, converting the chunk into binary Json data, and displaying the binary Json data on a page after assignment is completed according to a unique identifier UUID of each question.
4. The method for optimizing processing of high concurrency data requests as recited in claim 3, wherein the step of sending an asynchronous network request, before setting a token and a timestamp in an interface Body of the request question, comprises:
setting different databases according to different request types to store data;
and setting a plurality of servers for data storage.
5. The method for optimizing processing of high concurrency data requests of claim 4, further comprising:
each request is assigned a Go coroutine as an executable.
6. The optimizing processing device for the high concurrency data request is characterized by comprising a first processing module, a cache module, a first judging module and a loading module;
the first processing module is used for sending an asynchronous network request and setting a token and a time stamp in an interface Body of a request question;
the caching module is used for acquiring Json data transcoding after the data request is successful and writing the Json data transcoding into the local database;
the second judging module is used for judging whether the test question id exists in the local cache or not when the data is loaded;
and the loading module is used for loading data from the local database when the test question id exists.
7. The device for optimizing data requests according to claim 6, wherein the loading module is specifically configured to obtain cache data from the local cache pool, obtain data corresponding to different test question ids, obtain chunk corresponding to each table, convert the chunk into binary Json data, and display the binary Json data on a page after assignment is completed according to a unique identifier UUID of each question.
8. The apparatus for optimizing processing of high concurrency data requests of claim 7, further comprising a preprocessing module for storing data according to different databases set by request type; and setting a plurality of servers for data storage.
9. An electronic device, the electronic device comprising:
at least one processor; the method comprises the steps of,
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores computer program instructions executable by at least one processor to enable the at least one processor to perform the method of optimizing highly concurrent data requests according to any one of claims 1 to 5.
10. A non-transitory computer readable storage medium storing computer instructions that cause the computer to perform the method of optimizing highly concurrent data requests according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310230785.0A CN116431944A (en) | 2023-03-07 | 2023-03-07 | Optimization processing method, device, equipment and medium for high concurrency data request |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310230785.0A CN116431944A (en) | 2023-03-07 | 2023-03-07 | Optimization processing method, device, equipment and medium for high concurrency data request |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116431944A true CN116431944A (en) | 2023-07-14 |
Family
ID=87082309
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310230785.0A Pending CN116431944A (en) | 2023-03-07 | 2023-03-07 | Optimization processing method, device, equipment and medium for high concurrency data request |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116431944A (en) |
-
2023
- 2023-03-07 CN CN202310230785.0A patent/CN116431944A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20180027061A1 (en) | Method and apparatus for elastically scaling virtual machine cluster | |
| CN108055311B (en) | HTTP asynchronous request method, device, server, terminal and storage medium | |
| US20180300250A1 (en) | Method and apparatus for storing data | |
| CN113419824A (en) | Data processing method, device, system and computer storage medium | |
| CN111813573B (en) | Communication method of management platform and robot software and related equipment thereof | |
| CN110019873B (en) | Face data processing method, device and equipment | |
| CN109582649B (en) | Metadata storage method, device and equipment and readable storage medium | |
| CN108519987A (en) | A kind of data persistence method and apparatus | |
| CN108595121B (en) | Data storage method and device | |
| CN108363719B (en) | Configurable transparent compression method in distributed file system | |
| CN112650449B (en) | Method and system for releasing cache space, electronic device and storage medium | |
| CN117271137A (en) | Multithreading data slicing parallel method | |
| CN108958659A (en) | A kind of small documents polymerization, device and the medium of distributed memory system | |
| CN111245887B (en) | Hbase connection dynamic holding method, Hbase connection dynamic holding equipment, Hbase connection dynamic storage medium and Hbase connection dynamic storage system | |
| CN116431944A (en) | Optimization processing method, device, equipment and medium for high concurrency data request | |
| CN111131367B (en) | Distributed access service processing method and device | |
| CN114116234B (en) | Three-dimensional scene model decompression loading method based on browser | |
| CN107229424B (en) | Data writing method for distributed storage system and distributed storage system | |
| CN112019343B (en) | OpenStack token optimization method and system | |
| CN113645324A (en) | IP distribution method and system based on queue | |
| CN112468576B (en) | Method and system for sharing cloud memory | |
| CN114553894B (en) | Data synchronization method, device, system and storage medium | |
| CN115599838B (en) | Data processing method, device, equipment and storage medium based on artificial intelligence | |
| CN114500406B (en) | Cloud file storage fine granularity QoS control method and system | |
| CN112003860B (en) | Memory management method, system and medium suitable for remote direct memory access |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |