CN112286946A - Data processing method, server and medium - Google Patents

Data processing method, server and medium Download PDF

Info

Publication number
CN112286946A
CN112286946A CN202011026090.3A CN202011026090A CN112286946A CN 112286946 A CN112286946 A CN 112286946A CN 202011026090 A CN202011026090 A CN 202011026090A CN 112286946 A CN112286946 A CN 112286946A
Authority
CN
China
Prior art keywords
access
network information
identifier
server
request
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011026090.3A
Other languages
Chinese (zh)
Other versions
CN112286946B (en
Inventor
李强
刘叶婷
马亚茹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Changsha Youheng Network Technology Co Ltd
Original Assignee
Changsha Youheng Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Changsha Youheng Network Technology Co Ltd filed Critical Changsha Youheng Network Technology Co Ltd
Priority to CN202011026090.3A priority Critical patent/CN112286946B/en
Publication of CN112286946A publication Critical patent/CN112286946A/en
Application granted granted Critical
Publication of CN112286946B publication Critical patent/CN112286946B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23Updating
    • G06F16/2358Change logging, detection, and notification
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2455Query execution
    • G06F16/24552Database cache management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2458Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
    • G06F16/2462Approximate or statistical queries
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/14Session management
    • H04L67/146Markers for unambiguous identification of a particular session, e.g. session cookie or URL-encoding

Abstract

The embodiment of the application provides a data processing method, a server and a medium. In the embodiment of the application, in addition to the service server responsible for providing the network information, the cache server is added to be responsible for managing the access volume of the network information, and specifically, the access volume of the network information can be locally recorded according to the access condition of the access side to the network information, and the access record of the access side to the network information is stored in the search server. Under the condition that the access amount of the locally recorded network information is effective, the access amount of the network information can be directly provided for a demand end, and the providing efficiency of the access amount information is improved; in addition, when the fact that the access quantity of the locally recorded network information is invalid is recognized, the access quantity of the network information can be obtained through recalculation according to the access record of the network information stored in the search server, the locally invalid access quantity is made up, and the effectiveness and the reliability of the access quantity provided to a required end are guaranteed.

Description

Data processing method, server and medium
Technical Field
The present application relates to the field of internet technologies, and in particular, to a data processing method, a server, and a medium.
Background
With the development of internet technology, the internet is more and more widely used, and users have more and more frequent access to the internet. In many internet domains, the amount of user access to network information is of some value. For the E-commerce field, the commodity recommendation strategy can be formulated according to the degree of the commodity enjoyed by a user estimated by the access amount of the user to a certain commodity. For another example, for industries such as self media and new media, the consideration of the contributor may be calculated based on the amount of access to a particular post.
In the prior art, for certain network information, in each day, a server side records the user access amount of the network information in the day, calculates the latest access total amount of the network information according to the user access amount in the day and the historical access total amount stored in a database, stores the latest access total amount into the database, and reads the latest access total amount from the database and returns the latest access total amount to a client side when the client side applies for the access total amount of the network information. However, in the process of writing the latest access amount into the database in this calculation manner, a write error may occur, and the latest access amount cannot be successfully stored into the database, so that data loss is caused, which may cause a difference between the user access amount taken by the client and the actual access amount.
Disclosure of Invention
Aspects of the present application provide a data processing method, a server, and a medium for providing a data recovery function to guarantee validity and reliability of a network information access amount in case of a failure of the network information access amount.
The embodiment of the application provides a data processing method, which is suitable for a server and comprises the following steps: receiving an access request of an access terminal to network information, wherein the access request comprises an identifier of the network information and a corresponding access updating identifier; updating the access amount of the locally recorded and ineffectual network information according to the access updating identification in the access request, and storing the identification of the network information and the corresponding access updating identification in a search server; and under the condition that the access quantity of the locally recorded network information is identified to be invalid, sending a search request to a search server, wherein the search request contains the identifier of the network information so as to request the existing access updating identifier corresponding to the network information; and recalculating the access amount of the network information according to the existing access updating identification corresponding to the network information returned by the search server.
An embodiment of the present application further provides a server, including: a processor and a memory storing a computer program; the processor to execute the computer program to: receiving an access request of an access terminal to network information, wherein the access request comprises an identifier of the network information and a corresponding access updating identifier; updating the access amount of the locally recorded and ineffectual network information according to the access updating identification in the access request, and storing the identification of the network information and the corresponding access updating identification in a search server; and under the condition that the access quantity of the locally recorded network information is identified to be invalid, sending a search request to a search server, wherein the search request contains the identifier of the network information so as to request the existing access updating identifier corresponding to the network information; and recalculating the access amount of the network information according to the existing access updating identification corresponding to the network information returned by the search server.
Embodiments of the present application also provide a computer-readable storage medium storing a computer program, which, when executed by a processor, causes the processor to implement the steps in the embodiments of the method of the present application.
In the embodiment of the application, in addition to a service server responsible for providing network information, a cache server responsible for managing the access volume of the network information is added, the access volume of the network information can be recorded locally according to the access condition of the access end to the network information, and the access record of the access end to the network information is stored in a search server; under the condition that the access amount of the locally recorded network information is effective, the access amount of the network information can be directly provided for a demand end, and the providing efficiency of the access amount information is improved; in addition, when the fact that the access quantity of the locally recorded network information is invalid is recognized, the access quantity of the network information can be obtained through recalculation according to the access record of the network information stored in the search server, the locally invalid access quantity is made up, and the effectiveness and the reliability of the access quantity provided to a required end are guaranteed.
Drawings
Fig. 1 is a schematic structural diagram of a network information processing system according to an embodiment of the present application;
FIG. 2 is a flowchart of a method for processing stub data according to an embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of a server according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions of the present application will be described in detail and completely with reference to the following specific embodiments of the present application and the accompanying drawings. It should be apparent that the described embodiments are only some of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The embodiment of the application provides a network information processing system, which comprises a service server, a cache server and a search server, wherein the cache server is responsible for managing the access volume of network information, can locally record the access volume of the network information according to the access condition of the access end to the network information, and stores the access record of the access end to the network information to the search server; under the condition that the access amount of the locally recorded network information is effective, the access amount of the network information can be directly provided for a demand end, and the providing efficiency of the access amount information is improved; in addition, when the fact that the access quantity of the locally recorded network information is invalid is recognized, the access quantity of the network information can be obtained through recalculation according to the access record of the network information stored in the search server, the locally invalid access quantity is made up, and the effectiveness and the reliability of the access quantity provided to a required end are guaranteed. In addition, in the embodiment of the application, the access record of the access terminal to the network information is stored in the search server, instead of directly storing the access amount of the access terminal to the network information, so that the problem that the cache server cannot obtain the access amount from the search server subsequently due to the fact that the access amount is lost when the access amount is written into the search server can be avoided. And the access records of the access terminal to the network information stored in the search server are stored one by one, the total loss probability is low, and even if partial access records are lost, the cache server can also ensure that the access amount of the access terminal to the network information is roughly calculated by the partial access records of the network information successfully stored in the search server. Further, in this embodiment, a cache server independent from the service server is specially responsible for the access amount processing, and the processing resource of the service server is not occupied, so that the access amount acquisition request of the access terminal for the network information can be processed in time without affecting the processing logic of the service server, thereby improving the timeliness of the access amount information of the network information acquired by the access terminal.
Further optionally, the system further provides a software development kit packaged with the access cache server for the access terminal, the software development kit includes an interface for accessing the cache server, the access terminal only needs to introduce the software development kit into a software project, and can interact with the cache server by calling the interface in the software development kit, statistics of the access amount of the network information is realized by the cache server, and the access amount of the network information is obtained from the cache server by the interface in the software development kit. The software development kit does not limit the application scene of the access terminal, so that the network information which can be processed by the cache server is more diversified.
The network information processing system according to the embodiment of the present application is described in detail below with reference to the drawings.
Fig. 1 is a schematic structural diagram of a network information processing system 100 according to an embodiment of the present application, and as shown in fig. 1, the network information processing system 100 includes a cache server 10, an access terminal 20, a search server 30, a service server 40, a message system 50, and a demand terminal 60. The access terminal 20 may be in communication connection with the cache server 10 through a mobile network, for example, the network format of the mobile network may be any one of 2G (gsm), 2.5G (gprs), 3G (WCDMA, TD-SCDMA, CDMA2000, UTMS), 4G (LTE), 4G + (LTE +), 5G, WiMax, or a new network format that will appear in the future, and the like, which is not limited specifically. The cache server 10 is a server with a time-sensitive cache function, and is configured to process data provided by the access terminal 20, and store a processing result in a local storage space, so that the access terminal 20 requests to obtain the processing result. The message system 50 is a distributed publish-subscribe message system with high throughput, and can process a plurality of data streams, the cache server 10 can communicate with the search server 30 and the service server 40 through the message system 50, and the message system 50 is configured to receive a request from the cache server 10 and transmit information to the search server 30 and the service server 40 by sending a message in response to the request, so that the search server 30 and the service server 40 can store the received data. The search server 30 is a server having a function of quickly retrieving a large amount of data, and may be used to make up for failed data for the cache server 10 and ensure the integrity of the data when the data in the local storage space of the cache server 10 is failed.
As shown in fig. 1, interaction 1 and 2.1, the cache server 10 may receive an access request of the access terminal 20 for network information, where the access request includes an identifier of the network information and a corresponding access update identifier. After receiving the access request for the network information sent by the access terminal 20, the cache server 10 may send a network information obtaining request to the service server 40 to request to obtain the network information corresponding to the identifier of the network information; as shown in an interactive action 3 in fig. 1, the service server 40 receives a network information obtaining request sent by the cache server 10, may query corresponding network information according to an identifier of the network information included in the request, and returns the network information to the cache server 10; further, the cache server 10 may send the network information returned by the service server 40 to the access terminal 20, so that the access terminal 20 can obtain the network information. Further, the access terminal 20 may present the network information to the user.
In this embodiment, in addition to the information transfer between the access terminal 20 and the service server 40, the cache server 10 locally records the access amount of each network information, and dynamically updates the access amount of the network information according to the access condition of the access terminal 20 to the network information. Based on this, as shown in an interactive action 2.2 in fig. 1, after receiving the access request of the network information, the cache server 10 may further update the access amount of the locally recorded and ineffectuated network information according to the access update identifier in the access request, and store the identifier of the network information and the corresponding access update identifier in the search server 30. The access update flag refers to a flag indicating what update operation the access terminal 20 requests the cache server 10 to perform on the access amount of the network information, for example, if an increase or decrease operation is performed on the access amount of the network information, the access update flag may be +1 or-1, where +1 indicates that an increase operation is performed and-1 indicates that a decrease operation is performed. As shown in fig. 1, the cache server 10 includes a local storage space, the access amount of the network information is recorded in the local storage space of the cache server 10, and the cache server 10, upon receiving an access request sent by the access terminal 20, may determine whether the access amount of the network information recorded in the local storage space is valid, and update the access amount of the network information recorded in the local storage space according to the access update identifier if the access amount is valid. In this embodiment, since the cache server 10 is a time-efficient cache server, and the access volume stored in the local storage space is invalid, the cache server 10 stores the access update identifier of the network information in the search server 30, on one hand, it may record the access record of the access terminal 20 to the network information, and on the other hand, it may recalculate the access volume of the network information by using the access record of the network information stored in the search server 30 as a calculation basis for compensating for the invalid access volume in the cache server 10 when the access volume of the local network information is invalid. As shown in fig. 1, interactive actions 4 and 5, the cache server 10 is further configured to send a search request to the search server 30 in case of identifying that the access amount of the locally recorded network information is invalid, where the search request includes an identifier of the network information to request an existing access update identifier corresponding to the network information. The search server 30, upon receiving the search request, may query an existing access update identifier corresponding to the network information according to the identifier of the network information in the search request, and return the queried existing access update identifier to the cache server 10. Further, as shown in interaction 6 in fig. 1, the cache server 10 may recalculate the access amount of the network information according to the existing access update identifier corresponding to the network information returned by the search server 30, and replace the access amount of the same network information in the local storage space with the recalculated access amount of the network information, thereby compensating for the failed access amount in the local storage space.
In this embodiment, without limiting the manner of recalculating the access amount of the network information, taking access update identifiers as +1 and-1 as an example, the cache server 10 may accumulate the multiple access update identifiers from the initial timestamp to the latest timestamp according to the timestamps corresponding to the multiple access update identifiers returned by the search server 30, store the accumulated result as the latest access amount of the network information in the local storage space of the cache server 10, and compensate for the failed access amount in the local storage space. It should be noted that the above calculation manner is only an exemplary illustration, and the calculation manner may also be different according to different implementation manners of the access update identifier, if the access update identifier is a letter or other identifier, the cache server 10 needs to convert the access update identifier returned by the search server 30 into a corresponding number of times of access volume according to a corresponding relationship between the access update identifier and the access volume, and then calculate the number of times of access volume after conversion to obtain the access volume of the network information, where a specific implementation manner may be set according to an actual situation.
In an alternative embodiment, the cache server 10 may write the identification of the network information and the corresponding access update identification to the search server 30 in an asynchronous manner when storing the identification of the network information and the corresponding access update identification in the search server 30. Optionally, as shown in the interaction 2.2.1 in the dashed box in fig. 1, when writing the identifier of the network information and the corresponding access update identifier to the search server 30, the cache server 10 may send an asynchronous message to the search server 30 through the message system 50, where the asynchronous message includes the identifier of the network information and the corresponding access update identifier, so that the search server 30 receives and stores the identifier of the network information and the corresponding access update identifier. For example, the cache server 10 may send a write request to the message system 50 when receiving the identifier of the network information and the corresponding access update identifier in the access request sent by the access terminal 20, where the write request includes the identifier of the network information and the corresponding access update identifier, and the message system 50 may send an asynchronous message including the identifier of the network information and the corresponding access update identifier to the search server 30 in an asynchronous manner when receiving the write request, so as to notify the stored identifier of the network information and the corresponding access update identifier. In terms of implementation, the implementation manners of the cache server 10 and the search server 30 are not limited, and any server that can implement the above functions is applicable to the embodiment of the present application. For example, cache server 10 may employ a Redis server with good aging caching performance, and message system 50 may employ a distributed publish-subscribe message system (Apache Kafka) with high throughput capabilities.
Further optionally, the identifier for writing the network information and the corresponding access update identifier to the search server 30 may cause a write failure due to a network failure or a temporary downtime of the search server 30. In this embodiment, in order to ensure that the access records of the access terminal 20 to the network information can be successfully written into the search server 30, a local queue is further provided on the cache server 10 side for the search server 30 to actively read the identifier of the network information and the corresponding access update identifier. Based on this, if the writing fails, the cache server 10 writes the identifier of the network information and the corresponding access update identifier into the local queue, so that the search server 30 actively reads and stores the identifier of the network information and the corresponding access update identifier from the local queue. As shown in the interactive action 2.2.2 and the interactive action 2.2.3 between the local queue and the search server 30 in fig. 1, if the message system 50 fails to send the message, or the message system 50 succeeds in sending the message, but the search server 30 cannot successfully store the identifier of the network information and the corresponding access update identifier, the identifier of the network information and the corresponding access update identifier may be written into the local queue, so that the search server 30 actively reads from the local queue and stores the identifier. In this embodiment, the manner in which the search server 30 actively reads the identifier of the network information and the corresponding access update identifier from the local queue is not limited, for example, the search server 30 may periodically send a read request to the cache server 10, where the request may include the identifier of the network information stored in the search server 30. After receiving the read request, the cache server 10 may query an access update identifier corresponding to the identifier of the network information from the local queue according to the identifier sum of the network information, and return the queried access update identifier corresponding to the identifier of the network information to the search server 30. Further optionally, if the search server 30 locally has an access update identifier corresponding to the identifier of the network information, the read request may further include: the search server 30 has locally a timestamp corresponding to the access update identification. In this way, the cache server 10 can acquire the access update identifier corresponding to the identifier of the network information and saved after the time stamp from the local alignment, and return it to the search server 30.
Further optionally, as shown in the interaction 2.2.1 in the dashed box of fig. 1, the cache server 10 may also send an asynchronous message to the service server 40 corresponding to the network information in an asynchronous manner through the message system 50 while writing the identifier of the network information and the corresponding access update identifier to the search server 30, so that the service server 40 receives and stores the identifier of the network information and the corresponding access update identifier. Accordingly, as shown in the interaction 2.2.3 between the local queue and the service server 40 in fig. 1, if the writing fails, the identifier of the network information and the corresponding access update identifier are written into the local queue, so that the service server 40 actively reads and stores the identifier of the network information and the corresponding access update identifier from the local queue. The identifier of the network information stored in the service server 40 and the corresponding access update identifier may be recorded as original data, or may be recorded as an access update backup, so as to make up for the failed access for the local storage space of the cache server 10. As for the way in which the cache server 10 writes the identifier of the network information and the corresponding access update identifier into the service server 40, and the way in which the service server 40 reads and stores the identifier of the network information and the corresponding access update identifier from the local queue, reference may be made to the content of the embodiment in which the cache server 10 writes the identifier of the network information and the corresponding access update identifier into the search server 30, which is not described herein again.
Further optionally, the time interval between the search server 30 or the service server 40 actively reading the identifier of the network information and the corresponding access update identifier from the local queue is less than the expiration duration of the identifier of the network information and the corresponding access update identifier set by the cache server 10. Due to the timeliness of the cache server 10, the access amount of the network information stored in the local storage space has a fixed effective time, and the network information cannot be used if the access amount of the network information in the local storage space fails. Therefore, in order to ensure that the access amount of the network information in the local storage space can be obtained at any time, the search server 30 or the service server 40 may actively read the identifier of the network information and the corresponding access update identifier from the local queue during the validity period of the access amount of the network information. In this way, even when the access amount of the network information in the local storage space is invalid, the latest access update identifier of the network information can be acquired from the search server 30 or the service server 40, and further the latest access update identifier of the acquired network information is given, so that the access amount of the network information can be recalculated, and the invalid access amount in the local storage space can be compensated.
Further optionally, after providing the identifier of the network information and the corresponding access update identifier stored in the local queue corresponding to the identifier of the network information included in the read request to the search server 30 or the service server 40, it is considered that, since the length of the queue is limited, the cache server 10 may delete the identifier of the network information and the corresponding access update identifier stored in the local queue in the case where the search server 30 or the service server 40 successfully stores the received identifier of the network information and the corresponding access update identifier, so as not to cause the queue to be congested, and the case where the identifier of the network information and the corresponding access update identifier which are not successfully written in the search server 30 or the service server 40 cannot be continuously stored. In this embodiment, since the cache server 10 deletes the identifier of the network information and the corresponding access update identifier stored in the local queue in the case that the search server 30 or the service server 40 successfully stores the identifier of the network information and the corresponding access update identifier. Thus, the search server 30 or the service server 40 may also send a read request to the cache server 10 each time the message system 50 fails to send an asynchronous message, or each time the identification of network information and the corresponding access update identification are not successfully saved. When receiving a read request sent by the search server 30 or the service server 40, the cache server 10 may determine whether the local queue is empty before reading, and if not, directly return the identifier of the network information stored in the local queue and the corresponding access update identifier to the search server 30 or the service server 40, and delete the identifier of the stored network information and the corresponding access update identifier in the local queue under the condition that the search server 30 or the service server 40 successfully stores the identifier of the network information and the corresponding access update identifier, so as to ensure that all the identifier of the network information stored next time and the corresponding access update identifier are the identifier of the latest network information and the corresponding access update identifier that the search server 30 or the service server 40 did not successfully store.
In an optional embodiment, as shown in fig. 1 by interaction 7 and interaction 8, the cache server 10 may further receive an access amount obtaining request sent by the demand side 60, where the access amount obtaining request includes an identifier of the network information, and the cache server 10 may return the corresponding access amount of the local storage space to the demand side 60 according to the identifier of the network information. Since the access amount of the network information in the local storage space is invalid, when identifying whether the access amount of the locally recorded network information is invalid, the cache server 10 may further determine whether the access amount of the locally recorded network information is invalid when receiving an access amount acquisition request for acquiring the access amount of the network information, which is sent by the demand side 60. If the access amount of the locally recorded network information is invalid, the existing access update identifier corresponding to the network information may be obtained from the search server 30 through the interaction actions 4 and 5 in fig. 1, and recalculated to make up for the invalid access amount in the local storage space, so that the demand end 60 may request to obtain the invalid access amount. In this embodiment, since the search server 30 is a server with a fast indexing function, after receiving a search request sent by the cache server 10, it is possible to quickly query an existing access update identifier corresponding to the network information from a large amount of data, and return a query result to the cache server 10, thereby ensuring timeliness of the access amount of the requesting end 60 requesting to acquire the network information.
It should be noted that in the embodiment of the present application, the access terminal 20 and the demand terminal 60 may be the same terminal or different terminals. If the two terminals are the same, the access terminal 20 or the demand terminal 60 may send an access request for network information to the cache server 10 to request the cache server 10 to update the access amount of the network information, or send an access amount obtaining request to the cache server 10 to request the cache server 10 to obtain the access amount of the updated network information. If the access request is different, the cache server 10 may update the access amount of the network information when receiving the access request of the network information sent by the access terminal 20, the access amount after the update of the network information may be provided to the demand terminal 60, and the demand terminal 60 sends the access amount obtaining request to the cache server 10, that is, may obtain the access amount after the update of the network information.
In the embodiment of the present application, an access interface for accessing the cache server 10 is further provided for the access terminal 20, and an access amount obtaining interface for requesting to obtain an access amount of the network information is provided for the demand terminal 60, and the provided interfaces are packaged in a software development kit, so that the access terminal 20 sends an access request to the server 10 through the access interface, and the demand terminal 60 sends an access amount obtaining request to the server 10 through the access amount obtaining interface. It should be noted that the access terminal 20 and the demand terminal 60 in the embodiment of the present application may be the same or different, and are not limited herein. Moreover, the software development kit provided by the embodiment of the application can be applied to various scenes in the internet field, so that the embodiment of the application can be used for carrying out access amount statistics on network information generated in various scenes, and is more diversified in the application process.
In this embodiment, the implementation form of the network information is not limited, and may be, for example, an application page, a web page, data for statistics performed by a server, or the like. If the network information is a page in the application software, the service server 40 may be a server corresponding to the application software, and the access terminal 20 or the demand terminal 60 is a terminal installed with the application software. The application software can be game application software, instant messaging application software, question and answer application software, social application software and the like. If the network information is a web page, the service server 40 is a web server, and the access terminal 20 or the demand terminal 60 is a terminal for installing a browser. If the network information is data for statistics of the server, the access terminal 20 or the demand terminal 60 may be another server, the service server 40 may be a storage server providing a data base for the access terminal 20 or the demand terminal 60, and the specific implementation form may be determined according to the specific demand. In addition, the operation type represented by the access update identifier of the network information may represent an increase operation of accessing the network information, or may represent a decrease operation of accessing the network information, and the operation type represented by the access update identifier may also be different according to different service requirements. For example, the network information is a post in a forum, and the access terminal 20 accesses the post once for +1 times of access represented by the post, the operation type represented by the access update identifier is an add operation. For another example, the network information is information representing the number of lottery draws, and each time the access terminal 20 performs a lottery draw, the number of lottery draws will be-1, and the operation type represented by the access update identifier is the reduction operation.
In the embodiment of the application, in addition to a service server responsible for providing network information, a cache server responsible for managing the access volume of the network information is added, the access volume of the network information can be recorded locally according to the access condition of the access end to the network information, and the access record of the access end to the network information is stored in a search server; under the condition that the access amount of the locally recorded network information is effective, the access amount of the network information can be directly provided for a demand end, and the providing efficiency of the access amount information is improved; in addition, when the fact that the access quantity of the locally recorded network information is invalid is recognized, the access quantity of the network information can be obtained through recalculation according to the access record of the network information stored in the search server, the locally invalid access quantity is made up, and the effectiveness and the reliability of the access quantity provided to a required end are guaranteed. Furthermore, the interface for accessing the cache server is packaged into the software development kit, so that the interface can be provided for an access terminal and/or a demand terminal in any application scene for use, the types of network information which can be processed by the network information processing system are enriched, and the applicability is wider.
An embodiment of the present application further provides a data processing method, which is applicable to a server in the network information processing system, and fig. 2 is a flowchart of the data processing method according to the embodiment of the present application, and as shown in fig. 2, the method includes:
s1, receiving an access request of the access terminal to the network information, wherein the access request comprises the network information identification and the corresponding access updating identification.
S2, according to the access updating identification in the access request, updating the access amount of the locally recorded and ineffectual network information, and storing the identification of the network information and the corresponding access updating identification in the search server.
And S3, sending a search request to the search server when the condition that the access amount of the locally recorded network information is invalid is identified, wherein the search request contains the identification of the network information so as to request the existing access updating identification corresponding to the network information.
And S4, recalculating the access amount of the network information according to the existing access updating identification corresponding to the network information returned by the search server.
In the embodiment of the application, the local access amount of the network information which is not invalid can be updated according to the received network information identifier and the corresponding access update identifier in the access request sent by the access terminal, and the network information identifier and the corresponding access update identifier are stored in the search server. Under the condition that the access quantity of the local network information is identified to be invalid, a search request can be sent to the search server, recalculation is carried out according to the existing access updating identification of the network information returned by the search server, the access quantity of the network information is obtained, the access quantity of the local invalid network information is compensated, and the integrity of data is ensured.
In an optional embodiment, when the identifier of the network information and the corresponding access update identifier are stored in the search server, the identifier of the network information and the corresponding access update identifier may be written to the search server in an asynchronous manner. By the asynchronous writing mode, the access terminal can request to acquire the access amount of the locally stored network information without waiting for the written response result, and the real-time acquisition requirement of the access terminal can be met. And under the condition of write failure, writing the identifier of the network information and the corresponding access updating identifier into a local queue so that the search server can actively read and store the identifier of the network information and the corresponding access updating identifier from the local queue, and further ensuring the integrity of data, so that under the condition that the access amount of the locally stored network information is invalid, the existing access updating identifier of the network information can be timely obtained from the search server to be recalculated, and the invalid access amount is compensated. In another optional embodiment, the identifier of the network information and the corresponding access update identifier may also be written to the service server corresponding to the network information in an asynchronous manner, so as to save the original data, or serve as backup data for recovering the access amount of the locally failed network information. Correspondingly, if the writing fails, the identifier of the network information and the corresponding access update identifier are written into the local queue, so that the service server can actively read and store the identifier of the network information and the corresponding access update identifier from the local queue.
Further optionally, the time interval for the search server or the service server to actively read the identifier of the network information and the corresponding access update identifier from the local queue is smaller than the expiration duration for the identifier of the network information and the corresponding access update identifier set by the server. The method and the device can ensure that the existing access updating identification of the network information can be obtained from the search server or the service server when the access amount of the locally failed network information is recovered, and ensure that the data is not lost.
In an optional embodiment, a read request sent by the search server or the service server to the local queue may also be received, where the read request includes an identifier of the network information, and the identifier of the network information and the corresponding access update identifier, which are stored in the local queue and correspond to the identifier of the network information included in the read request, are provided to the search server or the service server, so that the search server or the service server can still obtain the lost data when the writing of the identifier of the network information and the corresponding access update identifier to the search server or the service server fails. Further, under the condition that the search server or the service server successfully acquires and stores the identifier of the network information and the corresponding access update identifier, the identifier of the network information and the corresponding access update identifier stored in the local queue are deleted, and the local queue is prevented from being blocked.
In an optional embodiment, when identifying whether the access amount of the locally recorded network information is invalid, it may further be determined whether the access amount of the locally recorded network information is invalid under the condition that an access amount obtaining request for obtaining the access amount of the network information sent by a demand side is received, and when determining that the access amount of the locally recorded network information is invalid, a search request is sent to the search server to obtain an existing access update identifier of the network information, so as to recalculate the access amount of the network information.
In an optional embodiment of the present application, the access interface and/or the access amount obtaining interface may be further packaged in a software development kit, and the software development kit is provided to the access terminal and/or the demand terminal, so that the access terminal and/or the demand terminal sends the access request to the server through the access interface and/or sends the access amount obtaining request to the server through the access amount obtaining interface, where the access terminal and the demand terminal may be the same or different. In addition, the software development kit can be applied to various scenes in the internet field, so that the processing of the network information is more diversified in the embodiment of the application.
In the embodiment of the application, the access amount of the network information can be locally recorded according to the access condition of the access terminal to the network information, and the access record of the access terminal to the network information is stored in the search server; under the condition that the locally recorded network information access amount is effective, the network information access amount can be directly provided for the demand end, and the access amount information providing efficiency is improved; in addition, when the fact that the access quantity of the locally recorded network information is invalid is recognized, the access quantity of the network information can be obtained through recalculation according to the access record of the network information stored in the search server, the locally invalid access quantity is made up, and the effectiveness and the reliability of the access quantity provided to a required end are guaranteed.
It should be noted that the implementation logic of the method provided in the foregoing embodiment is the same as the corresponding logic in the foregoing system embodiment, and specific contents may be referred to the foregoing system embodiment, and are not described herein again. In addition, the executing subjects of the steps in the above method embodiments may be the same apparatus, or different apparatuses may be used as the executing subjects of the method. For example, the execution subjects of steps S1 to S4 may be device a; for another example, the execution subject of steps S1 and S2 may be device a, and the execution subject of steps S3 and S4 may be device B; and so on. In addition, in the flow described in the above embodiments and the drawings, a plurality of operations that appear in a specific order are included, but it should be clearly understood that these operations may be performed out of the order they appear herein or in parallel, and the order of the operations such as S1, S2, etc. is merely used to distinguish various operations, and the order of the operations itself does not represent any order of execution. Additionally, the flows may include more or fewer operations, and the operations may be performed sequentially or in parallel.
Fig. 3 is a schematic structural diagram of a server according to an embodiment of the present application, and as shown in fig. 3, the cache server 10 includes: a processor 11, a memory 12 storing computer programs, a local queue 15 and a local storage space 16; the processor 11 and the memory 12 may be one or more, and the local queue 15 and the local storage space 16 are used for storing local data of the server 10.
The memory 12 is mainly used for storing computer programs, and these computer programs can be executed by the processor 11, so that the processor 11 controls the cache server 10 to implement corresponding functions, and complete corresponding actions or tasks. In addition to storing computer programs, the memory 12 may be configured to store various other data to support operations on the cache server 10. Examples of such data include instructions for any application or method operating on the cache server 10.
The memory 12, which may be implemented by any type of volatile or non-volatile memory device or combination thereof, may include, for example, a Static Random Access Memory (SRAM), an electrically erasable programmable read-only memory (EEPROM), an erasable programmable read-only memory (EPROM), a programmable read-only memory (PROM), a read-only memory (ROM), a magnetic memory, a flash memory, a magnetic disk, or an optical disk.
In the embodiment of the present application, the implementation form of the processor 11 is not limited, and may be, for example, but not limited to, a CPU, a GPU, an MCU, or the like. The processor 11 may be regarded as a control system of the cache server 10, and may be configured to execute a computer program stored in the memory 12 to control the cache server 10 to implement corresponding functions and complete corresponding actions or tasks. It should be noted that, depending on the implementation form and the scene where the cache server 10 is located, the functions, actions or tasks that need to be implemented may be different; accordingly, the computer programs stored in the memory 12 may be different, and the execution of different computer programs by the processor 11 may control the cache server 10 to perform different functions, perform different actions or tasks.
In some optional embodiments, as shown in fig. 3, the cache server 10 may further include: power supply components 13 and communication components 14, among other components. Only some components are schematically shown in fig. 3, which does not mean that the cache server 10 includes only the components shown in fig. 3, and the cache server 10 may further include other components according to different application requirements, depending on the product form of the cache server 10.
In the embodiment of the present application, when the processor 11 executes the computer program in the memory 12, it is configured to: receiving an access request of an access terminal to network information, wherein the access request comprises an identifier of the network information and a corresponding access updating identifier; updating the access amount of the network information which is recorded in the local storage space 16 and has not failed according to the access updating identifier in the access request, and storing the identifier of the network information and the corresponding access updating identifier into the search server; and in case of identifying that the access amount of the network information recorded in the local storage space 16 is invalid, sending a search request to the search server, wherein the search request contains an identifier of the network information to request an existing access update identifier corresponding to the network information; and recalculating the access amount of the network information according to the existing access updating identification corresponding to the network information returned by the search server.
In an alternative embodiment, the processor 11, when storing the identification of the network information and the corresponding access update identification in the search server, is configured to: writing the identifier of the network information and the corresponding access updating identifier into the search server in an asynchronous mode; if the writing fails, the identifier of the network information and the corresponding access update identifier are written into the local queue 15, so that the search server actively reads and stores the identifier of the network information and the corresponding access update identifier from the local queue 15.
In an alternative embodiment, the processor 11 is further configured to: writing the identifier of the network information and the corresponding access updating identifier into a service server corresponding to the network information in an asynchronous mode; if the writing fails, the identifier of the network information and the corresponding access update identifier are written into the local queue 15, so that the service server actively reads and stores the identifier of the network information and the corresponding access update identifier from the local queue 15.
In an optional embodiment, the time interval between the search server or the service server actively reading the network information identifier and the corresponding access update identifier from the local queue 15 is less than the expiration duration of the network information identifier and the corresponding access update identifier set by the server.
In an alternative embodiment, the processor 11 is further configured to: receiving a reading request for the local queue 15 sent by a search server or a service server, wherein the reading request comprises an identifier of network information; providing the identifier of the network information corresponding to the identifier of the network information included in the read request and the corresponding access update identifier stored in the local queue 15 to the search server or the service server; and delete the identity of the network information stored in the local queue 15 and the corresponding access update identity.
In an alternative embodiment, the processor 11, when identifying whether the access amount of the network information recorded in the local storage space 16 is invalid, is configured to: receiving an access quantity acquisition request which is sent by a demand end and used for acquiring the access quantity of the network information; in the case where the access amount acquisition request is received, it is determined whether the access amount of the network information recorded in the local storage space 16 is invalid.
In an alternative embodiment, the processor 11 is further configured to: and packaging the access interface and/or the access quantity acquisition interface in a software development kit, and providing the software development kit for the access terminal to send an access request to the server through the access interface and/or send an access quantity acquisition request to the server through the access quantity acquisition interface.
Accordingly, the present application also provides a computer readable storage medium storing a computer program, which when executed by a processor causes the processor to implement the steps in the method embodiments of the present application.
The communication component of fig. 3 described above is configured to facilitate communication between the device in which the communication component is located and other devices in a wired or wireless manner. The device where the communication component is located can access a wireless network based on a communication standard, such as a WiFi, a 2G, 3G, 4G/LTE, 5G and other mobile communication networks, or a combination thereof. In an exemplary embodiment, the communication component receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component may further include a Near Field Communication (NFC) module, Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and the like.
The power supply assembly of fig. 3 described above provides power to the various components of the device in which the power supply assembly is located. The power components may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device in which the power component is located.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims (10)

1. A data processing method, adapted to a cache server, comprising:
receiving an access request of an access terminal to network information, wherein the access request comprises an identifier of the network information and a corresponding access updating identifier;
updating the access amount of the locally recorded and ineffectual network information according to the access updating identification in the access request, and storing the identification of the network information and the corresponding access updating identification in a search server; and
under the condition that the access quantity of the locally recorded network information is identified to be invalid, sending a search request to a search server, wherein the search request contains an identifier of the network information so as to request an existing access updating identifier corresponding to the network information;
and recalculating the access amount of the network information according to the existing access updating identification corresponding to the network information returned by the search server.
2. The method of claim 1, wherein storing the identification of the network information and the corresponding access update identification in a search server comprises
Writing the identifier of the network information and the corresponding access updating identifier into a search server in an asynchronous mode;
and if the writing fails, writing the identifier of the network information and the corresponding access updating identifier into a local queue so that the search server can actively read from the local queue and store the identifier of the network information and the corresponding access updating identifier.
3. The method of claim 1, further comprising:
writing the identifier of the network information and the corresponding access updating identifier into a service server corresponding to the network information in an asynchronous mode;
and if the writing fails, writing the identifier of the network information and the corresponding access updating identifier into a local queue so that the service server can actively read and store the identifier of the network information and the corresponding access updating identifier from the local queue.
4. The method according to claim 2 or 3, wherein a time interval between the search server or the service server actively reading the network information identifier and the corresponding access update identifier from the local queue is less than a time period for which the cache server sets the network information identifier and the corresponding access update identifier to be invalid.
5. The method of claim 4, further comprising:
receiving a reading request of a local queue sent by the search server or the service server, wherein the reading request comprises an identifier of the network information;
providing an access update identifier corresponding to the identifier of the network information included in the read request, which is stored in a local queue, to the search server or the service server; and
and deleting the identifier of the network information stored in the local queue and the corresponding access updating identifier.
6. The method of claim 4, wherein identifying whether the amount of access to the locally recorded network information is stale comprises:
receiving an access quantity acquisition request which is sent by a demand end and used for acquiring the access quantity of the network information;
and under the condition of receiving the access amount acquisition request, judging whether the access amount of the locally recorded network information is invalid or not.
7. The method of claim 6, further comprising:
and packaging the access interface and/or the access quantity acquisition interface in a software development kit, and providing the software development kit for the access terminal to send an access request to the server through the access interface and/or send an access quantity acquisition request to the server through the access quantity acquisition interface.
8. A cache server, comprising: a processor and a memory storing a computer program;
the processor to execute the computer program to:
receiving an access request of an access terminal to network information, wherein the access request comprises an identifier of the network information and a corresponding access updating identifier;
updating the access amount of the locally recorded and ineffectual network information according to the access updating identification in the access request, and storing the identification of the network information and the corresponding access updating identification in a search server; and
under the condition that the access quantity of the locally recorded network information is identified to be invalid, sending a search request to a search server, wherein the search request contains an identifier of the network information so as to request an existing access updating identifier corresponding to the network information;
and recalculating the access amount of the network information according to the existing access updating identification corresponding to the network information returned by the search server.
9. The cache server of claim 8, wherein the processor, when storing the identification of the network information and the corresponding access update identification in a search server, is configured to:
writing the identifier of the network information and the corresponding access updating identifier into the search server in an asynchronous mode;
and if the writing fails, writing the identifier of the network information and the corresponding access updating identifier into a local queue so that the search server can actively read from the local queue and store the identifier of the network information and the corresponding access updating identifier.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, causes the processor to carry out the steps of the method according to any one of claims 1 to 7.
CN202011026090.3A 2020-09-25 2020-09-25 Data processing method, server and medium Active CN112286946B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011026090.3A CN112286946B (en) 2020-09-25 2020-09-25 Data processing method, server and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011026090.3A CN112286946B (en) 2020-09-25 2020-09-25 Data processing method, server and medium

Publications (2)

Publication Number Publication Date
CN112286946A true CN112286946A (en) 2021-01-29
CN112286946B CN112286946B (en) 2024-01-12

Family

ID=74421378

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011026090.3A Active CN112286946B (en) 2020-09-25 2020-09-25 Data processing method, server and medium

Country Status (1)

Country Link
CN (1) CN112286946B (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102693501A (en) * 2012-05-31 2012-09-26 刘志军 Method for analyzing Internet advertisement popularizing effect
CN104104717A (en) * 2014-06-30 2014-10-15 广州唯品会网络技术有限公司 Inputting channel data statistical method and device
CN104796439A (en) * 2014-01-16 2015-07-22 腾讯科技(深圳)有限公司 Webpage pushing method, webpage pushing client, webpage pushing server and webpage pushing system
WO2016131481A1 (en) * 2015-02-18 2016-08-25 Telefonaktiebolaget Lm Ericsson (Publ) An intermediate network node for providing a service to end user devices in a wireless communications network
US20180295134A1 (en) * 2017-04-07 2018-10-11 Citrix Systems, Inc. Systems and methods for securely and transparently proxying saas applications through a cloud-hosted or on-premise network gateway for enhanced security and visibility
CN110377854A (en) * 2019-05-31 2019-10-25 平安科技(深圳)有限公司 User access activity information monitoring method and device, computer equipment
CN110598149A (en) * 2019-08-15 2019-12-20 平安普惠企业管理有限公司 Webpage access method, device and storage medium
CN110708211A (en) * 2019-08-30 2020-01-17 上海唯链信息科技有限公司 Network flow testing method and system
CN111666497A (en) * 2020-06-16 2020-09-15 腾讯科技(上海)有限公司 Application program loading method and device, electronic equipment and readable storage medium

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102693501A (en) * 2012-05-31 2012-09-26 刘志军 Method for analyzing Internet advertisement popularizing effect
CN104796439A (en) * 2014-01-16 2015-07-22 腾讯科技(深圳)有限公司 Webpage pushing method, webpage pushing client, webpage pushing server and webpage pushing system
CN104104717A (en) * 2014-06-30 2014-10-15 广州唯品会网络技术有限公司 Inputting channel data statistical method and device
WO2016131481A1 (en) * 2015-02-18 2016-08-25 Telefonaktiebolaget Lm Ericsson (Publ) An intermediate network node for providing a service to end user devices in a wireless communications network
US20180295134A1 (en) * 2017-04-07 2018-10-11 Citrix Systems, Inc. Systems and methods for securely and transparently proxying saas applications through a cloud-hosted or on-premise network gateway for enhanced security and visibility
CN110377854A (en) * 2019-05-31 2019-10-25 平安科技(深圳)有限公司 User access activity information monitoring method and device, computer equipment
CN110598149A (en) * 2019-08-15 2019-12-20 平安普惠企业管理有限公司 Webpage access method, device and storage medium
CN110708211A (en) * 2019-08-30 2020-01-17 上海唯链信息科技有限公司 Network flow testing method and system
CN111666497A (en) * 2020-06-16 2020-09-15 腾讯科技(上海)有限公司 Application program loading method and device, electronic equipment and readable storage medium

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
AMAN DUBEY 等: "Implementation of an interlligent traffic control system and real time traffic statistics broadcasting", 《ELECTRONICS, COMMUNICATION AND AEROSPACE TECHNOLOGY》, pages 33 - 37 *
吴荣火 等: "考研类网站访问量的统计预测模型及其应用", 《 玉林师范学院学报 》, pages 115 - 121 *
陈泰伟 等: "网站新闻全网阅读量统计方法研究", 《中国传媒科技》, pages 117 - 119 *

Also Published As

Publication number Publication date
CN112286946B (en) 2024-01-12

Similar Documents

Publication Publication Date Title
CN109271435B (en) Data extraction method and system supporting breakpoint continuous transmission
CN102780603B (en) Web traffic control method and device
US20200344128A1 (en) Storage capacity evaluation method based on content delivery network application and device thereof
CN111966289B (en) Partition optimization method and system based on Kafka cluster
CN111787126B (en) Container creation method, server, and storage medium
CN111061752B (en) Data processing method and device and electronic equipment
CN112346829A (en) Method and equipment for task scheduling
EP3788505B1 (en) Storing data items and identifying stored data items
CN106503008B (en) File storage method and device and file query method and device
CN112486915B (en) Data storage method and device
CN114020444B (en) Calling system and method for resource service application in enterprise digital middle station
CN112433921A (en) Method and apparatus for dynamic point burying
CN110955639A (en) Data processing method and device
CN104915376B (en) A kind of archival compression method of file in cloud storage
CN112597151A (en) Data processing method, device, equipment and storage medium
CN113326146A (en) Message processing method and device, electronic equipment and storage medium
CN112286946B (en) Data processing method, server and medium
CN108536759B (en) Sample playback data access method and device
CN110555744A (en) Service data processing method and system
CN109586970B (en) Resource allocation method, device and system
CN113612832A (en) Streaming data distribution method and system
CN113297267A (en) Data caching and task processing method, device, equipment and storage medium
CN113568966A (en) Data processing method and system used between ODS layer and DW layer
CN108920722B (en) Parameter configuration method and device and computer storage medium
CN113297245A (en) Method and device for acquiring execution information

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant