CN113452753B - Data distribution method, device, equipment and storage medium - Google Patents

Data distribution method, device, equipment and storage medium Download PDF

Info

Publication number
CN113452753B
CN113452753B CN202110559837.XA CN202110559837A CN113452753B CN 113452753 B CN113452753 B CN 113452753B CN 202110559837 A CN202110559837 A CN 202110559837A CN 113452753 B CN113452753 B CN 113452753B
Authority
CN
China
Prior art keywords
data
piece
hotspot
service server
issuing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110559837.XA
Other languages
Chinese (zh)
Other versions
CN113452753A (en
Inventor
左孝雷
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing QIYI Century Science and Technology Co Ltd
Original Assignee
Beijing QIYI Century Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing QIYI Century Science and Technology Co Ltd filed Critical Beijing QIYI Century Science and Technology Co Ltd
Priority to CN202110559837.XA priority Critical patent/CN113452753B/en
Publication of CN113452753A publication Critical patent/CN113452753A/en
Application granted granted Critical
Publication of CN113452753B publication Critical patent/CN113452753B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • H04L67/1004Server selection for load balancing
    • H04L67/1008Server selection for load balancing based on parameters of servers, e.g. available memory or workload
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5083Techniques for rebalancing the load in a distributed system
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/52Network services specially adapted for the location of the user terminal

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The application relates to a data distribution method, a device, equipment and a storage medium. The method comprises the steps of acquiring full data; separating at least one piece of hot spot data from the total data; and issuing at least one piece of hotspot data to a service server. Since the data is sent actively, that is, the hotspot data is sent to the service server actively without a user request, the user can obtain the hotspot data without a request, and thus, by adopting the technical scheme of the embodiment, the data can be sent in real time, and the problem of overlarge access pressure of the distribution server caused by that a plurality of service servers access the distribution server at the same time is avoided.

Description

Data distribution method, device, equipment and storage medium
Technical Field
The present application relates to the field of computers, and in particular, to a data distribution method, apparatus, device, and storage medium.
Background
In a traditional data distribution process based on a Content Delivery Network (CDN), a user requests data from the CDN, and a distribution server in the CDN selects a service server according to location information of the user and distributes the data to the user through the service server. It can be seen that the conventional data distribution is passive distribution based on user request, however, such passive distribution not only increases network bandwidth and network delay, but also increases the access pressure of the database.
Disclosure of Invention
The application provides a data distribution method, a data distribution device, data distribution equipment and a storage medium, which are used for solving the problems that network bandwidth is increased, network delay exists and the access pressure of a database can be increased due to the transmission data distribution based on passive distribution.
In a first aspect, a data distribution method is provided, including:
acquiring full data;
separating at least one piece of hot spot data from the full data;
and issuing the at least one piece of hotspot data to a service server.
Optionally, separating at least one piece of hotspot data from the full amount of data includes:
acquiring material identifications of all data in the full data;
and for any piece of data in the full amount of data, when a preset material identification database belonging to the hot spot data comprises the material identification of the data, determining the data as the hot spot data.
Optionally, issuing the at least one piece of hotspot data to a service server, including:
generating a data file corresponding to the at least one piece of hot spot data according to a binary format of ProtoBuf;
and issuing the data file to the service server.
Optionally, the method further comprises:
acquiring a separation timestamp of the at least one piece of hotspot data;
judging whether the separation timestamp is consistent with preset issuing time or not;
and if so, executing the step of issuing the at least one piece of hotspot data to the service server.
Optionally, after acquiring the full amount of data, the method further includes:
receiving a data acquisition request sent by the service server, wherein the data acquisition request carries an identifier of target hotspot data;
and acquiring the target hot spot data from the cached total data based on the identification of the target hot spot data, and returning the target hot spot data to the service server.
In a second aspect, a data distribution method is provided, including:
acquiring full data; separating at least one piece of hot spot data from the full data; the distribution server acquires the at least one piece of hotspot data and issues the at least one piece of hotspot data to the service server; receiving a data acquisition request sent by a service server, wherein the data acquisition request carries an identifier of the target hotspot data; based on the identification of the target hotspot data, acquiring the target hotspot data from the cached total data, and returning the target hotspot data to the service server;
the business server receives and stores the at least one piece of hotspot data; judging whether the stored hotspot data has missing target hotspot data; and if the missing target hotspot data exist, sending the data acquisition request.
Optionally, the following steps are performed by a distribution server capable of communicating with the traffic server:
the distribution server executes the acquisition of the full amount of data; separating at least one piece of hot spot data from the full data; the distribution server acquires the at least one piece of hotspot data and issues the at least one piece of hotspot data to the service server; receiving a data acquisition request sent by a service server, wherein the data acquisition request carries an identifier of the target hotspot data; and acquiring the target hotspot data from the cached total data based on the identification of the target hotspot data, and returning the target hotspot data to the service server.
In a third aspect, there is provided a data distribution apparatus comprising:
an acquisition unit configured to acquire full-volume data;
the separation unit is used for separating at least one piece of hot spot data from the full data;
and the issuing unit is used for issuing the at least one piece of hot spot data to the service server.
An electronic device, comprising: the system comprises a processor, a memory and a communication bus, wherein the processor and the memory are communicated with each other through the communication bus; the memory for storing a computer program; the processor is configured to execute the program stored in the memory, and implement the data distribution method according to the first aspect.
In a fifth aspect, a computer-readable storage medium is provided, in which a computer program is stored, which computer program, when being executed by a processor, implements the data distribution method according to the first aspect.
Compared with the prior art, the technical scheme provided by the embodiment of the application has the following advantages: according to the technical scheme provided by the embodiment of the application, the full data is obtained, the at least one piece of hot data is obtained by separating the full data, and the at least one piece of hot data is issued to the service server. Since the data is sent actively, that is, the hotspot data is sent to the service server actively without a user request, the user can obtain the hotspot data without a request, and thus, by adopting the technical scheme of the embodiment, the data can be sent in real time, and the problem of overlarge access pressure of the distribution server caused by that a plurality of service servers access the distribution server at the same time is avoided.
In addition, after the hot spot data is distributed, the original remote access of the service server is changed into local access, so that the bandwidth cost is reduced, the data access efficiency is improved, and the service server plays a good role in reducing the stability and the cost of the service.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
Fig. 1 is a schematic flow chart of a data distribution method in an embodiment of the present application;
FIG. 2 is a schematic flow chart illustrating another data distribution method according to an embodiment of the present application;
FIG. 3 is a schematic flow chart illustrating another data distribution method according to an embodiment of the present application;
FIG. 4 is a schematic structural diagram of a data distribution system in an embodiment of the present application;
FIG. 5 is a schematic structural diagram of a data distribution device in an embodiment of the present application;
fig. 6 is a schematic structural diagram of an electronic device in an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.
The term "and/or" herein is merely an association relationship describing an associated object, and means that there may be three relationships, for example, a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter associated objects are in an "or" relationship.
In order to facilitate understanding of the embodiments of the present application, some terms referred to in the present application will be explained below.
Full data: generally refers to data obtained in batches, such as pieces of data for a certain service pulled from the cloud.
Hot spot data: data that is accessed in large quantities within a short time. The hot spot data may be related to a time attribute, a region attribute, or an interaction attribute, for example, data of some regions may be accessed in a large amount in a short time as soon as the data is released, so such hot spot data is related to the region attribute; as another example, some data that is typically published during prime time (e.g., eight-ten pm) is easily accessed in large quantities in a short period of time once published, so such hot spot data is associated with temporal attributes; also some data representing the user's replies or comments are easily accessed in large quantities in a short time, so such hot data are relevant to the interaction attributes.
Cold data: the data left by removing the hot spot data from the full volume data is cold data.
In order to solve the problem that the network bandwidth is increased, network delay exists and the access pressure of a database is increased due to the passive distribution-based driven data distribution proposed in the related art, an embodiment of the present application provides a data distribution method, which may include the following steps, as shown in fig. 1:
step 101, acquiring full data;
step 102, separating at least one piece of hotspot data from the full data;
and 103, issuing at least one piece of hot spot data to a service server.
In this embodiment, steps 101 to 103 may be performed by the same device, for example, all the steps are performed by the distribution server, and the separation module performing step 102 is integrated in the distribution server; or, step 101 and step 103 are executed by the same device, for example, by a distribution server, and the separation module executing step 102 runs in another device, where the distribution server can communicate with the device on which the separation module runs through a network, and after acquiring the full amount of data, the distribution server calls the separation module through the network to perform separation on the full amount of data, so as to obtain at least one piece of hotspot data.
Optionally, in this embodiment, the hotspot data includes, but is not limited to, a hotspot picture, a hotspot video, forwarding data of the user, and/or a comment amount of the user.
Optionally, the separation of cold and hot data may be performed on the full data based on the comparison of the materials. Specifically, material identification of each piece of data in the full data is obtained; and for any piece of data in the full amount of data, when the preset material identification database belonging to the hot data comprises the material identification of the data, determining the data as the hot data.
The material identifier, that is, the material information, may include information for uniquely identifying the material, such as a number or a name of the material, or may include an address link for acquiring the material.
Taking the material identifier as the number of the material as an example, the material identifier library may include the number of the material of each hotspot data, and when the material identifier library includes the number of the material of the total data, the total data is determined as the hotspot data.
The method comprises the following steps of obtaining a material identification library in advance by adopting a big data statistics mode on the basis of the principle that the access frequency is not less than a frequency threshold value on a big data side; it should be understood that obtaining the material identifier library in the principle that the access frequency is not less than the frequency threshold is only an optional embodiment, and the material identifier library may also be obtained according to a regional attribute or an interaction attribute, which is not specifically limited in this embodiment.
Alternatively, the frequency threshold may be set empirically for the human.
Correspondingly, after the material identification library is obtained in a big data statistics mode, a hotspot data query interface provided by a big data side can be accessed through a related technology provided by a BRPC frame, so that hotspot data are separated from the full data.
Optionally, in this embodiment, when the full amount of data is pulled from the cloud, both the time for pulling the full amount of data from the cloud and the time for performing cold-hot data separation on the pulled full amount of data may be preset.
In one example, the full amount of data can be periodically pulled from the cloud, and cold and hot data separation is performed in real time, so that hot data can be timely issued to the service server;
in another example, the full amount of data can be periodically pulled from the cloud, and the cold data and the hot data are periodically separated, so that the cold data and the hot data are intensively separated from the full amount of data pulled for many times.
Optionally, in this embodiment, the time for the distribution server to issue the undelivered hotspot data may be preset.
For example, hot spot data is periodically issued to each service server; or, issuing the hotspot data within a preset time after extracting the non-issued hotspot data, and the like.
According to the technical scheme provided by the embodiment of the application, the full data is obtained, the at least one piece of hot data is obtained by separating the full data, and the at least one piece of hot data is issued to the service server. Since the data is sent actively, that is, the hotspot data is sent to the service server actively without a user request, the user can obtain the hotspot data without a request, and thus, by adopting the technical scheme of the embodiment, the data can be sent in real time, and the problem of overlarge access pressure of the distribution server caused by that a plurality of service servers access the distribution server at the same time is avoided.
In addition, after the hot spot data is distributed, the original remote access of the service server is changed into local access, so that the bandwidth cost is reduced, the data access efficiency is improved, and the service server plays a good role in reducing the stability and the cost of the service.
In order to save time and improve the resource utilization rate of the distribution server, another embodiment of the present application may set to periodically issue hot spot data. Specifically, for at least one piece of hotspot data separated from the full data, a separation timestamp of the at least one piece of hotspot data is acquired, whether the separation timestamp is consistent with a preset issuing time or not is judged, if the separation timestamp is consistent with the preset issuing time, the at least one piece of hotspot data is issued to the service server, and if the separation timestamp is inconsistent with the preset issuing time, the preset issuing time is waited to arrive, and then the at least one piece of hotspot data is issued to the service server.
The preset issuing time may be set manually or calculated according to a preset issuing period, which is not limited in this embodiment.
It can be understood that, if the separation timestamp is not consistent with the preset delivery time, when the preset delivery time arrives, the hotspot data delivered to the service server may include, in addition to the at least one piece of hotspot data, hotspot data separated from other full-volume data different from the full-volume data in step 101, that is, while waiting for the preset delivery time to arrive, new full-volume data is obtained, and new hotspot data is separated from the new full-volume data.
In another embodiment of the present application, when the data size of at least one piece of hotspot data separated from the full data is relatively large, considering that at least one piece of hotspot data is directly distributed to the service server, there may be problems that part of the data is lost, and it is difficult for the service server to receive all the hotspot data in real time.
Optionally, in this embodiment, a data file corresponding to at least one piece of hotspot data is generated according to a binary format of the ProtoBuf, and the data file is issued to the service server.
Optionally, in this embodiment, at least one piece of hot data may be written into the same data file; of course, in order to increase the issuing speed, the number of data files written in at least one hot data file may be determined according to the current network bandwidth. For example, when the storage space occupied by at least one piece of hot spot data is 10M, if the current network bandwidth can transmit 3M data files at most, it may be determined that the number of the data files written in the at least one piece of hot spot data file may be 4, where 3 data files are all 3M, and the remaining one data file is 1M.
It should be understood that, when the number of data files written in at least one hot spot data file is determined according to the network bandwidth, the number of the finally determined data files should be ensured to be smaller than the number of hot spot data in at least one hot spot data.
It can be understood that, in this embodiment, the hot data written in different data files are not intersected, that is, the same hot data cannot be written in both the a data file and the B data file.
Optionally, when the at least one piece of hotspot data is delivered in a data file manner, whether to deliver the data file to the service server may be determined by whether the generation timestamp of the data file is consistent with a preset delivery time.
In this embodiment, the generating timestamp of the hot data may be a time when the hot data is written into the data file.
In another embodiment of the present application, after pulling the full amount of data, Redis caching may be performed on the full amount of data, so that after the hot spot data in the service server is lost, the lost hot spot data is obtained from the Redis caching.
Specifically, as shown in fig. 2, the process of the distribution server returning the missing hotspot data to the service server may include the following steps:
step 201, receiving a data acquisition request sent by a service server;
the data acquisition request carries the identification of the target hotspot data.
The target hotspot data is hotspot data lost in the service server.
Optionally, the identification of the target hotspot data includes, but is not limited to, material identification of the target hotspot data.
Step 202, based on the identification of the target hot spot data, obtaining the target hot spot data from the cached total data, and returning the target hot spot data to the service server.
In the following, the interaction between the distribution server and the service server is described by taking an example that the distribution server can separate cold data and hot data, and at this time, a separation module for separating cold data and hot data is integrated in the distribution server.
Optionally, another embodiment of the present application provides a data distribution method, as shown in fig. 3, which may include the following processes:
301, a distribution server acquires full data;
step 302, the distribution server separates at least one piece of hotspot data from the full data;
step 303, the distribution server issues at least one piece of hotspot data to the service server;
step 304, the service server receives and stores at least one piece of hotspot data;
step 305, the service server judges whether the stored hotspot data has missing target hotspot data, if so, step 306 is executed, otherwise, the process is ended;
in practical application, when a business server uses hot spot data, if the hot spot data is found to be missing, the full amount of data in the Redis cache of the distribution server is accessed through the technology provided by the BRPC, so that the missing hot spot data is obtained.
Step 306, the service server sends a data acquisition request to the distribution server, wherein the data acquisition request carries an identifier of the target hotspot data;
step 307, the distribution server receives a data acquisition request;
step 308, the distribution server acquires target hot spot data from the cached total data based on the identification of the target hot spot data;
step 309, the distribution server returns the target hotspot data to the service server.
A data distribution system provided in the embodiment of the present application is still described below by taking an example that modules for implementing hot and cold data separation are integrated in a distribution server, as shown in fig. 4, the system may include:
a distribution server 401 and a service server 402;
a distribution server 401 for acquiring full data; separating at least one piece of hot spot data from the full data; the distribution server acquires at least one piece of hotspot data and issues the at least one piece of hotspot data to the service server 402;
a service server 402, configured to receive and store at least one piece of hot spot data; judging whether the stored hot spot data has missing target hot spot data or not; if the target hotspot data are missing, a data acquisition request is sent to the distribution server 401, and the data acquisition request carries the identifier of the target hotspot data.
The distribution server 401 is further configured to:
receiving a data acquisition request;
and acquiring target hotspot data from the cached full data based on the identification of the target hotspot data, and returning the target hotspot data to the service server.
Based on the same concept, a data distribution device is provided in the embodiments of the present application, and for specific implementation of the device, reference may be made to the description of the method embodiment, and repeated descriptions are omitted. As shown in fig. 5, the apparatus mainly includes:
an obtaining unit 501, configured to obtain full data;
a separating unit 502, configured to separate at least one piece of hotspot data from the full amount of data;
the issuing unit 503 is configured to issue at least one piece of hotspot data to the service server.
Optionally, the separation unit 502 is specifically configured to:
acquiring material identifications of all data in the full data;
and for any piece of data in the full amount of data, when the preset material identification database belonging to the hot data comprises the material identification of the data, determining the data as the hot data.
Optionally, the issuing unit 503 is specifically configured to:
generating a data file corresponding to at least one piece of hot spot data according to a binary format of ProtoBuf;
and transmitting the data file to a service server.
Optionally, the data distribution apparatus is further configured to:
acquiring a separation timestamp of at least one piece of hotspot data;
judging whether the separation timestamp is consistent with preset issuing time or not;
and if so, executing the step of issuing at least one piece of hot spot data to the service server.
Optionally, the data distribution apparatus is further configured to:
after acquiring the full data, receiving a data acquisition request sent by a service server, wherein the data acquisition request carries an identifier of target hotspot data;
and acquiring target hotspot data from the cached full data based on the identification of the target hotspot data, and returning the target hotspot data to the service server.
Based on the same concept, an embodiment of the present application further provides an electronic device, as shown in fig. 6, the electronic device mainly includes: a processor 601, a memory 602, and a communication bus 603, wherein the processor 601 and the memory 602 communicate with each other via the communication bus 603. The memory 602 stores a program executable by the processor 601, and the processor 701 executes the program stored in the memory 602, so as to implement the following steps:
acquiring full data;
separating at least one piece of hot spot data from the full data;
and issuing at least one piece of hot spot data to a service server.
The communication bus 603 mentioned in the above electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus 603 may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown in FIG. 6, but this is not intended to represent only one bus or type of bus.
The Memory 602 may include a Random Access Memory (RAM) or a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. Alternatively, the memory may be at least one storage device located remotely from the processor 601.
The Processor 601 may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), etc., and may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component.
In still another embodiment of the present application, there is also provided a computer-readable storage medium having stored therein a computer program which, when run on a computer, causes the computer to execute the data distribution method described in the above-described embodiment.
In the above embodiments, all or part of the implementation may be realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored on a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wire (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wirelessly (e.g., infrared, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that includes one or more of the available media. The available media may be magnetic media (e.g., floppy disks, hard disks, tapes, etc.), optical media (e.g., DVDs), or semiconductor media (e.g., solid state drives), among others.
It is noted that, in this document, relational terms such as "first" and "second," and the like, may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The foregoing are merely exemplary embodiments of the present invention, which enable those skilled in the art to understand or practice the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (8)

1. A method for data distribution, comprising:
acquiring full data;
separating at least one piece of hot spot data from the full data;
issuing the at least one piece of hotspot data to a service server;
the issuing of the at least one piece of hotspot data to the service server includes:
periodically issuing the at least one piece of hotspot data to the service server;
after the acquiring of the full amount of data, the method further comprises:
receiving a data acquisition request sent by the service server, wherein the data acquisition request carries an identifier of target hotspot data;
and acquiring the target hotspot data from the cached total data based on the identification of the target hotspot data, and returning the target hotspot data to the service server.
2. The method of claim 1, wherein separating at least one piece of hotspot data from the full amount of data comprises:
acquiring material identifications of all data in the full data;
and for any piece of data in the total data, when a preset material identification database belonging to the hot data comprises the material identification of the data, determining the data as the hot data.
3. The method of claim 1, wherein issuing the at least one piece of hotspot data to a service server comprises:
generating a data file corresponding to the at least one piece of hotspot data according to a binary format of ProtoBuf;
and issuing the data file to the service server.
4. The method of claim 1, further comprising:
acquiring a separation timestamp of the at least one piece of hotspot data;
judging whether the separation timestamp is consistent with preset issuing time or not;
and if so, executing the step of issuing the at least one piece of hotspot data to the service server.
5. A method for data distribution, comprising:
the distribution server acquires the full data; separating at least one piece of hot spot data from the full data; the distribution server acquires the at least one piece of hotspot data and issues the at least one piece of hotspot data to the service server; receiving a data acquisition request sent by a service server, wherein the data acquisition request carries an identifier of target hotspot data; based on the identification of the target hot spot data, acquiring the target hot spot data from the cached total data, and returning the target hot spot data to the service server;
the business server receives and stores the at least one piece of hotspot data; judging whether the stored hotspot data has missing target hotspot data; and if the missing target hotspot data exist, sending the data acquisition request.
6. A data distribution apparatus, comprising:
an acquisition unit configured to acquire full-volume data;
the separation unit is used for separating at least one piece of hot spot data from the full data;
the issuing unit is used for issuing the at least one piece of hot spot data to the service server;
the issuing unit is used for:
the issuing of the at least one piece of hotspot data to the service server includes:
periodically issuing the at least one piece of hotspot data to the service server;
the issuing unit is further configured to:
after the acquiring the full amount of data, the method further comprises:
receiving a data acquisition request sent by the service server, wherein the data acquisition request carries an identifier of target hotspot data;
and acquiring the target hotspot data from the cached total data based on the identification of the target hotspot data, and returning the target hotspot data to the service server.
7. An electronic device, comprising: the system comprises a processor, a memory and a communication bus, wherein the processor and the memory are communicated with each other through the communication bus; the memory for storing a computer program; the processor, which executes the program stored in the memory, implements the data distribution method of any one of claims 1 to 4.
8. A computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the data distribution method of any one of claims 1 to 4.
CN202110559837.XA 2021-05-21 2021-05-21 Data distribution method, device, equipment and storage medium Active CN113452753B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110559837.XA CN113452753B (en) 2021-05-21 2021-05-21 Data distribution method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110559837.XA CN113452753B (en) 2021-05-21 2021-05-21 Data distribution method, device, equipment and storage medium

Publications (2)

Publication Number Publication Date
CN113452753A CN113452753A (en) 2021-09-28
CN113452753B true CN113452753B (en) 2022-09-30

Family

ID=77810009

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110559837.XA Active CN113452753B (en) 2021-05-21 2021-05-21 Data distribution method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN113452753B (en)

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106407002B (en) * 2016-08-22 2018-07-13 平安科技(深圳)有限公司 Data processing task executes method and apparatus
CN109120709A (en) * 2018-09-03 2019-01-01 杭州云创共享网络科技有限公司 A kind of caching method, device, equipment and medium
CN109597915B (en) * 2018-09-18 2022-03-01 北京微播视界科技有限公司 Access request processing method and device
CN109246229B (en) * 2018-09-28 2021-08-27 网宿科技股份有限公司 Method and device for distributing resource acquisition request
CN110213356B (en) * 2019-05-21 2021-11-12 深圳壹账通智能科技有限公司 Login processing method based on data processing and related equipment
CN110557445A (en) * 2019-08-22 2019-12-10 上海艾融软件股份有限公司 Access request routing method and device, storage medium and electronic equipment
CN112764948A (en) * 2021-01-22 2021-05-07 土巴兔集团股份有限公司 Data transmission method, data transmission device, computer device, and storage medium

Also Published As

Publication number Publication date
CN113452753A (en) 2021-09-28

Similar Documents

Publication Publication Date Title
CN111510395B (en) Service message reporting method, device, equipment and medium
CN108897854B (en) Monitoring method and device for overtime task
CN107404480B (en) A kind of transmission method of stream medium data, storage medium and streaming media server
CN113343088A (en) Data processing method, system, device, equipment and storage medium
CN103733568A (en) Stream processing using a client-server architecture
CN115004673B (en) Message pushing method, device, electronic equipment and computer readable medium
CN108055311B (en) HTTP asynchronous request method, device, server, terminal and storage medium
CN113179314B (en) Channel installation package processing method and device
CN109510850B (en) Method, device and system for processing browsing request
CN115622906A (en) Application log capturing system and method
CN113452753B (en) Data distribution method, device, equipment and storage medium
CN114090623A (en) Method and device for creating cache resources, electronic equipment and storage medium
CN112118352B (en) Method and device for processing notification trigger message, electronic equipment and computer readable medium
KR101845195B1 (en) Multiple Resource Subscriptions Association Method in an M2M system
CN113783913A (en) Message pushing management method and device
CN115297095B (en) Back source processing method, device, computing equipment and storage medium
CN113127923A (en) Method and device for managing authority
CN112039936A (en) Data transmission method, first data processing equipment and monitoring system
CN109088907B (en) File transfer method and device
CN112306791B (en) Performance monitoring method and device
CN105635930B (en) Method and device for executing deletion operation of group member resources and initiator device
CN114301848A (en) CDN-based communication method, system, device and storage medium
CN113473247A (en) Video playing request processing method, device and system and electronic equipment
CN112000618A (en) File change management method, device, equipment and storage medium for cluster nodes
CN113055443B (en) Resource data deployment method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant