CN112988769A

CN112988769A - Advertisement service data processing method, device, system and storage medium

Info

Publication number: CN112988769A
Application number: CN202110168136.3A
Authority: CN
Inventors: 支海邦
Original assignee: Beijing QIYI Century Science and Technology Co Ltd
Current assignee: Beijing QIYI Century Science and Technology Co Ltd
Priority date: 2021-02-04
Filing date: 2021-02-04
Publication date: 2021-06-18

Abstract

The application relates to a method, a device, a system and a storage medium for processing advertisement service data, wherein the method comprises the following steps: the method comprises the steps of firstly obtaining incremental data of target advertisement business data, then updating the current target advertisement business data according to the incremental data to obtain updated target advertisement business data, and finally sending the updated target advertisement business data to a distribution server so as to facilitate later distribution. Therefore, in the technical scheme of the application, only the incremental data of the target advertisement service data is acquired, and in the process of acquiring the updated target advertisement service data, the decoupling of the incremental content and the previously produced content in the production link is realized, the target advertisement service data does not need to be exported in full, the time required by data export is saved, and the efficiency of producing the advertisement service data is improved.

Description

Advertisement service data processing method, device, system and storage medium

Technical Field

The present application relates to the field of data processing technologies, and in particular, to a method, an apparatus, a system, and a storage medium for processing advertisement service data.

Background

In the current network era, the advertisement delivery through the network is more and more common, such as the advertisement delivery through the web page, video and the like. For a platform side for delivering advertisements, when delivering advertisements, advertisement service data needs to be produced, that is, advertisement service data is derived from an advertisement service database and then distributed to a client side equipped with the platform, so as to complete delivery of advertisements.

At present, advertisement service data are derived from an advertisement service database, a timing full derivation mode is often adopted, due to the fact that the advertisement service data are different in size, the advertisement service data with large data size and complex data structure need to be distributed frequently, for the data, a large amount of time can be consumed by the current timing full derivation mode, and therefore the data derivation speed is reduced, the derivation efficiency can be affected, and further the distribution time delay is caused, and the higher real-time requirement of some advertisement service data cannot be met.

Disclosure of Invention

In order to overcome the problems of slow data export speed and low export efficiency in the related technology at least to a certain extent, the application provides an advertisement service data processing method, device, system and storage medium.

According to a first aspect of the present application, there is provided an advertisement service data processing method, including:

obtaining incremental data of target advertisement service data;

updating the current target advertisement service data according to the incremental data to obtain updated target advertisement service data;

and sending the updated target advertisement service data to a distribution server.

In an optional embodiment, the obtaining incremental data of the target advertisement service data includes:

acquiring a target storage position with changed data;

exporting data stored in the target storage position to obtain initial incremental data;

and acquiring incremental data of a target type from the initial incremental data as the incremental data of the target advertisement service data, wherein the target type is the type of the target advertisement service data.

In an optional embodiment, the obtaining the target storage location where the data is changed includes:

receiving a data table record identifier with changed data;

when the number of the received data table record identifications reaches a preset number, packaging the data table record identifications of the preset number into data packets, and pushing the data packets to a preset monitoring queue;

and if the data packet exists in the preset monitoring queue, acquiring the data packet, and taking a data table record identifier in the data packet as the target storage position.

In an optional embodiment, the updating the current target advertisement service data according to the incremental data to obtain updated target advertisement service data includes:

and combining the incremental data and the current target advertisement service data to obtain the updated target advertisement service data.

In an optional embodiment, after updating the current target advertisement service data according to the incremental data to obtain updated target advertisement service data, and before distributing the updated target advertisement service data to the client according to a preset distribution manner, the method further includes:

and determining the version number of the updated advertisement service data according to a preset version number updating rule.

In an optional embodiment, the method further comprises:

responding to an advertisement display instruction sent by a client, and calling advertisement business data to be distributed corresponding to the advertisement display instruction from the distribution server;

and distributing the advertisement service data to be distributed to the client according to a preset distribution mode.

In an optional embodiment, the distributing the advertisement service data to be distributed to the client according to a preset distribution mode includes:

determining the storage position of each data block according to the current data block storage state, wherein the data blocks are obtained by dividing the advertisement service data to be distributed according to preset division rules in advance;

and sending the storage position to the client so that the client downloads the corresponding data block from the storage position and obtains the advertisement service data to be distributed according to the downloaded data block.

In an optional embodiment, the determining the storage location of each data block according to the current storage state of the data block includes:

determining the storage state of each data block by other clients in the cluster where the client is located according to the current storage state of the data block;

for any data block, determining the network identification of the client storing the data block as the storage position of the data block.

According to a second aspect of the present application, there is provided an advertisement service data processing apparatus, the apparatus comprising:

the first acquisition module is used for acquiring incremental data of the target advertisement service data;

the updating module is used for updating the current target advertisement service data according to the incremental data to obtain the updated target advertisement service data;

and the sending module is used for sending the updated target advertisement service data to a distribution server.

In an optional embodiment, the obtaining module includes:

the first acquisition unit is used for acquiring a target storage position with changed data;

the derivation unit is used for deriving the data stored in the target storage position to obtain initial incremental data;

and the second acquisition unit is used for acquiring the incremental data of the target type from the initial incremental data as the incremental data of the target advertisement service data, wherein the target type is the type of the target advertisement service data.

In an optional embodiment, the first obtaining unit includes:

the receiving subunit is used for receiving the data table record identifier with changed data;

the packaging subunit is used for packaging the data table record identifications with the preset number into data packets and pushing the data packets to a preset monitoring queue when the number of the received data table record identifications reaches the preset number;

and the obtaining subunit is configured to obtain the data packet if the data packet exists in the preset listening queue, and use a data table record identifier in the data packet as the target storage location.

In an optional embodiment, the update module comprises:

and the merging unit is used for merging the incremental data and the current target advertisement service data to obtain the updated target advertisement service data.

In an optional embodiment, the apparatus further comprises:

and the determining module is used for determining the version number of the updated advertisement service data according to a preset version number updating rule.

In an optional embodiment, the module further comprises:

the calling module is used for calling advertisement business data to be distributed corresponding to the advertisement display instruction from the distribution server in response to the advertisement display instruction sent by the client;

and the distribution module is used for distributing the advertisement service data to be distributed to the client according to a preset distribution mode.

In an alternative embodiment, the distribution module comprises:

the determining unit is used for determining the storage position of each data block according to the current data block storage state, wherein the data blocks are obtained by dividing the advertisement service data to be distributed according to preset dividing rules in advance;

and the distribution unit is used for sending the storage position to the client so as to enable the client to download the corresponding data block from the storage position and obtain the advertisement service data to be distributed according to the downloaded data block.

In an optional embodiment, the determining unit comprises:

the first determining subunit is configured to determine, according to the current storage state of the data block, a storage state of each data block by another client in the cluster where the client is located;

and the second determining subunit is used for determining the network identification of the client side storing the data block as the storage position of the data block for any data block.

According to a third aspect of the present application, there is provided an advertisement service data processing system, comprising: at least one processor and memory;

the processor is configured to execute the advertisement service data processing program stored in the memory, so as to implement the advertisement service data processing method according to the first aspect of the present application.

According to a fourth aspect of the present application, there is provided a storage medium storing one or more programs executable by the advertisement service data processing system according to the third aspect of the present application to implement the advertisement service data processing method according to the first aspect of the present application.

The technical scheme provided by the application can comprise the following beneficial effects: the method comprises the steps of firstly obtaining incremental data of target advertisement business data, then updating the current target advertisement business data according to the incremental data, realizing decoupling of the incremental content and the previously produced content in a production link in the process of obtaining the updated target advertisement business data because the method only obtains the incremental data of the target advertisement business, and finally sending the updated target advertisement business data to a distribution server so as to be convenient for later distribution. Based on this, in the technical scheme of the application, only incremental data of the target advertisement service data is acquired, and full derivation is not needed, so that decoupling of incremental content and previously produced content in a production link is realized, time required by data derivation is saved, and efficiency of producing advertisement service data is improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and together with the description, serve to explain the principles of the application.

Fig. 1 is a schematic flowchart of an advertisement service data processing method according to an embodiment of the present application;

FIG. 2 is a schematic flow chart illustrating a process for obtaining incremental data of targeted advertising service data according to an embodiment of the present application;

FIG. 3 is a signal flow diagram illustrating a method of performing advertising data production according to one embodiment of the present application;

FIG. 4 is a flowchart of a specific example of a method for advertising data production provided by an embodiment of the present application;

fig. 5 is a schematic flowchart illustrating a process of distributing advertisement service data to a client in an advertisement service data processing method according to an embodiment of the present application;

fig. 6 is a signal flow diagram illustrating distribution of advertisement service data according to an embodiment of the present application;

FIG. 7 is a schematic flow chart illustrating distribution of advertisement traffic data to a client according to an embodiment of the present application;

fig. 8 is a flowchart illustrating a download path determination according to another embodiment of the present application;

fig. 9 is a schematic structural diagram of an advertisement data processing apparatus according to another embodiment of the present application;

fig. 10 is a schematic structural diagram of an advertisement data processing system according to another embodiment of the present application.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

Referring to fig. 1, fig. 1 is a schematic flowchart illustrating an advertisement service data processing method according to an embodiment of the present application.

As shown in fig. 1, the advertisement service data processing method provided in this embodiment may include:

and S101, acquiring incremental data of the target advertisement service data.

It should be noted that the target advertisement service data refers to a certain type of advertisement service data, and since there are various types of advertisement service data, such as rtb data supporting an online delivery service and tracking data supporting a tracking service, in order to avoid confusion that may be generated at a later stage, various types of data may be separately and temporarily stored, for example, an incremental directory is set for each type of data, and after the incremental data is obtained, the data is stored in the corresponding incremental directory according to the type of the data, and a specific process may refer to fig. 2, where fig. 2 is a schematic flow diagram for obtaining the incremental data of the target advertisement service data according to an embodiment of the present application.

As shown in fig. 2, a process for obtaining incremental data of target advertisement service data provided by an embodiment of the present application may include:

step S201, a target storage location where data changes is acquired.

The step of obtaining the target storage location may be implemented by means of a preset snoop queue, which is essentially a linear table with limited operations of front-end (head of line) deletion and back-end (tail of line) insertion. Before this step, a preset snoop queue needs to be initialized, and the initialization process may be to add a relevant instruction to put a storage location where data changes into the snoop queue in the database. In a specific example, the snoop queue may be a Redis queue, and the insertion of the storage location where the data in the database changes into the Redis queue may be implemented by means of an lpush instruction.

Since the database has a hierarchy, for example, the storage location of the data a may be the database a — the data table 1 — the record a, that is, the data a is the data of the record a of the data table 1 stored in the database a, if the data a changes, the storage location inserted into the monitoring queue may be specific to the hierarchy of the record, or may be specific to only the hierarchy of the data table, and both storage locations may exist in the monitoring queue at the same time.

In a specific example, there may be data table a and data table B in the database, where data table a is shown in table 1 and data table B is shown in table 2.

Recording	Data of
		Record A1	Data A1
Record A2	Data A2
		Record A3	Data A3
Record A4	Data A4

TABLE 1

Recording	Data of
		Record B1	Data B1
Record B2	Data B2
		Record B3	Data B3
Record B4	Data B4

TABLE 2

Wherein, the data in the data table a changes to record a3 storage location, and the data in the data table B changes to record B4 storage location, so the storage locations in the snoop queue are:

the storage position one: database/data table a/record a 3;

storage position two: database/data table B/record B4.

Of course, what level of hierarchy of storage locations to use may be predefined, which may be based on the size of the data table and the complexity of the data stored therein. For a data table with single storage data and small occupied space, when the data of the data table changes, a target storage location only specific to the data table can be inserted into the snoop queue, and for the storage location, all data in the data table needs to be acquired. For a data table with more complex stored data and larger occupied space, when the data of the data table changes, a storage position (namely, a data table record identifier) specific to the level of recording can be inserted into the monitoring queue, and for the storage position, only incremental data corresponding to the data table record identifier in the storage position needs to be acquired. The data table record identification represents an id obtained by recording each piece of data in the data table during storage, and each piece of data has a unique record id.

Specifically, for example, the storage location is used as a data table record identifier, when the data table record identifier is inserted into a preset snoop queue, the data table record identifier may be encapsulated into a data packet according to a certain protocol (for example, a protobuf protocol), and then inserted into the preset snoop queue, and in order to reduce the length of the snoop queue, a plurality of target storage locations may be encapsulated into one data packet (for example, 10 target storage locations are encapsulated into one data packet), and then inserted into the snoop queue. For example, first, receiving data table record identifiers with changed data, when the number of the received data table record identifiers reaches a preset number, encapsulating the preset number of the data table record identifiers into data packets, and pushing the data packets to a preset monitoring queue.

In addition, in this step, the Exporter service may be used to derive the data packet from the preset snoop queue, for example, if the data packet exists in the preset snoop queue, the data packet in the preset queue may be obtained, and the data table record identifier in the data packet may be used as the target storage location.

In a specific example, the implementation may be implemented by using a brpop instruction, and due to the blocking method of the brpop instruction, when the brpop instruction is used, and a value returned by the brpop instruction is a preset value, the data packet stored in the brpop instruction is taken out from the snoop queue. It should be noted that, based on the characteristics of the queue, the data packet fetched from the snoop queue is deleted at the same time as the fetch operation. Of course, a timing acquisition mode may also be adopted, for example, a data packet is taken out from the snoop queue once every 10 seconds, and all data packets in the snoop queue can be taken out once every time.

And S202, exporting the data stored in the target storage position to obtain initial incremental data.

After the target storage location is obtained in the foregoing steps, the data stored in the target storage location may be exported, the process may still be implemented by means of an Exporter service, and after the Exporter service obtains the target storage location, the Exporter service may directly obtain the data of the target storage location according to the target storage location.

Taking the contents of table 1 and table 2 as examples, the target storage locations are database/data table a/record A3 and database/data table B/record B4, so that the data A3 and the data B4 stored in the two storage locations can be directly obtained.

Since the advertisement service data are of various types, for a certain type of advertisement service data, they are generally stored in the same data table, for example, rtb data supporting online delivery service is stored in data table a, and tracking data supporting tracking service is stored in data table B, when this step derives data, if the target storage location is related to both data table a and data table B, then when deriving data, data type labeling may be performed on data, for example, data derived from data table a is labeled with "rtb", and data derived from data table B is labeled with "tracking". Such that the derived data and the annotations to the data collectively comprise the initial incremental data.

Step S203, obtaining the increment data of the target type from the initial increment data as the increment data of the target advertisement service data, wherein the target type is the type of the target advertisement service data.

Because the initial incremental data obtained in the foregoing step will label the type of each type of data, and in a specific example, an incremental catalog is set for each type of data, in this step, the incremental data of the target type (i.e., the type of the target advertisement service data) can be obtained from the initial incremental data, and is temporarily stored in the incremental catalog corresponding to the target type as the incremental data of the target advertisement service data.

And S102, updating the current target advertisement service data according to the incremental data to obtain the updated target advertisement service data.

In this step, the current target advertisement service data is updated according to the incremental data, which may be in a merging manner, specifically, the incremental data and the current target advertisement service data are merged to obtain the updated target advertisement service data.

It should be noted that, the foregoing data change may be added, deleted, and modified, but the addition in the three cases means that a data table record is newly added, and the deletion and modification are performed on an existing data table record, so in this scheme, a data table record identifier, that is, the foregoing target storage location may be labeled, if the data table record is newly added, the data table record identifier is labeled with "new" or another representative label, such as "1", and if the data table record is an existing data table record, the data table record identifier is labeled with "existing" or another representative label, such as "0".

Meanwhile, when the incremental data of the target advertisement service data is obtained, in order to facilitate the later-stage identification of new and existing data, the data table record identifier, the label of the data table record identifier and specific data can be mapped into a data pair, the data pair is determined to be the incremental data, and the incremental data is merged according to the label in the step.

In a specific example, if the incremental data is marked with "new addition", the incremental data can be directly added to the existing target advertisement service data to form updated target advertisement service data; if the mark is 'existing', the data table record identification consistent with the data table record identification mapped by the incremental data can be found from the data table record identifications mapped by each data in the existing target advertisement service data, and then the incremental data is directly replaced by the existing data (wherein, the deleting condition can be that the existing data is replaced by a null value).

Of course, the deleted and modified data can be directly expanded into the existing target advertisement service data without paying attention to the deleted and modified data, and as long as the data is incremental.

For any type of advertisement service data, a merger service may be separately configured to perform step S102, after the merger service updates the advertisement service data, a new version number is set for the updated advertisement service data, that is, the version number of the updated advertisement service data is determined according to a preset version number update rule, and the preset version number update rule may be updated according to a date and time, for example, the time when the merger service is updated is 50 minutes at 17 points 11, 12, 2020, 11, and then the version number may be 2011121750, in order to distinguish different types, a type identifier may be added before or after the merger service, for example, for rtb data, "rtb" may be used for identification, and then the final version number is 2011121750rtb or rtb 2011121750.

It should be noted that the version number may be stored in a preset location, such as a configuration center, and the configuration center may send the latest version number to the client according to the requirement of the client.

And step S103, sending the updated target advertisement service data to a distribution server.

It should be noted that the distribution server is used to distribute the target advertisement service data to the client, and a specific distribution process will be described in subsequent steps, which is not described herein again.

In the embodiment, the incremental data of the target advertisement service data is firstly acquired, then the current target advertisement service data is updated according to the incremental data, and because the scheme only acquires the incremental data of the target advertisement service, the process is the production of the incremental content of the advertisement service data, the scheme realizes the decoupling of the incremental content and the previously produced content in the production link in the process of acquiring the updated target advertisement service data, and finally sends the updated target advertisement service data to the distribution server so as to be convenient for later distribution. Based on this, in the technical scheme of the application, only incremental data of the target advertisement service data is acquired, and full derivation is not needed, so that decoupling of incremental content and previously produced content in a production link is realized, time required by data derivation is saved, and efficiency of producing advertisement service data is improved.

To describe the scheme of the present embodiment in more detail, the method of the present application is described below by taking rtb data supporting an online serving service and a tracking data supporting a tracking service as examples, and specifically refer to fig. 3 and fig. 4, where fig. 3 is a signal flow chart when an embodiment of the present application provides a method for generating advertisement service data, and fig. 4 is a specific example flow chart of a method for generating advertisement service data provided by an embodiment of the present application.

It should be noted that, in practical applications, two ways of full-size derivation and incremental derivation are faced to data tables with different complexities, and the process of incremental derivation is the steps in step S101 and step S102 in the foregoing embodiment.

As shown in fig. 3, there are 4 data tables in the database: table 1, table 2, table 3, and table 4, where table 1 and table 2 are labeled as "full export", and table 3 and table 4 are labeled as "incremental export", first, as in step S401 in fig. 4, it is determined whether a data source changes, where the data source in this step refers to a data table of the database in fig. 3, and the specific determination process is performed by the database itself, where when data in a certain data table of the database changes, the database may consider that the data source has changed, and when a data table in the database changes, a storage location where the data has changed may be inserted into a Redis queue (as in step S402 in fig. 4), specifically, a record ID of the data table having changed.

Subsequently, the Exporter service shown in fig. 3 listens to the Redis queue, and listens to whether the Redis queue is empty (step S403 in fig. 4), if so, the Exporter service continues to listen to the Redis queue (step S404 in fig. 4), and if not, the Exporter service may perform incremental export or full export of the data table according to the target storage location and the flag of the data table (step S405 in fig. 4).

At this time, two data types given in this example are rtb data supporting the online delivery service and tracking data supporting the tracking service, different data types are exported to different data directories, as shown in fig. 3, for example, rtb data is exported to a rtb data directory, tracking data is exported to a tracking data directory, and a merger service is separately configured for data directories of different data types, as shown in fig. 3, the merger service listens to the data directories (step S406 in fig. 4).

When data exported by an Exporter service (i.e. incremental data exported by an increment or full data exported by full amount, hereinafter referred to as target data) is monitored in the data directory (step S407 in fig. 4), the advertisement service data to be distributed currently is updated according to the target data, specifically, the content in the data directory is traversed (step S408 in fig. 4), then, whether the content in the data directory is full data (i.e. full data in the data table exported by full amount) or incremental data is determined according to the identifier of "full export" or "incremental export" carried in the data exported by the Exporter service (step S409 in fig. 4), if the content is full data, all the data in the current advertisement service data is replaced by full data (step S410 in fig. 4), if the content is incremental data, the target data is merged with the current advertisement service data (step S411 in fig. 4), in this way, a new total amount of advertisement service data is generated (step S412 in fig. 4), and the version number of the new total amount of advertisement service data is generated, so that the update of the current advertisement service data is completed, and then the configuration center updates the version number of the advertisement service data stored therein to the version number of the new total amount of advertisement service data generated this time (step S413 in fig. 4).

It should be noted that the new full amount of advertisement service data generated by the merger service is stored in the corresponding data output directory according to the data type, for example, rtb data is stored in the rtb data output directory, and tracking data is stored in the tracking data output directory.

Referring to fig. 5, fig. 5 is a schematic flowchart illustrating a process of distributing advertisement service data to a client in an advertisement service data processing method according to an embodiment of the present application.

As shown in fig. 5, in this embodiment, the process of distributing advertisement service data to the client may include:

step S501, responding to an advertisement display instruction sent by a client, and calling advertisement business data to be distributed corresponding to the advertisement display instruction from a distribution server.

It should be noted that the advertisement display instruction sent by the client may include a version number of data that needs to be requested, where the version number is obtained from a preset location by the client, and in a specific example, the preset location may be the configuration center mentioned in the foregoing embodiment, and for the description of the configuration center, reference may be made to the foregoing embodiment, and details are not described here again.

In this embodiment, the client may first obtain a version number of the required advertisement service data from the configuration center, specifically, for example, the client needs to obtain rtb data, the client will request the configuration center for a version number of rtb data, because in the above embodiment, after a certain type of advertisement service data is produced, the version number of the type of data stored in the configuration center is updated correspondingly, the version number obtained by the client at this time is a latest version number of rtb data, and after the client obtains the version number, the version number is packaged as an advertisement display instruction.

In response to the advertisement display instruction, the embodiment analyzes the advertisement display instruction to obtain the version number included in the advertisement display instruction, and then downloads the advertisement service data corresponding to the advertisement display instruction according to the version number. The relationship between the version number and the advertisement service data can refer to the foregoing embodiments, and details are not repeated here.

And step S502, distributing the advertisement service data to be distributed to the client according to a preset distribution mode.

In this embodiment, there may be many preset distribution manners, for example, the obtained advertisement service data may be directly sent to the client, but the advertisement service data may be relatively large, which may occupy a relatively large bandwidth, and if the network environment is poor, the transmission may also fail, and then the advertisement service data needs to be sent again, which may result in poor distribution efficiency.

As shown in fig. 6, a signal flow diagram for distributing advertisement service data according to an embodiment of the present application is provided, and a Dragonfly (mirror image distribution system) may be used for distributing advertisement service data, as shown in fig. 6, a general mirror image distribution system is composed of four parts: a File Server (i.e. a main body storing the generated advertisement service data, a File Server shown in fig. 6, a distribution Server mentioned in the previous embodiment), a Server (a Dragonfly Server shown in fig. 6, in which a Nginx service is run), a client cluster (a Dragonfly client cluster shown in fig. 6), and a configuration center (a main body storing the latest version number of the advertisement service data mentioned in the previous embodiment). The client (i.e., the client shown in fig. 6) in this embodiment refers to any client in the client cluster, and the main body for executing the advertisement service data distribution method of this embodiment may be a server in the radial distribution system.

Specifically, referring to fig. 7, fig. 7 is a schematic flowchart illustrating a process of distributing advertisement service data to a client according to an embodiment of the present application.

As shown in fig. 7, the process of distributing advertisement service data to the client according to this embodiment may include:

step S701, determining the storage position of each data block according to the current data block storage state, wherein the data blocks are obtained by dividing advertisement service data to be distributed in advance according to preset division rules.

It should be noted that in this step, the advertisement service data may be divided into data blocks (blocks shown in fig. 6) in the process of acquiring the advertisement service data in step S502, for example, the advertisement service data having a size of 1GB is acquired in step S502, and then in the downloading process, every 100MB is downloaded, the downloaded 100MB is packaged into one data Block until the acquisition is completed. Of course, after the whole advertisement service data is acquired, the data blocks may be obtained by dividing the advertisement service data according to the granularity of 100 MB.

It should be noted that the data block transmission history refers to a history record of distributing the data block in step S701 to the client, for example, if the client a has previously obtained the advertisement service data of the version number, then the data block of the advertisement service data exists in the client a, and then the network identifier of the client a may be used as a download path to directly obtain the data block of the advertisement service data from the client a.

Specifically, referring to fig. 8, fig. 8 is a schematic flowchart of determining a download path according to another embodiment of the present application.

As shown in fig. 8, the process of determining the download path may include:

step S801, determining the storage state of each data block by other clients in the cluster where the client is located according to the current storage state of the data block.

Based on the characteristics of advertisement service data production, new data is generally added on the basis of original data, so that the divided data blocks may have the same condition, certainly, for advertisement service data with the same version number, the data blocks are necessarily consistent, but for advertisement service data with different version numbers, the data blocks may also have the same condition, so that a client in a client cluster may store part of or even all data blocks of the advertisement service data, and the storage records are stored in a server, that is, the network identifier of the client is increased in the transmission history of the data blocks of the server every time the client acquires the advertisement service data.

Therefore, the transmission history of each data block in the advertisement service data can be directly obtained from the transmission history of the data block of the server, and then the storage state of the client for the data block can be obtained.

Step S802, for any data block, the network identification of the client storing the data block is determined as the storage position of the data block.

In this step, if a client stores the required data block, the network identifier of the client is determined as a download path. Of course, in order to increase the transmission speed, the server may also monitor the network environment between the client and the client sending the data request, and determine the network identifier of the client with the best network environment as the final download path.

Step S702, the storage position is sent to the client so that the client downloads the corresponding data block from the storage position and obtains the advertisement service data to be distributed according to the downloaded data block. In the embodiment, the downloading path with higher transmission speed is acquired in a point-to-point mode in the client cluster, so that the distribution speed and efficiency are improved.

Referring to fig. 9, fig. 9 is a schematic structural diagram of an advertisement service data processing apparatus according to another embodiment of the present application.

As shown in fig. 9, the apparatus provided in this embodiment may include:

a first obtaining module 901, which obtains incremental data of target advertisement service data;

an updating module 902, configured to update the current target advertisement service data according to the incremental data to obtain updated target advertisement service data;

a sending module 903, configured to send the updated target advertisement service data to a distribution server.

In an optional embodiment, the obtaining module comprises:

the exporting unit is used for exporting the data stored in the target storage position to obtain initial incremental data;

In an alternative embodiment, the first obtaining unit includes:

the packaging subunit is used for packaging the data table record identifications with the preset number into data packets and pushing the data packets into a preset monitoring queue when the number of the received data table record identifications reaches the preset number;

and the acquisition subunit is used for acquiring the data packet if the data packet exists in the preset monitoring queue, and taking the data table record identifier in the data packet as a target storage position.

In an alternative embodiment, the update module comprises:

In an alternative embodiment, the apparatus further comprises:

In an optional embodiment, the module further comprises:

In an alternative embodiment, the distribution module comprises:

the determining unit is used for determining the storage position of each data block according to the current data block storage state, and the data blocks are obtained by dividing the advertisement service data to be distributed in advance according to preset dividing rules;

and the distribution unit is used for sending the storage position to the client so that the client downloads the corresponding data block from the storage position and obtains the advertisement service data to be distributed according to the downloaded data block.

In an alternative embodiment, the determining unit comprises:

the first determining subunit is used for determining the storage state of each data block by other clients in the cluster where the client is located according to the current storage state of the data block;

and the second determining subunit is used for determining the network identification of the client in which the data block is stored as the storage position of the data block for any data block.

Referring to fig. 10, fig. 10 is a schematic structural diagram of an advertisement service data processing system according to another embodiment of the present application.

As shown in fig. 10, the system includes: at least one processor 1001, memory 1002, at least one network interface 1003, and other user interfaces 1004. The various components in advertisement services data processing system 1000 are coupled together by a bus system 1005. It is understood that bus system 1005 is used to enable communications among the components connected. The bus system 1005 includes a power bus, a control bus, and a status signal bus, in addition to a data bus. But for the sake of clarity the various busses are labeled in figure 10 as the bus system 1005.

The user interface 1004 may include, among other things, a display, a keyboard, or a pointing device (e.g., a mouse, trackball, touch pad, or touch screen, among others.

It is to be understood that the memory 1002 in embodiments of the present invention may be either volatile memory or nonvolatile memory, or may include both volatile and nonvolatile memory. The non-volatile Memory may be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable PROM (EEPROM), or a flash Memory. Volatile Memory can be Random Access Memory (RAM), which acts as external cache Memory. By way of illustration and not limitation, many forms of RAM are available, such as Static random access memory (Static RAM, SRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic random access memory (Synchronous DRAM, SDRAM), Double Data Rate Synchronous Dynamic random access memory (ddr Data Rate SDRAM, ddr SDRAM), Enhanced Synchronous SDRAM (ESDRAM), synchlronous SDRAM (SLDRAM), and Direct Rambus RAM (DRRAM). The memory 1002 described herein is intended to comprise, without being limited to, these and any other suitable types of memory.

In some embodiments, memory 1002 stores the following elements, executable units or data structures, or a subset thereof, or an expanded set thereof: an operating system 10021 and applications 10022.

The operating system 10021 includes various system programs, such as a framework layer, a core library layer, a driver layer, and the like, and is used for implementing various basic services and processing hardware-based tasks. The application 10022 includes various applications, such as a Media Player (Media Player), a Browser (Browser), and the like, for implementing various application services. The program implementing the method according to the embodiment of the present invention may be included in the application program 10022.

In the embodiment of the present invention, by calling the program or the instruction stored in the memory 1002, specifically, the program or the instruction stored in the application 10022, the processor 1001 is configured to execute the method steps provided by the method embodiments, for example, the method steps include:

obtaining incremental data of target advertisement service data;

In an optional embodiment, obtaining the incremental data of the target advertisement service data includes:

acquiring a target storage position with changed data;

In an alternative embodiment, obtaining a target storage location where data changes includes:

receiving a data table record identifier with changed data;

and if the data packet exists in the preset monitoring queue, acquiring the data packet, and taking a data table record identifier in the data packet as a target storage position.

In an optional embodiment, updating the current target advertisement service data according to the incremental data to obtain updated target advertisement service data includes:

and combining the incremental data with the current target advertisement service data to obtain the updated target advertisement service data.

In an optional embodiment, the method further comprises:

responding to an advertisement display instruction sent by a client, and calling advertisement business data to be distributed corresponding to the advertisement display instruction from a distribution server;

In an optional embodiment, distributing advertisement service data to be distributed to a client according to a preset distribution mode includes:

determining the storage position of each data block according to the current data block storage state, wherein the data blocks are obtained by dividing advertisement service data to be distributed in advance according to preset division rules;

In an alternative embodiment, determining the storage location of each data block according to the current storage state of the data block includes:

determining the storage state of each data block by other clients in a cluster where the client is located according to the current storage state of the data block;

for any data block, the network identification of the client storing the data block is determined as the storage position of the data block.

The method disclosed by the embodiment of the invention can be applied to the processor 1001 or can be implemented by the processor 1001. The processor 1001 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be implemented by integrated logic circuits of hardware or instructions in the form of software in the processor 1001. The Processor 1001 may be a general-purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, or discrete hardware components. The various methods, steps and logic blocks disclosed in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software elements in the decoding processor. The software elements may be located in ram, flash, rom, prom, or eprom, registers, among other storage media that are well known in the art. The storage medium is located in the memory 1002, and the processor 1001 reads the information in the memory 1002 and performs the steps of the method in combination with the hardware.

It is to be understood that the embodiments described herein may be implemented in hardware, software, firmware, middleware, microcode, or any combination thereof. For a hardware implementation, the Processing units may be implemented in one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), general purpose processors, controllers, micro-controllers, microprocessors, other electronic units configured to perform the functions of the present Application, or a combination thereof.

For a software implementation, the techniques herein may be implemented by means of units performing the functions herein. The software codes may be stored in a memory and executed by a processor. The memory may be implemented within the processor or external to the processor.

The embodiment of the invention also provides a storage medium (computer readable storage medium). The storage medium herein stores one or more programs. Among others, the storage medium may include volatile memory, such as random access memory; the memory may also include non-volatile memory, such as read-only memory, flash memory, a hard disk, or a solid state disk; the memory may also comprise a combination of memories of the kind described above.

When one or more programs in the storage medium are executable by one or more processors to implement the above-described advertisement service data processing method executed on the advertisement service data production and distribution system side:

obtaining incremental data of target advertisement service data;

acquiring a target storage position with changed data;

receiving a data table record identifier with changed data;

In an optional embodiment, the method further comprises:

Those of skill would further appreciate that the various illustrative components and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied in hardware, a software module executed by a processor, or a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

The above embodiments are provided to further explain the objects, technical solutions and advantages of the present invention in detail, it should be understood that the above embodiments are merely exemplary embodiments of the present invention and are not intended to limit the scope of the present invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.

Claims

1. An advertisement service data processing method is characterized by comprising the following steps:

obtaining incremental data of target advertisement service data;

2. The method of claim 1, wherein obtaining incremental data for the targeted advertising campaign data comprises:

acquiring a target storage position with changed data;

3. The method of claim 2, wherein obtaining the target storage location where the data changes comprises:

receiving a data table record identifier with changed data;

4. The method of claim 1, wherein the updating the current targeted advertisement service data according to the incremental data to obtain updated targeted advertisement service data comprises:

5. The method according to any one of claims 1 to 4, wherein after the current target advertisement service data is updated according to the incremental data to obtain updated target advertisement service data, and before the updated target advertisement service data is distributed to the client according to a preset distribution manner, the method further comprises:

6. The method of claim 1, further comprising:

7. The method according to claim 6, wherein the distributing the advertisement service data to be distributed to the client according to a preset distribution mode comprises:

8. The method of claim 7, wherein determining the storage location of each data block according to the current storage state of the data block comprises:

9. An advertisement service data processing apparatus, characterized in that the apparatus comprises:

10. An advertisement service data processing system, comprising: at least one processor and memory;

the processor is configured to execute the advertisement service data processing program stored in the memory to implement the advertisement service data processing method according to any one of claims 1 to 8.

11. A storage medium storing one or more programs executable by the advertising service data processing system according to claim 10 to implement the advertising service data processing method according to any one of claims 1 to 8.