CN112633906A - Advertisement material synchronization method, device, equipment and medium - Google Patents
Advertisement material synchronization method, device, equipment and medium Download PDFInfo
- Publication number
- CN112633906A CN112633906A CN201910904001.1A CN201910904001A CN112633906A CN 112633906 A CN112633906 A CN 112633906A CN 201910904001 A CN201910904001 A CN 201910904001A CN 112633906 A CN112633906 A CN 112633906A
- Authority
- CN
- China
- Prior art keywords
- material data
- advertisement
- advertisement material
- data
- type
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 239000000463 material Substances 0.000 title claims abstract description 310
- 238000000034 method Methods 0.000 title claims abstract description 56
- 230000008569 process Effects 0.000 claims abstract description 12
- 238000012545 processing Methods 0.000 claims description 21
- 230000001360 synchronised effect Effects 0.000 claims description 18
- 238000004590 computer program Methods 0.000 claims description 14
- 230000015654 memory Effects 0.000 claims description 14
- 238000004806 packaging method and process Methods 0.000 claims description 5
- 238000012544 monitoring process Methods 0.000 claims description 4
- 230000003190 augmentative effect Effects 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 13
- 230000006870 function Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 239000000758 substrate Substances 0.000 description 2
- 108010001267 Protein Subunits Proteins 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/901—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
Abstract
The present disclosure provides an advertisement material data synchronization method, including: obtaining a plurality of advertisement material data, wherein the advertisement material data comprises advertiser identification information and material content data; determining a hash value of advertiser identification information of each advertisement material data of the plurality of advertisement material data; allocating a bucket to each of the advertisement material data based on the hash value; and using multiple threads to process the advertisement material data in each barrel in parallel so as to synchronize the advertisement material data to the media side, wherein the threads of different barrels are independent, and the advertisement material data are processed in the same barrel in sequence. The disclosure also provides an advertisement material data synchronization device, an electronic device and a computer readable medium.
Description
Technical Field
The present disclosure relates to the field of internet technologies, and in particular, to a method, an apparatus, a device, and a medium for synchronizing advertisement materials.
Background
The information flow advertisement is an expression form of the original advertisement, generally alternates in the original content information of the product, the user experience is good, and the advertiser can also carry out accurate advertisement putting according to the user label. In view of the good information flow advertisement delivery effect and the large amount of natural flow brought by media, the advertisement delivery demand of advertisers under the direct delivery mode is increasing, so that a large amount of advertisement material data interaction between the media of the two parties is brought, and the interaction speed of the advertisement material data becomes one of the bottlenecks of the advertisement delivery timeliness. In the existing offline synchronization technology, the timeliness of advertisement material data is low, and the strategy intention of an advertiser for modifying an advertisement cannot be reflected in time in the advertisement competition delivery process. In the existing module separation synchronization technology, the synchronization mode of the advertisement material data synchronization module is still serial synchronization, the data synchronization efficiency is not optimized, and the speed is low. In addition, there is an order of advertisement delivery, for example, first, the bid of advertisement delivery is set to 1 yuan, then the bid of advertisement delivery is modified to 2 yuan, if the data transmission order changes, the final bid of advertisement will not meet the expectation of the advertiser, and in the prior art, because the advertisement delivery has an order, the advertisement material data can not be synchronized in parallel in a multithread manner.
Disclosure of Invention
In view of this, the present disclosure provides an advertisement material synchronization method, apparatus, device, and medium.
One aspect of the present disclosure provides an advertisement material data synchronization method, including: obtaining a plurality of advertisement material data, wherein the advertisement material data comprises advertiser identification information and material content data; determining a hash value of advertiser identification information of each advertisement material data of the plurality of advertisement material data; allocating a bucket to each of the advertisement material data based on the hash value; and using multiple threads to process the advertisement material data in each barrel in parallel so as to synchronize the advertisement material data to the media side, wherein the threads of different barrels are independent, and the advertisement material data are processed in the same barrel in sequence.
According to an embodiment of the present disclosure, the obtaining of the plurality of advertisement material data includes: monitoring the incremental index database; and responding to the monitored new augmented advertisement material data in the incremental index database, and acquiring the advertisement material data from the incremental index database.
According to an embodiment of the present disclosure, the obtaining of the plurality of advertisement material data includes: obtaining a material synchronous record; determining synchronous progress information based on the material synchronous record; and obtaining a preset amount of advertisement material data from an increment index database based on the synchronous progress information.
According to an embodiment of the present disclosure, for each bucket, processing the advertising material data includes: obtaining advertisement material data according to the sequence, wherein the advertisement material data also comprises material types; determining whether the material type in the advertisement material data is a preset type; processing the advertising material data based on the material type so as to synchronize the advertising material data to a media side when the material type is a predetermined type; and sending alarm information under the condition that the material type is not a preset type.
According to an embodiment of the present disclosure, the material type includes a material classification and a material operation type, and the processing the advertisement material data based on the material type includes: packaging the advertisement material data into a corresponding material format based on the material classification; and calling a corresponding data synchronization interface based on the material operation type so as to synchronize the advertisement material data to a media side.
According to an embodiment of the present disclosure, the method further comprises performing a full-scale synchronization of the advertising material data in a timed manner.
Another aspect of the present disclosure provides an advertisement material data synchronization apparatus, including: the system comprises an obtaining module, a storage module and a display module, wherein the obtaining module is used for obtaining a plurality of advertisement material data, and the advertisement material data comprises advertiser identification information and material content data; a determining module for determining a hash value of advertiser identification information of each of the plurality of advertisement material data; an allocation module for allocating a bucket to each of the advertisement material data based on the hash value; and the synchronization module is used for processing the advertisement material data in each barrel in parallel by using multiple threads so as to synchronize the advertisement material data to a media side, wherein the threads of different barrels are mutually independent, and the advertisement material data are processed in the same barrel in sequence.
According to an embodiment of the present disclosure, the synchronization module includes: the obtaining submodule is used for obtaining advertisement material data according to the sequence, and the advertisement material data also comprises a material type; the determining submodule is used for determining whether the material type in the advertising material data is a preset type; a synchronization submodule, configured to process the advertisement material data based on the material type so as to synchronize the advertisement material data to a media side when the material type is a predetermined type; and the alarm submodule is used for sending alarm information under the condition that the material operation type is not a preset type.
Another aspect of the present disclosure provides an electronic device including: one or more processors; memory for storing one or more computer programs, wherein the one or more computer programs, when executed by the one or more processors, cause the one or more processors to implement the above-described method.
Another aspect of the disclosure provides a computer-readable medium having stored thereon executable instructions that, when executed by a processor, cause the processor to implement the above-described method.
According to the method, the advertisement material data are dynamically partitioned into the buckets, so that multithreading parallel data synchronization can be realized, the problem of the advertisement putting sequence is solved, and the advertisement material data synchronization speed is increased.
Drawings
The above and other objects, features and advantages of the present disclosure will become more apparent from the following description of embodiments of the present disclosure with reference to the accompanying drawings, in which:
FIG. 1 schematically illustrates an application scenario of the advertising material data synchronization method and system according to an embodiment of the present disclosure;
FIG. 2 schematically illustrates a flow chart of an advertising material data synchronization method according to an embodiment of the present disclosure;
FIG. 3 schematically illustrates a flow diagram for parallel processing of advertising material data in each bucket using multiple threads in accordance with an embodiment of the disclosure;
FIG. 4 schematically shows a flow chart for processing advertising material data according to an embodiment of the present disclosure;
FIG. 5 schematically illustrates a flow diagram of an advertising material data synchronization method according to another embodiment of the present disclosure;
FIG. 6 schematically illustrates an advertising material data bucketing schematic according to an embodiment of the present disclosure;
FIG. 7 schematically shows a block diagram of an advertising material data synchronization apparatus according to an embodiment of the present disclosure;
FIG. 8 schematically illustrates a block diagram of a synchronization module according to an embodiment of the disclosure; and
FIG. 9 schematically illustrates a block diagram of a computer system suitable for implementing the advertising material data synchronization method and system according to an embodiment of the present disclosure.
Detailed Description
Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be understood that the description is illustrative only and is not intended to limit the scope of the present disclosure. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the disclosure. It may be evident, however, that one or more embodiments may be practiced without these specific details. Moreover, in the following description, descriptions of well-known structures and techniques are omitted so as to not unnecessarily obscure the concepts of the present disclosure.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The terms "comprises," "comprising," and the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.
All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It is noted that the terms used herein should be interpreted as having a meaning that is consistent with the context of this specification and should not be interpreted in an idealized or overly formal sense.
Where a convention analogous to "at least one of A, B and C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B and C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.). Where a convention analogous to "A, B or at least one of C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B or C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.). It will be further understood by those within the art that virtually any disjunctive word and/or phrase presenting two or more alternative terms, whether in the description, claims, or drawings, should be understood to contemplate the possibilities of including one of the terms, either of the terms, or both terms. For example, the phrase "a or B" should be understood to include the possibility of "a" or "B", or "a and B".
The embodiment of the disclosure provides an advertisement material data synchronization method, which comprises the following steps: obtaining a plurality of advertisement material data, wherein the advertisement material data comprises advertiser identification information and material content data; determining a hash value of advertiser identification information of each advertisement material data in the plurality of advertisement material data; allocating a bucket to each advertisement material data based on the hash value; and using multiple threads to process the advertisement material data in each barrel in parallel so as to synchronize the advertisement material data to the media side, wherein the threads of different barrels are independent, and the advertisement material data are processed in the same barrel in sequence.
Fig. 1 schematically shows an application scenario of the advertisement material data synchronization method according to an embodiment of the present disclosure. It should be noted that fig. 1 is only an example of a system architecture to which the embodiments of the present disclosure may be applied to help those skilled in the art understand the technical content of the present disclosure, and does not mean that the embodiments of the present disclosure may not be applied to other devices, systems, environments or scenarios.
As shown in FIG. 1, a system architecture according to this embodiment may include an advertiser server cluster 110, a server 120, and a terminal device 130. An advertising material data synchronization system is preset on the server 120, and an advertiser can send advertising material data to the server 120 through the advertiser server cluster 110, wherein the advertising material data comprises advertiser identification information and material content data. The server 120 determines a hash value of advertiser identification information of each advertisement material data after receiving the advertisement material data, and allocates a bucket to each advertisement material data according to the hash value to distinguish advertisement material data delivered by different advertisers. The server 120 processes the advertising material data in each bucket in parallel using multiple threads to synchronize the advertising material data to the media side of the terminal device 130.
The advertiser server cluster 110 is used for advertisers to formulate, modify or delete material content data, and each advertiser server is provided with advertiser identification information identifying the identity of the advertiser, which may be the physical address, routing information, etc. of the advertiser server.
The server 120 is preset with an advertisement material data synchronization system for executing an advertisement material data synchronization method, and the server 120 may process material content data sent by an advertiser and synchronize the material content data to the user terminal device 130 side for a user to browse and view.
The terminal device 130 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop portable computers, desktop computers, and the like. On which various messenger client applications may be installed, such as a shopping-like application, a web browser application, a search-like application, an instant messaging tool, a mailbox client, social platform software, and so forth (by way of example only). The server 120 may launch the material content data onto various communication client applications for viewing by the user.
It should be noted that the advertisement material data synchronization method provided by the embodiment of the present disclosure may be generally executed by the server 120. Accordingly, the advertisement material data synchronization system provided by the embodiment of the present disclosure may be disposed in the server 120. The method for synchronizing advertisement material data provided by the embodiments of the present disclosure may also be performed by a server or a cluster of servers that is different from the server 120 and that is capable of communicating with the terminal device 130 and/or the advertiser server cluster 110. Accordingly, the advertisement material data synchronization system provided by the embodiment of the present disclosure may also be disposed in a server or a server cluster different from the server 120 and capable of communicating with the terminal device 130 and/or the advertiser server cluster 110.
It should be understood that the number of terminal devices, advertiser server clusters, and servers in FIG. 1 are illustrative only. There may be any number of terminal devices, advertiser server clusters, and servers, as desired for implementation.
Fig. 2 schematically shows a flow chart of an advertising material data synchronization method according to an embodiment of the present disclosure.
As shown in fig. 2, the method includes operations S210 to S240.
In operation S210, a plurality of advertisement material data including advertiser identification information and material content data is obtained. According to the embodiment of the disclosure, the advertiser identification information is unique identification information for identifying the identity of the advertiser, such as a physical address, a routing address and the like of a server capable of issuing material content data for the advertiser. The material content data may be specific advertising content published by the advertiser, including text, pictures, sounds, videos, etc., such as "small size and large capacity-printer, outstanding! "," XX is big 1.5 pieces of frequency conversion cold-warm intelligent wall hanging air conditioner ", etc. The advertiser may send the advertising material data to the incremental index database. The advertisement material data can be obtained from the increment index database by monitoring the increment index database in real time and responding to the monitoring of the newly-added advertisement material data in the increment index database, so that the timeliness of the advertisement material data synchronization is improved. The advertisement material data further includes material synchronization record information. The obtaining of the plurality of advertisement material data may be to obtain material synchronization record information, determine synchronization progress information according to the material synchronization record information, and further obtain a predetermined number of advertisement material data from an incremental index database according to the synchronization progress information. For example, suppose that the data of the advertisement material to be processed is 30000, and the current processed progress is 18000. And linking the advertisement material database, comparing the numbers of the synchronized advertisement material data stored in the advertisement material database, taking out the maximum value, and assuming that the maximum value is 18000, wherein the maximum value is the progress of the current synchronized advertisement material data. 100 pieces of advertisement material data are directly read from the incremental index database each time and stored in the memory to be processed, and the number of the advertisement material data is 18001-18100.
In operation S220, a hash value of advertiser identification information of each of the plurality of advertisement material data is determined. For example, the advertiser identification information may be converted into a Bytes array, and then a Hash value of each advertiser identification information may be obtained by a murmurmur 2 Hash algorithm.
In operation S230, a bucket is allocated to each advertisement material data based on the above hash value. And allocating buckets for different advertisers according to the hash values so as to place the advertisement material data of the different advertisers in different buckets. Each bucket is provided with a bucket number with a unique identifier. The advertiser can store the advertisement material data into the corresponding barrel number container according to the barrel dividing rule.
In operation S240, advertisement material data in each bucket is processed in parallel using multiple threads so as to synchronize the advertisement material data to a media side, wherein the threads are independent between different buckets and are processed in sequence in the same bucket.
According to the method, the advertisement material data are dynamically partitioned into the buckets, so that multithreading parallel data synchronization can be realized, the problem of the advertisement putting sequence is solved, and the advertisement material data synchronization speed is increased.
Operation S240 of the embodiment of the present disclosure is described in detail below with reference to fig. 3.
FIG. 3 schematically illustrates a flow diagram for parallel processing of advertising material data in each bucket using multiple threads in accordance with an embodiment of the disclosure.
As shown in fig. 3, the method includes operations S310 to S340.
In operation S310, advertisement material data, which further includes a material type, is obtained in order.
In operation S320, it is determined whether a material type in the advertisement material data is a predetermined type.
In operation S330, in case that the material type is a predetermined type, the advertisement material data is processed based on the material type so as to be synchronized to the media side.
In operation S340, in case the material type is not the predetermined type, an alarm message is issued.
As shown in fig. 3, the method may further include operation S350 of determining whether the response of the media side is successful, generating a media mapping table if the response is successful, and sequentially extracting next advertisement material data from the bucket. If the response is unsuccessful, alarm information is sent out. The above-mentioned alarm information can also be stored in the file tabulation of failing, and withdraw the next advertising material data from the bucket in order.
The material types comprise material classification and material operation types. Operation S330 of the embodiment of the present disclosure is described in detail below with reference to fig. 4.
FIG. 4 schematically shows a flow chart for processing advertising material data according to an embodiment of the present disclosure.
As shown in fig. 4, the method includes operations S410 to S420.
The material type comprises a material classification type and a material operation type, and the judging whether the material type is a preset type comprises judging whether the material classification is the preset type and judging whether the material operation type is the preset type.
In operation S410, advertisement material data is packaged into a corresponding material format based on the material classification.
If the material is classified into a preset type, the preset type of the material classification can be a promotion plan, a promotion unit, a promotion creative idea and the like, and the advertisement material data is packaged into a corresponding material format. And if the material classification is not the preset type, sending alarm information.
In operation S420, based on the material operation type, a corresponding data synchronization interface is called to synchronize the advertisement material data to the media side.
If the material operation type is a preset type, the preset type of the material operation type can be material addition, material deletion, material modification and the like, and a corresponding data synchronization interface is called to synchronize the advertisement material data to the media side. And if the material operation type is not the preset type, sending alarm information.
Fig. 5 schematically shows a flowchart of an advertising material data synchronization method according to another embodiment of the present disclosure.
As shown in fig. 5, the method includes operations S510 to S570.
In operation S510, advertisement material data synchronization information is acquired. For example, the synchronization progress of the current advertisement material data can be obtained by linking the advertisement material database.
For example, during the double 11 period, different advertisers put a large amount of advertisements, and a large amount of advertisement material data interaction is generated, assuming that the number of pieces of advertisement material data to be processed is 30000, and the current processing progress is 18000. Wherein, advertisement material data includes in order:
……
advertisement material data number 18001, advertiser id101, the advertisement of putting is the title: "Small size and high Capacity-Printer, sufficient excellence! ";
the number of the advertisement material data is 18002, the advertiser id102, and the bid of each click of the released advertisement is 2 yuan;
advertisement material data number 18003, advertiser id101, adjust the advertisement title to: "small-size high-capacity-color printer";
the number of the advertisement material data is 18004, the advertiser id102, and the price of each click of the advertisement is adjusted to be 3 yuan;
……
and linking the advertisement material database, comparing the numbers of the synchronized advertisement material data stored in the advertisement material database, taking out the maximum value, and assuming that the maximum value is 18000, wherein the maximum value is the progress of the current synchronized advertisement material data.
In operation S520, a connection is established and the incremental index database is monitored to obtain advertisement material data to be processed.
100 pieces of advertisement material data are directly read from the incremental index database each time and stored in the memory to be processed, and the number of the advertisement material data is 18001-18100.
In operation S530, a hash value of advertiser identification information of each advertisement material database is acquired.
Performing byte array conversion on each material data advertiser id, then performing Murmur2 Hash operation, performing modulus operation on the operation result according to the number of the barrels, and sequentially putting the material data into the barrels according to the modulus result.
In operation S540, the advertisement material data is stored in the corresponding bucket according to the hash value.
FIG. 6 schematically illustrates an advertising material data bucketing schematic according to an embodiment of the present disclosure.
If the calculation result of the advertiser id101 is 1 and the calculation result of the advertiser id102 is 3, as shown in fig. 6, the advertisement material data issued by the advertiser id101 is put into the bucket 1, and the advertisement material data issued by the advertiser id102 is put into the bucket 3.
Reference is made back to fig. 5. In operation S550, the in-bucket advertising material data is processed in parallel by multiple threads to synchronize the in-bucket advertising material data to the media side. And if the advertisement material data synchronization fails, updating the advertisement material data to a failure file list, and sending an alarm. Synchronous retry of the advertising material data can also be performed until successful. If the synchronization is successful, the result is stored in the media mapping table.
For example, for bucket 1, sequentially process advertisement material data in the bucket in order, judge that serial number 18001 is newly-increased and promotes the intention, encapsulate media and promote intention material format, call media http add Ad interface, synchronous advertisement material data to the media side. The number 18003 is for modifying the promotion creative idea, and calls the media http update Ad interface to synchronize the advertisement material data.
And (3) sequentially processing the material data in the barrel according to the sequence aiming at the barrel 3, wherein the judgment number 18002 is a newly-added promotion unit, packaging the material format of the media promotion unit, calling a media http addAd group interface, and synchronizing the advertisement material data to the media side. Number 18004 is a modify promotion unit, and calls media http update Ad group interface to synchronize advertisement material data.
The advertisement material data synchronization processes among the buckets are mutually independent, and the advertisement material data synchronization processes are synchronized to the media side in parallel through the Https interface in a multithread mode.
After all the advertisement material data are synchronized, at the media side, the final advertisement delivery topic of the advertiser id101 is: "Small size and big capability — color printer", advertiser id102 bids the final ad for 3 yuan per click, which is consistent with the media side ad delivery data.
In operation S560, full-scale synchronization of the advertisement material data is periodically performed. For example, a preset time of day is set for full timed synchronization. If the timing full-quantity synchronization is set in the morning every day, the difference between the latest advertisement material data in the incremental index database and the media side advertisement material data is compared, and the consistency of the latest advertisement material data and the media side advertisement material data is kept.
Fig. 7 schematically shows a block diagram of an advertisement material data synchronization apparatus 700 according to an embodiment of the present disclosure.
As shown in fig. 7, the apparatus 700 includes an obtaining module 710, a determining module 720, an assigning module 730, and a synchronizing module 740.
The obtaining module 710, for example, performs operation S210 described above with reference to fig. 2, for obtaining a plurality of advertisement material data, the advertisement material data including advertiser identification information and material content data.
The determining module 720, for example, performs the operation S220 described above with reference to fig. 2, for determining a hash value of the advertiser identification information of each of the plurality of advertisement material data.
The allocating module 730, for example, performs the operation S230 described above with reference to fig. 2, for allocating a bucket to each advertisement material data based on the above hash value.
The synchronization module 740, for example, performs operation S240 described above with reference to fig. 2, for processing the advertisement material data in each bucket in parallel using multiple threads, so as to synchronize the advertisement material data to the media side, wherein the threads are independent from one another between different buckets, and the processing is performed in sequence in the same bucket.
Fig. 8 schematically illustrates a block diagram of a synchronization module 800 according to an embodiment of the disclosure.
As shown in FIG. 8, the synchronization module 800 includes an acquisition submodule 810, a determination submodule 820, a synchronization submodule 830, and an alarm submodule 840.
The obtaining sub-module 810, for example, performs the operation S310 described above with reference to fig. 3, for obtaining an advertising material data in order, the advertising material data further including a material type.
The determining sub-module 820, for example, performs the operation S320 described above with reference to fig. 3, for determining whether the material type in the above-mentioned advertisement material data is a predetermined type.
The synchronization sub-module 830, for example, performs the operation S330 described above with reference to fig. 3, for processing the above-mentioned advertisement material data based on the material type in case that the material type is a predetermined type, so as to synchronize the advertisement material data to the media side.
The alarm submodule 840, for example, performs the operation S340 described above with reference to fig. 3, for issuing an alarm message in case the material operation type is not the predetermined type.
Any number of modules, sub-modules, units, sub-units, or at least part of the functionality of any number thereof according to embodiments of the present disclosure may be implemented in one module. Any one or more of the modules, sub-modules, units, and sub-units according to the embodiments of the present disclosure may be implemented by being split into a plurality of modules. Any one or more of the modules, sub-modules, units, sub-units according to embodiments of the present disclosure may be implemented at least in part as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented in any other reasonable manner of hardware or firmware by integrating or packaging a circuit, or in any one of or a suitable combination of software, hardware, and firmware implementations. Alternatively, one or more of the modules, sub-modules, units, sub-units according to embodiments of the disclosure may be at least partially implemented as a computer program module, which when executed may perform the corresponding functions.
For example, any plurality of the obtaining module 710, the determining module 720, the allocating module 730, the synchronizing module 740, the obtaining sub-module 810, the determining sub-module 820, the synchronizing sub-module 830, and the alarming sub-module 840 may be combined and implemented in one module, or any one of the modules may be split into a plurality of modules. Alternatively, at least part of the functionality of one or more of these modules may be combined with at least part of the functionality of the other modules and implemented in one module. According to an embodiment of the present disclosure, at least one of the obtaining module 710, the determining module 720, the allocating module 730, the synchronizing module 740, the obtaining sub-module 810, the determining sub-module 820, the synchronizing sub-module 830, and the alarming sub-module 840 may be implemented at least in part as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented in hardware or firmware in any other reasonable manner of integrating or packaging a circuit, or in any one of three implementations of software, hardware, and firmware, or in any suitable combination of any of them. Alternatively, at least one of the obtaining module 710, the determining module 720, the assigning module 730, the synchronizing module 740, the obtaining sub-module 810, the determining sub-module 820, the synchronizing sub-module 830 and the alerting sub-module 840 may be at least partially implemented as a computer program module which, when executed, may perform a corresponding function.
FIG. 9 schematically illustrates a block diagram of a computer system suitable for implementing the advertising material data synchronization method and apparatus according to an embodiment of the present disclosure. The computer system illustrated in FIG. 9 is only one example and should not impose any limitations on the scope of use or functionality of embodiments of the disclosure. The computer system shown in fig. 9 may be implemented as an electronic device including at least one processor (e.g., processor 901) and at least one memory (e.g., storage portion 908).
As shown in fig. 9, a computer system 900 according to an embodiment of the present disclosure includes a processor 901 which can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM)902 or a program loaded from a storage section 908 into a Random Access Memory (RAM) 903. Processor 901 may comprise, for example, a general purpose microprocessor (e.g., a CPU), an instruction set processor and/or associated chipset, and/or a special purpose microprocessor (e.g., an Application Specific Integrated Circuit (ASIC)), among others. The processor 901 may also include on-board memory for caching purposes. The processor 901 may comprise a single processing unit or a plurality of processing units for performing the different actions of the method flows according to embodiments of the present disclosure.
In the RAM903, various programs and data necessary for the operation of the system 900 are stored. The processor 901, the ROM 902, and the RAM903 are connected to each other through a bus 904. The processor 901 performs various operations of the method flows according to the embodiments of the present disclosure by executing programs in the ROM 902 and/or the RAM 903. Note that the programs may also be stored in one or more memories other than the ROM 902 and the RAM 903. The processor 901 may also perform various operations of the method flows according to embodiments of the present disclosure by executing programs stored in the one or more memories.
According to embodiments of the present disclosure, method flows according to embodiments of the present disclosure may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication section 909, and/or installed from the removable medium 911. The computer program, when executed by the processor 901, performs the above-described functions defined in the system of the embodiment of the present disclosure. The systems, devices, apparatuses, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the present disclosure.
The present disclosure also provides a computer-readable medium, which may be embodied in the apparatus/device/system described in the above embodiments; or may exist separately and not be assembled into the device/apparatus/system. The computer readable medium carries one or more programs which, when executed, implement the method according to an embodiment of the disclosure.
According to embodiments of the present disclosure, a computer readable medium may be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer-readable signal medium may include a propagated data signal with computer-readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, optical fiber cable, radio frequency signals, etc., or any suitable combination of the foregoing.
For example, according to embodiments of the present disclosure, a computer-readable medium may include the ROM 902 and/or the RAM903 described above and/or one or more memories other than the ROM 902 and the RAM 903.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
Those skilled in the art will appreciate that various combinations and/or combinations of features recited in the various embodiments and/or claims of the present disclosure can be made, even if such combinations or combinations are not expressly recited in the present disclosure. In particular, various combinations and/or combinations of the features recited in the various embodiments and/or claims of the present disclosure may be made without departing from the spirit or teaching of the present disclosure. All such combinations and/or associations are within the scope of the present disclosure.
The embodiments of the present disclosure have been described above. However, these examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although the embodiments are described separately above, this does not mean that the measures in the embodiments cannot be used in advantageous combination. The scope of the disclosure is defined by the appended claims and equivalents thereof. Various alternatives and modifications can be devised by those skilled in the art without departing from the scope of the present disclosure, and such alternatives and modifications are intended to be within the scope of the present disclosure.
Claims (10)
1. An advertisement material data synchronization method comprises the following steps:
obtaining a plurality of advertisement material data, wherein the advertisement material data comprises advertiser identification information and material content data;
determining a hash value of advertiser identification information of each advertisement material data of the plurality of advertisement material data;
allocating a bucket to each of the advertisement material data based on the hash value; and
and (3) parallelly processing the advertisement material data in each barrel by using multiple threads so as to synchronize the advertisement material data to the media side, wherein the threads of different barrels are independent, and the advertisement material data are processed in the same barrel in sequence.
2. The method of claim 1, wherein the obtaining a plurality of advertising material data comprises:
monitoring the incremental index database;
and responding to the monitored new augmented advertisement material data in the incremental index database, and acquiring the advertisement material data from the incremental index database.
3. The method of claim 1, wherein the obtaining a plurality of advertising material data comprises:
obtaining a material synchronous record;
determining synchronous progress information based on the material synchronous record; and
and obtaining a preset amount of advertisement material data from an increment index database based on the synchronous progress information.
4. The method of claim 1, wherein for each bucket, processing advertising material data comprises:
obtaining advertisement material data according to the sequence, wherein the advertisement material data also comprises material types;
determining whether the material type in the advertisement material data is a preset type;
processing the advertising material data based on the material type so as to synchronize the advertising material data to a media side when the material type is a predetermined type; and
and sending alarm information under the condition that the material type is not a preset type.
5. The method of claim 4, wherein the material types include a material classification and a material operation type, the processing the advertising material data based on the material types including:
packaging the advertisement material data into a corresponding material format based on the material classification; and
and calling a corresponding data synchronization interface based on the material operation type so as to synchronize the advertisement material data to the media side.
6. The method according to any one of claims 1 to 5, further comprising performing full-scale synchronization of the advertising material data periodically.
7. An advertising material data synchronization device, comprising:
the system comprises an obtaining module, a storage module and a display module, wherein the obtaining module is used for obtaining a plurality of advertisement material data, and the advertisement material data comprises advertiser identification information and material content data;
a determining module for determining a hash value of advertiser identification information of each of the plurality of advertisement material data;
an allocation module for allocating a bucket to each of the advertisement material data based on the hash value; and
and the synchronization module is used for processing the advertisement material data in each barrel in parallel by using multiple threads so as to synchronize the advertisement material data to a media side, wherein the threads of different barrels are mutually independent, and the advertisement material data are processed in the same barrel in sequence.
8. The apparatus of claim 7, wherein the synchronization module comprises:
the obtaining submodule is used for obtaining advertisement material data according to the sequence, and the advertisement material data also comprises a material type;
the determining submodule is used for determining whether the material type in the advertising material data is a preset type;
a synchronization submodule, configured to process the advertisement material data based on the material type so as to synchronize the advertisement material data to a media side when the material type is a predetermined type; and
and the alarm submodule is used for sending alarm information under the condition that the material operation type is not a preset type.
9. An electronic device, comprising:
one or more processors;
a memory for storing one or more computer programs,
wherein the one or more computer programs, when executed by the one or more processors, cause the one or more processors to implement the method of any of claims 1 to 6.
10. A computer readable medium having stored thereon executable instructions which, when executed by a processor, cause the processor to carry out the method of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910904001.1A CN112633906A (en) | 2019-09-24 | 2019-09-24 | Advertisement material synchronization method, device, equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910904001.1A CN112633906A (en) | 2019-09-24 | 2019-09-24 | Advertisement material synchronization method, device, equipment and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112633906A true CN112633906A (en) | 2021-04-09 |
Family
ID=75282532
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910904001.1A Pending CN112633906A (en) | 2019-09-24 | 2019-09-24 | Advertisement material synchronization method, device, equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112633906A (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002259805A (en) * | 2001-02-28 | 2002-09-13 | Nippon Telegraph & Telephone East Corp | Internet connecting system and control method for system |
| CN101059854A (en) * | 2006-04-19 | 2007-10-24 | 腾讯科技（深圳）有限公司 | On-line advertisement dynamic throwing system and method |
| CN101187949A (en) * | 2007-12-26 | 2008-05-28 | 腾讯科技（深圳）有限公司 | A high-capacity data statistical method and system |
| US20090030785A1 (en) * | 2007-07-26 | 2009-01-29 | Yahoo! Inc. | Monetizing rich media advertising interaction |
| CN103729778A (en) * | 2013-12-12 | 2014-04-16 | 广州市网威信息技术有限公司 | Omni-channel advertisement accurate delivery system and method |
| CN105117933A (en) * | 2015-08-05 | 2015-12-02 | 北京奇虎科技有限公司 | Advertisement material data obtaining method and apparatus |
| CN105721567A (en) * | 2016-01-29 | 2016-06-29 | 上海分众软件技术有限公司 | Network pushing system and pushing control method thereof for marketplace advertisements |
| CN105787133A (en) * | 2016-03-31 | 2016-07-20 | 北京小米移动软件有限公司 | Method and device for filtering advertisement information |
| CN107993093A (en) * | 2017-12-04 | 2018-05-04 | 王勇 | Network map businessman's figure border interface tab advertisement dynamic replacing options |
| US20180322401A1 (en) * | 2017-05-03 | 2018-11-08 | Oracle International Corporation | Object count prediction using distributed processing |
| CN109961312A (en) * | 2017-12-26 | 2019-07-02 | 北京奇虎科技有限公司 | Statistical method, device and the computer readable storage medium of ad data |
-
2019
- 2019-09-24 CN CN201910904001.1A patent/CN112633906A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002259805A (en) * | 2001-02-28 | 2002-09-13 | Nippon Telegraph & Telephone East Corp | Internet connecting system and control method for system |
| CN101059854A (en) * | 2006-04-19 | 2007-10-24 | 腾讯科技（深圳）有限公司 | On-line advertisement dynamic throwing system and method |
| US20090030785A1 (en) * | 2007-07-26 | 2009-01-29 | Yahoo! Inc. | Monetizing rich media advertising interaction |
| CN101187949A (en) * | 2007-12-26 | 2008-05-28 | 腾讯科技（深圳）有限公司 | A high-capacity data statistical method and system |
| CN103729778A (en) * | 2013-12-12 | 2014-04-16 | 广州市网威信息技术有限公司 | Omni-channel advertisement accurate delivery system and method |
| CN105117933A (en) * | 2015-08-05 | 2015-12-02 | 北京奇虎科技有限公司 | Advertisement material data obtaining method and apparatus |
| CN105721567A (en) * | 2016-01-29 | 2016-06-29 | 上海分众软件技术有限公司 | Network pushing system and pushing control method thereof for marketplace advertisements |
| CN105787133A (en) * | 2016-03-31 | 2016-07-20 | 北京小米移动软件有限公司 | Method and device for filtering advertisement information |
| US20180322401A1 (en) * | 2017-05-03 | 2018-11-08 | Oracle International Corporation | Object count prediction using distributed processing |
| CN107993093A (en) * | 2017-12-04 | 2018-05-04 | 王勇 | Network map businessman's figure border interface tab advertisement dynamic replacing options |
| CN109961312A (en) * | 2017-12-26 | 2019-07-02 | 北京奇虎科技有限公司 | Statistical method, device and the computer readable storage medium of ad data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105787077B (en) | Data synchronization method and device | |
| WO2019056640A1 (en) | Order processing method and device | |
| CN108897854B (en) | Monitoring method and device for overtime task | |
| CN106790549B (en) | Data updating method and device | |
| CN107451785B (en) | Method and apparatus for outputting information | |
| CN112329049A (en) | Business data management method, device, electronic equipment and medium | |
| CN110673959A (en) | System, method and apparatus for processing tasks | |
| CN111478781A (en) | Message broadcasting method and device | |
| CN113760488A (en) | Method, device, equipment and computer readable medium for scheduling task | |
| CN112817562A (en) | Service processing method and device | |
| WO2022156087A1 (en) | Data blood relationship establishing method and apparatus, computer device, and storage medium | |
| CN108966034B (en) | Virtual article display method, device and storage medium | |
| CN113364664A (en) | Instant messaging method and device | |
| CN112633906A (en) | Advertisement material synchronization method, device, equipment and medium | |
| CN111582996B (en) | Service information display method and device | |
| CN113741888A (en) | Service processing method and device | |
| CN114169733A (en) | Resource allocation method and device | |
| CN111010449B (en) | Image information output method, system, device, medium, and electronic apparatus | |
| CN110673827B (en) | Resource calling method and device based on android system and electronic equipment | |
| CN109840073B (en) | Method and device for realizing business process | |
| CN112308074A (en) | Method and device for generating thumbnail | |
| CN113852840B (en) | Video rendering method, device, electronic equipment and storage medium | |
| CN114979004B (en) | Information processing method, device, equipment and medium | |
| CN110597802A (en) | Message processing method and device | |
| US8473419B1 (en) | Dependency resolution in publish/subscribe |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |