CN113129061B - Advertisement index verification method and system - Google Patents
Advertisement index verification method and system Download PDFInfo
- Publication number
- CN113129061B CN113129061B CN202110424535.1A CN202110424535A CN113129061B CN 113129061 B CN113129061 B CN 113129061B CN 202110424535 A CN202110424535 A CN 202110424535A CN 113129061 B CN113129061 B CN 113129061B
- Authority
- CN
- China
- Prior art keywords
- advertisement
- request
- data
- online
- orientation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0242—Determining effectiveness of advertisements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/258—Data format conversion from or to a database
Abstract
The embodiment of the invention provides an advertisement index checking method and system, comprising the following steps: collecting information of each online advertisement to form advertisement data to be played back, and collecting a request for each online advertisement as flow data to be played back; playing back the advertisement data to be played back to finish the online of each advertisement, and directly analyzing the setting of each online advertisement to obtain each corresponding effective orientation; the request in the flow data is replayed, and the online advertisement is indexed to hit the advertisement matched with the request; acquiring all advertisements hit by each request, and acquiring respective corresponding effective orientations according to each advertisement ID; acquiring user attributes from the corresponding requests according to the effective orientation; judging the inclusion relation between the effective targeting of the hit advertisement and the user attribute in the corresponding request, checking whether the advertisement index matching carried out for the request is accurate, recording the inaccurate advertisement index matching and feeding back. The limitation of the construction data is removed, and the coverage rate of the test scene is enriched.
Description
Technical Field
The invention relates to the field of software testing, in particular to an advertisement index verification method and system.
Background
The advertisement data and the request data are constructed manually, and the function of the advertisement index module is verified by utilizing an automatic script according to a certain or a plurality of directional combination modes. In carrying out the present invention, the applicant has found that at least the following problems exist in the prior art: the advertisement data and the request data are both constructed manually, the data form is single, and the coverage rate of the test scene is low.
Disclosure of Invention
The embodiment of the invention provides an advertisement index verification method and system, which adopt online traffic to carry out test playback and verify all candidate matches returned by an advertisement index module, so that the limitation of manually constructed data is eliminated, and the coverage rate of a test scene is greatly enriched.
In order to achieve the above object, in one aspect, an embodiment of the present invention provides an advertisement index verification method, including:
collecting and storing information of each online advertisement by using a data synchronization tool, forming advertisement data to be played back by using the information of each online advertisement, collecting and storing a request for each online advertisement by using a traffic replication tool, and taking the collected request as traffic data to be played back; wherein the request is made for targeting of advertisements, the targeting being a certain user attribute of a set advertisement audience;
playing back the advertisement data to be played back, disposing the advertisement data to be played back according to preset conditions to finish online of each advertisement, and directly analyzing the setting of each online advertisement to obtain corresponding effective orientation of each online advertisement; the request in the flow data is replayed, and indexes are carried out in the online advertisements according to the request so as to hit the advertisements matched with the request; wherein the effective orientation refers to an orientation with a value not being null;
for each request in the flow data, acquiring all advertisements hit by the request, acquiring respective corresponding effective orientations according to the advertisement IDs, and acquiring user attributes from the corresponding requests according to the effective orientations; and
by judging the inclusion relation between the effective targeting of the hit advertisement and the user attribute in the corresponding request, whether the advertisement index matching carried out for the request is accurate or not is checked, and inaccurate advertisement index matching is recorded and fed back.
In another aspect, an embodiment of the present invention provides an advertisement index verification system, including:
the data collection module is used for collecting and storing the information of each online advertisement by using the data synchronization tool, forming the information of each online advertisement into advertisement data to be played back, collecting and storing the request of each online advertisement by using the traffic replication tool, and taking the collected request as traffic data to be played back; wherein the request is made for targeting of advertisements, the targeting being a certain user attribute of a set advertisement audience;
the advertisement playback module is used for playing back the advertisement data to be played back and disposing the advertisement data to be played back according to preset conditions so as to finish online of each advertisement;
the intelligent advertisement analysis module is used for directly analyzing the setting of each online advertisement to obtain the corresponding effective orientation of each online advertisement; wherein the effective orientation refers to an orientation with a value not being null;
the flow playback module is used for playing back the request in the flow data, and indexing the request in the online advertisement according to the request so as to hit the advertisement matched with the request;
the advertisement index module is used for acquiring all advertisements hit by each request in the flow data according to each advertisement ID and acquiring corresponding effective orientation;
the matching verification module is used for acquiring user attributes from corresponding requests according to effective orientation; by judging the inclusion relation between the effective targeting of the hit advertisement and the user attribute in the corresponding request, whether the advertisement index matching carried out for the request is accurate or not is checked, and inaccurate advertisement index matching is recorded and fed back.
The technical scheme has the following beneficial effects: the online flow is adopted for testing and playback, and all candidate matching verification returned by the advertisement index module is carried out, so that the limitation of manual construction data is eliminated, and the coverage rate of a testing scene is greatly enriched.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of an advertisement index checking method according to an embodiment of the present invention;
FIG. 2 is a block diagram of an advertisement index checking system according to an embodiment of the present invention;
FIG. 3 is a flow chart of another method of advertisement index verification according to an embodiment of the present invention;
FIG. 4 is a diagram of verification data preview statistics of an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
As shown in fig. 1, in combination with an embodiment of the present invention, there is provided an advertisement index checking method, including:
s101: collecting and storing information of each online advertisement by using a data synchronization tool, forming advertisement data to be played back by using the information of each online advertisement, collecting and storing a request for each online advertisement by using a traffic replication tool, and taking the collected request as traffic data to be played back; wherein the request is made for targeting of advertisements, the targeting being a certain user attribute of a set advertisement audience;
s102: playing back the advertisement data to be played back, disposing the advertisement data to be played back according to preset conditions to finish online of each advertisement, and directly analyzing the setting of each online advertisement to obtain corresponding effective orientation of each online advertisement; the request in the flow data is replayed, and indexes are carried out in the online advertisements according to the request so as to hit the advertisements matched with the request; wherein the effective orientation refers to an orientation with a value not being null;
s103: for each request in the flow data, acquiring all advertisements hit by the request, acquiring respective corresponding effective orientations according to the advertisement IDs, and acquiring user attributes from the corresponding requests according to the effective orientations; and
s104: by judging the inclusion relation between the effective targeting of the hit advertisement and the user attribute in the corresponding request, whether the advertisement index matching carried out for the request is accurate or not is checked, and inaccurate advertisement index matching is recorded and fed back.
Preferably, the saved advertisement to be played back is stored in a lightweight data interchange format JSON format; the collected requests of the online advertisements are expressed by adopting a lightweight data exchange format JSON format;
the advertisement index checking method further comprises the following steps:
s105: before playing back the advertisement data to be played back, writing the advertisement data in the JSON format into a distributed publishing and subscribing message system Kafka; when the advertisement data to be played back is played back, the advertisement data in JSON format is read from Kafka.
Preferably, in step 2, the playing back the advertisement data to be played back and disposing the advertisement data to be played back according to a preset condition to complete online of each advertisement specifically includes:
playing back the advertisement data to be played back, and generating advertisement indexes which are ordered in a certain direction by each advertisement data;
wherein a certain orientation is age.
Preferably, the time to play back the advertisement data to be played back is earlier than the time to play back the request in the traffic data.
Preferably, step 104 specifically includes:
s1041: aiming at each effective orientation related to each advertisement hit by the request, acquiring a corresponding user attribute value of the request according to the effective orientation, and when the intersection of the corresponding user attribute value and the effective orientation value is not empty, determining that corresponding index matching is satisfied for the user attribute value of the orientation when indexing is performed in the online advertisement according to the request; when the intersection of the corresponding user attribute value and the effective targeting value is empty, determining that the corresponding index matching is not satisfied for the targeted user attribute value setting when indexing is carried out in the online advertisement according to the request;
s1042: when all the directed user attribute values are set to meet respective index matching when the online advertisement is indexed, the advertisement index matching aiming at the request is judged to be accurate, and the verification is successful; when the user attribute value of any orientation is set to be not met with corresponding index matching when the online advertisement is indexed, the advertisement index matching aiming at the request is judged to be inaccurate, verification is unsuccessful, and a result that the orientation is not met with the user attribute value setting is recorded and fed back.
As shown in fig. 2, in combination with an embodiment of the present invention, there is provided an advertisement index verification system, including:
a data collection module 21, configured to collect and store information of each online advertisement by using a data synchronization tool, form advertisement data to be played back from the information of each online advertisement, collect and store a request for each online advertisement by using a traffic replication tool, and use the collected request as traffic data to be played back; wherein the request is made for targeting of advertisements, the targeting being a certain user attribute of a set advertisement audience;
the advertisement playback module 22 is used for playing back the advertisement data to be played back and disposing the advertisement data to be played back according to preset conditions so as to finish online of each advertisement;
the advertisement intelligent analysis module 23 is used for directly analyzing the setting of each online advertisement to obtain the corresponding effective orientation of each online advertisement; wherein the effective orientation refers to an orientation with a value not being null;
a traffic playback module 24 for playing back the request in the traffic data, indexing in the online advertisement according to the request to hit the advertisement matching the request;
the advertisement index module 25 is configured to obtain, for each request in the traffic data, all advertisements hit by the request, and obtain respective corresponding valid orientations according to each advertisement ID;
a match check module 26 for obtaining user attributes from the corresponding requests according to the effective orientation; by judging the inclusion relation between the effective targeting of the hit advertisement and the user attribute in the corresponding request, whether the advertisement index matching carried out for the request is accurate or not is checked, and inaccurate advertisement index matching is recorded and fed back.
Preferably, the saved advertisement to be played back is stored in a lightweight data interchange format JSON format; the collected requests of the online advertisements are expressed by adopting a lightweight data exchange format JSON format;
the advertisement index checking system further comprises:
an intermediate storage unit 27 for writing the advertisement data in JSON format to the distributed publish-subscribe message system Kafka before playback of the advertisement data to be played back; when the advertisement data to be played back is played back, the advertisement data in JSON format is read from Kafka.
Preferably, the advertisement playback module 22 is specifically configured to:
playing back the advertisement data to be played back, and generating advertisement indexes which are ordered in a specific orientation by each advertisement data;
wherein the specific orientation is age.
Preferably, the time to play back the advertisement data to be played back is earlier than the time to play back the request in the traffic data.
Preferably, the matching verification module 26 includes:
the targeting verification subunit 261 is configured to obtain, for each valid targeting related to each advertisement targeted by the request, a user attribute value corresponding to the request according to the valid targeting, and when an intersection between the user attribute value corresponding to the request and the valid targeting value is not empty, determine that the setting of the user attribute value corresponding to the targeting satisfies corresponding index matching when indexing in the online advertisement according to the request; when the intersection of the corresponding user attribute value and the effective targeting value is empty, determining that the corresponding index matching is not satisfied for the targeted user attribute value setting when indexing is carried out in the online advertisement according to the request;
an advertisement index checking subunit 262, configured to determine that the advertisement index matching performed for the request is accurate and the checking is successful when all the targeted user attribute value settings of the online advertisement meet respective index matching when the online advertisement is indexed; when the user attribute value of any orientation is set to be not met with corresponding index matching when the online advertisement is indexed, the advertisement index matching aiming at the request is judged to be inaccurate, verification is unsuccessful, and a result that the orientation is not met with the user attribute value setting is recorded and fed back.
The beneficial effects obtained by the invention are as follows:
the online flow is adopted for testing and playback, and all candidate matching verification returned by the advertisement index module is carried out, so that the limitation of manual construction data is eliminated, and the coverage rate of a testing scene is greatly enriched; meanwhile, before the advertisement data is played back, the advertisement is intelligently analyzed and the effective orientation is extracted, so that the checking complexity of checking is reduced, and the overall efficiency of the system is improved.
The foregoing technical solutions of the embodiments of the present invention will be described in detail with reference to specific application examples, and reference may be made to the foregoing related description for details of the implementation process that are not described.
Abbreviations and key terms involved in the present invention are defined as follows:
1. advertisement index: a core module of the advertisement delivery system is responsible for index construction of each targeting condition of advertisements and targeted retrieval of audience groups.
2. Directional matching (index matching): advertisements meeting the conditions are retrieved in the advertisement indexing system according to audience group attributes (age, gender, region, etc.).
3. TCPCopy-an open source TCP protocol based traffic replication tool.
4. Rsync: rsync (remote synchronize) is a remote data synchronization tool that can rapidly synchronize files between multiple hosts over a LAN/WAN, and can also use Rsync to synchronize different directories in a local hard disk.
5. Kafka: is a high throughput distributed publish-subscribe messaging system sourced by the Apache software foundation.
6. Redis-an open source written using ANSI C, contains a variety of data structures, supports networking, memory-based, optionally persistent key-value pair storage database.
7. JSON (JavaScript Object Notation, JS object numbered musical notation): is a lightweight data exchange format. It stores and presents data in a text format that is completely independent of the programming language, based on a subset of ECMAScript (js specification formulated by the european computer institute).
8. MYSQL: a relational database management system.
The invention relates to an advertisement index verification system based on data playback, which is used for testing an advertisement index system (advertisement index module), analyzing advertisements based on online flow playback and verifying the matching of all candidate advertisements of the advertisement index module. The process of manually constructing data is eliminated, the correctness of the directional matching of each advertisement retrieved by the advertisement index module is checked on the basis of the online real data flow playback, and the defect of low coverage rate of an automatic script test scene is overcome by utilizing the diversity and the complexity of the online real data.
The overall architecture of the present invention is shown in fig. 3, and the system can be divided into 5 parts of online data collection (including traffic data and advertisement data), data playback, intelligent advertisement parsing, matching verification and report generation.
The system completes one check task roughly into the following 5 steps:
step one: the system uses the Rsync tool to synchronize information of all advertisements online to the local file as advertisement data to be played back, and simultaneously uses the request data file collected by the TCPCopy tool as traffic data to be played back.
Step two: the advertisement playback module performs data playback prior to the request playback module 10s, and the advertisement playback system (advertisement playback module) reads and writes the advertisement JSON data in the file into the Kafka, and the advertisement indexing module consumes the Kafka (the advertisement JSON data therein) to complete advertisement online. Such as: the online is to generate a directional inverted index, namely, advertisements can be found according to specific values of ages.
Meanwhile, the intelligent advertisement analysis module analyzes the effective orientation of advertisement setting and stores the analysis result into a key value pair storage database Redis (namely, analyzes the set orientation of each advertisement), wherein the effective orientation refers to the orientation of which the value is not null.
The advertisement is effectively and directionally extracted, so that the complexity of subsequent matching verification can be effectively reduced, and the overall performance of the verification system is improved. The reason why the advertisement playback system (advertisement playback module) is executed 10s in advance is to ensure that there must be an advertisement online at the beginning of the traffic playback, without wasting each request.
Step three: after the advertisement playback system (advertisement playback module) is started for 10s, the flow playback system (flow playback module) starts to play back the flow data request to the tested advertisement index module one by one, the advertisement index module returns all the advertisement IDs hit by the advertisement index module after receiving the request, and the verification system transmits the request JSON (JSON is a lightweight data exchange format) and the advertisement set returned by the advertisement index module as inputs to the matching verification module. The method comprises the steps of playing back advertisement data to be played back, and generating advertisement indexes which are sequenced in a specific direction by each advertisement data; wherein the specific orientation is age.
Step four: the matching verification module reads the effective orientation of the advertisement from the Redis written by the advertisement intelligent analysis module according to the advertisement ID, then obtains the relevant attribute (user attribute) from the request JSON according to the effective orientation, determines whether the advertisement orientation is normal matching by judging the inclusion relation of the corresponding attribute in the request, and records the abnormal matching result into a MySQL table as shown in figure 4.
For example: if the advertisement index returns an advertisement with ID 10476716, the advertisement intelligent analysis module writes Redis with the following data: { "gener": [402], "age": [1030,1031,1032,1033,1034,1035,1036,1037,1038,1039], "geo": [30100,30101,30102,30103,30104] }, then the orientation that this advertisement needs to check is: if the matching verification module obtains the value of the age from the request JSON as [1050], and the result is a null array after intersecting with the advertisement set value of the age [1030,1031,1032,1033,1034,1035,1036,1037,1038,1039], the matching verification module considers that the orientation does not meet the set value range, records the value of the age into the Mysql data table, if the value of the age is contained in the set orientation, continuously judges the containing relation of the attributes corresponding to the gender and the geo and the request JSON, stops verification and writes error information into the Mysql when the value of the age does not meet the containing relation, and so on, the matching verification can verify the effective orientation of each advertisement returned by the advertisement index.
Step five: after the playback of the flow file is finished, the verification system can generate a report according to the MySQL record and inform a task executor that the direction of the advertisement is clear in the report, so that the problem analysis cost is reduced.
The beneficial effects obtained by the invention are as follows:
the online flow is adopted for testing and playback, and all candidate matching verification returned by the advertisement index module is carried out, so that the limitation of manual construction data is eliminated, and the coverage rate of a testing scene is greatly enriched; meanwhile, before the advertisement data is played back, the advertisement is intelligently analyzed and the effective orientation is extracted, so that the checking complexity of checking is reduced, and the overall efficiency of the system is improved.
It should be understood that the specific order or hierarchy of steps in the processes disclosed are examples of exemplary approaches. Based on design preferences, it is understood that the specific order or hierarchy of steps in the processes may be rearranged without departing from the scope of the present disclosure. The accompanying method claims present elements of the various steps in a sample order, and are not meant to be limited to the specific order or hierarchy presented.
In the foregoing detailed description, various features are grouped together in a single embodiment for the purpose of streamlining the disclosure. This method of disclosure is not to be interpreted as reflecting an intention that the claimed embodiments of the subject matter require more features than are expressly recited in each claim. Rather, as the following claims reflect, invention lies in less than all features of a single disclosed embodiment. Thus the following claims are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate preferred embodiment of this invention.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. As will be apparent to those skilled in the art; various modifications to these embodiments will be readily apparent, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the disclosure. Thus, the present disclosure is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The foregoing description includes examples of one or more embodiments. It is, of course, not possible to describe every conceivable combination of components or methodologies for purposes of describing the aforementioned embodiments, but one of ordinary skill in the art may recognize that many further combinations and permutations of various embodiments are possible. Accordingly, the embodiments described herein are intended to embrace all such alterations, modifications and variations that fall within the scope of the appended claims. Furthermore, as used in the specification or claims, the term "comprising" is intended to be inclusive in a manner similar to the term "comprising," as interpreted when employed as a transitional word in a claim. Furthermore, any use of the term "or" in the specification of the claims is intended to mean "non-exclusive or".
Those of skill in the art will further appreciate that the various illustrative logical blocks (illustrative logical block), units, and steps described in connection with the embodiments of the invention may be implemented by electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components (illustrative components), elements, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design requirements of the overall system. Those skilled in the art may implement the described functionality in varying ways for each particular application, but such implementation is not to be understood as beyond the scope of the embodiments of the present invention.
The various illustrative logical blocks or units described in the embodiments of the invention may be implemented or performed with a general purpose processor, a digital signal processor, an Application Specific Integrated Circuit (ASIC), a field programmable gate array or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described. A general purpose processor may be a microprocessor, but in the alternative, the general purpose processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a digital signal processor and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a digital signal processor core, or any other similar configuration.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may be stored in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. In an example, a storage medium may be coupled to the processor such that the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an ASIC, which may reside in a user terminal. In the alternative, the processor and the storage medium may reside as distinct components in a user terminal.
In one or more exemplary designs, the above-described functions of embodiments of the present invention may be implemented in hardware, software, firmware, or any combination of the three. If implemented in software, the functions may be stored on a computer-readable medium or transmitted as one or more instructions or code on the computer-readable medium. Computer readable media includes both computer storage media and communication media that facilitate transfer of computer programs from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer. For example, such computer-readable media may include, but is not limited to, RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that may be used to carry or store program code in the form of instructions or data structures and other data structures that may be read by a general or special purpose computer, or a general or special purpose processor. Further, any connection is properly termed a computer-readable medium, e.g., if the software is transmitted from a website, server, or other remote source via a coaxial cable, fiber optic cable, twisted pair, digital Subscriber Line (DSL), or wireless such as infrared, radio, and microwave, and is also included in the definition of computer-readable medium. The disks (disks) and disks (disks) include compact disks, laser disks, optical disks, DVDs, floppy disks, and blu-ray discs where disks usually reproduce data magnetically, while disks usually reproduce data optically with lasers. Combinations of the above may also be included within the computer-readable media.
The foregoing description of the embodiments has been provided for the purpose of illustrating the general principles of the invention, and is not meant to limit the scope of the invention, but to limit the invention to the particular embodiments, and any modifications, equivalents, improvements, etc. that fall within the spirit and principles of the invention are intended to be included within the scope of the invention.
Claims (10)
1. An advertisement index checking method, comprising:
collecting and storing information of each online advertisement by using a data synchronization tool, forming advertisement data to be played back by using the information of each online advertisement, collecting and storing a request for each online advertisement by using a traffic replication tool, and taking the collected request as traffic data to be played back; wherein the request is made for targeting of advertisements, the targeting being a certain user attribute of a set advertisement audience;
playing back the advertisement data to be played back, disposing the advertisement data to be played back according to preset conditions to finish online of each advertisement, and directly analyzing the setting of each online advertisement to obtain corresponding effective orientation of each online advertisement; the request in the flow data is replayed, and indexes are carried out in the online advertisements according to the request so as to hit the advertisements matched with the request; wherein the effective orientation refers to an orientation with a value not being null;
for each request in the flow data, acquiring all advertisements hit by the request, acquiring respective corresponding effective orientations according to the advertisement IDs, and acquiring user attributes from the corresponding requests according to the effective orientations; and
by judging the inclusion relation between the effective targeting of the hit advertisement and the user attribute in the corresponding request, whether the advertisement index matching carried out for the request is accurate or not is checked, and inaccurate advertisement index matching is recorded and fed back.
2. The advertisement index checking method according to claim 1, wherein the saved advertisement to be played back is stored in a lightweight data interchange format JSON format; the collected requests of the online advertisements are expressed by adopting a lightweight data exchange format JSON format;
the advertisement index checking method further comprises the following steps:
before playing back the advertisement data to be played back, writing the advertisement data in the JSON format into a distributed publishing and subscribing message system Kafka; when the advertisement data to be played back is played back, the advertisement data in JSON format is read from Kafka.
3. The method for verifying the advertisement index according to claim 1, wherein the playing back the advertisement data to be played back and disposing the advertisement data to be played back according to a preset condition to complete the online of each advertisement, specifically comprises:
playing back the advertisement data to be played back, and generating advertisement indexes which are ordered in a specific orientation by each advertisement data;
wherein the particular orientation is age.
4. The method of advertisement index verification according to claim 1, wherein,
the time to play back the advertisement data to be played back is earlier than the time to play back the request in the traffic data.
5. The method for verifying advertisement index according to claim 1, wherein the verifying whether the advertisement index matching performed for the request is accurate by determining the inclusion relationship between the effective targeting of the targeted advertisement and the user attribute in the corresponding request, recording the inaccurate advertisement index matching and feeding back, specifically comprises:
aiming at each effective orientation related to each advertisement hit by the request, acquiring a corresponding user attribute value of the request according to the effective orientation, and when the intersection of the corresponding user attribute value and the effective orientation value is not empty, determining that corresponding index matching is satisfied for the user attribute value of the orientation when indexing is performed in the online advertisement according to the request; when the intersection of the corresponding user attribute value and the effective targeting value is empty, determining that the corresponding index matching is not satisfied for the targeted user attribute value setting when indexing is carried out in the online advertisement according to the request;
when all the directed user attribute values are set to meet respective index matching when the online advertisement is indexed, the advertisement index matching aiming at the request is judged to be accurate, and the verification is successful; when the user attribute value of any orientation is set to be not met with corresponding index matching when the online advertisement is indexed, the advertisement index matching aiming at the request is judged to be inaccurate, verification is unsuccessful, and a result that the orientation is not met with the user attribute value setting is recorded and fed back.
6. An advertisement index verification system, comprising:
the data collection module is used for collecting and storing the information of each online advertisement by using the data synchronization tool, forming the information of each online advertisement into advertisement data to be played back, collecting and storing the request of each online advertisement by using the traffic replication tool, and taking the collected request as traffic data to be played back; wherein the request is made for targeting of advertisements, the targeting being a certain user attribute of a set advertisement audience;
the advertisement playback module is used for playing back the advertisement data to be played back and disposing the advertisement data to be played back according to preset conditions so as to finish online of each advertisement;
the intelligent advertisement analysis module is used for directly analyzing the setting of each online advertisement to obtain the corresponding effective orientation of each online advertisement; wherein the effective orientation refers to an orientation with a value not being null;
the flow playback module is used for playing back the request in the flow data, and indexing the request in the online advertisement according to the request so as to hit the advertisement matched with the request;
the advertisement index module is used for acquiring all advertisements hit by each request in the flow data according to each advertisement ID and acquiring corresponding effective orientation;
the matching verification module is used for acquiring user attributes from corresponding requests according to effective orientation; by judging the inclusion relation between the effective targeting of the hit advertisement and the user attribute in the corresponding request, whether the advertisement index matching carried out for the request is accurate or not is checked, and inaccurate advertisement index matching is recorded and fed back.
7. The advertisement index checking system according to claim 6, wherein the saved advertisement to be played back is stored in a lightweight data interchange format JSON format; the collected requests of the online advertisements are expressed by adopting a lightweight data exchange format JSON format;
the advertisement index checking system further comprises:
the intermediate storage unit is used for writing the advertisement data in the JSON format into the distributed publishing and subscribing message system Kafka before playing back the advertisement data to be played back; when the advertisement data to be played back is played back, the advertisement data in JSON format is read from Kafka.
8. The advertising indexing system of claim 6, wherein the advertising playback module is specifically configured to:
playing back the advertisement data to be played back, and generating advertisement indexes which are ordered in a specific orientation by each advertisement data;
wherein the particular orientation is age.
9. The advertisement index checking system of claim 6, wherein the time to play back the advertisement data to be played back is earlier than the time to play back the request in the traffic data.
10. The advertisement index checking system of claim 6, wherein said match checking module comprises:
the orientation verification subunit is used for aiming at each effective orientation related to each advertisement hit by the request, acquiring a corresponding user attribute value of the request according to the effective orientation, and setting the user attribute value of the orientation to meet corresponding index matching when indexing is carried out in the online advertisement according to the request when the intersection of the corresponding user attribute value of the request and the effective orientation value is not empty; when the intersection of the corresponding user attribute value and the effective targeting value is empty, determining that the corresponding index matching is not satisfied for the targeted user attribute value setting when indexing is carried out in the online advertisement according to the request;
the advertisement index checking subunit is used for judging that the advertisement index matching carried out for the request is accurate and the checking is successful when all the directed user attribute value settings of the online advertisement meet respective index matching when the online advertisement is indexed; when the user attribute value of any orientation is set to be not met with corresponding index matching when the online advertisement is indexed, the advertisement index matching aiming at the request is judged to be inaccurate, verification is unsuccessful, and a result that the orientation is not met with the user attribute value setting is recorded and fed back.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110424535.1A CN113129061B (en) | 2021-04-20 | 2021-04-20 | Advertisement index verification method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110424535.1A CN113129061B (en) | 2021-04-20 | 2021-04-20 | Advertisement index verification method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113129061A CN113129061A (en) | 2021-07-16 |
| CN113129061B true CN113129061B (en) | 2023-07-18 |
Family
ID=76777933
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110424535.1A Active CN113129061B (en) | 2021-04-20 | 2021-04-20 | Advertisement index verification method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113129061B (en) |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101496403A (en) * | 2006-07-31 | 2009-07-29 | 微软公司 | Associating advertisements with on-demand media content |
| KR101003045B1 (en) * | 2009-06-29 | 2010-12-22 | 주식회사 모임 | Apparatus and method for presenting personalized advertisements information based on artificial intelligence, and recording medium thereof |
| CN103927671A (en) * | 2013-01-16 | 2014-07-16 | 舜易科技发展（上海）有限公司 | Advertisement putting method and system, advertisement plug-in device and advertisement putting management system |
| CN105654201A (en) * | 2015-12-30 | 2016-06-08 | 上海珍岛信息技术有限公司 | Advertisement flow prediction method and device |
| CN106817296A (en) * | 2017-01-12 | 2017-06-09 | 微梦创科网络科技（中国）有限公司 | The method of testing of information recommendation, device and electronic equipment |
| US9973830B1 (en) * | 2017-01-03 | 2018-05-15 | Interactive Advertising Bureau, Inc. | Supporting video ad serving into video streams |
| CN108170719A (en) * | 2017-12-05 | 2018-06-15 | 深圳市金立通信设备有限公司 | A kind of search method, server and computer readable storage medium |
| CN109472644A (en) * | 2018-11-14 | 2019-03-15 | 浙江出海数字技术有限公司 | The acquisition of ad traffic data and statistical analysis system and its method |
| KR102009360B1 (en) * | 2018-10-22 | 2019-08-09 | 신호열 | Method for providing reward according to online advertising |
| CN110610377A (en) * | 2019-08-09 | 2019-12-24 | 微梦创科网络科技（中国）有限公司 | Advertisement effect testing method and system |
| CN111475399A (en) * | 2020-03-11 | 2020-07-31 | 平安科技（深圳）有限公司 | Virtual test method and device |
| CN112449214A (en) * | 2020-11-25 | 2021-03-05 | 恩亿科(北京)数据科技有限公司 | OTT advertisement putting method, system, computer equipment and storage medium |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8707182B2 (en) * | 2010-01-20 | 2014-04-22 | Verizon Patent And Licensing Inc. | Methods and systems for dynamically inserting an advertisement into a playback of a recorded media content instance |
| US20110295683A1 (en) * | 2010-05-26 | 2011-12-01 | Hulu Llc | Method and apparatus for rapid and scaleable directed advertisting service |
| US20170213243A1 (en) * | 2012-01-03 | 2017-07-27 | Google Inc. | Media content advertisement system based on a ranking of a segment of the media content and user interest |
| US20160239869A1 (en) * | 2015-02-17 | 2016-08-18 | Buzztala, LLC a New York Corporation | Various methods and apparatuses for real time bidding and optimization of video ads for organic and paid media |
-
2021
- 2021-04-20 CN CN202110424535.1A patent/CN113129061B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101496403A (en) * | 2006-07-31 | 2009-07-29 | 微软公司 | Associating advertisements with on-demand media content |
| KR101003045B1 (en) * | 2009-06-29 | 2010-12-22 | 주식회사 모임 | Apparatus and method for presenting personalized advertisements information based on artificial intelligence, and recording medium thereof |
| CN103927671A (en) * | 2013-01-16 | 2014-07-16 | 舜易科技发展（上海）有限公司 | Advertisement putting method and system, advertisement plug-in device and advertisement putting management system |
| CN105654201A (en) * | 2015-12-30 | 2016-06-08 | 上海珍岛信息技术有限公司 | Advertisement flow prediction method and device |
| US9973830B1 (en) * | 2017-01-03 | 2018-05-15 | Interactive Advertising Bureau, Inc. | Supporting video ad serving into video streams |
| CN106817296A (en) * | 2017-01-12 | 2017-06-09 | 微梦创科网络科技（中国）有限公司 | The method of testing of information recommendation, device and electronic equipment |
| CN108170719A (en) * | 2017-12-05 | 2018-06-15 | 深圳市金立通信设备有限公司 | A kind of search method, server and computer readable storage medium |
| KR102009360B1 (en) * | 2018-10-22 | 2019-08-09 | 신호열 | Method for providing reward according to online advertising |
| CN109472644A (en) * | 2018-11-14 | 2019-03-15 | 浙江出海数字技术有限公司 | The acquisition of ad traffic data and statistical analysis system and its method |
| CN110610377A (en) * | 2019-08-09 | 2019-12-24 | 微梦创科网络科技（中国）有限公司 | Advertisement effect testing method and system |
| CN111475399A (en) * | 2020-03-11 | 2020-07-31 | 平安科技（深圳）有限公司 | Virtual test method and device |
| CN112449214A (en) * | 2020-11-25 | 2021-03-05 | 恩亿科(北京)数据科技有限公司 | OTT advertisement putting method, system, computer equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113129061A (en) | 2021-07-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100386736C (en) | Tracking for affairs coincide variation of database | |
| KR100921158B1 (en) | Method and System for Managing Database | |
| CN104636336A (en) | Video search method and device | |
| CN110941738B (en) | Recommendation method and device, electronic equipment and computer-readable storage medium | |
| JP2008538634A (en) | Method, computer readable media and data structure for building a trusted database of digital audio identifier elements and identifying media items | |
| CN109712608A (en) | Multitone area wake-up test method, apparatus and storage medium | |
| CN115358643B (en) | Message-based upstream and downstream document generation method and device and storage medium | |
| CN107729375B (en) | Log data sorting method and device | |
| CN114020790A (en) | Data query method and device | |
| CN111291990A (en) | Quality monitoring processing method and device | |
| CN109408050A (en) | The code generating method and device of appliance applications interface for rail vehicle | |
| CN111125018B (en) | File exception tracing method, device, equipment and storage medium | |
| CN113129061B (en) | Advertisement index verification method and system | |
| CN104317820B (en) | Statistical method and device for report forms | |
| CN111817867A (en) | Method and system for multi-log collaborative analysis in distributed environment | |
| CN115408032A (en) | Data model management method, device, server, medium and product | |
| CN115238655A (en) | Json data editing method and device | |
| CN112148947B (en) | Method and system for excavating and brushing users in batches | |
| CN111708954B (en) | Ranking method and system of ranking list | |
| CN111290804A (en) | Service configuration system, service configuration method, device and configuration server | |
| CN115599976B (en) | User grouping method, device, electronic equipment and storage medium | |
| CN113094265B (en) | Analysis method and analysis device for test script and electronic equipment | |
| CN111581065B (en) | Mobile terminal message partial pressure test system and method based on live broadcast scene | |
| CN114116729B (en) | Test data processing method and equipment | |
| CN117785706A (en) | Method, device and storage medium for optimizing test case generation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |