WO2022236842A1

WO2022236842A1 - Advertisement replacement or addition processing method, system and apparatus

Info

Publication number: WO2022236842A1
Application number: PCT/CN2021/094000
Authority: WO
Inventors: 刘川民
Original assignee: 刘川民
Priority date: 2021-05-10
Filing date: 2021-05-17
Publication date: 2022-11-17
Also published as: CN113222662A

Abstract

An advertisement replacement or addition processing method, system and apparatus, which relate to the field of image processing. The method comprises: acquiring first data, the first data being video data or image data; identifying a first area, in the first data, of first advertisement content in the first data; determining whether the first advertisement content in the first area meets a replacement condition; if the first advertisement content does not meet the replacement condition, sending the first data to a first data receiver; if the first advertisement content meets the replacement condition, performing the following processing: on the basis of the first advertisement content and feature information of a second data receiver, generating second advertisement content; replacing the first advertisement content in the first data with the second advertisement content to obtain second data; and sending the second data to the second data receiver. By means of the method, the effects and benefits of advertisement can be improved.

Description

A Processing Method, System and Device for Advertisement Replacement or Addition

technical field

The present invention relates to the field of image processing, in particular to a processing method, system and device for advertisement replacement or addition.

Background technique

For various activities or events, there are a large number of on-site audiences and TV audiences to watch, and the corresponding advertising effects are huge. Therefore, there are advertising spaces on some parts of these activities or events or on-site personnel. These advertising spaces can allow on-site audiences and TV viewers. For example, for an international sports event, such as the World Cup, there will be many advertising spaces around the stadium. The advertisements in these positions will be uniformly presented to the whole world or different places along with the broadcast of the game. different audiences in different regions. However, because the language, culture, and brand requirements of different countries are different, if an advertisement on an advertisement position is presented to audiences with different backgrounds with the same form of advertisement content, different audiences of advertisements will not be able to accurately Either have a good understanding of the meaning of advertisements, or restrict different audiences from receiving more suitable advertisements of different brands, resulting in limited advertising effects and wasting precious advertising space resources.

Similarly, for a player in a football game, the position, content and presentation method of the advertising endorsement brand presented on the jersey are relatively fixed, and are simultaneously disseminated to audiences with different advertising needs. These traditional on-site advertising display methods, due to limited advertising positions, limit the supply capacity of advertising space suppliers and the effect of cross-regional and cross-viewer display of advertisements.

Similarly, for the same program or event, the existing advertisement distribution method is that each advertisement distributor distributes advertisements to lower-level advertisement distributors or advertisement audiences according to the same advertisement method. The advertisement distribution method is not flexible and cannot meet the independent delivery requirements of advertisement distribution. affect the performance of the ad.

Contents of the invention

In order to solve the above problems and improve the display effect of advertisements in different environments, the present invention provides a processing method, system, device and medium for replacing or adding advertisements.

In order to achieve the above purpose, the present invention provides a processing method for replacing or adding advertisements, the method comprising:

Acquiring first data, where the first data is video data or image data;

identifying the first advertisement content in the first data or the first area of the first advertisement display carrier in the first data;

judging whether the first advertisement content or the first advertisement display carrier in the first area satisfies a replacement condition;

If the first advertisement content or the first advertisement display carrier does not meet the replacement condition, sending the first data to the first data receiver;

If the first advertisement content or the first advertisement display carrier meets the replacement condition, the following processing is performed;

Generate second advertisement content based on the first advertisement content and characteristic information of the second data recipient; or generate second advertisement content based on the first advertisement display carrier and characteristic information of the second data recipient;

replacing the first advertisement content in the first data with the second advertisement content to obtain the second data; or displaying the second advertisement content on the first advertisement display carrier to obtain the second data;

sending the second data to the second data receiver.

Among them, the principle of the present invention is: the live broadcast of sports events or activities is to collect live video images and then transmit them to terminals around the world for playback after corresponding processing, but currently the same signal source and the same video data are used for playback. This method will reduce the advertising effect in the video due to the differences in language and culture in each region, and the video is composed of images frame by frame. The feature information is adjusted accordingly, so that the advertisement in the video played by each data receiver matches the feature information, so that the audience corresponding to the data receiver can receive and understand the meaning of the advertisement to the greatest extent, and improve the effect of the advertisement and benefits.

Among them, for the same program or event, the requirements of each advertisement distributor are different. The present invention can recognize and replace the fixed entity advertisement content in the traditional video or picture according to the requirements, which can increase the flexibility of advertisement distribution and satisfy different advertisements. The autonomy of the advertising distributor can achieve different advertising effects.

The specific processing method is: obtain each frame of the original image in the video, then identify the area where the advertisement content in the original image is located, and further judge whether there is advertisement content that needs to be replaced in the advertisement content in the original image, because each frame of image There may be a lot of advertising content in the game, for example, there are many billboards or advertisements in the stadium, and there may be advertisements on the players' jerseys and on the surface of various field equipment. This method is based on preset requirements (such as in response to the needs of advertisers, or the needs of the broadcaster, or the needs of the application, etc.) to determine whether there is an advertisement content that needs to be replaced in the advertisement content in the original image, if there is, the advertisement replacement process is performed on the original image, and if there is no advertisement replacement process, the design does not The purpose of this method is to be able to process key or special or preset advertisements according to needs, without having to process all advertisements, which saves the amount of data processing and improves the speed of image processing.

If there is an advertisement content that needs to be replaced in the original image, the following replacement process will be performed for any first advertisement content that needs to be replaced. The purpose is to replace the advertisement content in the original image with the characteristics of the data receiver to which it is transmitted or sent Information is matching, so that local audiences can more accurately and easily understand and receive the meaning of the advertisement, and then accurately and efficiently improve the effect of the advertisement. The specific method is: based on the first advertisement content and the second data receiver’s Feature information, generating second advertisement content; replacing the first advertisement content in the first data with the second advertisement content to obtain the second data; sending the second data to the second data recipient.

Preferably, in this method, both the first data receiver and the second data receiver include: an advertisement distribution platform and/or an advertisement playback terminal. The advertisement distribution platform is used to distribute advertisements to corresponding subsequent terminal devices or other platforms. In this method, the original data contains the original advertisement content, and the original data is processed in parallel by multiple lines, one of which is when the original data can be directly sent to the advertisement content without Replace the terminal equipment corresponding to the audience of the advertisement that can be watched; one of the processing lines can also send the original data to the advertisement distribution platform, and then the advertisement distribution platform will distribute the original data to subsequent terminals or other platforms; when the data needs to replace the advertisement content , the data needs to be sent to the advertising content replacement platform, and the above-mentioned advertising content replacement operation is performed. After the advertising content is replaced, new data can be obtained. The new data can be sent to the terminal corresponding to the advertising audience, and the new data can also be sent to the advertising distribution platform. distribution platform for processing.

Preferably, in this method, the feature information of the advertisement distribution platform includes one or more of the following information: information about the language type of advertisements placed on the advertisement distribution platform, geographical location information of the advertisement distribution platform, and advertisement version information , the identity feature information of the lower-level advertisement distribution platform or the advertisement audience; based on the identity characteristic information of the advertisement distribution platform, the second advertisement content matching the first advertisement content or the first advertisement display carrier is obtained from the database; based on the advertisement distribution The identity characteristic information of the platform obtains the second advertisement content matching the first advertisement content from a database. When the second data receiver is the advertisement distribution platform, the advertisement replacement platform will need to replace the first advertisement content with the second advertisement content and send it to the advertisement distribution platform. At this time, the advertisement replacement platform will first obtain the identity information of the advertisement distribution platform , and then obtain the second advertisement content that matches the first advertisement content from the database based on the identity feature information of the advertisement distribution platform, and then complete the subsequent advertisement content replacement operation, and send the data after the advertisement content replacement to the advertisement distribution platform , and then the ad distribution platform completes subsequent ad distribution operations.

Preferably, the characteristic information of the advertisement playback terminal in this method includes one or more of the following information: geographic location information of the advertisement playback terminal user, age information of the advertisement playback terminal user, gender information of the advertisement playback terminal user and The tag information of the advertisement playback terminal user; the second advertisement content matching the first advertisement content or the first advertisement display carrier is obtained from a database based on the characteristic information of the advertisement playback terminal. Wherein, when the characteristic information of the advertisement playing terminals is different, it is necessary to match different second advertisement contents to meet user needs corresponding to different advertisement playing terminals, thereby improving the effect of advertisement playing.

Preferably, in this method, said replacing the first advertisement content in the first data with the second advertisement content to obtain the second data includes:

Identifying feature point coordinates of the first area, and obtaining a filled area or a covered area or a projected area based on the feature point coordinates of the first area;

calculating a projected deformation rate of the first advertisement content based on the feature point coordinates or the boundary information of the first area;

filling the filled area with the second advertisement content with reference to the projected deformation rate to obtain the second data; or covering the covered area with the second advertisement content with reference to the projected deformation rate to obtain the the second data; or project the second advertisement content onto the projected area with reference to the projection deformation rate to obtain the second data.

Among them, the feature point coordinates are the coordinates of the features in the first area, and the features in the first area are identified through the corresponding recognition model. After the features are identified, the corresponding coordinates are obtained through their position information in the original image, and then the feature points are obtained. Coordinates: the position, size and shape of the first area can be obtained through the coordinates of the feature points, and then the filled area corresponding to the first area can be obtained.

Wherein, this method can use a pre-trained advertisement recognition model to identify the advertisement content, such as identifying the characteristics of the advertisement content, and then obtain the feature point coordinates of the advertisement content, and judge the specific position of the advertisement content through the identified feature point coordinates. Further, the feature points can be artificially added in the advertisement content or borders, etc., to simplify learning and training and recognition speed.

Wherein, the method obtains the second data by filling the second advertisement content into the filled area with reference to the projected deformation rate; or covering the second advertisement content into the filled area with reference to the projected deformation rate The covered area obtains the second data; or projects the second advertisement content to the projected area with reference to the projection deformation rate to obtain the second data; the second advertisement content and the first advertisement content can be ensured The location, size and shape are matched to ensure the authenticity of the second advertisement content embedded in the first data, thereby ensuring the authenticity and effect of the advertisement when the second data is played in the first terminal.

Preferably, the method further includes: performing the following processing on any one of the first advertisement contents that meets the replacement condition:

Obtain the standard content of the first advertisement content corresponding to time T;

Obtaining the real-time content of the first advertisement content corresponding to time T;

Comparing the standard content and the real-time content, if there is a difference between the standard content and the real-time content, judging that there is an obstacle in the real-time content;

Obtaining first position information of the obstacle in the first area based on a comparison result of the standard content and the real-time content, and extracting obstacle content from the first area;

Based on the first position information, the extracted obstacle content is added to the second data.

Among them, in order to ensure the real effect and restoration effect of the image, this method will extract the obstacles that block the original advertisement content in the original image when replacing the advertisement content in the original image, and then complete the advertisement content replacement. The corresponding obstacles are put into the new image according to their positions in the original image. The purpose of this is to truly restore the on-site image or video effect and improve the realism and restoration of the video. If at a certain moment the athlete's body blocks the billboard and only part of the advertisement content can be seen, the processing method of the present invention is to extract the stored standard advertisement content at the corresponding moment, and then compare it with the real-time advertisement content at the corresponding moment. By comparing the results, you can obtain information such as the position and shape of the obstacle that blocks the advertisement, and then extract the obstacle. After replacing the advertisement content, put the obstacle back into the replaced image, so that the obstacle is in the The position in the image remains unchanged, so that obstacles can form the same blocking effect on the new advertising content, so that terminal users can watch the replaced advertising content and obstacles at the same time, and truly restore the on-site effect. Considering differences in image resolution and shooting effects, content comparison can set different difference thresholds to improve comparison speed and eliminate interference.

Wherein, the method also includes performing the following processing on any one of the first advertisement contents satisfying the replacement condition:

Obtain first position information of the obstacle in the first area based on a comparison result of the standard content and the real-time content, and acquire a non-obstacle area in the first area based on the first position information ;

displaying all or part of the second advertisement content in the non-obstacle area to obtain the second data.

Among them, the method can identify obstacles in the first advertisement content, obtain the obstacle area and non-obstacle area in the first area based on the identified obstacles, and then display all or part of the second advertisement content on the non-obstacle area. The area, that is, the advertisement content can be displayed in the non-obstacle area according to the need, so as to ensure the display effect of the advertisement.

Preferably, in this method, generating the second advertisement content based on the first advertisement content and the characteristic information of the second data recipient includes:

Based on the characteristic information of the advertisement playing terminal, the user information corresponding to the advertisement playing terminal is obtained, and the user information includes one or more of the following information: the language type information used by the user, the name information of the country where the user is located, the user information The specific region information of the country where the user is located, the cultural customs information of the user's area, the average age information of the user, and the gender information of the user;

Extracting the first image content and the first audio content in the first advertisement content;

converting the first image content and the first audio content into second image content and second audio content that match the user information corresponding to the advertisement playback terminal;

The second advertisement content is obtained based on the second image content and the second audio content.

Wherein, this method also includes:

identifying a plurality of preset areas in the first data for a plurality of advertisement contents in the first data;

judging whether the advertisement content in the preset area is blocked by an occluder, and obtaining a preferred area that is not occluded by the occluder;

Based on the advertisement placement requirement, the preset advertisement content is placed in the preferred area.

That is to say, this method can identify multiple areas where the advertisement content in the first data is located. Some areas are blocked by occluders, and their advertising value and benefit are low, while some areas that are not blocked by occluders are not preferred areas for advertising. , the preferred area is the most effective advertising display area. Reasonable use of the preferred area has practical value, and the advertising content can be placed in the preferred area according to the needs of advertising delivery, such as delivery time, delivery priority, delivery content, etc., and the target advertisement can be dynamically kept unblocked as needed Regions are areas of preference, or proper synchronization of frame movement to maintain scene fidelity.

The present invention also provides an advertisement projection method, the method comprising:

acquiring third data, where the third data is video data or image data;

identifying a second region in the third data of third advertising content in the third data;

judging whether the third advertisement content in the second area satisfies the replacement condition,

If the third advertisement content does not meet the replacement condition, sending the third data to the first data receiver;

If the content of the third advertisement satisfies the replacement condition, the following processing is performed;

generating fourth advertisement content based on the third advertisement content and characteristic information of the second data receiver;

identifying a projected area of the fourth advertising content in the third data;

projecting the fourth advertisement content on the projection area to obtain fourth data;

sending the fourth data to the second data receiver.

Wherein, through the above-mentioned advertising projection method, new advertising content can be projected to other areas in the image, instead of replacing, covering or filling the advertising content, that is, there is a new new advertisement that meets the viewing needs of the second data receiver, The original advertising content is also retained, and the specific preset advertising projection area can be selected according to actual needs, such as selecting some fixed areas or some variable areas, or areas that have little influence on video content, etc. This enables the user to watch the original advertisement and the replaced advertisement at the same time.

The present invention also provides a processing system for advertisement replacement or addition, said system comprising:

an acquisition unit, configured to acquire first data, where the first data is video data or image data;

An identifying unit, configured to identify the first advertisement content in the first data or the first area of the first advertisement display carrier in the first data;

A judging unit, configured to judge whether the first advertisement content or the first advertisement display carrier in the first area satisfies a replacement condition;

a sending unit, configured to send the first data to the first data receiver if the first advertisement content or the first advertisement display carrier does not satisfy the replacement condition;

A processing unit, configured to perform the following processing if the first advertisement content or the first advertisement display carrier meets the replacement condition;

sending the second data to the second data receiver.

The present invention also provides an advertisement processing device, which includes a memory, a processor, and a computer program stored in the memory and operable on the processor. When the processor executes the computer program, the advertisement is realized. Substitution or addition of processing method steps.

The present invention also provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the advertisement replacement or addition processing method are realized.

One or more technical solutions provided by the present invention have at least the following technical effects or advantages:

The present invention adjusts each frame of image according to the geographical address information of the terminal it plays, so that the advertisement in the video played by each terminal matches the characteristic information of the second data receiver, so that the second data receiver corresponds to The audience can receive and understand the meaning of the advertisement to the greatest extent, and improve the effect and benefit of the advertisement.

The present invention fills the second advertisement content with reference to the projection deformation rate of the first advertisement content to the filled area to obtain a new image, which can ensure that the position, size and shape of the second advertisement content match the first advertisement content, and ensure that the second advertisement content The authenticity after embedding the original image further guarantees the authenticity and effect of the advertisement when the video is played in the corresponding terminal provided by the present invention.

When the present invention replaces the advertising content in the original image, it will extract the obstacles that block the original advertising content in the original image, and then after completing the replacement of the advertising content, place the corresponding obstacles according to their positions in the original image. Into the new image, it can truly restore the on-site image or video effect, and improve the realism and restoration of the video.

Description of drawings

The drawings described here are used to provide a further understanding of the embodiments of the present invention, constitute a part of the present invention, and do not constitute a limitation to the embodiments of the present invention;

Fig. 1 is a schematic flowchart of the processing method of advertisement replacement or addition in Embodiment 1 of the present invention;

Fig. 2 is the schematic diagram of the present invention in actual application process;

Figure 3 is a schematic diagram of the original image collected by the live event live broadcast;

Fig. 4 is a schematic diagram of vertex coordinates of the first advertisement content;

Fig. 5 is a characteristic schematic diagram of the first advertisement content;

Figure 6 is a schematic diagram of the filled area of the original image;

Fig. 7 is the new image processed through this method;

FIG. 8 is a schematic flow diagram of an advertisement projection method;

Fig. 9 is a schematic diagram of composition of a processing system for advertisement replacement or addition.

Detailed ways

In order to understand the above-mentioned purpose, features and advantages of the present invention more clearly, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that the embodiments of the present invention and the features in the embodiments may be combined with each other without conflicting with each other.

In the following description, many specific details are set forth in order to fully understand the present invention. However, the present invention can also be implemented in other ways different from the scope of this description. Therefore, the protection scope of the present invention is not limited by the following disclosure. limitations of specific examples.

It should be understood that "system", "device", "unit" and/or "module" as used herein is a method used to distinguish different components, elements, parts, sections or assemblies of different levels. However, the words may be replaced by other expressions if other words can achieve the same purpose.

As indicated in the specification and claims, the terms "a", "an", "an" and/or "the" are not specific to the singular and may include the plural unless the context clearly indicates an exception. Generally speaking, the terms "comprising" and "comprising" only suggest the inclusion of clearly identified steps and elements, and these steps and elements do not constitute an exclusive list, and the method or device may also contain other steps or elements.

This description uses flowcharts to explain operations performed by a system according to an embodiment of this description. It should be understood that the preceding or following operations are not necessarily performed in the exact order. Instead, various steps may be processed in reverse order or simultaneously. At the same time, other operations can be added to these procedures, or a certain step or steps can be removed from these procedures.

Embodiment one

Please refer to FIG. 1. FIG. 1 is a schematic flowchart of the processing method for replacing or adding advertisements in Embodiment 1 of the present invention. Embodiment 1 of the present invention provides a processing method for replacing or adding advertisements. The method includes:

Acquiring first data, where the first data is video data or image data;

sending the second data to the second data receiver.

Wherein, in Embodiment 1 of the present invention, both the first data receiver and the second data receiver include: an advertisement distribution platform and/or an advertisement playback terminal. Wherein, the advertising playback terminal in the present invention can be a computer, television, mobile phone, smart watch, smart bracelet, smart game console, tablet computer, mobile computer, etc. The present invention does not limit the specific implementation of the advertising playback terminal. It only needs to have a corresponding video or image playback function. Wherein, the advertisement distribution platform may be any platform with advertisement processing and distribution functions, and the present invention does not limit the specific implementation of the advertisement distribution platform.

Wherein, the first advertisement display carrier in the embodiment of the present invention may be an advertisement frame, an advertisement frame, an advertisement platform, etc., and the first advertisement display carrier is used for displaying or playing or displaying advertisements, and the present invention is not specific to the specific details of the first advertisement display carrier. The implementation direction is limited.

Wherein, in Embodiment 1 of the present invention, the characteristic information of the advertisement distribution platform is the identity characteristic information of the advertisement distribution platform; based on the identity characteristic information of the advertisement distribution platform, the said Second advertisement content. Wherein, the identity feature information of the advertisement distribution platform can be the characteristic code of the advertisement distribution platform, or an identity code, or a code or a serial number, etc., that is, it is sufficient to determine the identity information of the advertisement distribution platform. The specific implementation manner and form of the information are not limited.

Due to the limited advertising space in traditional on-site advertising, the supply capacity of advertising space suppliers and the effect of cross-region and cross-viewer display of advertisements are limited. If these traditional advertising spaces are presented with different contents and brands according to different broadcast regions, languages, and audiences according to the method in this embodiment, the display effect of the advertising spaces will be effectively improved, and more flexible and more Lots of ad space available. Because the above-mentioned advertisements are mostly displayed or take place on the spot, they are shot from multiple points or dynamic positions, and the angle and distance of advertisement presentation will change dynamically. The established model identifies the replacement advertisement at this position, and then replaces or superimposes the new advertisement on the original dynamic advertisement position. Even for advertisement positions with changing angles and speeds during motion, different advertising content can be fitted to cover traditional advertisement positions. On the video, different advertising content is presented to different viewers, and the visual effect similar to traditional fixed advertising is achieved.

Without considering the fitting fidelity, different advertisement contents can also be directly projected to corresponding advertisement presentation positions. The above-mentioned replacement, superimposition, and projection of advertisements can be completed in real-time editing, and can also be completed by separately editing the video afterwards.

In this embodiment, image recognition technology can be used to superimpose the people and objects previously blocked in front of each frame of advertisement onto the new advertisement content, similar to the visual effect of only replacing the original advertisement content.

With the improvement of image recognition technology and computer processing power, the above-mentioned method can not only perform the above-mentioned processing on the post-event video recording, but also complete synchronous video processing with low delay.

Through the above-mentioned implementation mode, the advertising space supplier can put the advertisements of the same game or scene according to different advertisement delivery requirements, and put them through video editing.

Among them, in the first embodiment of the present invention, the specific advertising content or positioning in the fixed area can be ignored, and the variable preset advertising content can be directly superimposed on the suitable advertising position on the video according to the delivery requirements, including traditional on-site advertising display area and other suitable areas. For realism, ads can still be embedded as backgrounds without obscuring people or important images.

Below in conjunction with accompanying drawing, the advertising content replacement process in the present invention is introduced in detail:

Figure 3 is the original image collected by the live event live broadcast, 1 is the original image; Figure 3 contains the first advertisement content 2 and obstacle 3, through image recognition, the vertex coordinates of the first advertisement content 2 are recognized, including 4 vertices ABCD, as shown in Figure 4; or identify the advertisement by the advertisement feature 5, and then identify the first advertisement boundary by the advertisement boundary features 4 and 6, including the advertisement feature 5 and the advertisement boundary features 4 and 6 in Figure 5, as shown in Figure 5 As shown; the filled position is obtained based on the vertex coordinates, or the filled position 7 is obtained through the advertisement boundary feature 5, as shown in Figure 6, and Figure 7 is a new image processed by this method, wherein 8 is the second advertisement content, and 9 for the new image.

All videos are composed of time-series picture frames. The following describes how to replace advertisements by modifying frame images. Similar methods are feasible as long as the replacement speed and effect are satisfied, and the embodiment of the present invention does not specifically limit it.

Identify the four vertices of the original advertisement A\B\C\D through Figure 4, such as identifying image tags with special encoding, which are pre-attached to the positioning vertices, or according to the known boundary features of the original advertisement in Figure 5 (the original advertisement The filled area of the original advertisement can be determined by identifying and determining feature 5 in FIG. 5 .

At the same time, according to L1/L2, L3/L4, determine the projection deformation rate of the advertising space. L1 is the left width of the rectangular area where the original advertisement is located, L2 is the right side of the rectangular area where the original advertisement is located, and L3 is the length of the upper side of the rectangular area where the original advertisement is located. L4 is the length of the lower side of the rectangular area where the original advertisement is located. The plane deformation rate can be calculated according to any ratio of L1/L2 or L3/L4. If 3D deformation is considered, both ratios must be considered.

The ad that will be used for replacement, with reference to the calculated deformation rate, simulates the size of the filled area, and superimposes it into the original frame.

When the original advertisement is blocked by an obstacle, the obstacle in this embodiment can be a human body or equipment or other objects. This embodiment of the present invention does not make specific limitations. The human body in the area where the advertisement content is located is identified through the image, and compared with the The part of the human body in the overlapping frame of the original advertising space (the original advertising space has been identified) is superimposed on the frame of the replacement advertisement content, so as to achieve the effect of advertisement replacement.

In the above advertisement recognition or obstacle recognition or advertisement position recognition process, special coded image tags can be added to the four corners of the area where the advertisement is located, which will simplify the recognition speed of the frame. Even if the four corners without labels are recognized, it can be predicted, and the recognition process can be completed quickly without learning process.

Among them, in the embodiment of the present invention, for the advertisement recognition on the athlete's clothing or carrier, the nature is similar, the difference is that the clothing or carrier does not necessarily appear in a single plane, but can still be divided into several small planes, each small plane is a separate The advertising content of the advertisement content can be replaced by the same processing method in the present invention, which does not affect the principle of recognition and simulation, but only increases the amount of calculation.

Please refer to Fig. 2, which is a schematic diagram of the present invention in the actual application process;

Among them, the original image includes the corresponding advertisement content. When there is an advertisement audience who can directly watch the original image without replacing the advertisement, it can be directly sent to the corresponding advertisement audience through the line, or the original image can be sent to the advertisement first. distribution platform, and then send it to subsequent ad audiences through the ad distribution platform, as shown in line 2, when the ad content needs to be replaced in the original ad content, the ad content can be replaced in the ad replacement platform first, and then Send it to the corresponding advertisement distributor through line 3, or send it to the corresponding advertisement audience through line 4. The original advertisement can also be distributed to the advertisement replacement platform through the advertisement distributor first, and then pass through the lines respectively after completing the advertisement replacement operation. Line five and line six are sent to the corresponding advertisement audience.

Wherein, in Embodiment 1 of the present invention, the advertising content replacement method of the method includes:

Wherein, in the embodiment of the present invention, when there is an obstacle in front of the advertising content, the method further includes: performing the following processing on any first advertising content that needs to be replaced:

Obtain the real-time content of the first advertisement content corresponding to time T;

Compare the standard content with the real-time content, if there is a difference between the standard content and the real-time content, it is judged that there is an obstacle in the real-time content;

Obtain the position information of the obstacle in the original image based on the comparison result of the standard content and the real-time content, and extract the obstacle content from the original image;

Based on the location information of obstacles in the original image, the extracted obstacle content is added to the new image.

Obtain the standard content of the first advertisement content corresponding to time T, such as an image without obstacles;

Obtain the real-time content of the first advertisement content corresponding to time T, such as an image of an athlete with an obstacle;

Comparing the standard content and the real-time content, if there is a difference between the standard content and the real-time content, judging that there is an obstacle in the real-time content, that is, judging that there is an obstacle athlete;

Obtain first position information of the obstacle in the first area based on a comparison result of the standard content and the real-time content, and obtain the first position information of the athlete in the image, and obtain the first position information based on the first position information. A non-obstacle area in an area, that is, an area that is not blocked by the athlete's body;

Wherein, in the embodiment of the present invention, the characteristic information of the advertisement playback terminal includes one or more of the following information: geographic location information of the advertisement playback terminal user, age information of the advertisement playback terminal user, age information of the advertisement playback terminal user, Gender information and label information of the advertisement playing terminal user; and obtaining the second advertisement content matching the first advertisement content from a database based on the characteristic information of the advertisement playing terminal.

Wherein, in the embodiment of the present invention, generating the second advertisement content based on the first advertisement content and the characteristic information of the second data recipient includes:

Wherein, the method obtains user information corresponding to the advertisement playback terminal based on the characteristic information of the advertisement playback terminal, and generates corresponding second advertisement content through specific user information, and the user information includes one or more of the following information Type: the language type information used by the user, the name information of the country where the user is located, the specific region information of the country where the user is located, the cultural customs information of the user's area, the average age information of the user, the gender information of the user; the language in the advertisement due to the different language types It needs to be replaced accordingly; due to the different information such as culture, religion and language of different countries, it is necessary to replace the corresponding advertisement content according to the name of the country; some countries such as China have a large territory, and they also use multiple languages in their country. When the advertisement content is changed, it can be replaced with the corresponding local language according to the specific regional information; if the user's region has special cultural customs, such as some original advertisement content conflicts with its cultural customs, it can be replaced with one that matches its cultural customs or is easy to accept Different age groups have different understandings of advertisements. For example, when playing on children's channels, the advertisement content can be replaced by cartoon content.

Wherein, in the embodiment of the present invention, the method also includes that the method also includes:

For example, there are 5 advertisement contents in the first data, and each advertisement contents corresponds to a preset area, namely area 1 to area 5, in which area 1 and area 2 are blocked by people, and their advertising value and benefit are low, at this time According to the needs of advertising, such as advertisers request to place an advertisement in area 3 or area 4 or area 5, the specific delivery time and location can be flexibly adjusted according to actual needs, so that the unoccluded area can be fully utilized Its advertising value improves the advertising display effect.

Embodiment two

Please refer to Figure 8, Figure 8 is a schematic flowchart of an advertisement projection method, Embodiment 2 of the present invention provides an advertisement projection method, the method includes:

acquiring third data, where the third data is video data or image data;

sending the fourth data to the second data receiver.

Among them, the above-mentioned advertising projection method can project new advertising content to other areas in the image, instead of replacing or covering or filling the advertising content. The specific preset advertising projection area can be selected according to actual needs, such as selecting some Fixed areas or some variable areas, or areas that have less influence on video content, etc.

Wherein, when the advertisement is projected, if there is a corresponding obstacle, the obstacle is also kept, so that the advertisement is projected as the background of the obstacle.

Embodiment Three

Please refer to FIG. 9, which is a schematic diagram of the composition of an advertisement replacement or addition processing system. Embodiment 3 of the present invention provides an advertisement replacement or addition processing system. The system includes:

sending the second data to the second data receiver.

Embodiment Four

Embodiment 4 of the present invention provides a processing device for advertisement replacement or addition, including a memory, a processor, and a computer program stored in the memory and operable on the processor, and the processor executes the computer program. The program is the steps to realize the processing method of advertisement replacement or addition.

Wherein, the processor can be a central processing unit (CPU, Central Processing Unit), and can also be other general-purpose processors, digital signal processors (digital signal processors), application specific integrated circuits (Application Specific Integrated Circuits), off-the-shelf programmable Gate array (Field programmable gate array) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor, or the processor may be any conventional processor, or the like.

The memory can be used to store the computer programs and/or modules, and the processor can realize various functions of the advertisement processing device in the invention by running or executing the data stored in the memory. The memory may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, at least one application required by a function (such as a sound playback function, an image playback function, etc.) and the like. In addition, the memory can include high-speed random access memory, and can also include non-volatile memory, such as hard disk, internal memory, plug-in hard disk, smart memory card, secure digital card, flash memory card, at least one magnetic disk storage device, flash memory device, or other volatile solid-state memory devices.

Embodiment five

Embodiment 5 of the present invention provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the advertisement replacement or addition processing method are realized.

If the advertisement replacement or addition processing device is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present invention realizes all or part of the processes in the methods of the above-mentioned embodiments, and can also be stored in a computer-readable storage medium through a computer program. When the computer program is executed by a processor, it can realize the implementation of each of the above-mentioned methods. example steps. Wherein, the computer program includes computer program code, object code form, executable file or some intermediate form and the like. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, U disk, removable hard disk, magnetic disk, optical disk, computer memory, read-only memory, random access memory, point carrier signal , telecommunication signals, and software distribution media. It should be noted that the content contained in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction.

The present invention has described the basic concepts. Obviously, for those skilled in the art, the above detailed disclosure is only an example, and does not constitute a limitation to this specification. Although not expressly stated here, those skilled in the art may make various modifications, improvements and corrections to this description. Such modifications, improvements and corrections are suggested in this specification, so such modifications, improvements and corrections still belong to the spirit and scope of the exemplary embodiments of this specification.

Meanwhile, this specification uses specific words to describe the embodiments of this specification. For example, "one embodiment", "an embodiment", and/or "some embodiments" refer to a certain feature, structure or characteristic related to at least one embodiment of this specification. Therefore, it should be emphasized and noted that two or more references to "an embodiment" or "an embodiment" or "an alternative embodiment" in different places in this specification do not necessarily refer to the same embodiment . In addition, certain features, structures or characteristics in one or more embodiments of this specification may be properly combined.

In addition, those skilled in the art will understand that various aspects of this specification can be illustrated and described by several patentable categories or situations, including any new and useful process, machine, product or combination of substances, or any combination of them Any new and useful improvements. Correspondingly, various aspects of this specification may be entirely executed by hardware, may be entirely executed by software (including firmware, resident software, microcode, etc.), or may be executed by a combination of hardware and software. The above hardware or software may be referred to as "block", "module", "engine", "unit", "component" or "system". Additionally, aspects of this specification may be embodied as a computer product comprising computer readable program code on one or more computer readable media.

A computer storage medium may contain a propagated data signal embodying a computer program code, for example, in baseband or as part of a carrier wave. The propagated signal may have various manifestations, including electromagnetic form, optical form, etc., or a suitable combination. A computer storage medium may be any computer-readable medium, other than a computer-readable storage medium, that can be used to communicate, propagate, or transfer a program for use by being coupled to an instruction execution system, apparatus, or device. Program code residing on a computer storage medium may be transmitted over any suitable medium, including radio, electrical cable, fiber optic cable, RF, or the like, or combinations of any of the foregoing.

The computer program codes required for the operation of each part of this manual can be written in any one or more programming languages, including object-oriented programming languages such as Java, Scala, Smalltalk, Eiffel, JADE, Emerald, C++, C#, VB.NET, Python etc., conventional procedural programming languages such as C language, Visual Basic, Fortran 2003, Perl, COBOL 2002, PHP, ABAP, dynamic programming languages such as Python, Ruby and Groovy, or other programming languages. The program code may run entirely on the user's computer, or as a stand-alone software package, or run partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server. In the latter case, the remote computer can be connected to the user computer through any form of network, such as a local area network (LAN) or wide area network (WAN), or to an external computer (such as through the Internet), or in a cloud computing environment, or as a service Use software as a service (SaaS).

In addition, unless explicitly stated in the claims, the order of processing elements and sequences described in this specification, the use of numbers and letters, or the use of other names are not used to limit the sequence of processes and methods in this specification. While the foregoing disclosure has discussed by way of various examples some embodiments of the invention that are presently believed to be useful, it should be understood that such detail is for illustrative purposes only and that the appended claims are not limited to the disclosed embodiments, but rather, the claims The claims are intended to cover all modifications and equivalent combinations that fall within the spirit and scope of the embodiments of this specification. For example, although the system components described above may be implemented by hardware devices, they may also be implemented by a software-only solution, such as installing the described system on an existing server or mobile device.

In the same way, it should be noted that in order to simplify the expression disclosed in this specification and help the understanding of one or more embodiments of the invention, in the foregoing description of the embodiments of this specification, sometimes multiple features are combined into one embodiment, drawings or descriptions thereof. This method of disclosure does not, however, imply that the subject matter of the specification requires more features than are recited in the claims. Indeed, embodiment features are less than all features of a single foregoing disclosed embodiment.

Each patent, patent application, patent application publication, and other material, such as article, book, specification, publication, document, etc., cited in this specification is hereby incorporated by reference in its entirety. Application history documents that are inconsistent with or conflict with the content of this specification are excluded, and documents (currently or later appended to this specification) that limit the broadest scope of the claims of this specification are also excluded. It should be noted that if there is any inconsistency or conflict between the descriptions, definitions, and/or terms used in the accompanying materials of this manual and the contents of this manual, the descriptions, definitions and/or terms used in this manual shall prevail .

Finally, it should be understood that the embodiments described in this specification are only used to illustrate the principles of the embodiments of this specification. Other modifications are also possible within the scope of this description. Therefore, by way of example and not limitation, alternative configurations of the embodiments of this specification may be considered consistent with the teachings of this specification. Accordingly, the embodiments of this specification are not limited to the embodiments explicitly introduced and described in this specification.

While preferred embodiments of the invention have been described, additional changes and modifications to these embodiments can be made by those skilled in the art once the basic inventive concept is appreciated. Therefore, it is intended that the appended claims be construed to cover the preferred embodiment as well as all changes and modifications which fall within the scope of the invention.

Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalent technologies, the present invention also intends to include these modifications and variations.

Claims

A processing method for advertisement replacement or addition, characterized in that the method includes:

Acquiring first data, where the first data is video data or image data;

identifying the first advertisement content in the first data or the first area of the first advertisement display carrier in the first data;

judging whether the first advertisement content or the first advertisement display carrier in the first area satisfies a replacement condition;

If the first advertisement content or the first advertisement display carrier does not meet the replacement condition, sending the first data to the first data receiver;

If the first advertisement content or the first advertisement display carrier meets the replacement condition, the following processing is performed;

Generate second advertisement content based on the first advertisement content and characteristic information of the second data recipient; or generate second advertisement content based on the first advertisement display carrier and characteristic information of the second data recipient;

replacing the first advertisement content in the first data with the second advertisement content to obtain the second data; or displaying the second advertisement content on the first advertisement display carrier to obtain the second data;

sending the second data to the second data receiver.
The method for processing advertisement replacement or addition according to claim 1, wherein both the first data receiver and the second data receiver include: an advertisement distribution platform and/or an advertisement playback terminal.
The method for processing advertisement replacement or addition according to claim 2, wherein the characteristic information of the advertisement distribution platform includes one or more of the following information: information about the language type of advertisements placed by the advertisement distribution platform, The geographic location information of the advertisement distribution platform, the advertisement version information, the identity characteristic information of the subordinate advertisement distribution platform or the advertisement audience; The second advertisement content matched by the carrier.
The method for processing advertisement replacement or addition according to claim 2, wherein the feature information of the advertisement playback terminal includes one or more of the following information: geographic location information of the advertisement playback terminal user, advertisement playback terminal The user's age information, the gender information of the advertisement playback terminal user and the label information of the advertisement playback terminal user; based on the characteristic information of the advertisement playback terminal, the first advertisement content or the first advertisement display carrier is obtained from the database. 2. Advertising content.
The method for processing advertisement replacement or addition according to claim 1, wherein said replacing the first advertisement content in the first data with the second advertisement content to obtain the second data includes : or displaying the second advertisement content on the first advertisement display carrier to obtain the second data includes:

Identifying feature point coordinates of the first area, and obtaining a filled area or a covered area or a projected area based on the feature point coordinates of the first area;

calculating a projected deformation rate of the first advertisement content based on the feature point coordinates or the boundary information of the first area;

filling the filled area with the second advertisement content with reference to the projected deformation rate to obtain the second data; or covering the covered area with the second advertisement content with reference to the projected deformation rate to obtain the the second data; or project the second advertisement content onto the projected area with reference to the projection deformation rate to obtain the second data.
The method for processing advertisement replacement or addition according to claim 1, further comprising: performing the following processing on any one of the first advertisement content that meets the replacement conditions:

Obtain the standard content of the first advertisement content corresponding to time T;

Obtaining the real-time content of the first advertisement content corresponding to time T;

Comparing the standard content and the real-time content, if there is a difference between the standard content and the real-time content, judging that there is an obstacle in the real-time content;

Obtaining first position information of the obstacle in the first area based on a comparison result of the standard content and the real-time content, and extracting obstacle content from the first area;

adding the extracted obstacle content to the second data based on the first position information;

or;

Obtain the standard content of the first advertisement content corresponding to time T;

Obtaining the real-time content of the first advertisement content corresponding to time T;

Comparing the standard content and the real-time content, if there is a difference between the standard content and the real-time content, judging that there is an obstacle in the real-time content;

Obtain first position information of the obstacle in the first area based on a comparison result of the standard content and the real-time content, and acquire a non-obstacle area in the first area based on the first position information ;

displaying all or part of the second advertisement content in the non-obstacle area to obtain the second data.
The method for processing advertisement replacement or addition according to claim 4, wherein the generating the second advertisement content based on the first advertisement content and the characteristic information of the second data recipient comprises:

Based on the characteristic information of the advertisement playing terminal, the user information corresponding to the advertisement playing terminal is obtained, and the user information includes one or more of the following information: the language type information used by the user, the name information of the country where the user is located, the user information The specific region information of the country where the user is located, the cultural customs information of the user's area, the average age information of the user, and the gender information of the user;

Extracting the first image content and the first audio content in the first advertisement content;

converting the first image content and the first audio content into second image content and second audio content that match the user information corresponding to the advertisement playback terminal;

The second advertisement content is obtained based on the second image content and the second audio content.
The method for processing advertisement replacement or addition according to claim 1, further comprising:

identifying a plurality of preset areas in the first data for a plurality of advertisement contents in the first data;

judging whether the advertisement content in the preset area is blocked by an occluder, and obtaining a preferred area that is not occluded by the occluder;

Based on the advertisement placement requirement, the preset advertisement content is placed in the preferred area.
A processing method system for advertisement replacement or addition, characterized in that the system includes:

an acquisition unit, configured to acquire first data, where the first data is video data or image data;

An identifying unit, configured to identify the first advertisement content in the first data or the first area of the first advertisement display carrier in the first data;

A judging unit, configured to judge whether the first advertisement content or the first advertisement display carrier in the first area satisfies a replacement condition;

a sending unit, configured to send the first data to the first data receiver if the first advertisement content or the first advertisement display carrier does not meet the replacement condition;

A processing unit, configured to perform the following processing if the first advertisement content or the first advertisement display carrier meets the replacement condition;

Generate second advertisement content based on the first advertisement content and characteristic information of the second data recipient; or generate second advertisement content based on the first advertisement display carrier and characteristic information of the second data recipient;

replacing the first advertisement content in the first data with the second advertisement content to obtain the second data; or displaying the second advertisement content on the first advertisement display carrier to obtain the second data;

sending the second data to the second data receiver.
An advertisement processing device, comprising a memory, a processor, and a computer program stored in the memory and operable on the processor, characterized in that, when the processor executes the computer program, the computer program according to claim 1 is realized. Steps in any one of the above-mentioned advertisement replacement or addition processing methods in -8.