CN108076373A - Processing method, device and the electronic equipment of video image - Google Patents

Processing method, device and the electronic equipment of video image Download PDF

Info

Publication number
CN108076373A
CN108076373A CN201710079414.1A CN201710079414A CN108076373A CN 108076373 A CN108076373 A CN 108076373A CN 201710079414 A CN201710079414 A CN 201710079414A CN 108076373 A CN108076373 A CN 108076373A
Authority
CN
China
Prior art keywords
video image
business object
display area
attribute information
target service
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710079414.1A
Other languages
Chinese (zh)
Inventor
周舒岩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Sensetime Technology Development Co Ltd
Original Assignee
Beijing Sensetime Technology Development Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Sensetime Technology Development Co Ltd filed Critical Beijing Sensetime Technology Development Co Ltd
Priority to CN201710079414.1A priority Critical patent/CN108076373A/en
Publication of CN108076373A publication Critical patent/CN108076373A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/426Internal components of the client ; Characteristics thereof
    • H04N21/42653Internal components of the client ; Characteristics thereof for processing graphics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/30Creation or generation of source code
    • G06F8/34Graphical or visual programming
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally

Abstract

The embodiment of the present invention provides a kind of processing method of video image, device and electronic equipment.Wherein, the processing method of the video image includes:When detecting in video image there are during business object display area, the attribute information of the business object display area is obtained;Based on the attribute information of the business object display area, target service object is drawn using computer graphics mode.By the embodiment of the present invention, in the case where not influencing the normal viewing experience of video image, the replacement to the business object in video image is realized, improves the bandwagon effect of the business object in video image.

Description

Processing method, device and the electronic equipment of video image
Technical field
The present invention relates to a kind of information processing technology more particularly to processing method of video image, device and electronic equipments.
Background technology
With the development of Internet technology, people use internet viewing video more and more, as a result, internet video Business opportunity is provided for many new business.Since internet video can become important service traffics entrance, thus it is considered It is the high-quality resource of advertisement implantation.
At present, user includes the video in global field using the video of internet viewing, but due to language limitation or The reasons such as cultural difference, the advertisement occurred in video can not be not achieved in global general-use or all in different geographical best Propagation and promotion effect.
Moreover, the advertisement occurred in video has corresponding target group, may be only applicable to male or female user or Person is only applicable to the user of some age level or is only applicable to the user of some country, for other users then Advertising results are not almost had.
The content of the invention
It is an object of the present invention to provide a kind of scheme of the processing of video image, to improve the business in video image The bandwagon effect of object.
It is according to embodiments of the present invention in a first aspect, providing a kind of processing method of video image.The described method includes:When It detects in video image there are during business object display area, obtains the attribute information of the business object display area;Base In the attribute information of the business object display area, target service object is drawn using computer graphics mode.
Optionally, the attribute information of the business object display area includes the foreground zone of the business object display area Domain information;The attribute information based on the business object display area, target service is drawn using computer graphics mode Object, including:If there are overlay regions for the foreground area of the business object display area and the business object display area The target service object is then drawn in domain using computer graphics mode in remaining area, and the remaining area includes the industry Region in object display area of being engaged in addition to the overlapping region.
Optionally, the method further includes:Obtain the category of the business object display area marked in the video image Property information.
Optionally, in the attribute information based on the business object display area, painted using computer graphics mode Before target service object processed, the method further includes:The attribute information of the video image is obtained, wherein, the video figure The attribute information of picture includes the target area information of the video image and target group gender information;According to the video image Attribute information determine the target service object.
Optionally, the attribute information according to the video image determines the target service object, including:When described When attribute information is the target area information of the video image, from the corresponding business object of target area information Determine the target service object;When the attribute information be the video image target group gender information when, from institute It states and the target service object is determined in the corresponding business object of target group gender information.
Optionally, the target service object includes pre-set business object.
Optionally, the attribute information based on the business object display area, is drawn using computer graphics mode Target service object, including:Described in the attribute information adjustment of the business object display area in the video image The displaying attribute of target service object;Based on the displaying attribute of the target service object after adjustment, using computer graphics Mode draws the target service object.
Optionally, the attribute information of the business object display area includes location information, dimension information and/or angle letter Breath;The attribute information of the business object display area in the video image adjusts the target service object Displaying attribute, including:The attribute information of the business object display area in the video image, by movement, At least one of scaling, rotation, symmetrical, deformation adjustment the target service object.
Optionally, the attribute information of the business object display area includes transparence information;It is described according to the video The attribute information of the business object display area in image adjusts the displaying attribute of the target service object, including:Root The transparent of the target service object is adjusted according to the transparence information of the business object display area in the video image Degree.
Optionally, the target service object is with semantic special efficacy or advertising sticker.
Optionally, the target service object includes the special efficacy of following at least one form comprising advertising message:Two dimension Paster special efficacy, three-dimensional special efficacy, particle effect.
Second aspect according to embodiments of the present invention additionally provides a kind of processing unit of video image, described device bag It includes:First acquisition module, for when detecting in video image there are during business object display area, obtaining the business object The attribute information of display area;Drafting module, for the attribute information based on the business object display area, using computer Plotting mode draws target service object.
Optionally, the attribute information of the business object display area includes the foreground zone of the business object display area Domain information;The drafting module, if for the business object display area and the prospect of the business object display area The target service object, the residue are then drawn in remaining area using computer graphics mode there are overlapping region in region Region includes the region in addition to the overlapping region in the business object display area.
Optionally, described device further includes:Second acquisition module, for obtaining the business marked in the video image The attribute information of object display area.
Optionally, described device further includes:3rd acquisition module, for obtaining the attribute information of the video image, In, the attribute information of the video image includes the target area information of the video image and target group gender information;Really Cover half block, for determining the target service object according to the attribute information of the video image.
Optionally, the determining module includes:First determination unit, for working as the attribute information for the video image Target area information when, from the corresponding business object of target area information determine the target service object; Second determination unit, for when the attribute information be the video image target group gender information when, from the mesh The target service object is determined in the corresponding business object of mark crowd gender information.
Optionally, the target service object includes pre-set business object.
Optionally, the drafting module includes:Adjustment unit, for the business object in the video image The attribute information of display area adjusts the displaying attribute of the target service object;Drawing unit, for based on the institute after adjustment The displaying attribute of target service object is stated, the target service object is drawn using computer graphics mode.
Optionally, the attribute information of the business object display area includes location information, dimension information and/or angle letter Breath;The adjustment unit passes through shifting for the attribute information of the business object display area in the video image At least one of dynamic, scaling, rotation, symmetrical, deformation adjustment the target service object.
Optionally, the attribute information of the business object display area includes transparence information;The adjustment unit is used for The transparence information of the business object display area in the video image adjusts the saturating of the target service object Lightness.
Optionally, the target service object is with semantic special efficacy or advertising sticker.
Optionally, the target service object includes the special efficacy of following at least one form comprising advertising message:Two dimension Paster special efficacy, three-dimensional special efficacy, particle effect.
The third aspect according to embodiments of the present invention, additionally provides a kind of electronic equipment, including:Processor, memory lead to Cell part and communication bus, the processor, the memory and the communication device are completed mutual by the communication bus Between communication;For the memory for storing an at least executable instruction, the executable instruction makes the processor perform such as The processing method of any video image in first aspect.
Fourth aspect according to embodiments of the present invention additionally provides a kind of computer readable storage medium, the computer Readable storage medium storing program for executing is stored with:For when detecting in video image there are during business object display area, obtaining the business The attribute information of object display area;Based on the attribute information of the business object display area, using computer graphics mode Draw the executable instruction of target service object.
The processing scheme of the video image provided according to embodiments of the present invention whether there is industry by detecting in video image Business object display area in the business object display area in detecting video image, obtains business object display area Attribute information, and further according to the attribute information, using object display area of the computer graphics mode in video image Interior drafting target service object, makes the target service object in video image cover original business object, so as to complete video The replacement of business object in image, realizes in the case where not influencing video viewing experience, and it is suitable to be shown in video image Business object, improve video image in business object bandwagon effect.When target service object is used to show advertisement, a side Face, the drawing area of target service objects draw original business object in video image, be equivalent to video image into It has gone the replacement of business object, has not interfered with the normal viewing experience of video;On the other hand, which can be more suitable The viewing group of video image is closed, business object in video image is improved and shows effect.
Description of the drawings
Fig. 1 is a kind of step flow chart of the processing method for the video image for showing according to embodiments of the present invention one;
Fig. 2 is a kind of step flow chart of the processing method for the video image for showing according to embodiments of the present invention two;
Fig. 3 is a kind of structure diagram of the processing unit for the video image for showing according to embodiments of the present invention three;
Fig. 4 is a kind of structure diagram of the processing unit for the video image for showing according to embodiments of the present invention four;
Fig. 5 is the structure diagram for a kind of electronic equipment for showing according to embodiments of the present invention five.
Specific embodiment
(identical label represents identical element in several attached drawings) and embodiment below in conjunction with the accompanying drawings, implement the present invention The specific embodiment of example is described in further detail.Following embodiment does not limit the present invention's for illustrating the present invention Scope.
It will be understood by those skilled in the art that the terms such as " first ", " second " in the embodiment of the present invention are only used for distinguishing Different step, equipment or module etc. neither represent any particular technology meaning, also do not indicate that the inevitable logic between them is suitable Sequence.
Embodiment one
Reference Fig. 1 shows a kind of step flow chart of the processing method of according to embodiments of the present invention one video image.
The processing method of the video image of the present embodiment can be used for being replaced original business object in video image, Displaying has spectators the new business object of higher bandwagon effect in video image, to improve business object in video image Show effect.The executive agent of the processing method of the video image can include but is not limited to play video client or Person and the corresponding server of client for playing video.
The processing method of the video image of the present embodiment comprises the following steps:
Step S102:When detecting in video image there are during business object display area, business object show area is obtained The attribute information in domain.
In the present embodiment, video image can be the live streaming class video image being broadcast live, or the recorded broadcast of program request Class video image.Business object display area is included in video image, for showing business object in video image, for example, What is be implanted into video image has the advertisement promoted with communication effect.Business object or the recording scene in video image Shown in business object, for example, business object display area can be arranged on record scene in advertisement exhibition unit, wherein, Advertisement can have been launched in advertisement exhibition unit, advertisement can also not launched.
The attribute information of business object display area include location information of the business object display area in video image, The specific objects information such as dimension information, shape information, angle information, transparence information and colouring information can be determined conveniently Business object display area.
When performing this step, it can be realized with the presence or absence of business object by detecting in video image, be regarded when detecting There are during business object, determining in video image there are business object display area in frequency image, and then obtain business object exhibition Show the attribute information in region.Specifically, the method as graphical analyses such as the feature recognition and extractions of shadow or use may be employed Convolutional neural networks model whether there is business object to detect in video image, and there are business in video image is detected During object, the attribute information of business object display area is obtained.
Step S104:Based on the attribute information of business object display area, target industry is drawn using computer graphics mode Business object.
After the attribute information of the business object display area in obtaining video image, industry is determined according to the attribute information Business object display area, draws target service object in the display area.Preferably, target service object is made to cover business pair As original business object in display area.Wherein, target service object can carry out true according to spectators' type of video image It is fixed, and be preferably the business object using the spectators of video image as target group, for causing the type of target service object Or content is suitble to spectators, so as to improve the bandwagon effect of the business object in video image.
The step is performed, is equivalent to and replaces original business object in video image using target service object, raising regards Experience of the new target service object to spectators in frequency image can effectively improve showing for business object in video image Effect;Moreover, target service object only covers original business object, it will not be with the video body matter of other in video image Conflict is generated, so as to not interfere with the normal viewing experience of video image.For the industry of business object is not shown in video image Business object display area based on the attribute information of business object display area, draws target industry in business object display area Business object in the case where not influencing video image, can carry out the displaying of target service object in video image.
Specifically, according to attribute informations such as the position of business object display area, size, shape, transparency and colors, really The association attributeses such as specific location, size, shape, transparency and the color of the fixed business object display area, and then determine the industry Object display area of being engaged in simultaneously draws target service object in business object display area.
It, can be with when drawing target service object in addition, if video image includes multiple business object display areas In multiple business object display areas, one or more targets are drawn according to the attribute information of multiple business object display areas Business object.
In the processing for drawing target service object, target service object is drawn and can be led to using computer graphics mode It crosses appropriate computer graphic image and the modes such as draws or render and realize, include but not limited to:Drawn based on OpenGL graphic plottings It holds up and draws etc..OpenGL defines one across programming language, the graphic package of the specialty of cross-platform programming interface specification Interface, it is unrelated with hardware, it can easily carry out the drafting of 2D or 3D graph images.By OpenGL, can not only realize The drafting of 2D effects such as 2D pasters, can also realize the drafting of 3D special efficacys and the drafting of particle effect etc..But it is not limited to OpenGL, other manner, such as Unity or OpenCL are equally applicable.
The processing method of the above-mentioned video image for the embodiment of the present invention, if in video image original business object class Type is improper or to show effect poor for spectators, can be by client executing this method, to the transmission of video received Video image in stream carries out above-mentioned processing;This method can be performed also by server, in the video transmission stream of transmission Video image carries out above-mentioned processing, and suitable target service object is drawn in video image, instead of original business object, with That improves the business object in video image shows effect.
For example, by taking the live video of the competitive sports such as international football match or Basketball Match as an example, competition area In be provided with more billboard, the target group of these billboards are usually local audience, and tag line is also local language, For the spectators of foreign country, the promotion effect of these advertisements is relatively low.In the external competitive sports of live streaming, this can be utilized Original advertisement in live video image is substituted for for the wide of local audience by the processing method of the video image of embodiment It accuses, to improve the promotion effect of the advertisement in video image.
The processing method of the video image provided according to embodiments of the present invention whether there is industry by detecting in video image Business object display area in the business object display area in detecting video image, obtains business object display area Attribute information, and further according to the attribute information, using object display area of the computer graphics mode in video image Interior drafting target service object, makes the target service object in video image cover original business object, so as to complete video The replacement of business object in image, realizes in the case where not influencing video viewing experience, and it is suitable to show in video image Business object, improve business object in video image and show effect.When target service object is used to show advertisement, a side Face, the drawing area of target service objects draw original business object in video image, be equivalent to video image into It has gone the replacement of business object, has not interfered with the normal viewing experience of video;On the other hand, which can be more suitable The viewing group of video image is closed, business object in video image is improved and shows effect.
Embodiment two
Reference Fig. 2 shows a kind of step flow chart of the processing method of according to embodiments of the present invention two video image, This method can be considered that one kind of the processing method of the video image of above-described embodiment one optionally performs mode.
The processing method of the video image of the present embodiment can be by arbitrarily having regarding for data sampling and processing and transfer function The receiving device of frequency content transmission stream performs, and including but not limited to plays the client of video, is equipped with the movement of the client Terminal and with the corresponding server of the client etc..
The processing method of the video image of the present embodiment comprises the following steps:
Step S202:When detecting in video image there are during business object display area, business object show area is obtained The attribute information in domain.
In the present embodiment, in the processing that whether there is business object display area in video image is detected, to video figure Original business object is detected as in.Original business object can be to have semantic advertisement in implantation video image Primary advertising figure in the recorded broadcast scene of paster or video image.If detecting in video image there are business object, The attribute information of business object display area is obtained by the processing such as detecting, extracting.Detection business object may be employed arbitrary suitable When detection mode realize, in the embodiment of the present invention, a kind of feasible pattern be can utilize it is advance it is trained, for detecting First convolution neural network model of original business object in video image carries out video image the detection of business object. Wherein, the training of the first convolution neural network model can be included:
The feature vector of first sample image to be trained is obtained, wherein, being included at least in feature vector has sample image In business object location information;Process of convolution is carried out to feature vector, obtains feature vector convolution results;Judging characteristic to Whether the location information of corresponding business object meets the condition of convergence in amount convolution results;If satisfied, it then completes to convolutional network The training of model;If not satisfied, then according to the location information and/or confidence of corresponding business object in feature vector convolution results Spend information, adjust convolutional network model parameter and according to the parameter of the convolutional network model after adjustment to convolutional network model into Row iteration is trained, until the location information of the business object after repetitive exercise meets the condition of convergence.
Illustrate herein, in actual application scenarios, for recorded broadcast video image, if having been marked with industry in video image The attribute information for object display area of being engaged in can directly acquire the attribute of the business object display area marked in video image Information.
Step S204:The attribute information of video image is obtained, target service pair is determined according to the attribute information of video image As.
Target service object is determined according to the attribute information of video image, can to show target industry in video image During business object, there is preferable bandwagon effect.
Wherein, the attribute information of video image includes the target area information of video image and target group gender information. When attribute information is the target area information of video image, mesh is determined from the corresponding business object of target area information Mark business object;When attribute information is the target group gender information of video image, from opposite with target group gender information Target service object is determined in the business object answered.
For example, by taking the video image of the competitive sports such as international football match or Basketball Match as an example, competition area In be provided with more billboard, the target area of the advertisement launched in these billboards is competition area the country one belongs to or ground Domain, for the spectators of other countries or region, the promotion effect of these advertisements is relatively low.Therefore, for other countries or ground The video image of the competitive sports in domain, can be by the use of choosing the advertisement for local audience as target service object.
For another example if the target group of video image is mostly women, the advertisement of women product can be chosen as target Business object.
In addition, in definite target service object, pre-set business object can also be chosen as target service object.
It, can be from receiving terminal (client or the reception of video content transport stream when obtaining the data of target service object The server of video content transport stream) target service object data is locally extracted, video content transport stream can also be sent Server receives the data of target service object.
S206:The displaying of the attribute information adjustment target service object of business object display area in video image Attribute.
In the present embodiment, after determining and obtaining target service object, believed according to the attribute of business object display area It ceases to adjust the displaying attribute of target service object, so that target service object and the business object display area in video image Unanimously, target service object is avoided to be clashed with the content in video image.
In a kind of feasible embodiment, the attribute information of business object display area includes location information, dimension information And/or angle information, it can be according to these information, by least one of operation such as movement, scaling, rotation, deformation, to adjust Whole target service object so that the displaying such as position, size, angle and shape of target service object attribute is and business object Display area is consistent.
In another feasible embodiment, the attribute information of business object display area includes transparence information, can be with The transparency of target service object is adjusted according to the transparence information.For example, in video image records scene, business object exhibition Show after transparency (such as glass), then it can be according to the transparence information of the business object display area in video image, phase Ground is answered to reduce the transparency of target service object.
S208:Based on the displaying attribute of the target service object after adjustment, target industry is drawn using computer graphics mode Business object.
In the processing for drawing target service object, based on the displaying attribute of the target service object after adjustment, in video Target service object is drawn in the business object display area of image, target service object can be enabled to cover business object Original business object in display area, avoids target service object from being clashed with the main body in video image or content, from And avoid influencing the normal viewing experience of video image.
Preferably, the attribute information of business object display area further includes the foreground area letter of business object display area Breath in the processing for drawing target service object, judges the foreground zone of business object display area and business object display area Domain whether there is overlapping region.If fruit business object display area, there are overlapping region, is equivalent to target industry with its foreground area The foreground area of business object and business object display area is there are overlapping region, then using computer graphics mode in remaining area Target service object is drawn, conflicts so as to which target service object be avoided to be generated with the foreground area, influences the viewing of video image Experience.Wherein, remaining area includes the region in addition to overlapping region in business object display area.
Wherein, the foreground area of business object display area is usually the foreground zone of original business object in video image Domain.The information of the foreground area of business object display area can be, but not limited to, and use is trained, for detecting video image In the nervus opticus network model of foreground area of original business object be detected.Wherein, to volume Two and nerve net The training of network model can include:
The second feature vector of the second sample image is obtained, wherein, the second sample image is to include prospect markup information With the sample image of background markup information;Process of convolution is carried out to second feature vector, obtains second feature Vector convolution result; Processing is amplified to second feature Vector convolution result;Judge whether amplified second feature Vector convolution result meets volume The product condition of convergence;If satisfied, then complete the training to the second convolution neural network model;If not satisfied, then according to amplified Second feature Vector convolution result adjusts the network parameter of the second convolution neural network model and according to the second convolution after adjustment The network parameter of neural network model is iterated training to the second convolution neural network model, until second after repetitive exercise Feature vector convolution results meet the convolution condition of convergence.
In the present embodiment, computer graphics mode is waited using such as OpenGL modes, mesh is drawn in above-mentioned drawing area Business object is marked, carries out the displaying of target service object.Wherein, target service object is the special efficacy or wide for including semantic information Paster is accused, including in the form of two-dimentional paster special efficacy, the advertisement of the forms displaying such as three-dimensional special efficacy form, particle effect form.For example, The advertisement shown in the form of three-dimensional special efficacy, the advertisement special efficacy may include the video frame of the displaying image composition of multiple different conditions, It draws the respective image of video frame successively on position is showed by the computer graphics mode such as OpenGL, is achieved in advertisement effect The dynamic of fruit, which shows, spectators to be attracted to watch, and promote the interest that advertisement is launched and shown, improve advertisement dispensing and displaying effect Rate.In some cases, advertisement can also be shown in the form of three-dimensional special efficacy, and the word of advertisement is such as shown by particle effect mode Or LOGO etc..
The processing method of video image provided in an embodiment of the present invention passes through the business object in video image is detected During display area, the attribute information of business object display area is obtained, and it is true according to the attribute information of business object display area The business object that sets the goal and the displaying attribute that target service object is adjusted according to the attribute information of video image, using calculating Target service object is drawn in the object display area of machine plotting mode in video, so as to not influence the normal of video image The replacement of business object in video image is completed in the case of viewing experience, and causes the target service object symbol in video image Target area and target group of video image etc. is closed, there is higher bandwagon effect.
Embodiment three
Reference Fig. 3 shows a kind of structure diagram of the processing unit of according to embodiments of the present invention three video image.
The processing unit of the video image of the present embodiment includes:First acquisition module 302 detects video image for working as In there are during business object display area, obtain the attribute information of the business object display area;Drafting module 304, is used for Based on the attribute information of the business object display area, target service object is drawn using computer graphics mode.
The processing unit of the video image provided according to embodiments of the present invention whether there is industry by detecting in video image Business object display area in the business object display area in detecting video image, obtains business object display area Attribute information, and further according to the attribute information, using object display area of the computer graphics mode in video image Interior drafting target service object, makes the target service object in video image cover original business object, so as to complete video The replacement of business object in image, realizes in the case where not influencing video viewing experience, and it is suitable to show in video image Business object, improve business object in video image and show effect.When target service object is used to show advertisement, a side Face, the drawing area of target service objects draw original business object in video image, be equivalent to video image into It has gone the replacement of business object, has not interfered with the normal viewing experience of video;On the other hand, which can be more suitable The viewing group of video image is closed, business object in video image is improved and shows effect.
Example IV
The present embodiment has carried out further improvement to the processing unit of the video image shown in above-described embodiment three, changes The processing unit of video image after is as shown in Figure 4.
The processing unit of the video image remove include the first acquisition module 302 in embodiment three and drafting module 304 it Outside, the second acquisition module 306, the 3rd acquisition module 308 and determining module 310 are further included.
Optionally, the attribute information of the business object display area includes the foreground zone of the business object display area Domain information;The drafting module 304, if before for the business object display area and the business object display area Scene area then draws the target service object there are overlapping region using computer graphics mode in remaining area, described surplus Remaining region includes the region in addition to the overlapping region in the business object display area.
Optionally, the second acquisition module 306 is used to obtain the business object display area marked in the video image Attribute information.
Optionally, the 3rd acquisition module 308 is used to obtain the attribute information of the video image, wherein, the video figure The attribute information of picture includes the target area information of the video image and target group gender information;Determining module 310 is used for The target service object is determined according to the attribute information of the video image.
Optionally, the determining module 310 includes:First determination unit 3102 is described for working as the attribute information During the target area information of video image, the target industry is determined from the corresponding business object of target area information Business object;Second determination unit 3104, for when the attribute information be the video image target group gender information when, The target service object is determined from the corresponding business object of target group gender information.
Optionally, the target service object includes pre-set business object.
Optionally, the drafting module 304 includes:Adjustment unit 3042, for according in the video image The attribute information of business object display area adjusts the displaying attribute of the target service object;Drawing unit 3044, for base The displaying attribute of the target service object after adjustment draws the target service object using computer graphics mode.
Optionally, the attribute information of the business object display area includes location information, dimension information and/or angle letter Breath;The adjustment unit 3042 leads to for the attribute information of the business object display area in the video image Cross move, scale, rotating, symmetrically, at least one of the deformation adjustment target service object.
Optionally, the attribute information of the business object display area includes transparence information;The adjustment unit 3042 The target service object is adjusted for the transparence information of the business object display area in the video image Transparency
Optionally, the target service object is with semantic special efficacy or advertising sticker.
Optionally, the target service object includes the special efficacy of following at least one form comprising advertising message:Two dimension Paster special efficacy, three-dimensional special efficacy, particle effect.
The processing unit of the video image of the present embodiment is used to implement the place of video image in aforesaid plurality of embodiment of the method Reason method, such as the processing method of the video image in embodiment one and two, and the advantageous effect with corresponding embodiment of the method, Details are not described herein.
Embodiment five
The embodiment of the present invention five provides a kind of electronic equipment, such as can be mobile terminal, personal computer (PC), put down Plate computer, server etc..Below with reference to Fig. 5, it illustrates suitable for being used for realizing the terminal device of the embodiment of the present invention or service The structure diagram of the electronic equipment 500 of device:As shown in figure 5, electronic equipment 500 includes one or more processors, communication member Part etc., one or more of processors are for example:One or more central processing unit (CPU) 501 and/or one or more Image processor (GPU) 513 etc., processor can according to the executable instruction being stored in read-only memory (ROM) 502 or From the storage executable instruction that is loaded into random access storage device (RAM) 503 of part 508 perform various appropriate actions and Processing.Communication device includes communication component 512 and/or communication interface 509.Wherein, communication component 512 may include but be not limited to net Card, the network interface card may include but be not limited to IB (Infiniband) network interface card, and communication interface 509 includes such as LAN card, modulation /demodulation The communication interface of the network interface card of device etc., communication interface 509 perform communication process via the network of such as internet.
Processor can communicate with read-only memory 502 and/or random access storage device 503 to perform executable instruction, It is connected by communication bus 504 with communication component 512 and is communicated through communication component 512 with other target devices, so as to completes this The corresponding operation of processing method for any one video image that inventive embodiments provide, for example, being deposited when detecting in video image In business object display area, the attribute information of the business object display area is obtained;It is shown based on the business object The attribute information in region draws target service object using computer graphics mode.
In addition, in RAM 503, various programs and data needed for device operation can be also stored with.CPU501 or GPU513, ROM502 and RAM503 are connected with each other by communication bus 504.In the case where there is RAM503, ROM502 is can Modeling block.RAM503 stores executable instruction or executable instruction is operationally write into ROM502, and executable instruction makes place It manages device and performs the corresponding operation of the above method.Input/output (I/O) interface 505 is also connected to communication bus 504.Communication component 512 can be integrally disposed, may be set to be with multiple submodule (such as multiple IB network interface cards), and is linked in communication bus On.
I/O interfaces 505 are connected to lower component:Importation 506 including keyboard, mouse etc.;It is penetrated including such as cathode The output par, c 507 of spool (CRT), liquid crystal display (LCD) etc. and loud speaker etc.;Storage part 508 including hard disk etc.; And the communication interface 509 of the network interface card including LAN card, modem etc..Driver 510 is also according to needing to connect It is connected to I/O interfaces 505.Detachable media 511, such as disk, CD, magneto-optic disk, semiconductor memory etc. are pacified as needed On driver 510, in order to which the computer program read from it is mounted into storage part 508 as needed.
Need what is illustrated, framework as shown in Figure 5 is only a kind of optional realization method, can root during concrete practice The component count amount and type of above-mentioned Fig. 5 are made choice, deleted, increased or replaced according to actual needs;It is set in difference in functionality component Put, can also be used it is separately positioned or integrally disposed and other implementations, such as GPU and CPU separate setting or can be by GPU collection Into on CPU, communication device separates setting, can also be integrally disposed on CPU or GPU, etc..These interchangeable embodiment party Formula each falls within protection scope of the present invention.
Particularly, according to embodiments of the present invention, it is soft to may be implemented as computer for the process above with reference to flow chart description Part program.For example, the embodiment of the present invention includes a kind of computer program product, including being tangibly embodied in machine readable media On computer program, computer program included for the program code of the method shown in execution flow chart, and program code can wrap The corresponding instruction of corresponding execution method and step provided in an embodiment of the present invention is included, detects that there are industry in video image for example, working as During object display area of being engaged in, the attribute information of the business object display area is obtained;Based on the business object display area Attribute information, target service object is drawn using computer graphics mode.In such embodiments, which can To be downloaded and installed from network by communication device and/or be mounted from detachable media 511.In the computer program When being executed by processor, the above-mentioned function of being limited in the method for the embodiment of the present invention is performed.
It may be noted that according to the needs of implementation, each step/component described in this application can be split as more multistep The part operation of two or more step/components or step/component can be also combined into new step/component by suddenly/component, To achieve the object of the present invention.
It is above-mentioned to realize or be implemented as in hardware, firmware according to the method for the embodiment of the present invention to be storable in note Software or computer code in recording medium (such as CD ROM, RAM, floppy disk, hard disk or magneto-optic disk) are implemented through net The original storage that network is downloaded is in long-range recording medium or nonvolatile machine readable media and will be stored in local recording medium In computer code, can be stored in using all-purpose computer, application specific processor or can compile so as to method described here Such software processing in journey or the recording medium of specialized hardware (such as ASIC or FPGA).It is appreciated that computer, processing Device, microprocessor controller or programmable hardware include can storing or receive software or computer code storage assembly (for example, RAM, ROM, flash memory etc.), when the software or computer code are by computer, processor or hardware access and when performing, realize Processing method described here.In addition, when all-purpose computer access is used to implement the code for the processing being shown in which, code It performs and is converted to all-purpose computer to perform the special purpose computer for the processing being shown in which.
Those of ordinary skill in the art may realize that each exemplary lists described with reference to the embodiments described herein Member and method and step can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually It is performed with hardware or software mode, specific application and design constraint depending on technical solution.Professional technician Described function can be realized using distinct methods to each specific application, but this realization is it is not considered that exceed The scope of the embodiment of the present invention.
The above description is merely a specific embodiment, but protection scope of the present invention is not limited thereto, any Those familiar with the art in the technical scope disclosed by the present invention, can readily occur in change or replacement, should all contain Lid is within protection scope of the present invention.Therefore, protection scope of the present invention should be based on the protection scope of the described claims.

Claims (10)

1. a kind of processing method of video image, which is characterized in that the described method includes:
When detect in video image there are during business object display area, obtain the business object display area attribute letter Breath;
Based on the attribute information of the business object display area, target service object is drawn using computer graphics mode.
2. according to the method described in claim 1, it is characterized in that, the attribute information of the business object display area includes institute State the foreground area information of business object display area;
The attribute information based on the business object display area, target service pair is drawn using computer graphics mode As, including:
If the foreground area of the business object display area and the business object display area there are overlapping region, is adopted The target service object is drawn in remaining area with computer plotting mode, the remaining area includes the business object exhibition Show the region in addition to the overlapping region in region.
3. method according to claim 1 or 2, which is characterized in that the method further includes:
Obtain the attribute information of the business object display area marked in the video image.
4. method according to any one of claim 1-3, which is characterized in that shown described based on the business object The attribute information in region, before drawing target service object using computer graphics mode, the method further includes:
The attribute information of the video image is obtained, wherein, the attribute information of the video image includes the video image Target area information and target group gender information;
The target service object is determined according to the attribute information of the video image.
5. according to the method described in claim 4, it is characterized in that, the attribute information according to the video image determines institute Target service object is stated, including:
When the attribute information is the target area information of the video image, from corresponding with the target area information The target service object is determined in business object;
When the attribute information be the video image target group gender information when, from the target group gender information The target service object is determined in corresponding business object.
6. method according to any one of claim 1-3, which is characterized in that the target service object includes default industry Business object.
7. according to the method any one of claim 1-6, which is characterized in that described to be based on the business object show area The attribute information in domain draws target service object using computer graphics mode, including:
The attribute information of the business object display area in the video image adjusts the target service object Show attribute;
Based on the displaying attribute of the target service object after adjustment, the target service is drawn using computer graphics mode Object.
8. the method according to the description of claim 7 is characterized in that the attribute information of the business object display area includes position Confidence breath, dimension information and/or angle information;
The attribute information of the business object display area in the video image adjusts the target service pair The displaying attribute of elephant, including:
The attribute information of the business object display area in the video image, by movement, scaling, rotation, right At least one of title, deformation adjustment the target service object.
9. a kind of processing unit of video image, which is characterized in that described device includes:
First acquisition module, for when detecting in video image there are during business object display area, obtaining the business pair As the attribute information of display area;
For the attribute information based on the business object display area, mesh is drawn using computer graphics mode for drafting module Mark business object.
10. a kind of electronic equipment, which is characterized in that including:Processor, memory, communication device and communication bus, the processing Device, the memory and the communication device complete mutual communication by the communication bus;
For the memory for storing an at least executable instruction, the executable instruction makes the processor perform right such as will Seek the processing method of any video images of 1-8.
CN201710079414.1A 2017-02-14 2017-02-14 Processing method, device and the electronic equipment of video image Pending CN108076373A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710079414.1A CN108076373A (en) 2017-02-14 2017-02-14 Processing method, device and the electronic equipment of video image

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710079414.1A CN108076373A (en) 2017-02-14 2017-02-14 Processing method, device and the electronic equipment of video image

Publications (1)

Publication Number Publication Date
CN108076373A true CN108076373A (en) 2018-05-25

Family

ID=62159189

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710079414.1A Pending CN108076373A (en) 2017-02-14 2017-02-14 Processing method, device and the electronic equipment of video image

Country Status (1)

Country Link
CN (1) CN108076373A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109726027A (en) * 2018-12-30 2019-05-07 联想(北京)有限公司 Message inspection method, device and electronic equipment
CN110213629A (en) * 2019-06-27 2019-09-06 腾讯科技(深圳)有限公司 A kind of Information Embedding method, apparatus, server and storage medium
CN110992251A (en) * 2019-11-29 2020-04-10 北京金山云网络技术有限公司 Logo replacing method and device in video and electronic equipment
CN111028338A (en) * 2019-12-06 2020-04-17 珠海金山网络游戏科技有限公司 Unity 3D-based image drawing method and device
WO2020092128A1 (en) * 2018-10-30 2020-05-07 Maycas Technology Limited Systems and methods for enhancing live audience experience on electronic device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103873741A (en) * 2014-04-02 2014-06-18 北京奇艺世纪科技有限公司 Method and device for substituting area of interest in video
CN104268282A (en) * 2014-10-15 2015-01-07 李阳 Web banner advertisement displaying method and system
US20150189350A1 (en) * 2013-12-27 2015-07-02 Inha-Industry Partnership Institute Caption replacement service system and method for interactive service in video on demand
CN104766229A (en) * 2015-04-22 2015-07-08 合一信息技术(北京)有限公司 Implantable advertisement putting method
CN105610954A (en) * 2015-12-31 2016-05-25 腾讯科技(深圳)有限公司 Media information processing method and system
CN106385591A (en) * 2016-10-17 2017-02-08 腾讯科技(上海)有限公司 Video processing method and video processing device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150189350A1 (en) * 2013-12-27 2015-07-02 Inha-Industry Partnership Institute Caption replacement service system and method for interactive service in video on demand
CN103873741A (en) * 2014-04-02 2014-06-18 北京奇艺世纪科技有限公司 Method and device for substituting area of interest in video
CN104268282A (en) * 2014-10-15 2015-01-07 李阳 Web banner advertisement displaying method and system
CN104766229A (en) * 2015-04-22 2015-07-08 合一信息技术(北京)有限公司 Implantable advertisement putting method
CN105610954A (en) * 2015-12-31 2016-05-25 腾讯科技(深圳)有限公司 Media information processing method and system
CN106385591A (en) * 2016-10-17 2017-02-08 腾讯科技(上海)有限公司 Video processing method and video processing device

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020092128A1 (en) * 2018-10-30 2020-05-07 Maycas Technology Limited Systems and methods for enhancing live audience experience on electronic device
CN109726027A (en) * 2018-12-30 2019-05-07 联想(北京)有限公司 Message inspection method, device and electronic equipment
CN110213629A (en) * 2019-06-27 2019-09-06 腾讯科技(深圳)有限公司 A kind of Information Embedding method, apparatus, server and storage medium
CN110992251A (en) * 2019-11-29 2020-04-10 北京金山云网络技术有限公司 Logo replacing method and device in video and electronic equipment
CN110992251B (en) * 2019-11-29 2023-11-10 北京金山云网络技术有限公司 Logo replacing method and device in video and electronic equipment
CN111028338A (en) * 2019-12-06 2020-04-17 珠海金山网络游戏科技有限公司 Unity 3D-based image drawing method and device
CN111028338B (en) * 2019-12-06 2023-08-08 珠海金山数字网络科技有限公司 Image drawing method and device based on Unity3D

Similar Documents

Publication Publication Date Title
CN107343211B (en) Method of video image processing, device and terminal device
CN108076373A (en) Processing method, device and the electronic equipment of video image
US10776970B2 (en) Method and apparatus for processing video image and computer readable medium
US11069094B1 (en) Generating realistic makeup in a digital video stream
CN107340852A (en) Gestural control method, device and terminal device
CN107341434A (en) Processing method, device and the terminal device of video image
CN108073671A (en) Business object recommends method, apparatus and electronic equipment
CN105975581A (en) Media information display method, client and server
CN110019600B (en) Map processing method, map processing device and storage medium
US20190155864A1 (en) Method and apparatus for recommending business object, electronic device, and storage medium
CN108076128A (en) User property extracting method, device and electronic equipment
CN104767830A (en) Information issuing management method and device
CN112839223B (en) Image compression method, image compression device, storage medium and electronic equipment
CN110136198A (en) Image processing method and its device, equipment and storage medium
CN108076387B (en) Business object pushing method and device and electronic equipment
CN108073669A (en) Business object methods of exhibiting, device and electronic equipment
CN110446093A (en) A kind of video progress bar display methods, device and storage medium
CN108073670A (en) Business object recommends method, apparatus and electronic equipment
CN106504025A (en) A kind of method for processing multimedia information and device
CN107770602A (en) Method of video image processing and device
CN108604389A (en) continuous depth ordering image synthesis
CN108076359A (en) Methods of exhibiting, device and the electronic equipment of business object
CN108073672A (en) Business object recommends method, apparatus and electronic equipment
CN116308530A (en) Advertisement implantation method, advertisement implantation device, advertisement implantation equipment and readable storage medium
CN116761037B (en) Method, device, equipment and medium for video implantation of multimedia information

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180525

RJ01 Rejection of invention patent application after publication