CN107770603A - Method of video image processing and device - Google Patents
Method of video image processing and device Download PDFInfo
- Publication number
- CN107770603A CN107770603A CN201610697461.8A CN201610697461A CN107770603A CN 107770603 A CN107770603 A CN 107770603A CN 201610697461 A CN201610697461 A CN 201610697461A CN 107770603 A CN107770603 A CN 107770603A
- Authority
- CN
- China
- Prior art keywords
- business object
- business
- video image
- video
- drafting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
- H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/812—Monomedia components thereof involving advertisement data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- Marketing (AREA)
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
- Image Analysis (AREA)
Abstract
The embodiment of the present invention provides a kind of method of video image processing and device.The method of video image processing includes:The video image of video content and the displaying information of business object to be drawn are obtained, the displaying information of the business object includes the information of drafting position of the business object in the video image;The business object is drawn using drafting position of the computer graphics mode in the video image, and the business object to draw sets business tine to link.The embodiment of the present invention is advantageous to save the system resource of Internet resources and/or client, and can draw with business object and be showed by being added in video pictures, so as to enrich the content of video pictures, has the effect of augmented reality;In addition, the business object also to draw sets related business tine link, the business object drawn for addition provides the high interactive mode of degrees of fusion, improve video content watch and interaction effect.
Description
Technical field
The present embodiments relate to video image processing technology, more particularly to method of video image processing and device.
Background technology
With the development of Internet technology, people use internet viewing video, thus, internet video more and more
Business opportunity is provided for many new business.Because internet video can turn into important service traffics entrance, thus be considered as
It is the high-quality resource of advertisement implantation.
By way of implantation, the wide of duration mainly is fixed in some time insertion of video playback for existing video ads
Accuse, or advertisement is placed in the region of video playback and its neighboring area fixed position.
But, on the one hand, this video ads mode not only takes Internet resources, also takes the system resource of client;
On the other hand, this video ads mode often bothers the normal video viewing experience of spectators, causes spectators to dislike, it is impossible to reach
The advertising results of anticipation.
The content of the invention
The purpose of the embodiment of the present invention is, there is provided a kind of method of video image processing and device, dynamically to regard
The related graph data of the business with interactive function is drawn in addition in the frequency page.
One side according to embodiments of the present invention, there is provided a kind of method of video image processing, including:Obtain video content
The displaying information of video image and business object to be drawn, the displaying information of the business object include the business object
The information of drafting position in the video image;Using drafting position of the computer graphics mode in the video image
The business object is drawn, and the business object to draw sets business tine to link;Show and depict the business
The video image of object.
Alternatively, methods described also includes:In response to user to the industry that shows on the interface for playing video content
The operation of business object, the business tine that the business tine link is pointed to is obtained, and show the business tine.
Alternatively, it is described to show the business tine and include:Floating window is ejected on the broadcast interface of the video content, and
And show the business tine in the floating window;Or show in the broadcast interface of the video content in the business
Hold.
Alternatively, the displaying information also includes the positional information or identification information of the business object;Methods described is also
Including:The view data of the business object is obtained according to the positional information of the business object or identification information.
Alternatively, methods described also includes:According to the positional information of the business object or identification information obtain with it is described
The related business tine link of business object.
Alternatively, the displaying information also links including the business tine related to the business object;Methods described is also
Including:Linked from business tine related to the business object described in the displaying acquisition of information.
Alternatively, obtaining displaying information of the business object in the video image includes:Determine in the video image
The drafting position of business object.
Alternatively, the drafting position for determining business object in the video image includes:Use predetermined track side
Method determines the video image according to the drafting position of the business object determined from the first video image of the video image
Described in business object drafting position.
Alternatively, the drafting position for determining business object in the video image includes:It is true from the video image
Set the goal the characteristic point of object, according to the characteristic point of destination object, using training in advance, for determining business object in video
The convolutional network model of drafting position in image, determines drafting position of the business object in the video image;Or,
The type of destination object is determined from the video image, and the drafting of the business object is determined according to the type of destination object
Position.
Alternatively, the type according to destination object determines that the drafting position of the business object includes:When the mesh
When the type for marking object is face type, determining the drafting position of the business object includes at least one of:Video image
Body region beyond the hair zones of middle personage, forehead region, cheek region, chin area, head;And/or when the mesh
When the type for marking object is background type, determining the drafting position of the business object includes:Background area in video image;
And/or when the type of the destination object is hand type, determining the drafting position of the business object includes:Video figure
As in centered on the region where hand, region in setting range;And/or when the type of the destination object is
When making type, determining the drafting position of the business object includes:Region set in advance in video image.
Alternatively, the view data of the business object is frame sequence;It is described to be regarded using computer graphics mode described
The business object is drawn in drafting position in frequency image to be included:From described image data acquisition and the video frame sync
Frame data, the frame data are drawn in the drafting position using computer graphics mode.
Alternatively, the displaying information of the video image for obtaining video content and business object to be drawn includes:
The video image and the displaying information are obtained from the video code flow of the video content.
Alternatively, the business object to draw sets the business tine link to include:According to the business
The region that object occupies sets the link toggle area of the business tine link.
Alternatively, the business object is special efficacy or advertising sticker with semanteme.
Alternatively, the business object includes the special efficacy of following at least one form comprising advertising message:Two-dimentional paster
Special efficacy, three-dimensional special efficacy and particle effect.
Alternatively, the video code flow is the live video stream based on H264 standards, and the displaying information is carried at institute
In the network abstraction layer unit for stating live video stream.
Another aspect according to embodiments of the present invention, there is provided a kind of video image processing device, including:Data acquisition list
Member, for obtaining the video image of video content and the displaying information of business object to be drawn, the exhibition of the business object
Show that information includes the information of drafting position of the business object in the video image;Drawing unit, for using calculating
Draw the business object, and the business object to draw in drafting position of the machine plotting mode in the video image
Business tine is set to link.
Alternatively, described device also includes:Detection unit is operated, for detecting user to playing the interface of video content
On the operation of the business object that shows;Business tine shows unit, for being detected in response to the operation detection unit
To the operation of the business object showed, obtain the business tine that the business tine link is pointed to, and show described
Business tine.
Alternatively, the business tine shows unit and is used to eject floating window on the broadcast interface of the video content, and
And show the business tine in the floating window, or show in the broadcast interface of the video content in the business
Hold.
Alternatively, the displaying information also includes the positional information or identification information of the business object;It is described to draw list
Member is additionally operable to obtain the view data of the business object according to the positional information or identification information of the business object.
Alternatively, the drawing unit is additionally operable to according to the acquisition of the positional information or identification information of the business object and institute
State the related business tine link of business object.
Alternatively, the displaying information also links including the business tine related to the business object;It is described to draw list
Member is additionally operable to link from business tine related to the business object described in the displaying acquisition of information.
Alternatively, the data capture unit is used for the drafting position for determining business object in the video image.
Alternatively, the data capture unit is used for using predetermined tracking according to from the first of the video image
The drafting position of the business object determined in video image determines the drafting position of business object described in the video image.
Alternatively, the data capture unit is used for:The characteristic point of destination object is determined from the video image, according to mesh
Mark object characteristic point, using training in advance, for determine business object in video image drafting position convolution net
Network model, determine drafting position of the business object in the video image;Or, determine target pair from the video image
The type of elephant, and determine according to the type of destination object the drafting position of the business object.
Alternatively, the data capture unit is used for:When the type of the destination object is face type, it is determined that described
The drafting position of business object includes at least one of:The hair zones of personage, forehead region, cheek area in video image
Body region beyond domain, chin area, head;And/or when the type of the destination object is background type, determine institute
Stating the drafting position of business object includes:Background area in video image;And/or when the type of the destination object is hand
During category type, determining the drafting position of the business object includes:In video image centered on the region where hand, set
Determine the region in scope;And/or when the type of the destination object is type of action, determine the drafting of the business object
Position includes:Region set in advance in video image.
Alternatively, the view data of the business object is frame sequence;The drawing unit is used for from described image data
The frame data with the video frame sync are obtained, and the frame is drawn in the drafting position using computer graphics mode
Data.
Alternatively, the data capture unit be used for from the video code flow of the video content obtain the video image with
And the displaying information.
Alternatively, the region that the drawing unit is used to be occupied according to the business object sets the business tine to link
Link toggle area.
Alternatively, the business object is special efficacy or advertising sticker with semanteme.
Alternatively, the business object includes the special efficacy of following at least one form comprising advertising message:Two-dimentional paster
Special efficacy, three-dimensional special efficacy and particle effect.
Alternatively, the video code flow is the live video stream based on H264 standards, and the displaying information is carried at institute
In the network abstraction layer unit for stating live video stream.
Another aspect according to embodiments of the present invention, propose a kind of terminal device, including one or more processors, storage
Device, communication interface and communication bus, one or more of processors, the memory and the communication interface pass through described logical
Believe that bus completes mutual communication;The memory is used to deposit an at least executable instruction, and the executable instruction makes institute
State and operated corresponding to the foregoing any method of video image processing of computing device.
The Computer Vision scheme provided according to embodiments of the present invention, can be by adding drafting business in video pictures
Object is simultaneously showed, and so as to enrich the content of video pictures, has the effect of augmented reality;In addition, the industry also to draw
Object of being engaged in sets related business tine link, user can further be obtained by the operation for the business object drawn to addition and
Show the business tine related to business object, provided the user the interactive function high with video pictures degrees of fusion, do not influenceed
The normal video viewing experience of beholder, is not easy to cause beholder to dislike, improve video content watch and interaction effect.When
The business object for being configured with business tine link is used for when showing advertisement, compared with traditional video ads mode, the business pair
As being combined with video playback, without by the network transmission additional ad video data unrelated with video, be advantageous to save net
The system resource of network resource and/or client, the interactive function high with video pictures degrees of fusion is also provided the user, has been improved
Video content watch and interaction effect.
Brief description of the drawings
Fig. 1 is the flow chart for the method for video image processing for showing embodiments of the invention one;
Fig. 2 shows the flow chart of according to embodiments of the present invention two method of video image processing;
Fig. 3 shows the structured flowchart of according to embodiments of the present invention three video image processing device;
Fig. 4 shows the structured flowchart of according to embodiments of the present invention four video image processing device;
Fig. 5 shows the structural representation of according to embodiments of the present invention five terminal device.
Embodiment
(identical label represents identical element in some accompanying drawings) and embodiment below in conjunction with the accompanying drawings, implement to the present invention
The embodiment of example is described in further detail.Following examples are used to illustrate the present invention, but are not limited to the present invention
Scope.
It will be understood by those skilled in the art that the term such as " first ", " second " in the embodiment of the present invention is only used for distinguishing
Different step, equipment or module etc., any particular technology implication is neither represented, also do not indicate that the inevitable logic between them is suitable
Sequence.
Embodiment one
Fig. 1 is the flow chart for the method for video image processing for showing embodiments of the invention one.Can be for example, by shown in Fig. 5
Device or this method is performed in the terminal device including the device.
Reference picture 1, in step S110, obtain the video image of video content and the displaying letter of business object to be drawn
Breath, the displaying information of the business object include the information of drafting position of the business object in the video image.
Here, video content can be video content to be played, such as perhaps live video content in order video.This is regarded
Frequency image can be for example, the video image for the video content that the band received from another terminal device plays or from
The video content downloaded in advance decodes obtained video image.Alternatively, the video is obtained from the video code flow of video content
The displaying information of image and the business object to be drawn.
Connected for example, can be established with video website, receive the video code flow for specifying program request or live video content, then to regarding
Frequency code stream is decoded, and obtains the displaying information of video image and business object.That is, according to the present embodiment, there is provided
The provider of video content need to together provide video image and the displaying information related to the video image, such as by video figure
Picture and the displaying information are encoded in video code flow.
According to a kind of optional embodiment of the present invention, the video code flow is based on the strong H264 standards of compressed capability
Live video stream, the displaying information is carried in the network abstraction layer unit of the live video stream, with from live video
Stream obtains video image and the displaying information.
According to an embodiment of the invention, business object to be drawn is that the object of drafting will be added in video image,
To enrich the content of video pictures.For this reason, it may be necessary to obtain the information of drafting position of the business object in video image.
Here, business object to be drawn can be with semantic special efficacy or advertising sticker.Specifically, business object can
Include, but not limited to the special efficacy of following at least one form comprising advertising message:Two-dimentional paster special efficacy, three-dimensional special efficacy and grain
Sub- special efficacy etc..It is to be understood that the invention is not restricted to be applicable the application scenarios of special efficacy or advertising sticker as business object, but energy
Enough it is applied to the situation of any addition drawing image data.In order to which business object preferably to be merged to the video picture in video image
, it is necessary to obtain the information of drafting position of the business object in video image in face., can in a kind of optional embodiment
The displaying information for the information for including drafting position of the business object in the video image is obtained from the transport stream of video content;
In another optional embodiment, it may be determined that the drafting position of business object in the video image.Examined from video image
The mode for surveying the drafting position of business object has a variety of, and a kind of drafting of video images detection business object will be described hereinafter
The illustrative embodiments of position.
In step S120, the business pair is drawn using drafting position of the computer graphics mode in the video image
As, and the business object to draw sets business tine to link.
In order to persistently show the business object of drafting in video pictures, therefore the view data of frame sequence can be used to paint
Business object processed.Specifically, the video image of video content also has time series, therefore can be according to the video image of acquisition
The image data acquisition and the frame data of current video frame sync of sequence number or time offset value from frame sequence.
According to a kind of optional embodiment of the present invention, the picture number of the business object can be downloaded from server end in advance
According to, and the view data is stored under the specified folder of the machine., can be from the specified folder in order to draw the business object
Read the view data.
According to another optional embodiment of the present invention, business object is may also include in the displaying information that step S210 is obtained
Positional information or identification information.The positional information may be, but not limited to, and have the storage of the view data of the business object
The information of positional information, such as specified folder or the Uniform Resource Identifier (URL) for obtaining the view data.The identification information
It may be, but not limited to, have the file identification (such as file name) or resource index of view data.
Correspondingly, the method for video image processing can also include, and be believed according to the positional information of the business object or mark
Breath obtains the view data of the business object, for drawing the business object.
Specifically, from the image data acquisition and the frame data of the video frame sync of business object, and using meter
Calculation machine plotting mode draws the frame data in the drafting position, so that during drafting, the business pair with drafting
The video pictures of elephant are showed.
Business object can be drawn by applicable graph image drafting or rendering intent etc., include but is not limited to, be based on
OpenGL graph drawing engines are drawn etc..OpenGL defines one across programming language, cross-platform DLL specification
Professional graphic package interface, it is unrelated with hardware, can easily carry out the drafting of 2D or 3D graph images.Pass through
OpenGL, the drafting of 2D effects such as 2D pasters or special efficacy can be not only realized, can also realize that the drafting of 3D special efficacys and particle are special
Drafting of effect etc..
It is paster (such as advertising sticker) situation for business object, when carrying out the drafting of business object, can first obtains industry
The relevant information of business object, mark, the size of such as business object., can be according to drafting position after drafting position is determined
The coordinate of region (rectangular area as drawn position) is put, business object is zoomed in and out, rotate etc. and adjust, and then is passed through
Corresponding plotting mode such as OpenGL modes are drawn, so that the video pictures of the business object with drafting are showed.
In some cases, advertisement can also be shown in the form of three-dimensional special efficacy, such as by particle effect mode show advertisement word or
LOGO etc..
It should be noted that with the live rise in internet, increasing video occurs in a manner of live.It is this kind of
Video have scene it is simple, in real time, because spectators mainly watch on the mobile terminals such as mobile phone and the spies such as video image size is smaller
Point.In the case, for the dispensing such as advertisement putting for some business objects, on the one hand, due to the screen of mobile terminal
Display area is limited, if placing advertisement with traditional fixed position, can occupy main Consumer's Experience region, not only easily
User is caused to dislike, it is also possible to cause live main broadcaster person to lose spectators;On the other hand, for the live application of main broadcaster's class, due to
Live instantaneity, the advertisement of the fixed duration of traditional insertion can substantially bother the continuity of user and anchor exchange, influence to use
Family viewing experience;Another further aspect, because live content duration is natively shorter, also give using the fixed duration of traditional approach insertion
Advertisement bring difficulty.And advertisement is launched by business object, by advertisement putting and net cast content effective integration, mode
Flexibly, effect is lively, does not influence the live viewing experience of user not only, and improves the dispensing effect of advertisement.For use compared with
It is especially suitable that small display screen carries out the scene such as business object displaying, advertisement putting.
In addition, in step S120, in addition to drawing the business object, industry also is set for the business object of drafting
Business content link.
Business tine link is linking for the business tine related to the business object.For example, it is assumed that the business object is
The beverage bottle of certain branding campaign beverage, corresponding business tine link can be the links for the electric business for selling the branding campaign beverage
Or the link of the page of the branding campaign beverage is sold in the electric business website.Pass through the link, the net of the user-accessible electric business
Stand or sell the page of the branding campaign beverage.For another example assume that the business object is certain books in video image, accordingly
Business tine link can the books the encyclopaedia page link or electric business website on sell the books the page chain
Connect.
Here, can be the business tine link of the business object to be drawn configuration named web page in advance, can also be from the machine
Hard disk, storage card or internal memory read the business tine link downloaded in advance.By by the business object of drafting and the business
Hold link and interact association, set business tine to link for the business object.
In addition, according to a kind of optional embodiment of the present invention, the business tine can be linked to the image with business object
Data together store.In this case, the positional information of business object or identification information can be obtained according to displaying information
The business tine related to the business object is taken to link.
According to another optional embodiment of the present invention, the displaying information also includes the industry related to the business object
Business content link.Correspondingly, the method for video image processing also includes:From it is described displaying acquisition of information described in the business pair
As the business tine of correlation links.
Specifically, first, can be according to business in the processing for setting business tine to link for the business object of drafting
The region that object occupies in video image sets the link toggle area of the business tine link.Linking toggle area can be with
It is the region related to the region that business object occupies in video image, such as the external or inscribed rectangle of the beverage bottle of drafting
Region;Can four point coordinates external by this or inscribed rectangle limit the link toggle area.Hereafter, by user in the link
Operation in toggle area links with corresponding business tine interacts association.
On video playback interface play depict business object and with interactive function video image during,
When user for example clicks on video playback interface the business object drawn, it can be linked by the business tine and obtain and show
Corresponding business tine.
The method of video image processing provided by the present embodiment, business object can be drawn by being added in video pictures
And showed, so as to enrich the content of video pictures, there is the effect of augmented reality;In addition, the business pair also to draw
As setting related business tine link, user further can be obtained and be showed by the operation for the business object drawn to addition
The business tine related to business object, has provided the user the interactive function high with video pictures degrees of fusion, does not influence to watch
The normal video viewing experience of person, is not easy to cause beholder to dislike, improve video content watch and interaction effect.Work as configuration
The business object for having business tine to link is used for when showing advertisement, compared with traditional video ads mode, the business object with
Video playback is combined, and without by the network transmission additional ad video data unrelated with video, is advantageous to save network money
Source and/or the system resource of client, have also provided the user the interactive function high with video pictures degrees of fusion, have improved video
Content watch and interaction effect.
Embodiment two
Fig. 2 shows the flow chart of according to embodiments of the present invention two method of video image processing.
Reference picture 2, in step S210, obtain the video image of video content.
The video image can be in the video arrived for example, by video camera, the first-class image capture device continuous acquisition of shooting
The video image of appearance, or, the video content can be the video content prerecorded.
In step S220, the drafting position of business object in the video image is determined.
In embodiments of the present invention, the drafting position of business object at least can be determined by following two modes:Mode one,
The characteristic point of destination object is determined from video according to the characteristic point of destination object, using training in advance, for determining business
The convolutional network model of display location of the object in video image, it is determined that business object to be drawn painting in video image
Position processed;Mode two, the type of destination object is determined from video, according to the characteristic point of destination object, determines destination object
Type;According to the type of destination object, it is determined that the drafting position of business object to be drawn.
Hereinafter, above two mode is described in detail respectively.
Mode one
When occupation mode one is determined wait drafting position of the business object drawn in video image, it is necessary to training in advance
One convolutional network model, train the convolutional network model of completion that there is the drafting position for determining business object in video image
The function of putting;Or can also directly using third party trained completion, have determine business object in video image
Draw the convolutional network model of the function of position.
It should be noted that in the present embodiment, the training to business object emphatically is illustrated to destination object part
Training is referred to correlation technique realization, and the embodiment of the present invention is described only briefly to this.
When needing training in advance convolutional network model, a kind of feasible training method includes procedure below:
(1) characteristic vector of business object sample image to be trained is obtained.
Wherein, the information of the destination object in business object sample image is included in characteristic vector, and, business object
Positional information and/or confidence information.Wherein, the information of destination object indicates the image information of destination object;Business pair
The positional information of elephant indicates the position of business object, can be the positional information or business of business object central point
The positional information of object region;When the confidence information of business object indicates business object and is illustrated in current location, energy
The probability of the effect (be such as concerned or be clicked or watched) enough reached, the probability can be according to the statistical to historical data
Result setting is analysed, can also be set, can also be set according to artificial experience according to the result of emulation experiment.In practical application
In, while being trained to destination object, only the positional information of business object can be instructed according to being actually needed
Practice, only the confidence information of business object can also be trained, the two can also be trained.The two is carried out
Training, the convolutional network model after training is enabled to more effectively and accurately to determine the positional information and confidence of business object
Information is spent, to provide foundation for the displaying of business object.
Convolutional network model is trained by substantial amounts of sample image, the business object sample graph in the embodiment of the present invention
Business object as in can be by advance labeling position information, and either confidence information or two kinds of information have.Certainly, exist
In practical application, these information can also be obtained by other approach.And by carrying out corresponding information to business object in advance
Mark, can with the data and interaction times of effectively save data processing, improve data-handling efficiency.
There to be target object information, and, the positional information of business object and/or the business object sample of confidence information
This image is used as training sample, and characteristic vector pickup is carried out to it, obtains and includes target object information, and business object
The characteristic vector of positional information and/or confidence information.
Wherein, the extraction to characteristic vector can use the appropriate ways in correlation technique to realize that the embodiment of the present invention exists
This is repeated no more.
(2) process of convolution is carried out to the characteristic vector, obtains characteristic vector convolution results.
Include the information of destination object in the characteristic vector convolution results of acquisition, and, the positional information of business object
And/or confidence information.
The process of convolution number of characteristic vector can be set according to being actually needed, that is, in convolutional network model,
The number of plies of convolutional layer is configured according to being actually needed, and final characteristic vector convolution results meet error within the specific limits
(as image it is long or wide 1/20~1/5, it is preferable that can be the long or wide standard 1/10) of image.
Convolution results are that the result after feature extraction has been carried out to characteristic vector, and the result being capable of Efficient Characterization video image
In each related object feature and classification.
In the embodiment of the present invention, when both including the positional information of business object in characteristic vector, and business object is included
During confidence information, that is, in the case that the positional information and confidence information to business object are trained, this feature
Vector convolution result subsequently respectively carry out the condition of convergence judgement when share, without being reprocessed and being calculated, reduce by
Resource loss caused by data processing, improves data processing speed and efficiency.
(3) information of corresponding destination object in judging characteristic Vector convolution result is distinguished, and, the position of business object
Whether information and/or confidence information meet the condition of convergence.
Wherein, the condition of convergence is suitably set according to the actual requirements by those skilled in the art.When information meets the condition of convergence
When, it is believed that the parameter setting in convolutional network model is appropriate;When information can not meet the condition of convergence, it is believed that convolution
Parameter setting in network model is inappropriate, and, it is necessary to be adjusted to it, the adjustment is the process of an iteration, until using tune
The result that parameter after whole carries out process of convolution to characteristic vector meets the condition of convergence.
In a kind of feasible pattern, the condition of convergence can be according to default normal place and/or default standard degree of confidence
Set, e.g., by the position that the positional information of business object in characteristic vector convolution results indicates and the default normal bit
The distance between put and whether to meet the condition of convergence of certain threshold value as the positional information of business object;By characteristic vector convolution knot
Whether the difference in fruit between the confidence level of the confidence information instruction of business object and the default standard degree of confidence meets one
Determine the condition of convergence of threshold value as the confidence information of business object etc..
Wherein it is preferred to default normal place can be the business pair in the business object sample image for treat training
The mean place that the position of elephant obtains after being averaging processing;Default standard degree of confidence can be the business object for treating training
The average confidence that the confidence level of business object in sample image obtains after being averaging processing.According to business pair to be trained
Position and/or confidence level established standardses position and/or standard degree of confidence as the business object in sample image, because of sample image
To treat training sample and data volume is huge, thus the normal place and standard degree of confidence that set are also more objective and accurate.
It is specifically carrying out the positional information of corresponding business object in characteristic vector convolution results and/or confidence information
It is no meet the condition of convergence judgement when, a kind of feasible mode includes:
Obtain the positional information of corresponding business object in characteristic vector convolution results;Using first-loss function, calculate
The first distance between the position of the positional information instruction of corresponding business object and default normal place;According to the first distance
Whether the positional information of business object corresponding to judgement meets the condition of convergence;
And/or
Obtain the confidence information of corresponding business object in characteristic vector convolution results;Use the second loss function, meter
Second distance between the confidence level of the confidence information instruction of business object corresponding to calculation and default standard degree of confidence;According to
Whether the confidence information of business object meets the condition of convergence corresponding to second distance judgement.
In a kind of optional embodiment, first-loss function can be the positional information of business object corresponding to calculating
The function of Euclidean distance between the position of instruction and default normal place;And/or second loss function can be calculate pair
The function of Euclidean distance between the confidence level of the confidence information instruction for the business object answered and default standard degree of confidence.Adopt
With the mode of Euclidean distance, realize simple and can effectively indicate whether the condition of convergence is satisfied.But not limited to this, Qi Tafang
Formula, such as horse formula distance, bar formula distance etc. is equally applicable.
Preferably, as it was previously stated, default normal place is the business pair in the business object sample image for treat training
The mean place that the position of elephant obtains after being averaging processing;And/or default standard degree of confidence is the business pair for treating training
The average confidence obtained after being averaging processing as the confidence level of the business object in sample image.
For the information of the destination object in characteristic vector convolution results, the whether convergent judgement of information to destination object
The condition of convergence for being referred to convolutional network model used in connection with is judged, will not be repeated here.If the information of destination object
Meet the condition of convergence, then destination object can be classified, the generic of hard objectives object, think follow-up business object
Position is drawn to determine to provide reference and foundation.
(4) if meeting the condition of convergence, the training to convolutional network model is completed;If being unsatisfactory for the condition of convergence, basis
Characteristic vector convolution results, adjust the parameter of convolutional network model and according to the parameter of the convolutional network model after adjustment to convolution
Network model is iterated training, until the characteristic vector convolution results after repetitive exercise meet the condition of convergence.
By carrying out above-mentioned training to convolutional network model, convolutional network model can be to being shown based on destination object
The drafting position of business object carry out feature extraction and classification, so as to determining drafting of the business object in video image
The function of position.Wherein, when drafting position includes multiple, the training of above-mentioned business object confidence level, convolutional network mould are passed through
Type can also determine the order of quality of the bandwagon effect in multiple drafting positions, so that it is determined that optimal drafting position.Rear
In continuous application, when needing to show business object, the present image in video, which can determine that, effectively draws position.
In addition, before above-mentioned training is carried out to convolutional network model, business object sample image can also be entered in advance
Row pretreatment, including:Multiple business object sample images are obtained, wherein, include business in each business object sample image
The markup information of object;The position of business object is determined according to markup information, the position for the business object for judging to determine is with presetting
Whether the distance of position is less than or equal to given threshold;By business object corresponding to the business object less than or equal to given threshold
Sample image, it is defined as business object sample image to be trained.Wherein, predeterminated position and given threshold can be by this areas
Technical staff is appropriately arranged with using any appropriate ways, is such as calculated according to data statistic analysis result or correlation distance public
Formula or artificial experience etc., the embodiment of the present invention is not restricted to this.
In a kind of feasible pattern, the position of the business object determined according to markup information can be the center of business object
Position.The position of business object is being determined according to markup information, judge determine business object position and predeterminated position away from
From whether be less than or equal to given threshold when, the center of business object can be determined according to markup information;And then judge to be somebody's turn to do
Whether the variance of center and predeterminated position is less than or equal to given threshold.
By being pre-processed in advance to business object sample image, ineligible sample image can be filtered out,
To ensure the accuracy of training result.
The training of convolutional network model is realized by said process, training the convolutional network model of completion can be used for
Determine drafting position of the business object in video image.For example, during net cast, if main broadcaster's click-to-call service object refers to
When showing progress business object displaying, obtained in convolutional network model in live video image after the face feature point of main broadcaster,
The forehead position of the optimal location such as main broadcaster of displaying business object is can indicate that, and then mobile terminal controls live apply at this
Position shows business object;Or during net cast, if the instruction of main broadcaster's click-to-call service object carries out business object displaying
When, convolutional network model can directly determine the drafting position of business object according to live video image.
Mode two
In mode two, it is necessary first to according to the characteristic point of destination object, determine the type of destination object;Further according to target
The type of object, it is determined that the drafting position of business object to be drawn.
Wherein, the type of destination object includes but is not limited to:Face type, background type, hand type and type of action.
Wherein, face type is used to indicate that face occupies major part in video image, and background type is used to indicate background in video
Major part is occupied in image, hand type is used to indicate that hand occupies major part in video image, and type of action is then
For indicating that personage has carried out certain action.
Wherein, after the characteristic point of destination object is obtained, existing coherent detection, classification or study side can be used
Method determines the type of destination object.After the type of destination object is determined, it can determine to wait to draw according to the rule of setting
Business object drafting position, including:
When the type of destination object is face type, it is determined that the drafting position of business object to be drawn is included below extremely
It is one of few:Body region in video image beyond the hair zones of personage, forehead region, cheek region, chin area, head
Domain;And/or
When the type of destination object is background type, it is determined that the drafting position of business object to be drawn includes:Video
Background area in image;And/or
When the type of destination object is hand type, it is determined that the drafting position of business object to be drawn includes:Video
In image centered on the region where hand, region in setting range;And/or
When the type of destination object is type of action, it is determined that the drafting position of business object to be drawn includes:Video
Region set in advance in image.
Wherein, region set in advance can include in video image:Any region in video image outside personage, it is right
Can be appropriately arranged with region set in advance by those skilled in the art according to actual conditions, e.g., using action generation position as
Region in the setting range at center, or, the region in setting range beyond action generation position, or background area etc.
Deng the embodiment of the present invention is not restricted to this.
In a kind of optional embodiment, action corresponding to the type of action includes at least one of:Blink, open
Mouth, nod, shake the head, kissing, smiling, waving, scissors hand, clench fist, hold in the palm hand, perpendicular thumb, rifle posture of waving, pendulum V words hand, pendulum OK
Hand.
When drawing business object, the central point or any coordinate that can draw position are carried out for the central point of business object
The drafting of business object;For another example central point that a certain coordinate position drawn in position is defined as etc., the embodiment of the present invention
This is not restricted.Region set in advance can include in video image in embodiments of the present invention:Personage in video image
Region or video image in any region outside personage.
In addition, between the video image of the video content of continuous acquisition, position of any object in video pictures is not
Saltus step can be produced, that is to say, that in current video image, any object (such as reference object) would generally be in previous video figure
As place position near.Therefore, according to the exemplary embodiment of the present invention, regarded using predetermined tracking according to from described
The drafting of the business object determined in the first video image (former frame or front cross frame of such as current video image) of frequency image
Position determines the drafting position of business object described in the video image.By with from first video images detection to drafting
Position determines the mode of the drafting position of the business object in current video image, can be without entering to video image every time
Row full width detects, and reduces operand, improves speed and efficiency.
In step S230, the business pair is drawn using drafting position of the computer graphics mode in the video image
As, and the business object to draw sets business tine to link, so that the video pictures of the business object with drafting
Showed and make the business object of drafting that there is interactive function.
Step S230 is similar with foregoing step S120, will not be described here.
Hereafter, in the playing process of video content, user can be operated on the interface for playing video content, such as
Click on a certain position at interface, in the enterprising line slip in interface, progress multiple spot scaling etc. on interface.When detecting that user playing
After aforesaid operations on the interface of video content, if user performs operation to the business object in the video image that shows,
Perform step S240.
In step S240, in response to user to the behaviour of the business object showed on the interface for playing video content
Make, obtain the business tine that the business tine link is pointed to, and show the business tine.
Specifically, the interface for playing video content may be, but not limited to, the interface of video playback application, live application
Interface etc..Floating window can be ejected on the broadcast interface of video content, and shows the business tine in floating window, so as to user
After completing to check business tine, the broadcast interface of video content can return to.Or can also be in the broadcast interface of video content
In jump to the business tine link, the business tine is showed in the broadcast interface.
One application scenarios of the present embodiment are that in live application, the head of main broadcaster depicts certain on live picture
The advertising sticker of the headwear of brand and for the headwear advertising sticker be provided with headwear manufacturer official website webpage business in
Hold link.When user watch it is live during, when clicking the headwear region of live picture, pass through step S240 place
Reason, the live application obtains the official website webpage of corresponding headwear manufacturer by business tine link, and shows the official website net
Page.
The method of video image processing provided by the present embodiment, can detect industry to be drawn from the video content to be showed
The drafting position of business object, and all kinds of such as business objects of advertising sticker or special efficacy are drawn in addition in video pictures, are enriched
The contents of video pictures, there is the effect for the augmented reality that actual situation combines;In addition, the business object also to draw sets correlation
Business tine link, user can further obtain and be showed and business object by the operation for the business object drawn to addition
Related business tine, has provided the user the interactive function high with video pictures degrees of fusion, does not influence the normal of beholder and regards
Frequency viewing experience, be not easy to cause beholder to dislike, improve video content watch and interaction effect.When being configured with business tine
When the business object of link is used to show advertisement, compared with traditional video ads mode, the business object and video playback phase
With reference to without by the network transmission additional ad video data unrelated with video, being advantageous to save Internet resources and/or client
The system resource at end, the interactive function high with video pictures degrees of fusion is also provided the user, improved watching for video content
And interaction effect.
Embodiment three
Fig. 3 shows the structured flowchart of according to embodiments of the present invention three video image processing device.
Reference picture 3, the video image processing device of embodiment three include data capture unit 310 and drawing unit 320.
Data capture unit 310 is used for the video image for obtaining video content and the displaying letter of business object to be drawn
Breath, the displaying information of the business object include the information of drafting position of the business object in the video image.
Alternatively, data capture unit 310 be used for from the video code flow of the video content obtain the video image with
And the displaying information.
Drawing unit 320 is used to draw the industry using drafting position of the computer graphics mode in the video image
Business object, and the business object to draw sets business tine to link.
Alternatively, the displaying information also includes the positional information or identification information of the business object;Drawing unit 320
It is additionally operable to obtain the view data of the business object according to the positional information or identification information of the business object.
Alternatively, drawing unit 320 is additionally operable to according to the acquisition of the positional information or identification information of the business object and institute
State the related business tine link of business object.
Alternatively, the displaying information also links including the business tine related to the business object;Drawing unit 320
It is additionally operable to link from business tine related to the business object described in the displaying acquisition of information.
Alternatively, the region that drawing unit 320 is used to be occupied according to the business object sets the business tine to link
Link toggle area.
Alternatively, the view data of the business object is frame sequence;Drawing unit 320 is used to obtain from described image data
The frame data with the video frame sync are taken, and the frame number is drawn in the drafting position using computer graphics mode
According to.
Alternatively, the business object is special efficacy or advertising sticker with semanteme.
Alternatively, the business object includes the special efficacy of following at least one form comprising advertising message:Two-dimentional paster
Special efficacy, three-dimensional special efficacy and particle effect.
Alternatively, the video code flow is the live video stream based on H264 standards, and the displaying information is carried at institute
In the network abstraction layer unit for stating live video stream.
The processing unit of the present embodiment video image is used to realize corresponding video image in aforesaid plurality of embodiment of the method
Processing method, and the beneficial effect with corresponding embodiment of the method, will not be repeated here.
In addition, the processing unit of the video image of the present embodiment can be arranged in appropriate terminal device, including but not
It is limited to mobile terminal, PC etc..
Example IV
Fig. 4 shows the structured flowchart of according to embodiments of the present invention four video image processing device.
Reference picture 4, the video image processing device of example IV, which removes, includes data capture unit 310 and drawing unit 320
In addition, in addition to operation detection unit 330 and business tine show unit 340.
Operation detection unit 330 is used to detect user to the business object that shows on the interface for playing video content
Operation.Business tine show unit 340 be used in response to the operation detection unit detect to the business that shows
The operation of object, the business tine that the business tine link is pointed to is obtained, and show the business tine.
Alternatively, business tine shows unit 340 and is used to eject floating window on the broadcast interface of the video content, and
Show the business tine in the floating window, or show the business tine in the broadcast interface of the video content.
Alternatively, data capture unit 310 is used for the drafting position for determining business object in the video image.
Alternatively, data capture unit 310 is used for using predetermined tracking according to from the first of the video image
The drafting position of the business object determined in video image determines the drafting position of business object described in the video image.
Alternatively, data capture unit 310 is used for:The characteristic point of destination object is determined from the video image, according to mesh
Mark object characteristic point, using training in advance, for determine business object in video image drafting position convolution net
Network model, determine drafting position of the business object in the video image;Or, determine target pair from the video image
The type of elephant, and determine according to the type of destination object the drafting position of the business object.
Alternatively, data capture unit 310 is used for:When the type of the destination object is face type, it is determined that described
The drafting position of business object includes at least one of:The hair zones of personage, forehead region, cheek area in video image
Body region beyond domain, chin area, head;And/or when the type of the destination object is background type, determine institute
Stating the drafting position of business object includes:Background area in video image;And/or when the type of the destination object is hand
During category type, determining the drafting position of the business object includes:In video image centered on the region where hand, set
Determine the region in scope;And/or when the type of the destination object is type of action, determine the drafting of the business object
Position includes:Region set in advance in video image.
The processing unit of the present embodiment video image is used to realize corresponding video image in aforesaid plurality of embodiment of the method
Processing method, and the beneficial effect with corresponding embodiment of the method, will not be repeated here.
Embodiment five
Fig. 5 shows the structural representation of according to embodiments of the present invention five terminal device.The specific embodiment of the invention is not
Specific implementation to terminal device limits.
As shown in figure 5, the terminal device can include:Processor (processor) 502, communication interface
(Communications Interface) 504, memory (memory) 506 and communication bus 508.
Wherein:
Processor 502, communication interface 504 and memory 506 complete mutual communication by communication bus 508.
Communication interface 504, the network element for clients such as other with miscellaneous equipment or server etc. communicate.
Processor 502, for configuration processor 510, it can specifically perform the correlation step in above method embodiment.
Specifically, program 510 can include program code, and the program code includes computer-managed instruction.
Processor 510 is probably central processor CPU, or specific integrated circuit ASIC (Application
Specific Integrated Circuit), or it is arranged to implement the integrated electricity of one or more of the embodiment of the present invention
Road, or graphics processor GPU (Graphics Processing Unit).One or more processing that terminal device includes
Device, can be same type of processor, such as one or more CPU, or, one or more GPU;It can also be different type
Processor, such as one or more CPU and one or more GPU.
Memory 506, for depositing program 510.Memory 506 may include high-speed RAM memory, it is also possible to also include
Nonvolatile memory (non-volatile memory), for example, at least a magnetic disk storage.
Program 510 specifically can be used for so that processor 502 performs following operation:Obtain video content video image with
And the displaying information of business object to be drawn, the displaying information of the business object include the business object in the video
The information of drafting position in image;The industry is drawn using drafting position of the computer graphics mode in the video image
Business object, and the business object to draw sets business tine to link.
In a kind of optional embodiment, program 510 is additionally operable to so that processor 502 performs following operation:In response to
User obtains the business tine link and pointed to the operation of the business object showed on the interface for playing video content
Business tine, and show the business tine.
In a kind of optional embodiment, program 510 is used to cause processor 502 to perform following operation:Regarded described
Floating window is ejected on the broadcast interface of frequency content, and shows the business tine in the floating window;Or in the video
Show the business tine in the broadcast interface of appearance.
In a kind of optional embodiment, the displaying information also includes the positional information or mark of the business object
Information;Program 510 is additionally operable to so that processor 502 performs following operation:According to the positional information or mark of the business object
The view data of business object described in acquisition of information.
In a kind of optional embodiment, program 510 is additionally operable to so that processor 502 performs following operation:According to institute
State the positional information of business object or identification information obtains the business tine related to the business object and linked.
In a kind of optional embodiment, the displaying information also includes the business tine related to the business object
Link;Program 510 is additionally operable to so that processor 502 performs following operation:From it is described displaying acquisition of information described in the business
The related business tine link of object.
In a kind of optional embodiment, program 510 is used to cause processor 502 to perform following operation:It is it is determined that described
The drafting position of business object in video image.
In a kind of optional embodiment, program 510 is used to cause processor 502 specifically to perform following operate:Use
Predetermined tracking determines according to the drafting position of the business object determined from the first video image of the video image
The drafting position of business object described in the video image.
In a kind of optional embodiment, program 510 is used to cause processor 502 specifically to perform following operate:It is described
Determining the drafting position of business object in the video image includes:The characteristic point of destination object is determined from the video image,
According to the characteristic point of destination object, using training in advance, for determining drafting position of the business object in video image
Convolutional network model, determine drafting position of the business object in the video image;Or, determined from the video image
The type of destination object, and determine according to the type of destination object the drafting position of the business object.
In a kind of optional embodiment, program 510 is additionally operable to so that processor 502 performs following operation:When described
When the type of destination object is face type, determining the drafting position of the business object includes at least one of:Video figure
Body region as in beyond the hair zones of personage, forehead region, cheek region, chin area, head;And/or when described
When the type of destination object is background type, determining the drafting position of the business object includes:Background area in video image
Domain;And/or when the type of the destination object is hand type, determining the drafting position of the business object includes:Video
In image centered on the region where hand, region in setting range;And/or when the type of the destination object is
During type of action, determining the drafting position of the business object includes:Region set in advance in video image.
In a kind of optional embodiment, the view data of the business object is frame sequence;Program 510 is used to cause
Processor 502 specifically performs following operate:From described image data acquisition and the frame data of the video frame sync, using meter
Calculation machine plotting mode draws the frame data in the drafting position.
In a kind of optional embodiment, program 510 is used to cause processor 502 to perform following operation:When from described
The video code flow of video content obtains the video image and the displaying information.
In a kind of optional embodiment, program 510 is used to cause processor 502 to perform following operation:When according to institute
State the link toggle area that the region that business object occupies sets the business tine link.
In a kind of optional embodiment, the business object is special efficacy or advertising sticker with semanteme.
In a kind of optional embodiment, the business object includes following at least one form comprising advertising message
Special efficacy:Two-dimentional paster special efficacy, three-dimensional special efficacy and particle effect.
In a kind of optional embodiment, the video code flow is the live video stream based on H264 standards, the exhibition
Show that information is carried in the network abstraction layer unit of the live video stream.
The terminal device of the present embodiment video image is used to realize corresponding video image in aforesaid plurality of embodiment of the method
Processing method, and the beneficial effect with corresponding embodiment of the method, will not be repeated here.
It may be noted that according to the needs of implementation, all parts/step described in the embodiment of the present invention can be split as more
Multi-part/step, the part operation of two or more components/steps or components/steps can be also combined into new part/step
Suddenly, to realize the purpose of the embodiment of the present invention.
Above-mentioned method according to embodiments of the present invention can be realized in hardware, firmware, or be implemented as being storable in note
Software or computer code in recording medium (such as CD ROM, RAM, floppy disk, hard disk or magneto-optic disk), or it is implemented through net
The original storage that network is downloaded is in long-range recording medium or nonvolatile machine readable media and will be stored in local recording medium
In computer code, can be stored in using all-purpose computer, application specific processor or can compile so as to method described here
Such software processing in journey or the recording medium of specialized hardware (such as ASIC or FPGA).It is appreciated that computer, processing
Device, microprocessor controller or programmable hardware include can storing or receive software or computer code storage assembly (for example,
RAM, ROM, flash memory etc.), when the software or computer code are by computer, processor or hardware access and when performing, realize
Processing method described here.In addition, when all-purpose computer accesses the code for realizing the processing being shown in which, code
Perform special-purpose computer all-purpose computer is converted to for performing the processing being shown in which.
Those of ordinary skill in the art are it is to be appreciated that the list of each example described with reference to the embodiments described herein
Member and method and step, it can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually
Performed with hardware or software mode, application-specific and design constraint depending on technical scheme.Professional and technical personnel
Described function can be realized using distinct methods to each specific application, but this realization is it is not considered that exceed
The scope of the embodiment of the present invention.
Embodiment of above is merely to illustrate the embodiment of the present invention, and is not the limitation to the embodiment of the present invention, relevant skill
The those of ordinary skill in art field, in the case where not departing from the spirit and scope of the embodiment of the present invention, it can also make various
Change and modification, therefore all equivalent technical schemes fall within the category of the embodiment of the present invention, the patent of the embodiment of the present invention
Protection domain should be defined by the claims.
Claims (10)
1. a kind of method of video image processing, including:
Obtain the video image of video content and the displaying information of business object to be drawn, the displaying letter of the business object
Breath includes the information of drafting position of the business object in the video image;
The business object is drawn using drafting position of the computer graphics mode in the video image, and is drafting
The business object sets business tine to link.
2. according to the method for claim 1, wherein, methods described also includes:
In response to user to the operation of the business object showed on the interface for playing video content, obtain in the business
Hold the business tine that link is pointed to, and show the business tine.
3. method according to claim 1 or 2, wherein, obtain displaying information of the business object in the video image
Including:
Determine the drafting position of business object in the video image.
4. according to the method for claim 3, wherein, the drafting position for determining business object in the video image is wrapped
Include:
The characteristic point of destination object is determined from the video image, according to the characteristic point of destination object, uses training in advance, use
In it is determined that the convolutional network model of drafting position of the business object in video image, determines the business object in the video
Drafting position in image;
Or,
The type of destination object is determined from the video image, and the business object is determined according to the type of destination object
Draw position.
5. according to the method for claim 4, wherein, the type according to destination object determines painting for the business object
Position processed includes:
When the type of the destination object is face type, determine the business object drafting position include it is following at least it
One:Body region in video image beyond the hair zones of personage, forehead region, cheek region, chin area, head;With/
Or,
When the type of the destination object is background type, determining the drafting position of the business object includes:Video image
In background area;And/or
When the type of the destination object is hand type, determining the drafting position of the business object includes:Video image
In centered on the region where hand, region in setting range;And/or
When the type of the destination object is type of action, determining the drafting position of the business object includes:Video image
In region set in advance.
6. according to method according to any one of claims 1 to 5, wherein, the business object be special efficacy with semanteme or
Advertising sticker.
7. according to method according to any one of claims 1 to 6, wherein, the business object includes including advertising message
The special efficacy of following at least one form:Two-dimentional paster special efficacy, three-dimensional special efficacy and particle effect.
8. a kind of video image processing device, including:
Data capture unit, for obtaining the video image of video content and the displaying information of business object to be drawn, institute
Stating the displaying information of business object includes the information of drafting position of the business object in the video image;
Drawing unit, for drawing the business pair using drafting position of the computer graphics mode in the video image
As, and the business object to draw sets business tine to link.
9. device according to claim 8, wherein, described device also includes:
Detection unit is operated, for detecting user to the behaviour of the business object showed on the interface for playing video content
Make;
Show unit, in response to it is described operation detection unit detect to the operation of the business object showed, obtain
The business tine for taking the business tine link to point to, and show the business tine.
10. device according to claim 8 or claim 9, wherein, the business object is special efficacy or advertisement sticker with semanteme
Paper.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610697461.8A CN107770603B (en) | 2016-08-19 | 2016-08-19 | Video image processing method and device and terminal equipment |
CN202111315145.7A CN114051159A (en) | 2016-08-19 | 2016-08-19 | Video image processing method and device and terminal equipment |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610697461.8A CN107770603B (en) | 2016-08-19 | 2016-08-19 | Video image processing method and device and terminal equipment |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202111315145.7A Division CN114051159A (en) | 2016-08-19 | 2016-08-19 | Video image processing method and device and terminal equipment |
Publications (2)
Publication Number | Publication Date |
---|---|
CN107770603A true CN107770603A (en) | 2018-03-06 |
CN107770603B CN107770603B (en) | 2021-11-30 |
Family
ID=61262293
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610697461.8A Active CN107770603B (en) | 2016-08-19 | 2016-08-19 | Video image processing method and device and terminal equipment |
CN202111315145.7A Pending CN114051159A (en) | 2016-08-19 | 2016-08-19 | Video image processing method and device and terminal equipment |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202111315145.7A Pending CN114051159A (en) | 2016-08-19 | 2016-08-19 | Video image processing method and device and terminal equipment |
Country Status (1)
Country | Link |
---|---|
CN (2) | CN107770603B (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2021052095A1 (en) * | 2019-09-17 | 2021-03-25 | 北京字节跳动网络技术有限公司 | Image processing method and apparatus |
CN114051168A (en) * | 2021-10-29 | 2022-02-15 | 北京市商汤科技开发有限公司 | Display method, device, equipment, storage medium and program product |
CN114051169A (en) * | 2021-10-29 | 2022-02-15 | 北京市商汤科技开发有限公司 | Display method, device, equipment and storage medium |
WO2023071791A1 (en) * | 2021-10-29 | 2023-05-04 | 上海商汤智能科技有限公司 | Display method, apparatus, and device, storage medium, and program product |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2003021946A1 (en) * | 2001-09-03 | 2003-03-13 | Blueuniversal Co., Ltd. | Advertisement site information embedding moving picture digital information and moving picture digital information reproduction apparatus |
CN102455898A (en) * | 2010-10-29 | 2012-05-16 | 张明 | Cartoon expression based auxiliary entertainment system for video chatting |
CN103220490A (en) * | 2013-03-15 | 2013-07-24 | 广东欧珀移动通信有限公司 | Special effect implementation method in video communication and video user terminal |
CN103796069A (en) * | 2012-09-17 | 2014-05-14 | 公共电视公司 | System and method for providing interactive advertisement |
CN104219559A (en) * | 2013-05-31 | 2014-12-17 | 奥多比公司 | Placing unobtrusive overlays in video content |
CN104766229A (en) * | 2015-04-22 | 2015-07-08 | 合一信息技术(北京)有限公司 | Implantable advertisement putting method |
CN104853241A (en) * | 2015-05-11 | 2015-08-19 | 百度在线网络技术(北京)有限公司 | Advertisement exhibition method and system thereof |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102447873A (en) * | 2010-10-13 | 2012-05-09 | 张明 | Ha-ha video network video chat entertainment auxiliary system |
CN103890810B (en) * | 2011-10-25 | 2018-02-06 | 索尼公司 | Image processing equipment, method |
CN104780458A (en) * | 2015-04-16 | 2015-07-15 | 美国掌赢信息科技有限公司 | Method and electronic equipment for loading effects in instant video |
CN105117463B (en) * | 2015-08-24 | 2019-08-06 | 北京旷视科技有限公司 | Information processing method and information processing unit |
-
2016
- 2016-08-19 CN CN201610697461.8A patent/CN107770603B/en active Active
- 2016-08-19 CN CN202111315145.7A patent/CN114051159A/en active Pending
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2003021946A1 (en) * | 2001-09-03 | 2003-03-13 | Blueuniversal Co., Ltd. | Advertisement site information embedding moving picture digital information and moving picture digital information reproduction apparatus |
CN102455898A (en) * | 2010-10-29 | 2012-05-16 | 张明 | Cartoon expression based auxiliary entertainment system for video chatting |
CN103796069A (en) * | 2012-09-17 | 2014-05-14 | 公共电视公司 | System and method for providing interactive advertisement |
CN103220490A (en) * | 2013-03-15 | 2013-07-24 | 广东欧珀移动通信有限公司 | Special effect implementation method in video communication and video user terminal |
CN104219559A (en) * | 2013-05-31 | 2014-12-17 | 奥多比公司 | Placing unobtrusive overlays in video content |
CN104766229A (en) * | 2015-04-22 | 2015-07-08 | 合一信息技术(北京)有限公司 | Implantable advertisement putting method |
CN104853241A (en) * | 2015-05-11 | 2015-08-19 | 百度在线网络技术(北京)有限公司 | Advertisement exhibition method and system thereof |
Non-Patent Citations (1)
Title |
---|
卢宏涛等: "深度卷积神经网络在计算机视觉中的应用研究综述", 《JOURNAL OF ACQUISITION AND PROCESSING》 * |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2021052095A1 (en) * | 2019-09-17 | 2021-03-25 | 北京字节跳动网络技术有限公司 | Image processing method and apparatus |
CN114051168A (en) * | 2021-10-29 | 2022-02-15 | 北京市商汤科技开发有限公司 | Display method, device, equipment, storage medium and program product |
CN114051169A (en) * | 2021-10-29 | 2022-02-15 | 北京市商汤科技开发有限公司 | Display method, device, equipment and storage medium |
WO2023071791A1 (en) * | 2021-10-29 | 2023-05-04 | 上海商汤智能科技有限公司 | Display method, apparatus, and device, storage medium, and program product |
Also Published As
Publication number | Publication date |
---|---|
CN107770603B (en) | 2021-11-30 |
CN114051159A (en) | 2022-02-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107343211B (en) | Method of video image processing, device and terminal device | |
CN107770602A (en) | Method of video image processing and device | |
CN107341434A (en) | Processing method, device and the terminal device of video image | |
US11044295B2 (en) | Data processing method, apparatus and electronic device | |
CN107340852A (en) | Gestural control method, device and terminal device | |
CN107347166B (en) | Video image processing method and device and terminal equipment | |
WO2018033154A1 (en) | Gesture control method, device, and electronic apparatus | |
CN110019600B (en) | Map processing method, map processing device and storage medium | |
US11625874B2 (en) | System and method for intelligently generating digital composites from user-provided graphics | |
CN110286773A (en) | Information providing method, device, equipment and storage medium based on augmented reality | |
CN107343225B (en) | The method, apparatus and terminal device of business object are shown in video image | |
CN107633441A (en) | Commodity in track identification video image and the method and apparatus for showing merchandise news | |
CN107341435A (en) | Processing method, device and the terminal device of video image | |
CN107770603A (en) | Method of video image processing and device | |
WO2013120851A1 (en) | Method for sharing emotions through the creation of three-dimensional avatars and their interaction through a cloud-based platform | |
CN108109010A (en) | A kind of intelligence AR advertisement machines | |
US10939143B2 (en) | System and method for dynamically creating and inserting immersive promotional content in a multimedia | |
CN107638690A (en) | Method, device, server and medium for realizing augmented reality | |
CN108076373A (en) | Processing method, device and the electronic equipment of video image | |
CN110009407A (en) | A kind of advertisement sending method, device, advertisement playback terminal and storage medium | |
US10984572B1 (en) | System and method for integrating realistic effects onto digital composites of digital visual media | |
CN107770580B (en) | Video image processing method and device and terminal equipment | |
CN107578306A (en) | Commodity in track identification video image and the method and apparatus for showing merchandise news | |
CN114697741B (en) | Multimedia information playing control method and related equipment | |
CN110046313A (en) | The method of information sharing, client and server |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |