CN104519371A - Pushing method, pushing device and server - Google Patents

Pushing method, pushing device and server Download PDF

Info

Publication number
CN104519371A
CN104519371A CN201410855843.XA CN201410855843A CN104519371A CN 104519371 A CN104519371 A CN 104519371A CN 201410855843 A CN201410855843 A CN 201410855843A CN 104519371 A CN104519371 A CN 104519371A
Authority
CN
China
Prior art keywords
video image
display area
sliding window
region
positional information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201410855843.XA
Other languages
Chinese (zh)
Other versions
CN104519371B (en
Inventor
李鹏
高鹏程
高欣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
KUYUN INTERACTIVE TECHNOLOGY Ltd
Original Assignee
KUYUN INTERACTIVE TECHNOLOGY Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by KUYUN INTERACTIVE TECHNOLOGY Ltd filed Critical KUYUN INTERACTIVE TECHNOLOGY Ltd
Priority to CN201410855843.XA priority Critical patent/CN104519371B/en
Publication of CN104519371A publication Critical patent/CN104519371A/en
Application granted granted Critical
Publication of CN104519371B publication Critical patent/CN104519371B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/22—Matching criteria, e.g. proximity measures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Data Mining & Analysis (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Image Processing (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a pushing method, a pushing device and a server. The pushing method comprises the following steps: obtaining position information of a non-coverable region in a video image in the server by an obtaining module; calculating position information of a display region according to the display size of pushing information and the position information of the non-coverable region by a calculation module, wherein the display region and the non-coverable region are not overlapped; sending the pushing information and the position information of the display region to a client by a pushing module, and displaying the pushing information in the display region. In the client, the display region and the non-coverable region are not overlapped, so that the pushing information from the server cannot be overlapped with additional information from a TV station and cannot cause interference to a user, and the user experience is improved.

Description

Method for pushing, pusher and server
Technical field
The present invention relates to technical field of media play, particularly a kind of method for pushing, pusher and server.
Background technology
TV station often embeds some additional datas in the original multimedia data for presenting programme content, thus make to be embedded with in the video image corresponding to the multi-medium data of additional data and can not only demonstrate programme content, and one or more additional information can also be shown on programme content, these additional informations can be programme information, TV guide, advertisement etc., and these additional informations effectively can improve the experience sense of user.
Along with the development of intelligent terminal and Internet technology, client progressively achieves intellectuality, the client (such as intelligent television) of these intelligence can not only receive the multi-medium data of TV station, and can also the pushed information of real-time reception server.The exhibition of these pushed information takies the certain display area of display screen, and in the prior art, the display area of pushed information generally can select one piece of fixed area on display screen, such as: the lower left corner of display screen or the lower right corner.
But, sometimes the additional information that TV station sends also can be selected to show in the lower left corner of display screen or the lower right corner, the pushed information that now server sends partially or completely covers additional information, thus cause user cannot read the content of accessory information, namely pushed information causes interference to user.
Summary of the invention
The invention provides a kind of method for pushing, pusher and server, effectively can solve owing to existing between pushed information and additional information overlapping, thus user be produced to the problem of interference.
For achieving the above object, the invention provides a kind of method for pushing, comprising:
Obtaining in server inner video image can not the positional information of overlay area, and described can not overlay area be covered on programme content for showing the region of additional information;
According to the displaying size of pushed information with describedly the positional information calculation of overlay area can not go out the positional information of the display area in described video image, described display area is be covered in for showing the region of described pushed information on programme content, described display area and described can not overlay area not overlapping;
The positional information of described pushed information and described display area is sent to client to show described pushed information in described display area.
Alternatively, can not the step of positional information of overlay area comprise in described acquisition server inner video image:
Video image described in some frames is generated according to the multi-medium data got;
Digital Image Processing is carried out to identify the stagnant zone in video image described in some frames to video image described in the some frames generated, in described stagnant zone all the coordinate of point form described can not the positional information of overlay area.
Alternatively, described Digital Image Processing is specially inter-frame difference process.
Alternatively, in described acquisition server inner video image can not overlay area positional information step before also comprise:
According to each bar with preliminary dimension extracted from some frame video images in advance, the sampling picture block of additional information generates and additional information several Image Classifiers one to one described in each bar, the positive sample of described Image Classifier is for belonging to all sampling picture block of additional information described in same, the negative sample of described Image Classifier is the sampling picture block of several programme contents extracted from some frame video images, the sampling picture block of additional information described in the size of the sampling picture block of described programme content and each bar measure-alike, whole described Image Classifier forms additional information disaggregated model,
Can not the step of positional information of overlay area comprise in described acquisition server end inner video image:
Video image described in a frame is generated according to the multi-medium data got;
In video image described in the frame generated, set up first sliding window with described preliminary dimension, described first sliding window scans video image described in a frame with the first predetermined step-length;
According to described additional information disaggregated model to judge whether the picture in the first sliding window belongs to additional information, when judging that the picture in the first sliding window belongs to additional information, obtain the coordinate that each point is corresponding in the first sliding window, described first sliding window complete to the coordinate of the whole points got after whole video image scanning form described can not the positional information of overlay area.
Alternatively, the described displaying size according to pushed information and describedly can not the positional information step of display area that goes out in described video image of the positional information calculation of overlay area to comprise:
Second sliding window with described displaying size is set up in bottom right edge region in described video image, described second sliding window scans described bottom right edge region with the second predetermined step-length, and described bottom right edge region is be less than with the distance of the lower side of described video image region and be less than with the distance of the right edge of described video image region, wherein H is
Judge region in described second sliding window and describedly whether can not there is overlapping region in overlay area, when the region judged in described second sliding window and described can not overlay area there is not overlapping region time, then assert that the region in described second sliding window is an optional display area, and obtaining the interior coordinate all put of described optional display area using the positional information as described optional display area, described second sliding window completes and gets optional display area described at least one to after whole video image scanning;
From whole described optional display area, choose one using as described display area, the positional information of the described optional display area of selected taking-up is the positional information of described display area.
Alternatively, the value of m is the value of 5, n is 5.
Alternatively, describedly from whole described optional display area, one is chosen to comprise as the step of described display area:
Distance between the intermediate point calculating optional display area described in each and the best illustrated point pre-set;
Choose the minimum optional display area of distance between intermediate point and best illustrated point as described display area.
Alternatively, the distance of the lower side of described best illustrated point and described video image is
The distance of the right edge of described best illustrated point and described video image is
For achieving the above object, the present invention also provides a kind of pusher, comprising:
Acquisition module, can not the positional information of overlay area for obtain in server inner video image, and described can not overlay area be covered on programme content for showing the region of additional information;
Computing module, for according to the displaying size of pushed information with describedly the positional information calculation of overlay area can not go out the positional information of the display area in described video image, described display area is be covered in for showing the region of described pushed information on programme content, described display area and described can not overlay area not overlapping;
Pushing module, for being sent to client to show described pushed information in described display area by the positional information of described pushed information and described display area.
Alternatively, described acquisition module comprises:
First image generation unit, for generating video image described in some frames according to the multi-medium data got;
Digital image processing unit, for carrying out Digital Image Processing to identify the stagnant zone in video image described in some frames to video image described in the some frames generated, in described stagnant zone all the coordinate of point form described can not the positional information of overlay area.
Alternatively, described pusher also comprises:
Grader generation module, according to each bar with preliminary dimension extracted from some frame video images in advance, the sampling picture block of additional information generates and additional information several Image Classifiers one to one described in each bar, the positive sample of described Image Classifier is for belonging to all sampling picture block of additional information described in same, the negative sample of described Image Classifier is the sampling picture block of several programme contents extracted from some frame video images, the sampling picture block of additional information described in the size of the sampling picture block of described programme content and each bar measure-alike, whole described Image Classifier forms additional information disaggregated model,
Described acquisition module comprises:
Second image generation unit, for generating video image described in a frame according to the multi-medium data got;
First sliding window unit, for setting up first sliding window with described preliminary dimension in video image described in the frame generated, described first sliding window scans video image described in a frame with the first predetermined step-length;
First judging unit, for according to described additional information disaggregated model to judge whether the picture in the first sliding window belongs to additional information;
First coordinate acquiring unit, when picture for judging in the first sliding window when the first judging unit belongs to additional information, obtain the coordinate that each point is corresponding in the first sliding window, described first sliding window complete to the coordinate of the whole points got after whole video image scanning form described can not the positional information of overlay area.
Alternatively, described computing module comprises:
Second sliding window unit, second sliding window with described displaying size is set up for the bottom right edge region in described video image, described second sliding window scans described bottom right edge region with the second predetermined step-length, and described bottom right edge region is be less than with the distance of the lower side of described video image region and be less than with the distance of the right edge of described video image region, wherein, H is the height of video image, and W is the width of video image, m and n is the fixed value pre-set;
Second judging unit, for judging region in described second sliding window and describedly whether can not there is overlapping region in overlay area;
Second coordinate acquiring unit, for judge when the second judging unit region in described second sliding window and described can not overlay area there is not overlapping region time, assert that the region in described second sliding window is an optional display area, and obtaining the interior coordinate all put of described optional display area using the positional information as described optional display area, described second sliding window completes and gets optional display area described at least one to after whole video image scanning;
Choose unit, from whole described optional display area, choose one using as described display area, the positional information of the described optional display area of selected taking-up is the positional information of described display area.
Alternatively, the value of m is the value of 5, n is 5.
Alternatively, choose unit described in comprise:
Computation subunit, for the distance between the intermediate point that calculates optional display area described in each and the best illustrated point pre-set;
Choose subelement, for choosing the minimum optional display area of distance between intermediate point and best illustrated point as described display area.
Alternatively, the distance of the lower side of described best illustrated point and described video image is
The distance of the right edge of described best illustrated point and described video image is
For achieving the above object, present invention also offers a kind of server, comprising: pusher, described pusher adopts above-mentioned pusher.
The present invention has following beneficial effect:
The invention provides a kind of method for pushing, pusher and server, wherein this method for pushing comprises: acquisition module obtains can not the positional information of overlay area; Computing module according to the displaying size of pushed information and can not the positional information of overlay area to calculate the positional information of display area, wherein display area with can not overlay area not overlapping; The positional information of pushed information and display area is sent to client to show pushed information in display area by pushing module.In the client, due to display area and can not exist between overlay area overlapping, therefore the pushed information coming from server can not and come from TV station additional information and between also can not produce overlapping, thus make pushed information can not produce interference to user, and then improve the experience sense of user.
Accompanying drawing explanation
The structured flowchart of the pusher that Fig. 1 provides for the embodiment of the present invention one;
The flow chart of the method for pushing that Fig. 2 provides for the embodiment of the present invention one;
The structured flowchart of the pusher that Fig. 3 provides for the embodiment of the present invention two;
Fig. 4 is the schematic diagram in the bottom right edge region of video image in the embodiment of the present invention two;
The flow chart of the method for pushing that Fig. 5 provides for the embodiment of the present invention two;
The structured flowchart of the pusher that Fig. 6 provides for the embodiment of the present invention three;
The flow chart of the method for pushing that Fig. 7 provides for the embodiment of the present invention three.
Embodiment
For making those skilled in the art understand technical scheme of the present invention better, below in conjunction with accompanying drawing, method for pushing provided by the invention, pusher and server are described in detail.
Embodiment one
The structured flowchart of the pusher that Fig. 1 provides for the embodiment of the present invention one, as shown in Figure 1, this pusher comprises: acquisition module 1, computing module 2 and pushing module 3, wherein, acquisition module 1 can not the positional information of overlay area for obtain in server inner video image, can not overlay area be covered on programme content for showing the region of additional information; Computing module 2 is for according to the displaying size of pushed information with the positional information calculation of overlay area can not go out the positional information of the display area in video image, display area is be covered in for showing the region of pushed information on programme content, display area with can not overlay area not overlapping; Pushing module 3 is for being sent to client to show pushed information in display area by the positional information of pushed information and display area.
It should be noted that, when TV station sends multi-medium data to client, server also can receive this multi-medium data, and server can demonstrate corresponding video image according to the multi-medium data received, now server operator can be come to the client push information relevant to the content of this video image according to the video image in server.
It should be noted that, in the present invention with the upper left corner of video image for the origin of coordinates, with the upper side edge of video image for transverse axis, and be the positive direction of transverse axis by the direction in the sensing upper right corner, the upper left corner, with the limit, left side of video image for the longitudinal axis, and be the positive direction of transverse axis by the direction in the sensing lower left corner, the upper left corner, set up a coordinate system.
" size " in the present invention refers to shape and the size of corresponding region." positional information " in the present invention refers to the set of the whole somes coordinate in the coordinate system comprised in corresponding region.
In the present embodiment, due to display area and can not exist between overlay area overlapping, therefore the pushed information coming from server can not and come from TV station additional information and between also can not produce overlapping, thus make pushed information can not produce interference to user.
Be described in detail below in conjunction with the course of work of accompanying drawing to the pusher shown in Fig. 1.The flow chart of the method for pushing that Fig. 2 provides for the embodiment of the present invention one, as shown in Figure 2, this method for pushing is based on the pusher shown in Fig. 1, and this method for pushing comprises:
Step 101: obtaining in server inner video image can not the positional information of overlay area.
Step 101 is performed by acquisition module 1.This can not the positional information of overlay area for can not the set of the coordinate of whole points that comprises of overlay area.
Step 102: according to the displaying size of pushed information with the positional information calculation of overlay area can not go out the positional information of the display area in video image.
Step 102 is performed by computing module 2.The set of the coordinate of whole points that the positional information of display area comprises for display area.Wherein, the display area calculated and can not exist between overlay area overlapping, namely display area positional information and can not there is not identical coordinate in the positional information of overlay area.
Step 103: the positional information of pushed information and display area is sent to client to show pushed information in display area.
Step 103 is performed by pushing module 3.Show in video image in client, additional information and pushed information are all positioned on program pictures, and additional information and pushed information are not overlapping, thus can not affect viewing and admiring of user.
The invention process one provides a kind of method for pushing and pusher, and wherein this method for pushing comprises: acquisition module obtains can not the positional information of overlay area; Computing module according to the displaying size of pushed information and can not the positional information of overlay area to calculate the positional information of display area, wherein display area with can not overlay area not overlapping; The positional information of pushed information and display area is sent to client to show pushed information in display area by pushing module.In the client, due to display area and can not exist between overlay area overlapping, therefore the pushed information coming from server can not and come from TV station additional information and between also can not produce overlapping, thus make pushed information can not produce interference to user.
Embodiment two
The structured flowchart of the pusher that Fig. 3 provides for the embodiment of the present invention two, as shown in Figure 3, this pusher comprises: acquisition module 1, computing module 2 and pushing module 3, and wherein acquisition module 1 comprises: the first image generation unit 11 and digital image processing unit 12.
Wherein, the first image generation unit 11 generates some frame video images for the multi-medium data obtained according to getting; Digital image processing unit 12 for carrying out Digital Image Processing to identify the stagnant zone in some frame video images to the first image generation unit 11 to the some frame video images generated, in stagnant zone all the coordinate of point form can not the positional information of overlay area.
In actual applications, because program pictures is dynamic change, and the additional information be additional on program pictures is fixed static, therefore based on multi-frame video image, the corresponding additional information of stagnant zone in video image, thus in stagnant zone all the coordinate of point form can not the positional information of overlay area.
In the present embodiment, digital image processing unit 12 identifies the stagnant zone in video image by Digital Image Processing.Alternatively, this Digital Image Processing is specially inter-frame difference process.As follows with the roughly process identifying the stagnant zone in video image by inter-frame difference process:
First frame-to-frame differences is calculated:
D i ( x , y ) = | F i + 1 R ( x , y ) - F i R ( x , y ) | + | F i + 1 G ( x , y ) - F i G ( x , y ) | + | F i + 1 B ( x , y ) - F i B ( x , y ) |
Wherein, D i(x, y) represents that coordinate is the frame-to-frame differences o'clock between the i-th+1 frame and the i-th frame of (x, y) in the i-th frame video image, represent that in the i-th frame video image, coordinate is the red luma component of the point of (x, y), represent that in the i-th frame video image, coordinate is the Green brightness component of the point of (x, y), represent that in the i-th frame video image, coordinate is the blue luminences component of the point of (x, y), i value 1,2,3 ... n.
Then, coordinate is that the frame-to-frame differences of the point of (x, y) carries out accumulative summation.
S ( x , y ) = Σ i = 1 n Di ( x , y )
Wherein, S (x, y) denotation coordination be the accumulative of the frame-to-frame differences of the point of (x, y) and.
Finally, binaryzation is carried out to S (x, y), to judge coordinate is whether the point of (x, y) belongs to stagnant zone.
Q ( x , y ) = 0 S ( x , y ) ≤ q 1 S ( x , y ) > q
Wherein, Q (x, y) is the result exported after carrying out binaryzation to S (x, y), and q is the threshold value pre-set.When Q (x, y) export be 0 time, then judge that coordinate belongs to stagnant zone as the point of (x, y); When Q (x, y) export be 1 time, then judge that coordinate does not belong to stagnant zone as the point of (x, y).
By all adopting frame differential method to judge whether to belong to stagnant zone to each point in video image, thus can obtain in video image belong to stagnant zone coordinate a little, and then can obtain in video image can not the positional information of overlay area.
In this enforcement, because the algorithm realization of frame differential method is simple, programming complexity is low, good operation stability, identification accuracy high, therefore adopt frame differential method can to identify stagnant zone in video image quickly and accurately based on multi-frame video image.It should be noted that, the technological means adopting frame differential method to identify the stagnant zone in video image is preferred enforcement means of the present invention, but this can't produce restriction to technical scheme of the present invention, in the present invention also by other Digital Image Processing to get the stagnant zone in video image, will not enumerate herein.
Alternatively, digital image processing unit 12 comprises: the second sliding window unit 21, second judging unit 22, second coordinate acquiring unit 23 and choose unit 24.
Wherein, the second sliding window unit 21 sets up the second sliding window having and show size for the bottom right edge region in video image, the second sliding window scans bottom right edge region with the second predetermined step-length; Second judging unit 22 is for judging region in the second sliding window and whether can not there is overlapping region in overlay area; If the second coordinate acquiring unit 23 for the second judging unit 22 judge region in the second sliding window with can not overlay area there is not overlapping region time, region then in the second sliding window is an optional display area, obtain the coordinate of all points in optional display area using the positional information as optional display area, it should be noted that, when the second sliding window completes after to whole video image scanning, at least one optional display area can be got from bottom right edge region; Choose unit 24 for choosing one using as display area from whole optional display area, the positional information of the optional display area of selected taking-up is the positional information of display area.
Fig. 4 is the schematic diagram in the bottom right edge region of video image in the embodiment of the present invention two, as shown in Figure 4, in actual applications, for not affecting user's viewing and admiring programme content, bottom right edge region pushed information being predefined in video image is shown, this bottom right edge region specifically refers to and to be less than with the distance of the lower side of video image region and be less than with the distance of the right edge of video image region, wherein, H is the height of video image, and W is the width of video image, m and n is the fixed value pre-set.Preferably, the value of m is the value of 5, n is 5.
Further alternatively, choose unit 24 and comprise: computation subunit 25 and choose subelement 26, wherein, computation subunit 25 is for the distance between the intermediate point that calculates each optional display area and the best illustrated point S pre-set; Choose subelement 26 for choosing the minimum optional display area of distance between intermediate point and best illustrated point S as display area.Choose from whole optional display area one as follows using the detailed process as display area:
First, the distance between the intermediate point calculating each optional display area and the best illustrated point S pre-set:
d = ( x - x 0 ) 2 + ( y - y 0 ) 2
Wherein, d is the distance between the intermediate point of optional display area and the best illustrated point S pre-set, x and y represents abscissa and the ordinate of the intermediate point of optional display area respectively, x0 and y0 represents abscissa and the ordinate of best illustrated point S respectively.Preferably, the distance of the lower side of best illustrated point S and video image is the distance of the right edge of best illustrated point S and video image is namely best illustrated point S at the coordinate in set up coordinate system that originally carries out an invention is when the intermediate point of display area is positioned at best illustrated point S, under not affecting user and viewing and admiring the prerequisite of programme content, the visual attention location of user can be obtained to greatest extent.
Then, the distance between the intermediate point comparing each optional display area and the best illustrated point S pre-set, and select the minimum optional display area of distance between corresponding intermediate point and best illustrated point S as display area.
In actual applications, due to display area intermediate point from best illustrated point S more close to, the vision attention then getting user is higher, therefore in the present embodiment by selecting the minimum optional display area of distance between corresponding intermediate point and best illustrated point S as display area, can the guarantee user of maximum restriction to the concern of pushed information.
It should be noted that, by calculating the distance between the intermediate point of each optional display area and the best illustrated point S pre-set in the present embodiment, then choosing the minimum optional display area of distance between intermediate point and best illustrated point S as the technological means of display area is preferred enforcement means of the present invention, and this can't produce restriction to technical scheme of the present invention.In the present invention, an arbitrary optional display area can be chosen using as display area, all can realize display area with can not overlay area without overlapping.
Be described in detail below in conjunction with the course of work of accompanying drawing to the pusher shown in Fig. 3.The flow chart of the method for pushing that Fig. 5 provides for the embodiment of the present invention two, as shown in Figure 5, this method for pushing is based on the pusher shown in Fig. 3, and this method for pushing comprises:
Step 201: generate some frame video images according to the multi-medium data got.
Step 201 is performed by the first image generation unit 11.
Step 202: Digital Image Processing is carried out to identify the stagnant zone in some frame video images to the some frame video images generated, in stagnant zone all the coordinate of point form can not the positional information of overlay area.
Step 202 is performed by digital image processing unit 12.It should be noted that, when judge stagnant zone in video image or moving region, then need to carry out Digital Image Processing according to multi-frame video image and just can learn.
Preferably, Digital Image Processing is inter-frame difference process, by inter-frame difference process to identify that the detailed process of the stagnant zone in video image see foregoing teachings, can repeat no more herein.In stagnant zone all the coordinate of point form can not the positional information of overlay area.
Step 203: the second sliding window having and show size is set up in the bottom right edge region in video image, and the second sliding window scans bottom right edge region with the second predetermined step-length.
Step 203 is performed by the second sliding window unit 21.In video image, the go forward side by side technological means of line slip window scanning of sliding window is set up in a certain region is common technology means in this area, is not described in detail herein.
Step 204: judge region in the second sliding window and whether can not there is overlapping region in overlay area.
Step 204 is performed by the second judging unit 22.Second judging unit 22 by contrast second sliding window with whether can not there is the coordinate of identical point in overlay area, thus region in the second sliding window can be judged and whether can not there is overlapping region in overlay area.When the second judging unit 22 judge region in the second sliding window with can not overlay area there is overlapping region time, then sliding window step moves to the next position, and rejudges region in the second sliding window and whether can not there is overlapping region in overlay area; When the second judging unit 22 judge region in the second sliding window with can not overlay area there is not overlapping region time, then the region in the second sliding window is an optional display area, performs step 205.
Step 205: obtain the coordinate of all points in optional display area using the positional information as optional display area.
Step 205 is performed by the second coordinate acquiring unit 23.It should be noted that, step 204 and step 205 are synchronously carried out in the process scanned bottom right edge region with the second predetermined step-length at the second sliding window.When the second sliding window completes after to whole video image scanning, the positional information of at least one optional display area and this optional display area can be got from bottom right edge region.
Step 206: choose one using as display area from whole optional display area, the positional information of the optional display area of selected taking-up is the positional information of display area.
This step 206 performs by choosing unit 24.Choose unit 24 and can choose an arbitrary optional display area using as display area, all can realize display area with can not overlay area without overlapping.
Preferably, choose unit 24 and comprise: computation subunit 25 and choose subelement 26, step 206 comprises:
Step 2061: the distance between the intermediate point calculating each optional display area and the best illustrated point pre-set.
Step 2062: choose the minimum optional display area of distance between intermediate point and best illustrated point as display area.
Step 2061 is performed by computation subunit 25, and step 2062 performs by choosing subelement 26, and the detailed process of step 2061 and step 2062 see foregoing teachings, can repeat no more herein.
Step 207: the positional information of pushed information and display area is sent to client to show pushed information in display area.
Step 207 is performed by pushing module 3.The detailed process of this step can see in above-described embodiment one to the description of step 103, repeat no more herein.
Embodiment three
The structured flowchart of the pusher that Fig. 6 provides for the embodiment of the present invention three, as shown in Figure 6, this pusher comprises: grader generation module 4, acquisition module 1, computing module 2 and pushing module 3, and wherein acquisition module 1 comprises: the second image generation unit 13, first sliding window unit 14, first judging unit 15 and the first coordinate acquiring unit 16.
Wherein, grader generation module 4 is for generating and each bar additional information several Image Classifiers one to one according to the sampling picture block with each bar additional information of preliminary dimension extracted from some frame video images in advance, the positive sample of Image Classifier is all sampling picture block belonging to same additional information, the negative sample of Image Classifier is the sampling picture block of several programme contents extracted from some frame video images, the size of the sampling picture block of programme content and the sampling picture block of each bar additional information measure-alike, all images grader forms additional information disaggregated model.
Second image generation unit 13 is for generating a frame video image according to the multi-medium data got; First sliding window unit 14 for setting up first sliding window with preliminary dimension in the frame video image generated, and the first sliding window scans a frame video image with the first predetermined step-length; First judging unit 15 for according to additional information disaggregated model to judge whether the picture in the first sliding window belongs to additional information; When first coordinate acquiring unit 16 belongs to additional information for the picture judging in the first sliding window when the first judging unit, obtain the coordinate that each point is corresponding in the first sliding window, the first sliding window completes that form the coordinate of the whole points got after whole video image scanning can not the positional information of overlay area.
The difference of the present embodiment and above-described embodiment two is, in the present embodiment be adopt the method for grader classification with identify in video image can not the positional information of overlay area, and can to identify after only needing acquisition one frame video image in the present embodiment.
In the present embodiment, adopt the method for grader classification with identify in video image can not the roughly process of positional information of overlay area as follows:
First, in multi-frame video image according to the sampling picture block manually to extract each bar additional information with preliminary dimension.
Then, from the picture in multi-frame video image with the sampling picture block of measure-alike several programme contents of the sampling picture block manually extracting size and each bar additional information.
Then, grader generation model is to belong to all sampling picture block of same additional information as positive sample, using the sampling picture block of programme content as negative sample, positive and negative samples is trained, from the Image Classifier obtaining the corresponding bar additional information of identifiable design.
For identifying that the situation of a certain bar TV guide (this TV guide can occur in multi-frame video image) is described for the Image Classifier generated.The positive sample that this Image Classifier is corresponding is the sampling picture block of this TV guide of extracting from multi-frame video image, the sampling picture block of programme content of negative sample for providing from multi-frame video image, and the size of each sampling picture block is all identical in positive and negative samples, this Image Classifier identifiable design is utilized to go out TV guide in video image.
Based on above-mentioned principle, grader generation module can generate quantity several Image Classifiers identical with the kind quantity of additional information, a corresponding additional information of Image Classifier, all images grader forms an additional information disaggregated model, this additional information disaggregated model identifiable design goes out all kinds of additional informations in video image, and in video image, be can not overlay area in whole region corresponding to additional information.
Finally, according to additional information disaggregated model to all kinds of additional informations in video image to identify, utilize the first coordinate acquiring unit to carry out record with the coordinate corresponding to each point in these additional informations, thus can learn can not the positional information of overlay area simultaneously.
Be described in detail below in conjunction with the course of work of accompanying drawing to the pusher shown in Fig. 6.The flow chart of the method for pushing that Fig. 7 provides for the embodiment of the present invention three, as shown in Figure 7, this method for pushing is based on the pusher shown in Fig. 6, and this method for pushing comprises:
Step 301: the sampling picture block with each bar additional information of preliminary dimension according to extracting from some frame video images in advance generates and each bar additional information several Image Classifiers one to one.
Step 301 is performed by grader generation module 4.Grader generation module 4 generates with the process of each bar additional information each Image Classifier one to one see foregoing teachings, and repeat no more, all images grader forms additional information disaggregated model herein.
Step 302: generate a frame video image according to the multi-medium data got.
Step 302 is performed by the second image generation unit 13.
Step 303: set up first sliding window with preliminary dimension in the frame video image generated, the first sliding window scans a frame video image with the first predetermined step-length.
Step 303 is performed by the first sliding window unit 14.First sliding window unit 14 sets up first sliding window with the sampling picture block in training set sample with same size in the video image got, and this first sliding window scans whole video image with the first predetermined step-length.
Step 304: according to additional information disaggregated model to judge whether the picture in the first sliding window belongs to additional information.
Step 304 is performed by the first judging unit 15.In the process of the first sliding window scanning, the first judging unit 15 utilizes each Image Classifier in additional information disaggregated model to judge whether the picture in the first sliding window belongs to additional information.Particularly, utilize each Image Classifier to judge whether the picture in the first sliding window belongs to corresponding additional information successively, when the picture that some Image Classifiers are judged in the first sliding window belongs to corresponding additional information, region then in surperficial first sliding window belongs to can not overlay area, performs step 305.When the picture that all images grader is all judged in the first sliding window does not belong to corresponding additional information, when the picture that then the first judging unit 15 is judged in the first sliding window does not belong to additional information, first sliding window step moves to the next position, and re-uses additional information disaggregated model and judge whether the picture in the first sliding window belongs to additional information.
It should be noted that, utilize Image Classifier to judge that the process of the additional information of the correspondence in the first sliding window is as the state of the art, repeats no more herein.
Step 305: obtain the coordinate that in the first sliding window, each point is corresponding.
Step 305 is performed by the first coordinate acquiring unit 16.When the picture that the first judging unit 15 is judged in the first sliding window belongs to additional information, the first coordinate acquiring unit 16 obtains the coordinate that in the first sliding window, each point is corresponding.It should be noted that, step 304 and step 305 are synchronously carried out in the process scanned video image with the first predetermined step-length at the first sliding window.When the first sliding window completes after to the scanning of whole video image, the coordinate of whole points that the first coordinate acquiring unit 16 gets is formed can not the positional information of overlay area.
Step 306: according to the displaying size of pushed information with the positional information calculation of overlay area can not go out the positional information of the display area in video image.
Step 306 is performed by acquisition module 1.
Alternatively, the detailed process of step 306 realizes by step 203 ~ step 206 in above-described embodiment two, particular content can see in above-described embodiment two to the description of step 203 ~ step 206.
Step 307: the positional information of pushed information and display area is sent to client to show pushed information in display area.
Step 307 is performed by pushing module 3.The detailed process of this step can see in above-described embodiment one to the description of step 103, repeat no more herein.
Embodiment four
The embodiment of the present invention four provides a kind of server, this server comprises pusher, this pusher can adopt the pusher provided in above-described embodiment one, embodiment two or embodiment three, and the method for pushing of this pusher can see the description in corresponding embodiment.
Be understandable that, the illustrative embodiments that above execution mode is only used to principle of the present invention is described and adopts, but the present invention is not limited thereto.For those skilled in the art, without departing from the spirit and substance in the present invention, can make various modification and improvement, these modification and improvement are also considered as protection scope of the present invention.

Claims (16)

1. a method for pushing, is characterized in that, comprising:
Obtaining in server inner video image can not the positional information of overlay area, and described can not overlay area be covered on programme content for showing the region of additional information;
According to the displaying size of pushed information with describedly the positional information calculation of overlay area can not go out the positional information of the display area in described video image, described display area is be covered in for showing the region of described pushed information on programme content, described display area and described can not overlay area not overlapping;
The positional information of described pushed information and described display area is sent to client to show described pushed information in described display area.
2. method for pushing according to claim 1, is characterized in that, can not the step of positional information of overlay area comprise in described acquisition server inner video image:
Video image described in some frames is generated according to the multi-medium data got;
Digital Image Processing is carried out to identify the stagnant zone in video image described in some frames to video image described in the some frames generated, in described stagnant zone all the coordinate of point form described can not the positional information of overlay area.
3. method for pushing according to claim 2, is characterized in that, described Digital Image Processing is specially inter-frame difference process.
4. method for pushing according to claim 1, is characterized in that, in described acquisition server inner video image can not overlay area positional information step before also comprise:
According to each bar with preliminary dimension extracted from some frame video images in advance, the sampling picture block of additional information generates and additional information several Image Classifiers one to one described in each bar, the positive sample of described Image Classifier is for belonging to all sampling picture block of additional information described in same, the negative sample of described Image Classifier is the sampling picture block of several programme contents extracted from some frame video images, the sampling picture block of additional information described in the size of the sampling picture block of described programme content and each bar measure-alike, whole described Image Classifier forms additional information disaggregated model,
Can not the step of positional information of overlay area comprise in described acquisition server end inner video image:
Video image described in a frame is generated according to the multi-medium data got;
In video image described in the frame generated, set up first sliding window with described preliminary dimension, described first sliding window scans video image described in a frame with the first predetermined step-length;
According to described additional information disaggregated model to judge whether the picture in the first sliding window belongs to additional information, when judging that the picture in the first sliding window belongs to additional information, obtain the coordinate that each point is corresponding in the first sliding window, described first sliding window complete to the coordinate of the whole points got after whole video image scanning form described can not the positional information of overlay area.
5. method for pushing according to claim 1, is characterized in that, the described displaying size according to pushed information and describedly can not the positional information step of display area that goes out in described video image of the positional information calculation of overlay area to comprise:
Second sliding window with described displaying size is set up in bottom right edge region in described video image, described second sliding window scans described bottom right edge region with the second predetermined step-length, and described bottom right edge region is be less than with the distance of the lower side of described video image region and be less than with the distance of the right edge of described video image region, wherein H is the height of video image, and W is the width of video image, m and n is the fixed value pre-set;
Judge region in described second sliding window and describedly whether can not there is overlapping region in overlay area, when the region judged in described second sliding window and described can not overlay area there is not overlapping region time, then assert that the region in described second sliding window is an optional display area, and obtaining the interior coordinate all put of described optional display area using the positional information as described optional display area, described second sliding window completes and gets optional display area described at least one to after whole video image scanning;
From whole described optional display area, choose one using as described display area, the positional information of the described optional display area of selected taking-up is the positional information of described display area.
6. method for pushing according to claim 5, is characterized in that,
The value of m is 5;
The value of n is 5.
7. method for pushing according to claim 5, is characterized in that, describedly from whole described optional display area, chooses one to comprise as the step of described display area:
Distance between the intermediate point calculating optional display area described in each and the best illustrated point pre-set;
Choose the minimum optional display area of distance between intermediate point and best illustrated point as described display area.
8. method for pushing according to claim 7, is characterized in that,
The distance of the lower side of described best illustrated point and described video image is
The distance of the right edge of described best illustrated point and described video image is
9. a pusher, is characterized in that, comprising:
Acquisition module, can not the positional information of overlay area for obtain in server inner video image, and described can not overlay area be covered on programme content for showing the region of additional information;
Computing module, for according to the displaying size of pushed information with describedly the positional information calculation of overlay area can not go out the positional information of the display area in described video image, described display area is be covered in for showing the region of described pushed information on programme content, described display area and described can not overlay area not overlapping;
Pushing module, for being sent to client to show described pushed information in described display area by the positional information of described pushed information and described display area.
10. pusher according to claim 9, is characterized in that, described acquisition module comprises:
First image generation unit, for generating video image described in some frames according to the multi-medium data got;
Digital image processing unit, for carrying out Digital Image Processing to identify the stagnant zone in video image described in some frames to video image described in the some frames generated, in described stagnant zone all the coordinate of point form described can not the positional information of overlay area.
11. pushers according to claim 9, is characterized in that, described pusher also comprises:
Grader generation module, according to each bar with preliminary dimension extracted from some frame video images in advance, the sampling picture block of additional information generates and additional information several Image Classifiers one to one described in each bar, the positive sample of described Image Classifier is for belonging to all sampling picture block of additional information described in same, the negative sample of described Image Classifier is the sampling picture block of several programme contents extracted from some frame video images, the sampling picture block of additional information described in the size of the sampling picture block of described programme content and each bar measure-alike, whole described Image Classifier forms additional information disaggregated model
Described acquisition module comprises:
Second image generation unit, for generating video image described in a frame according to the multi-medium data got;
First sliding window unit, for setting up first sliding window with described preliminary dimension in video image described in the frame generated, described first sliding window scans video image described in a frame with the first predetermined step-length;
First judging unit, for according to described additional information disaggregated model to judge whether the picture in the first sliding window belongs to additional information;
First coordinate acquiring unit, when picture for judging in the first sliding window when the first judging unit belongs to additional information, obtain the coordinate that each point is corresponding in the first sliding window, described first sliding window complete to the coordinate of the whole points got after whole video image scanning form described can not the positional information of overlay area.
12. pushers according to claim 9, is characterized in that, described computing module comprises:
Second sliding window unit, second sliding window with described displaying size is set up for the bottom right edge region in described video image, described second sliding window scans described bottom right edge region with the second predetermined step-length, and described bottom right edge region is be less than with the distance of the lower side of described video image region and be less than with the distance of the right edge of described video image region, wherein, H is the height of video image, and W is the width of video image, m and n is the fixed value pre-set;
Second judging unit, for judging region in described second sliding window and describedly whether can not there is overlapping region in overlay area;
Second coordinate acquiring unit, for judge when the second judging unit region in described second sliding window and described can not overlay area there is not overlapping region time, assert that the region in described second sliding window is an optional display area, and obtaining the interior coordinate all put of described optional display area using the positional information as described optional display area, described second sliding window completes and gets optional display area described at least one to after whole video image scanning;
Choose unit, from whole described optional display area, choose one using as described display area, the positional information of the described optional display area of selected taking-up is the positional information of described display area.
13. pushers according to claim 12, is characterized in that,
The value of m is 5;
The value of n is 5.
14. pushers according to claim 12, is characterized in that, described in choose unit and comprise:
Computation subunit, for the distance between the intermediate point that calculates optional display area described in each and the best illustrated point pre-set;
Choose subelement, for choosing the minimum optional display area of distance between intermediate point and best illustrated point as described display area.
15. pushers according to claim 14, is characterized in that,
The distance of the lower side of described best illustrated point and described video image is
The distance of the right edge of described best illustrated point and described video image is
16. 1 kinds of servers, is characterized in that, comprise arbitrary described pusher in the claims 9-15.
CN201410855843.XA 2014-12-31 2014-12-31 Method for pushing, pusher and server Active CN104519371B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410855843.XA CN104519371B (en) 2014-12-31 2014-12-31 Method for pushing, pusher and server

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410855843.XA CN104519371B (en) 2014-12-31 2014-12-31 Method for pushing, pusher and server

Publications (2)

Publication Number Publication Date
CN104519371A true CN104519371A (en) 2015-04-15
CN104519371B CN104519371B (en) 2017-10-20

Family

ID=52793995

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410855843.XA Active CN104519371B (en) 2014-12-31 2014-12-31 Method for pushing, pusher and server

Country Status (1)

Country Link
CN (1) CN104519371B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105430471A (en) * 2015-11-26 2016-03-23 无锡天脉聚源传媒科技有限公司 Method and device for displaying live commenting in video
CN106534939A (en) * 2016-10-09 2017-03-22 北京金山安全软件有限公司 Multi-video preview method and device and electronic equipment
WO2017125027A1 (en) * 2016-01-20 2017-07-27 腾讯科技（深圳）有限公司 Method and device for displaying information, and computer storage medium
CN109993579A (en) * 2019-03-28 2019-07-09 北京酷云互动科技有限公司 Area determination method, system, server and computer-readable medium are launched in advertisement
CN112752121A (en) * 2020-05-26 2021-05-04 腾讯科技（深圳）有限公司 Video cover generation method and device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103634667A (en) * 2013-12-12 2014-03-12 珠海迈越信息技术有限公司 Method and apparatus for acquiring network push information based on set top box
CN103797812A (en) * 2012-07-20 2014-05-14 松下电器产业株式会社 Moving-image-with-comments generation device and moving-image-with-comments generation method
CN104219376A (en) * 2013-05-31 2014-12-17 Lg电子株式会社 Mobile terminal and controlling method thereof
CN104219559A (en) * 2013-05-31 2014-12-17 奥多比公司 Placing unobtrusive overlays in video content

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103797812A (en) * 2012-07-20 2014-05-14 松下电器产业株式会社 Moving-image-with-comments generation device and moving-image-with-comments generation method
CN104219376A (en) * 2013-05-31 2014-12-17 Lg电子株式会社 Mobile terminal and controlling method thereof
CN104219559A (en) * 2013-05-31 2014-12-17 奥多比公司 Placing unobtrusive overlays in video content
CN103634667A (en) * 2013-12-12 2014-03-12 珠海迈越信息技术有限公司 Method and apparatus for acquiring network push information based on set top box

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105430471A (en) * 2015-11-26 2016-03-23 无锡天脉聚源传媒科技有限公司 Method and device for displaying live commenting in video
CN105430471B (en) * 2015-11-26 2018-07-24 无锡天脉聚源传媒科技有限公司 The display methods and device of barrage in a kind of video
WO2017125027A1 (en) * 2016-01-20 2017-07-27 腾讯科技（深圳）有限公司 Method and device for displaying information, and computer storage medium
CN106993227A (en) * 2016-01-20 2017-07-28 腾讯科技（北京）有限公司 It is a kind of enter row information displaying method and apparatus
US10484641B2 (en) 2016-01-20 2019-11-19 Tencent Technology (Shenzhen) Company Limited Method and apparatus for presenting information, and computer storage medium
CN106993227B (en) * 2016-01-20 2020-01-21 腾讯科技（北京）有限公司 Method and device for information display
CN106534939A (en) * 2016-10-09 2017-03-22 北京金山安全软件有限公司 Multi-video preview method and device and electronic equipment
CN106534939B (en) * 2016-10-09 2019-07-05 北京金山安全软件有限公司 Multi-video preview method and device and electronic equipment
CN109993579A (en) * 2019-03-28 2019-07-09 北京酷云互动科技有限公司 Area determination method, system, server and computer-readable medium are launched in advertisement
CN112752121A (en) * 2020-05-26 2021-05-04 腾讯科技（深圳）有限公司 Video cover generation method and device
CN112752121B (en) * 2020-05-26 2023-06-09 腾讯科技（深圳）有限公司 Video cover generation method and device

Also Published As

Publication number Publication date
CN104519371B (en) 2017-10-20

Similar Documents

Publication Publication Date Title
CN106920229B (en) Automatic detection method and system for image fuzzy area
CN104519371A (en) Pushing method, pushing device and server
CN101601287B (en) Apparatus and methods of producing photorealistic image thumbnails
US9396569B2 (en) Digital image manipulation
JP5080302B2 (en) Image processing method
US8805020B2 (en) Apparatus and method for generating depth signal
CN104751097A (en) Vehicle identification code detection processing method and device
US9762889B2 (en) Subtitle detection for stereoscopic video contents
CN102147684B (en) Screen scanning method for touch screen and system thereof
KR20150112535A (en) Representative image managing apparatus and method
CN107801093A (en) Video Rendering method, apparatus, computer equipment and readable storage medium storing program for executing
CN111787240B (en) Video generation method, apparatus and computer readable storage medium
CN107113464B (en) Content providing apparatus, display apparatus, and control method thereof
CN110321969B (en) MTCNN-based face alignment method
CN105159923A (en) Video image based article extraction, query and purchasing method
CN106156691A (en) The processing method of complex background image and device thereof
CN103942756A (en) Post-processing filtering method for depth map
CN103544692A (en) Blind detection method for tamper with double-compressed JPEG (joint photographic experts group) images on basis of statistical judgment
CN112218005B (en) Video editing method based on artificial intelligence
CN101873506B (en) Image processing method for providing depth information and image processing system thereof
CN106780474B (en) Kinect-based real-time depth map and color map registration and optimization method
CN107784269A (en) A kind of method and system of 3D frame of video feature point extraction
CN102609958A (en) Method and device for extracting video objects
CN103686029B (en) A kind of video pixel opposite-angle interpolation method for the many optical projection systems of giant-screen
US9798932B2 (en) Video extraction method and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant