CN101753913A - Method and device for inserting hyperlinks in video, and processor - Google Patents

Method and device for inserting hyperlinks in video, and processor Download PDF

Info

Publication number
CN101753913A
CN101753913A CN200810241625A CN200810241625A CN101753913A CN 101753913 A CN101753913 A CN 101753913A CN 200810241625 A CN200810241625 A CN 200810241625A CN 200810241625 A CN200810241625 A CN 200810241625A CN 101753913 A CN101753913 A CN 101753913A
Authority
CN
China
Prior art keywords
described
hyperlink
key frame
video
picture
Prior art date
Application number
CN200810241625A
Other languages
Chinese (zh)
Other versions
CN101753913B (en
Inventor
牛彩卿
李智斌
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to CN2008102416251A priority Critical patent/CN101753913B/en
Publication of CN101753913A publication Critical patent/CN101753913A/en
Application granted granted Critical
Publication of CN101753913B publication Critical patent/CN101753913B/en

Links

Abstract

The embodiment of the invention relates to a method and a device for inserting hyperlinks in a video, and a processor. The method comprises: establishing associated corresponding relationship between a picture and a hyperlink; selecting a key frame in the video; associating the key frame with the picture through the same target object; according to the associated corresponding relationship between the picture and the hyperlink and the associated corresponding relationship between the key frame and the picture, obtaining the corresponding relationship between the key frame and the hyperlink, and generating a hyperlink file including the corresponding relationship between the key frame and the hyperlink; and executing the hyperlink file, and inserting the corresponding hyperlink in the key frame which plays the video. The embodiment of the invention realizes the automatic insertion of the hyperlinks in the video without human involvement, and greatly improves the efficiency and accuracy of inserting hyperlinks in the video, and the user experience of watching the video.

Description

Insert method, device and the processor of hyperlink in a kind of video

Technical field

The present invention relates to the communications field, relate in particular to the method, device and the processor that in video transmission, insert hyperlink.

Background technology

Along with the continuous development of the communication technology, the communication service that video transmission technologies and video are relevant is also fast-developing thereupon.The video hot link promptly inserts some hyperlink icons in video display process, behind the clickable hyperlinks icon, can see the content of hyperlink.

At present, the technology of insertion hyperlink is common in the advertising business in the video.Common advertising business is that advertisement or advertisement hyperlink are directly intercutted in video, pushes away to the user under the active, does not consider user's impression, is a kind of mandatory advertisement, and the user is powerless to the advertisement of being sick of.In addition, in video display process, the advertisement of some user's pull-downs also occurred at present, that is: the user can select to click and watch or do not watch by drop-down menu, has solved force users to a certain extent and has seen this problem of advertisement, is accepted by popular.This interactivity has demonstrated fully the characteristics of rich-media ads, gives the user better interaction mode than traditional commercial breaks.

Prior art provides the method for inserting hyperlink in a kind of video, and its implementation procedure is: with a video player displaying video content, and while user's browsing video content; In the frame of video part that needs insert, suspend video playback, manually that this frame of video is related with a target hyperlink, generate the hypervideo file of being with hyperlink.

The above-mentioned process of inserting hyperlink in video needs the people for browsing all frame of video, which frame to insert hyperlink so that determine at.Need artificial participation in specific implementation, inefficiency needs a large amount of manually for the overlength video, and almost be impossible realize for insert advertisement in the video of playing in real time.

Summary of the invention

The method of inserting hyperlink is provided in the embodiment of the invention in a kind of video, comprises: the related corresponding relation of setting up picture and hyperlink; Key frame in the selecting video; By this key frame of same target object association and this picture; According to this picture and the related corresponding relation of hyperlink and the related corresponding relation of this key frame and this picture, obtain the corresponding relation of this key frame and this hyperlink, generate the hyperlink file that comprises this key frame and this hyperlink corresponding relation; Carry out this hyperlink file, in the key frame of playing this video, insert corresponding hyperlink.

The device that inserts hyperlink in a kind of video is provided in the embodiment of the invention, and comprising: receiver is used to receive hyperlink, picture and video information; Processor is used to set up the related corresponding relation of this picture and this hyperlink; Choose the key frame in this video; By this key frame of same target object association and this picture; According to this picture and the related corresponding relation of hyperlink and the related corresponding relation of this key frame and this picture, obtain the corresponding relation of this key frame and this hyperlink, generate the hyperlink file that comprises this key frame and this hyperlink corresponding relation; Carry out this hyperlink file, in the key frame of playing this video, insert corresponding hyperlink; Transmitter is used to export the video that inserts this hyperlink.

A kind of processor is provided in the embodiment of the invention, comprises: hyperlink and picture associative cell, it is related with hyperlinked information to be used for the picture that will receive, sets up the related corresponding relation of this picture and this hyperlink; Select frame unit, be used for receiver, video information, the key frame in the selecting video information; The object matching unit is used for extracting the destination object of this picture and this key frame, and association has this key frame and this picture of same target object; The hyperlink file generating unit, be used for according to the related corresponding relation of this picture with the related corresponding relation of this hyperlink and this key frame and this picture, obtain the corresponding relation of this key frame and this hyperlink, generate the hyperlink file that comprises this key frame and this hyperlink corresponding relation; The hypervideo broadcast unit is carried out this hyperlink file, inserts corresponding hyperlink in the key frame of playing this video.

The method that provides according to the embodiment of the invention, device and processor are searched the hyperlink relevant with keyframe content according to the analysis to key frame of video, and in video the position insertion hyperlink of this key frame correspondence.Automatically realized in video, inserting hyperlink, need not human intervention; And the video that can like according to the user, push its interested other guide by the hyperlink in this video to the user, for example: advertisement, news or movie and television play.

Description of drawings

A kind of method flow diagram that in video insert hyperlink of Fig. 1 for providing in the embodiment of the invention one;

A kind of picture with the hyperlink related table of comparisons of Fig. 2 for providing in the embodiment of the invention one;

A kind of frame of video frame number with the picture related table of comparisons of Fig. 3 for providing in the embodiment of the invention one;

The related table of comparisons with hyperlink of frame of video frame number in a kind of hyperlink file that provides in the embodiment of the invention one is provided Fig. 4;

A kind of method flow diagram that in video insert hyperlink of Fig. 5 for providing in the embodiment of the invention two;

The related table of comparisons with hyperlink of frame of video frame number in a kind of hyperlink file that provides in the embodiment of the invention two is provided Fig. 6

A kind of apparatus structure schematic diagram that in video insert hyperlink of Fig. 7 for providing in the embodiment of the invention three;

The preparation implement body structure schematic diagram of Fig. 8 for providing in the embodiment of the invention four;

Fig. 9 another concrete structure schematic diagram of processor for providing in the embodiment of the invention five;

The hypervideo broadcast unit concrete structure schematic diagram of Figure 10 for providing in the embodiment of the invention five.

Specific embodiment

Fig. 1 comprises following concrete steps for the method for inserting hyperlink in video that the embodiment of the invention one provides.

Step S101 sets up the related corresponding relation of picture and hyperlink, and detailed process is as follows:

Wherein, each picture can be corresponding with a hyperlink.This hyperlink can be that (Uniform Resource Locator, URL), content pointed can be text, audio frequency, video or three's a combination in any in a uniform resource locator address.Picture can be BMP (bitmap), and JPEG (joint photographic experts group) (Joint Photographic Experts Group, common picture format such as JPEG), and comprise a concrete destination object in this picture.For example: comprise people's face of a certain star in the picture, perhaps comprise the picture of a BMW or the sign of BMW in the picture.Background in this picture can be single, also can be not single.In addition, the single target object can be comprised in the picture, also a plurality of different target objects can be comprised simultaneously.Provide the storage table of comparisons of some pictures of a kind of association and hyperlink in the embodiment of the invention one, as shown in Figure 2.Know those skilled in the art to knowing, expect that easily the mode of other non-forms stores the corresponding relation of these some pictures and hyperlink.

Step S102, the key frame in the selecting video, detailed process is as follows:

At first, read video information, video playback time and frame per second, calculate total video frame number.Herein, video information can be that (Moving Picture Expert Group, Motion Picture Experts Group comprises MPEG-1 to MPEG, MPEG-2, common video format such as MPEG-4).

Secondly, select the selected frame number of frame and record.This selects frame to be meant and some frames in the selecting video continuous images sequence according to number of video frames, adopts corresponding method to select frame.The frame of selecting is the key frame in this video.Three kinds of methods of selecting frame are provided in the embodiments of the invention.

Method one: video is carried out Shot Detection, choose key frame afterwards.Choosing of key frame can be first frame, intermediate frame or the tail frame of camera lens.The method that Shot Detection can adopt has: basic shot segmentation technique, image pixel difference method and color histogram difference method.The benefit of doing like this is, bigger difference is arranged between the different camera lenses, selects key frame on the basis of Shot Detection, and bigger difference is arranged between key frame and the key frame, avoids the unnecessary image and the coupling of frame of video in ensuing target identification.This method is applicable to the video that reproduction time is long, the video totalframes is bigger.

Method two: video is not carried out Shot Detection, choose some frames every some randomly.For example: select a frame every the 10-30 frame., can adjust the frame of video space-number according to the length of video playback time herein, long video can be selected long frame period number, and short-sighted frequency can be selected short frame period number.Because the impression of viewing and admiring that how much has influence on the user of inserting number of ads in one section video is inserted too much advertisement and is caused that spectators are bored.This method is suitable for longer video equally, and selects the method for frame simple, reduces operand.

Method three: select frame frame by frame.This selects frame method to be fit to short video, short video itself comprises less frame of video, and general camera lens switches often, selects frame to avoid Shot Detection consuming time frame by frame, and the identification possibility that also can guarantee to detect destination object in the key frame in subsequent step S103 is big.

Step S 103, and by picture among the same target object association above-mentioned steps S101 and the key frame among the above-mentioned steps S102, detailed process is as follows:

At first, the objectives object of key frame among picture and the step S102 among the extraction step S101.Wherein, the method that destination object extracts has: local invariant characteristic method (Scale Invariant feature transform, SIFT) but concrete list of references " special characteristics of image " (stinctiveimage features from scale-invariant keypoints with yardstick consistency key point, David G.Lowe, Di, theinternational journal of computer vision, 2004); For destination object to be matched is people's face, except the SIFT algorithm, can also utilize face recognition algorithms to carry out object matching, but concrete list of references " based on the recognition of face under the illumination variation of Gabor phase place statistical model " (Facerecognition under varying lighting based on the probabilistic model ofGabor, Laiyun Qing, Shiguang Shan, Xinlin Chen, Wen Gao, Phase.IEEE, 2006); Feature extraction also can be selected additive method, and its principle is to extract stable characteristics of image, i.e. destination object is so that detect the destination object with shape facility when further mating.Step S101 picture destination object can extract once the back and preserve, and uses when mating as the succeeding target characteristics of objects.

Subsequently, key frame selected among picture among the step S101 and the step S102 is carried out the destination object characteristic matching, but list of references " special characteristics of image " (stinctiveimage features from scale-invariant keypoints with yardstick consistency key point, David G.Lowe, Di, theinternational journal of computer vision, 2004), and document " utilizing the nearest method of searching to carry out the shape index " (Shape indexing using approximatenearest-neighbour search in high-dimensional spaces at higher dimensional space, Jeffrey S.Beis and DavidG.Lowe, In Conference on Computer Vision and Pattern Recognition, HiltonHead, South Carolina, pp.774-781,1997), find out key frame and picture, set up the related corresponding relation of this key frame and this corresponding picture with same destination object.Comprise the BMW icon simultaneously such as key frame of video and picture, then related this key frame of video and this picture.

Because picture with respect to the key frame negligible amounts of selecting in the video, can remove the destination object in the match video key frame by the destination object in the picture.Otherwise, also can remove to mate the destination object in the picture by the destination object in the key frame of video.Be principle to save the equipment operand in a word.

In addition, may comprise some destination objects in the common frame of video, therefore, may be related with a plurality of pictures.Situation according to realistic objective object coupling decide, and it is a kind of by related key frame frame number and picture that the embodiment of the invention provides, the related table of comparisons of realization key frame and picture, as shown in Figure 3.Know those skilled in the art to knowing, expect that easily the mode of other non-forms or non-frame number stores the corresponding relation of this key frame and picture.Wherein, frame number a, b ... n is a number of frames in the video, a, and b ... the ..n frame number may be a consecutive frame, also may be the frame number of some numbers of being separated by.Picture format can be various forms, for example: bitmap (bitmap, BMP), JPEG (joint photographic experts group) (Joint Photographic Experts Group, JPEG) etc.

Step S104, the hyperlink file of video correspondence among the generation above-mentioned steps S102, detailed process is as follows:

At first, according to the related table of comparisons of key frame frame number among the step S103 with picture, the related table of comparisons with hyperlink of picture among the finding step S101 can obtain the related corresponding relation of key frame frame number and hyperlink, as shown in Figure 4.For example, information can be learnt from Fig. 2, Fig. 3, and the hyperlink of key frame frame number K1 correspondence is URL1 among Fig. 4; The hyperlink of key frame frame number K2 correspondence is URL1 and URL2.

Subsequently, generate the hyperlink file that comprises information shown in Figure 4.The hyperlink file is another file that is different from video file among the step S102.Comprised the relevant information of the corresponding hyperlink of this video in this hyperlink file.Wherein comprise some records, include several fields in every record.For example: frame of video frame number and hyperlink, specifically as shown in Figure 4.In order to better meet user experience, every record in this hyperlink file can also comprise other field, will further introduce in follow-up embodiment.

Step S105 carries out the hyperlink file among the S104, inserts hyperlink in the video in playing the S102 step.

Read the hyperlink fileinfo, in displaying video, in the key frame of key frame frame number correspondence, insert corresponding hyperlink.

The hyperlink method of inserting in video that adopts the above embodiment of the present invention to provide can be inserted hyperlink automatically in video, according to the user's interest video, push the user's interest content by hyperlink to the user, for example: advertisement, news.Conceivable, a BMW is arranged in the video that the user watches, the hyperlink that the embodiment of the invention just can be relevant with its content with this BMW automatically is related, and by clickable hyperlinks, the user just can obtain relevant advertisement of BMW or sales information etc. immediately.

In order to obtain better effect in specific implementation, the embodiment of the invention two is provided at the method for inserting hyperlink in video that improvement is gone up on embodiment one basis.

Step S201 is identical with the embodiment of the invention one to step S203, does not repeat them here.

Step S204 determines the thermal region in the key frame of video.

Described thermal region is the zone that highlights in the video, can highlightedly show usually.The embodiment of the invention two provides a kind of method of definite thermal region:

Detected the several features point when carrying out target identification among the step S203, these characteristic points are different in the distribution density of picture.In the target identification zone, the distribution of characteristic point is than comparatively dense, and in the driftlessness zone, characteristic point distributes more sparse even some places do not have.Thermal region determines that method is as follows:

First row are searched these row and whether are comprised characteristic point from the video frame images left side.If comprise characteristic point, then write down the abscissa of this point.Otherwise, continue to search next column, comprise only classifying as of characteristic point up to finding.Abscissa is X1;

From video frame images the right first row, search these row and whether comprise characteristic point, if comprise characteristic point, then write down the abscissa of this point.Otherwise, continue to search next column, comprise only classifying as of characteristic point up to finding.Abscissa is X2;

First row is searched this row and whether is comprised characteristic point from the video frame images top, if comprise characteristic point, then writes down this characteristic point ordinate.Otherwise, continue to search next column, up to finding the behavior that comprises characteristic point to end.Ordinate Y1;

From following first row of video frame images, search this row and whether comprise characteristic point, if comprise characteristic point, then write down this characteristic point ordinate.Otherwise, continue to search, up to finding the behavior that comprises characteristic point to end.Ordinate Y2;

Thermal region left upper apex coordinate is that (X1, Y1), the bottom right apex coordinate is that (X2, Y2), thermal region is to be left upper apex with A to B, the rectangular area that B forms for the summit, bottom right to A.

Zone in the frame of video of the accurate place of destination object, comparatively dense is compared in the distribution of characteristic point.But, may still there be the point of some flase drops, more sparsely drop on outside the destination object zone.For accurate localization target area as far as possible comparatively, need to get rid of these sparse flase drop points.In order further to improve the accuracy that thermal region detects, the embodiment of the invention two further comprises step: get rid of the flase drop zone.Its method is as follows: utilize a scanning block block-by-block scanning calorimeter zone, remove the flase drop point, determine new boundary point.For example, can select the pixel block of a 20*20, from the A point, in its thermal region, from top to bottom, scanning calorimeter zone from left to right, (number of point is according to the dense degree decision of the SIFT characteristic point of object in the image, and value range herein chooses 1~10 to determine whether to have only a few point, also can adjust according to application need) drop on thermal region, if illustrate that then this point is the flase drop point, redefines the A point according to scanning block.If begin scanning from the B point, its scanning direction is from top to bottom, and from right to left, method is similar to from the method for A spot scan.

Step S205, the thumbnail of picture among the generation step S203.

Because the dimension of picture that coupling obtains among the step S203 is general bigger, it need be dwindled to do icon.Can adopt convergent-divergent algorithm commonly used to dwindle.According to the size that thumbnail requires the original image picture element is sampled, obtain new image.Suppose that the original image size is M*N, requiring thumbnail size is K1M*K2N, (K1<1, K2<1), its convergent-divergent algorithm is as follows: the first step: establish original image and be F (i, j), i=1,2,3......, M, j=1,2,3......N.Calculate image G (x, y) the number of pixels after compressing.The number of pixels of both direction is respectively x=1, and 2,3......K1M, y=1,2,3......K2N.Second step: count out some pixel in the sampling original image according to image pixel.G (x, y)=F (c1*x, c2*y), wherein, c1=1/k1, c2=1/k2.X=1,2,3......K1M, y=1,2,3......K2N, c1*x, c2*y calculate both direction sampled point pixel location.Can obtain the thumbnail of described picture.

Step S206, the hyperlink file of video correspondence among the generation above-mentioned steps S202.

The hyperlink file is another file that is different from video file among the step S202 equally in the embodiment of the invention two.This hyperlink file the inside has comprised the relevant information of the corresponding hyperlink of this video.Wherein comprise some records, include several fields in every record.For example: the key frame frame number, coupling picture name, coupling picture URL, key frame thermal region position and hyperlink etc., specifically as shown in Figure 6.Wherein, the key frame frame number is used for the unique identification key frame of video; The coupling picture name is used to identify picture or the thumbnail that has the same target object with corresponding key frame; Coupling picture URL is used for obtaining the corresponding coupling picture or the thumbnail of step S205 picture by this URL; Key frame thermal region station location marker is the thermal region position in the key frame of determining among the step S204; And hyperlink is the hyperlink of the coupling picture correspondence that obtains according to corresponding relation among the step S201, by hyperlink URL obtain with key frame of video or coupling picture in the relevant content of destination object.

Step S207 carries out the hyperlink file among the S206, and the thermal region in the key frame of video in playing the S202 step inserts the thumbnail of coupling picture.

Play the video file among the step S202, and obtain current displaying video frame frame number information.For example: the current frame of video frame number that obtains is K1, and the frame of video frame number field of each bar record of hyperlink file judges whether both are identical among more current frame number K1 and the step S206.Meet by relatively judging article one record, then at the thermal region ((X11 of the key frame of key frame frame number K1 correspondence, Y11) (X12, Y12)) insert coupling picture Picture1 in, the information of this picture Picture1 obtains by the URL of coupling picture, be URL11 in this example, wherein, this picture Picture1 is related with corresponding hyperlink URL 1.Promptly click this picture Picture1 that inserts among the key frame of video K1 as the user, just can show the content that hyperlink URL 1 is pointed, for example: advertisement, music, news etc.In other embodiments, the hyperlink icon is ejected in a zone of frame of video that also can be implemented in current displaying video, and this figure can be the thumbnail of hyperlink file or the thumbnail of corresponding coupling picture.Secondly, the rectangular area that the instant heating area coordinate is specified can be determined according to the thermal region position of hyperlink file in the position of hyperlink icon.This zone can be zone, the lower right corner, also can be other zones, and the selection in this zone is a principle not influence the appreciation video mainly.If do not find corresponding record in the hyperlink file of current video frame frame number in step S206, then continue displaying video and obtain current frame number.

Consider and to show the hyperlink icon at continuous some frames.Can see and have enough time clicking with the user be principle, and the hyperlink icon is appeared on continuous some frame of video.For example, suppose that this time is 15 seconds, so, if frame per second is 30 o'clock, then from detected beginning frame number, continuous 450 frames show the hyperlink icon.Can adjust according to actual needs during this time.When in mode in thermal region position display hyperlinked picture, when successive frame shows, the thermal region of first detected frame, the associated hot zone position information of hyperlink file shows according to positional information among the read step S206.The thermal region of all the other follow-up continuous some frames needs to estimate, but reference video motion object extraction related algorithm, see list of references " based on the video motion object extraction of adaptive background estimation " author: Xie Zhiping for details, He Yan, He Guiming Wuhan University journal (2006), and list of references " towards video object segmentation and the track algorithm research of MPEG-4 " author: Gu Guanghua, University On The Mountain Of Swallows's journal (2004).In the position of continuous some frame estimating target objects, highlighted demonstration thermal region in successive frame.Do not arrive when hyperlink icon display time of showing this moment, promptly shown 13 seconds, but be less than 15 seconds, and next hyperlink icon be need show the time that at this moment, several hyperlink need be simultaneously displayed on the frame of video.Way is as follows: then with the frame of video lower right corner or other area arrangement that need show of hyperlink icon in current broadcast, such as, can be according to putting in order from left to right, it is to be shown that time is up, and the hyperlink icon no longer shows.

Step S208, when the user clicks the picture thumbnail that shows among the step S207, the corresponding hyperlink content of setting up among the step S201 can be accessed.

Click the thumbnail zone of coupling picture, corresponding hyperlink URL in the hyperlink file among the read step S206 obtains the content that hyperlink is pointed to.At this moment, open the IE browser automatically and browse the content that hyperlink is pointed to.In addition, can suspend and play former video file, also can not suspend continuous broadcast.Drag mouse, cursor moves in the video frame images scope, and when moving to the thermal region scope, this zone is highlight regions, and cursor shape changes, and represents that this zone can click.

In the specific embodiments of the invention two, the execution sequence of each step can rationally be adjusted as required, for example: the execution sequence of step S204 and step S205 also can be before step S203, equally, also can simplify above steps as required, for example: step S204 and step S205 can select to optimize one on the basis of embodiment one.

The hyperlink method of inserting in video that provides in the embodiment of the invention two is provided, consider user experience, the thumbnail of coupling picture can be presented at the thermal region in the key frame of video, not only can not influence the user and watch video, and when the user's interest destination object was arranged, its relevant advertisement or news content can be visited easily by the user.

A kind of apparatus structure schematic diagram that in video insert hyperlink of Fig. 7 for providing in the embodiment of the invention three.This device comprises receiver 100, processor 200 and transmitter 300.Receiver 100 is used to receive hyperlink, picture and video information.Processor 200 is used for: according to picture that receives and hyperlinked information, the related corresponding relation of foundation and picture and hyperlink is set up as the related mapping table of the present invention's picture shown in Figure 2 with hyperlink; According to receiving video information, the key frame in the selecting video information can pass through the Shot Detection method, and random choice method or select the frame method to choose key frame is frame by frame introduced in embodiments of the invention one in detail, repeats no more herein; By extracting the destination object in picture and the key frame of video, association has the key frame and the picture of same target object, sets up as the related mapping table of the present invention's key frame frame number shown in Figure 3 with picture; Further,, set up the related mapping table of the present invention's key frame frame number shown in Figure 4 and hyperlink, and generate the hyperlink file according to the related mapping table of aforementioned picture with hyperlink; Carry out this hyperlink file, in the key frame of playing the video file that receives, insert corresponding hyperlink, generate the hypervideo file.Processor 200 can also be realized by software fully in other embodiments of the invention.Transmitter 300 is used for playing at this hypervideo file.The user promptly may have access to the user's interest content by clicking the hyperlink of inserting in this key frame of video, for example: advertisement, music and news etc.By this technical scheme, insert the hyperlink that to point to this destination object relevant information in all types of target object that in video, represents, watch video by the user, click its interested destination object, obtain user preferences, and provide the contents such as advertisement, music and news relevant with this destination object by hyperlink.Effectively strengthened the accuracy that contents such as advertisement are thrown in, and thrown in targetedly again and improved user experience.In addition, the present invention inserts hyperlink in video, is finished automatically by processor 200, need not artificial participation, has improved efficient and the accuracy of inserting hyperlink in the video greatly.

Be illustrated in figure 8 as the concrete structure schematic diagram of processor 100 in Fig. 7 of the present invention institute generator.In embodiments of the invention four, may further include in this processor 100: hyperlink and picture associative cell 10, select frame unit 11, object matching unit 12, hyperlink file generating unit 13 and hypervideo broadcast unit 14.It is related that hyperlink and picture associative cell 10 are used for picture and the hyperlinked information that will receive, and the related corresponding relation of foundation and picture and hyperlink is set up as the related mapping table of the present invention's picture shown in Figure 2 with hyperlink; Select frame unit 11 to be used for receiver, video information, the key frame in the selecting video information can pass through lens detection method, random choice method or select the frame method to choose key frame frame by frame; Object matching unit 12 is used for from the key frame and the reception picture that select frame unit 11 receptions to choose, by extracting the destination object in picture and the key frame of video, association has the key frame and the picture of same target object, sets up as the related mapping table of the present invention's key frame frame number shown in Figure 3 with picture; Hyperlink file generating unit 13 is used for according to picture and hyperlink related mapping table and the key frame frame number of object matching unit 12 generations and the related mapping table of picture of hyperlink with 10 storages of picture associative cell, set up the related mapping table of the present invention's key frame frame number shown in Figure 4 and hyperlink, and generate the hyperlink file that comprises key frame frame number and the related mapping table of hyperlink; Hypervideo broadcast unit 14 is used for receiver, video information and hyperlink file, carries out this hyperlink file, inserts corresponding hyperlink in the key frame of playing the video file that receives, generates the hypervideo file.

Figure 9 shows that processor 200 another concrete structure schematic diagrames that Fig. 7 of the present invention provides.In the embodiment of the invention five, comprise in the processor 100: hyperlink and picture associative cell 20, select frame unit 21, object matching unit 22, hyperlink file generating unit 23, hypervideo broadcast unit 24, determine thermal region unit 25 and thumbnail generation unit 26.Wherein, corresponding unit 10,11 and 12 function are identical in hyperlink and picture associative cell 20, the function of selecting frame unit 21 and object matching unit 22 and the embodiment of the invention four, do not repeat them here.Thumbnail generation unit 26, be used to generate and store the thumbnail of hyperlink and picture associative cell 20 picture that receives, thumbnail generates and can adopt the convergent-divergent algorithm to generate, as the detailed introduction of the embodiment of the invention two step S205, this thumbnail is used for inserting in frame of video the hyperlink click picture of hyperlink.Determine that thermal region unit 25 is used to receive selected key frame of video, determine the thermal region in the key frame, can adopt the method for definite thermal region that step S204 provides in the embodiment of the invention two, the thermal region in the key frame is with the form record of coordinate.Hyperlink file generating unit 23, be used for according to picture and the hyperlink related mapping table of hyperlink with 20 storages of picture associative cell, the key frame frame number that object matching unit 12 generates and the related mapping table of picture, thumbnail information in the thumbnail generation unit 26, and key frame thermal region information in definite thermal region unit 25, set up the related mapping table of the present invention's key frame frame number shown in Figure 6 and hyperlink, and generate the hyperlink file; Wherein each bar record includes fields such as frame of video frame number, coupling picture name, coupling picture URL, key frame thermal region position and hyperlink in the related mapping table shown in Fig. 6.Introduce the effect of a field below in conjunction with instantiation: the name of the corresponding coupling of the frame of video frame number K1 of key frame picture is called Picture1, and according to the destination object difference that comprises in the frame of video, the coupling picture of frame of video frame number correspondence can also have a plurality of.The coupling picture URL be used to provide the URL address that can have access to corresponding coupling picture-storage, also can provide can have access to the corresponding thumbnail storage of match map in the URL address of thumbnail generation unit 26.The thermal region position of the corresponding key frame of this frame of video frame number K1 be ((X11, Y11), (X12, Y12)), the hyperlink URL corresponding with mating picture Picture1 is URL1.Hypervideo broadcast unit 24 is used for receiver, video information and hyperlink file, carries out this hyperlink file, inserts corresponding hyperlink in the key frame of playing the video file that receives, promptly generates the hypervideo file.For example: the current frame of video frame number that obtains is K1, and the frame of video frame number field of each bar record of more current frame number K1 and hyperlink file judges whether both are identical.Meet by relatively judging article one record, then at the thermal region ((X11 of the key frame of key frame frame number K1 correspondence, Y11), (X12, Y12)) insert coupling picture Picture1 in, the information of this picture Picture1 obtains by the URL of coupling picture, is URL11 in this example, wherein, this picture Picture1 is related with corresponding hyperlink URL 1.Promptly click this picture Picture1 that inserts among the key frame of video K1 as the user, just can show the content that hyperlink URL 1 is pointed, for example: advertisement, music, news etc.

The hypervideo broadcast unit concrete structure schematic diagram of Figure 10 for providing in the embodiment of the invention five.Hypervideo broadcast unit 24 comprises frame information relatively subelement 241 and hyperlinked picture demonstration subelement 242.Whether the frame of video frame number that frame information comparison subelement 241 is used in comparison current video frame frame number and each bar record of hyperlink file mates, if coupling is obtained the phase information in this record, as shown in Figure 6 article one record.Hyperlink icon display subelement 242 is used to obtain the key frame thermal region position of frame of video frame number correspondence, inserts the coupling the clicked picture that points to corresponding hyperlink in the thermal region position.This coupling picture can obtain from the URL address of coupling picture.

Can learn ground, realize the apparatus structure of technical solution of the present invention, the embodiment of the invention three, four, five or six concrete structures that provided are provided, the division of each functional module only illustrates, can be as required in the practical application, consider such as the configuration requirement of hardware or the facility of software practice, and the above-mentioned functions distribution is finished by different functional modules, the internal structure that is about to described processor is divided into different functional modules, to finish all or part of function described above.

One of ordinary skill in the art will appreciate that all or part of step in the foregoing description method is to instruct relevant hardware to finish by program, the program of being somebody's turn to do can be stored in the computer read/write memory medium, the storage medium that is somebody's turn to do is as ROM/RAM, magnetic disc, CD etc.

Claims (13)

1. insert the method for hyperlink in the video, it is characterized in that, comprising:
Set up the related corresponding relation of picture and hyperlink;
Key frame in the selecting video;
By described key frame of same target object association and described picture;
According to described picture and the related corresponding relation of hyperlink and the related corresponding relation of described key frame and described picture, obtain the corresponding relation of described key frame and described hyperlink, generate the hyperlink file that comprises described key frame and described hyperlink corresponding relation;
Carry out described hyperlink file, in the key frame of playing described video, insert corresponding hyperlink.
2. method according to claim 1 is characterized in that, chooses key frame, chooses key frame or by selecting the frame method to choose key frame frame by frame by randomized by the Shot Detection method.
3. method according to claim 1 is characterized in that, comprises by described key frame of same target object association and described picture:
Extract the destination object in described picture and the described key frame;
The described picture that will have the same target object is related with described key frame.
4. according to the arbitrary described method of claim 1 to 3, it is characterized in that, further comprise: behind the key frame in the selecting video, determine the thermal region position of described key frame, in generating described hyperlink file, further write down the corresponding thermal region positional information of described key frame, carry out the described hyperlink file that comprises key frame thermal region positional information, in the key frame thermal region position of playing described video, insert corresponding hyperlink.
5. according to the arbitrary described method of claim 1 to 3, it is characterized in that, further comprise, generate and store the thumbnail of described picture, further described thumbnail corresponding address information stored in record in generating the hyperlink file, carry out the described hyperlink file that comprises the thumbnail address information, obtain corresponding thumbnail, in the key frame of playing described video, insert the thumbnail that points to described hyperlink by described thumbnail address.
6. insert the device of hyperlink in the video, it is characterized in that, comprising:
Receiver is used to receive hyperlink, picture and video information;
Processor is used to set up the related corresponding relation of described picture and described hyperlink; Choose the key frame in the described video; By described key frame of same target object association and described picture; According to described picture and the related corresponding relation of hyperlink and the related corresponding relation of described key frame and described picture, obtain the corresponding relation of described key frame and described hyperlink, generate the hyperlink file that comprises described key frame and described hyperlink corresponding relation; Carry out described hyperlink file, in the key frame of playing described video, insert corresponding hyperlink;
Transmitter is used to export the video that inserts described hyperlink.
7. a processor is characterized in that, comprising:
Hyperlink and picture associative cell, it is related with hyperlinked information to be used for the picture that will receive, sets up the related corresponding relation of described picture and described hyperlink;
Select frame unit, be used for receiver, video information, the key frame in the selecting video information;
The object matching unit is used for extracting the destination object of described picture and described key frame, and association has the described key frame and the described picture of same target object;
The hyperlink file generating unit, be used for according to the related corresponding relation of described picture with the related corresponding relation of described hyperlink and described key frame and described picture, obtain the corresponding relation of described key frame and described hyperlink, generate the hyperlink file that comprises described key frame and described hyperlink corresponding relation;
The hypervideo broadcast unit is carried out described hyperlink file, inserts corresponding hyperlink in the key frame of playing described video.
8. processor according to claim 7 is characterized in that, further comprises:
Determine the thermal region unit, be used for from selecting frame unit receiver, video key frame, and determine the thermal region of described key frame.
9. processor according to claim 8 is characterized in that:
The hyperlink file generating unit also is used for generating the further corresponding thermal region positional information of the described key frame of record of hyperlink file;
The hypervideo broadcast unit also is used to carry out the described hyperlink file that comprises key frame thermal region positional information, inserts corresponding hyperlink in the key frame thermal region position of playing described video.
10. processor according to claim 7 is characterized in that, further comprises:
The thumbnail generation unit is used to generate and store the thumbnail of described picture.
11. processor according to claim 10 is characterized in that:
The hyperlink file generating unit also is used for generating the further described thumbnail corresponding address information of record storage of hyperlink file;
The hypervideo broadcast unit also is used to carry out the described hyperlink file that comprises the thumbnail address information, obtains corresponding thumbnail by described thumbnail address, inserts the thumbnail picture that points to described hyperlink in the key frame of playing described video.
12. processor according to claim 7 is characterized in that, described hypervideo broadcast unit also comprises:
Frame information is subelement relatively, is used for searching the record whether described hyperlink file has coupling according to the current video frame frame number, if exist, then obtains corresponding hyperlinked information;
Hyperlink shows subelement, is used for inserting described hyperlink at described current video.
13. insert the device of hyperlink in the video, connect to form by receiver, processor and transmitter, it is characterized in that: described processor arbitrary processor that is claim 7 to the claim 12.
CN2008102416251A 2008-12-17 2008-12-17 Method and device for inserting hyperlinks in video, and processor CN101753913B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2008102416251A CN101753913B (en) 2008-12-17 2008-12-17 Method and device for inserting hyperlinks in video, and processor

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2008102416251A CN101753913B (en) 2008-12-17 2008-12-17 Method and device for inserting hyperlinks in video, and processor

Publications (2)

Publication Number Publication Date
CN101753913A true CN101753913A (en) 2010-06-23
CN101753913B CN101753913B (en) 2012-04-25

Family

ID=42480197

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2008102416251A CN101753913B (en) 2008-12-17 2008-12-17 Method and device for inserting hyperlinks in video, and processor

Country Status (1)

Country Link
CN (1) CN101753913B (en)

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102420804A (en) * 2010-09-27 2012-04-18 中国电信股份有限公司 Client-side, user information processing module and content pushing method and system
CN102547480A (en) * 2012-01-29 2012-07-04 北京明日时尚信息技术有限公司 Implementation method for interactive video advertisement platform
CN103021432A (en) * 2011-09-22 2013-04-03 中兴通讯股份有限公司 Method and terminal for processing advertisement
CN103428539A (en) * 2012-05-15 2013-12-04 腾讯科技(深圳)有限公司 Pushed information publishing method and device
CN103442295A (en) * 2013-08-23 2013-12-11 天脉聚源(北京)传媒科技有限公司 Method and device for playing videos in image
CN103686454A (en) * 2012-09-24 2014-03-26 腾讯科技(深圳)有限公司 Information acquisition method and apparatus
CN103856832A (en) * 2012-11-29 2014-06-11 上海文广互动电视有限公司 Hypermedia making and issuing system and method
CN103856817A (en) * 2012-11-29 2014-06-11 上海文广互动电视有限公司 Interactive play method and system of hypermedia
CN103970906A (en) * 2014-05-27 2014-08-06 百度在线网络技术(北京)有限公司 Method and device for establishing video tags and method and device for displaying video contents
CN103986980A (en) * 2014-05-30 2014-08-13 中国传媒大学 Hypermedia editing and producing method and system
CN104053059A (en) * 2013-03-14 2014-09-17 英特尔公司 Audio localization techniques for visual effects
CN104182400A (en) * 2013-05-22 2014-12-03 腾讯科技(深圳)有限公司 Method and device for displaying promotion information
CN104268273A (en) * 2014-10-14 2015-01-07 北京百度网讯科技有限公司 Processing method and device for pushing information, browser and browser plug-in
CN104735552A (en) * 2013-12-23 2015-06-24 北京中传数广技术有限公司 Live video label inserting method and system
CN104751107A (en) * 2013-12-30 2015-07-01 中国移动通信集团公司 Key data determination method, device and equipment for video
WO2015127865A1 (en) * 2014-02-26 2015-09-03 Tencent Technology (Shenzhen) Company Limited Information pushing method, terminal and server
CN105260368A (en) * 2014-07-15 2016-01-20 阿里巴巴集团控股有限公司 Video data editing method and device, business object pushing method, device and system
CN106162354A (en) * 2015-04-08 2016-11-23 许怡详 Video instant scene service-Engine
CN106254925A (en) * 2016-08-01 2016-12-21 乐视控股(北京)有限公司 Destination object extracting method based on video identification, equipment and system
CN107431828A (en) * 2015-02-24 2017-12-01 拍搜有限公司 For identifying the method and system of relevant media content
WO2018028533A1 (en) * 2016-08-08 2018-02-15 腾讯科技(深圳)有限公司 Media information publishing method, terminal, server, system and storage medium
CN107995533A (en) * 2012-12-08 2018-05-04 周成 The method of the video of pop-up tracking object in video
CN107431828B (en) * 2015-02-24 2020-03-13 拍搜有限公司 Method and system for identifying related media content

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1103473C (en) * 1997-04-02 2003-03-19 国际商业机器公司 Method for integrating hyperlinks in video
CN100471255C (en) * 2006-10-25 2009-03-18 浙江大学 Method for making and playing interactive video frequency with heat spot zone

Cited By (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102420804B (en) * 2010-09-27 2016-02-24 中国电信股份有限公司 Client, information processing module of user's, content delivery method and system
CN102420804A (en) * 2010-09-27 2012-04-18 中国电信股份有限公司 Client-side, user information processing module and content pushing method and system
CN103021432B (en) * 2011-09-22 2017-06-16 南京中兴软件有限责任公司 A kind of method and terminal for processing advertisement
CN103021432A (en) * 2011-09-22 2013-04-03 中兴通讯股份有限公司 Method and terminal for processing advertisement
CN102547480A (en) * 2012-01-29 2012-07-04 北京明日时尚信息技术有限公司 Implementation method for interactive video advertisement platform
CN103428539A (en) * 2012-05-15 2013-12-04 腾讯科技(深圳)有限公司 Pushed information publishing method and device
CN103686454A (en) * 2012-09-24 2014-03-26 腾讯科技(深圳)有限公司 Information acquisition method and apparatus
CN103856832B (en) * 2012-11-29 2018-07-20 上海文广互动电视有限公司 The making of hypermedia and delivery system and method
CN103856832A (en) * 2012-11-29 2014-06-11 上海文广互动电视有限公司 Hypermedia making and issuing system and method
CN103856817A (en) * 2012-11-29 2014-06-11 上海文广互动电视有限公司 Interactive play method and system of hypermedia
CN107995533A (en) * 2012-12-08 2018-05-04 周成 The method of the video of pop-up tracking object in video
CN104053059A (en) * 2013-03-14 2014-09-17 英特尔公司 Audio localization techniques for visual effects
CN104053059B (en) * 2013-03-14 2018-10-19 英特尔公司 Audio localization method and device for visual effect
CN104182400A (en) * 2013-05-22 2014-12-03 腾讯科技(深圳)有限公司 Method and device for displaying promotion information
CN103442295A (en) * 2013-08-23 2013-12-11 天脉聚源(北京)传媒科技有限公司 Method and device for playing videos in image
CN104735552A (en) * 2013-12-23 2015-06-24 北京中传数广技术有限公司 Live video label inserting method and system
CN104751107A (en) * 2013-12-30 2015-07-01 中国移动通信集团公司 Key data determination method, device and equipment for video
CN104751107B (en) * 2013-12-30 2018-08-03 中国移动通信集团公司 A kind of Video Key data determination method, device and equipment
US10368123B2 (en) 2014-02-26 2019-07-30 Tencent Technology (Shenzhen) Company Limited Information pushing method, terminal and server
WO2015127865A1 (en) * 2014-02-26 2015-09-03 Tencent Technology (Shenzhen) Company Limited Information pushing method, terminal and server
CN103970906A (en) * 2014-05-27 2014-08-06 百度在线网络技术(北京)有限公司 Method and device for establishing video tags and method and device for displaying video contents
CN103986980B (en) * 2014-05-30 2017-06-13 中国传媒大学 A kind of hypermedia editing method and system
CN103986980A (en) * 2014-05-30 2014-08-13 中国传媒大学 Hypermedia editing and producing method and system
CN105260368B (en) * 2014-07-15 2019-03-29 阿里巴巴集团控股有限公司 A kind of editor of video data, the method for pushing of business object, device and system
CN105260368A (en) * 2014-07-15 2016-01-20 阿里巴巴集团控股有限公司 Video data editing method and device, business object pushing method, device and system
CN104268273B (en) * 2014-10-14 2018-09-04 北京百度网讯科技有限公司 Processing method, device and browser, the browser plug-in of pushed information
CN104268273A (en) * 2014-10-14 2015-01-07 北京百度网讯科技有限公司 Processing method and device for pushing information, browser and browser plug-in
CN107431828B (en) * 2015-02-24 2020-03-13 拍搜有限公司 Method and system for identifying related media content
CN107431828A (en) * 2015-02-24 2017-12-01 拍搜有限公司 For identifying the method and system of relevant media content
CN106162354A (en) * 2015-04-08 2016-11-23 许怡详 Video instant scene service-Engine
CN106254925A (en) * 2016-08-01 2016-12-21 乐视控股(北京)有限公司 Destination object extracting method based on video identification, equipment and system
WO2018028533A1 (en) * 2016-08-08 2018-02-15 腾讯科技(深圳)有限公司 Media information publishing method, terminal, server, system and storage medium
US10595071B2 (en) 2016-08-08 2020-03-17 Tencent Technology (Shenzhen) Company Limited Media information delivery method and system, terminal, server, and storage medium

Also Published As

Publication number Publication date
CN101753913B (en) 2012-04-25

Similar Documents

Publication Publication Date Title
US20190289369A1 (en) Process and apparatus for advertising component placement
US9785840B2 (en) Methods and apparatus to measure brand exposure in media streams
US9372926B2 (en) Intelligent video summaries in information access
JP6606275B2 (en) Computer-implemented method and apparatus for push distributing information
US20160027065A1 (en) Web Identity to Social Media Identity Correlation
KR101869437B1 (en) Multi-view audio and video interactive playback
US9244923B2 (en) Hypervideo browsing using links generated based on user-specified content features
JP5857450B2 (en) Information processing apparatus, information processing method, and program
CA2771379C (en) Estimating and displaying social interest in time-based media
US9118886B2 (en) Annotating general objects in video
US9047376B2 (en) Augmenting video with facial recognition
US8160299B2 (en) Image processing apparatus
CN103210651B (en) Method and system for video summary
US8380039B2 (en) Method for aligning different photo streams
US8805165B2 (en) Aligning and summarizing different photo streams
TWI521456B (en) Video content-aware advertisement placement
US9252897B2 (en) Multi-feed event viewing
US9930311B2 (en) System and method for annotating a video with advertising information
Fu et al. Multi-view video summarization
AU2006314066B2 (en) Method and system for producing a video synopsis
CN103024464B (en) System and method with video-frequency playing content relevant information is provided
AU2008296144C1 (en) Delayed advertisement insertion in videos
US10410679B2 (en) Producing video bits for space time video summary
CN100511208C (en) System and method for providing a multimedia contents service based on user's preferences
US20170201793A1 (en) TV Content Segmentation, Categorization and Identification and Time-Aligned Applications

Legal Events

Date Code Title Description
PB01 Publication
C06 Publication
SE01 Entry into force of request for substantive examination
C10 Entry into substantive examination
GR01 Patent grant
C14 Grant of patent or utility model