CN106162354A - Video instant scene service-Engine - Google Patents

Video instant scene service-Engine Download PDF

Info

Publication number
CN106162354A
CN106162354A CN201510161599.1A CN201510161599A CN106162354A CN 106162354 A CN106162354 A CN 106162354A CN 201510161599 A CN201510161599 A CN 201510161599A CN 106162354 A CN106162354 A CN 106162354A
Authority
CN
China
Prior art keywords
video
eigenvalue
picture
client
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510161599.1A
Other languages
Chinese (zh)
Inventor
宋松
许怡详
肖雄辉
张岳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201510161599.1A priority Critical patent/CN106162354A/en
Publication of CN106162354A publication Critical patent/CN106162354A/en
Pending legal-status Critical Current

Links

Abstract

The present invention " video instant scene service-Engine ", it is provided that a kind of video corresponding technology and based on the Video Applications system constructed by this technology.User is watching live video program or during order video program, and this application system all can detect that in current picture the object with related information, and it is presented in a particular manner and operate further for user, thus provides more rich ground Video service.When present invention comprises in program making and use, obtain " eigenvalue " of video pictures and set according to this " eigenvalue " or obtain and present the system and method for related information.

Description

Video instant scene service-Engine
Technical field
Present invention relates in general to a kind of based on the Video Applications system constructed by video corresponding technology System and method, particularly the present invention relates to arrange related information in a kind of video frequency program and seeing When seeing video frequency program, the object extremely related information in current video with related information is carried out The system and method presented and use.
Background technology
In Video Applications in early days, user simply watches the video frequency program of broadcasting passively, as Viewing movie or television.The appearance of videocorder makes user be possible not only to the video frequency program watched Selected, it is also possible to video frequency program is carried out shirtsleeve operation such as F.F., playback, frozen frame. The development of digital video technology makes the digitized audio frequency and video of encoded compression can be with more Data send terminal use together to, so that digital audio/video can be with connected applications data Present to terminal use in new ways.Such as we are frequently seen when using Set Top Box EPG (electronic program guides) or homepage entrance are all that digital video is combined with application data Embody.User and video frequency program is made to have possessed the basis of interaction.
Existing video interactive pattern is as elementary cell with a programming events (event), This time quantum is organized in advance relevant data or application interact work with user Dynamic.Such as watching a film when, the whole time span of this film is a list Unit.Business development business or service provider can provide the introduction of film, and performer introduces, the flower of film The information on services such as wadding, can obtain these by certain triggering mode when user is interested when Information.This interactive mode needs user together with programming events has been associated in related data Will when fixing info class service is provided.But due to the granule with Pgmtime as unit Spending big, much demand based on programme content granularity cannot realize.But user is in viewing When one film or a real time programme, it is more likely that wish to enter with the content the most watched Row is interactive or understands more information at that time.Such as user is watching certain film when, right The beautiful shooting ground that closes of film creates suddenly keen interest, therefore it is highly desirable to know film shooting ground At which, there is kind of a hope for tourism.This interest body being caused user interaction by current program content Having showed the real demand of user, the service provided based on this real demand its is possible to be converted into Valuable service.The service being simultaneously associated from content be also according to different customer demands or Scene needs to be updated dynamically and change.But the association service with program as unit at present The content that user is seeing cannot be known accurately, the most just have no way of solving real time programme content and be correlated with The business demand of connection service.
Along with improving constantly of user's request, the application of simple video interactive can not meet end The requirements at the higher level of end subscriber.In the playing process of a video, user can find to feel emerging at any time The content of interest, and existing application model cannot know that user the most just cannot be in the content of viewing This moment and user produce alternately.User often needs the more letter of video content in this moment Breath or hope have to time interactive interrupt viewing, and application or instrument with other obtain information. The most largely intercept the interest that user is potential, much real-time based on video context Scene and interaction all cannot realize.In real-time/interactivity and the relatedness of video itself The most cannot meet higher demand.
For the problems referred to above and user's request, the invention provides a kind of video corresponding technology and Based on the Video Applications system constructed by this technology.No matter user is at viewing live television programming Or during order video program, this application system all can automatically identify in current picture has association The object of information, and it is presented in a particular manner operate further for user, thus More preferable Video service is provided.
Summary of the invention
In order to make it easy to understand, first below some terms that the present invention relates to are explained.
In the present invention, what is called " object " refers to user any portion of interest in video pictures Point or a combination thereof, such as the clothing of personage, vehicle, garden, or personage, ornaments etc..
Video corresponding technology provided by the present invention and based on the video constructed by this technology should Make user whether when watching live television programming or order video program by system, currently The object in picture with related information can be detected automatically by system, simultaneously with specifically Mode presents and operates further for user, thus provides preferably Video service.
Special object in video frequency program is carried out the system and method for information association.The present invention is led to Cross and real-time or non real-time the video pictures from video program source is analyzed frame by frame, Cong Zhongti Take default special object and be associated being stored in " object database " by itself and customizing messages, And the relevant information i.e. eigenvalue of this picture of this frame picture is stored in " characteristic value data storehouse ", It is stored in " object attribute data storehouse " by being used for this object information at client presentation mode simultaneously.
Specifically, the invention provides one for extracting special object also from video pictures By the related information corresponding to this object and present information and the feature of place frame of video (picture) Value is stored in the method for the system of associated databases respectively.
Determine the object specifically in watched video frequency program with related information.The present invention passes through Extract video player current video picture eigenvalue and by its with data base in or server On the program characteristic information that prestores compare, so that it is determined that current picture has related information Special object.
In programme televised live, due to programme arrangement and the complex operations of broadcast system so that client End player is difficult to obtain the accurate feature information of current picture, thus is determined in video pictures The related information of object brings difficulty.The present invention is all live by monitoring in real time at server end " property data base " is revised by channel in real time, thus ensure that and determine affiliated partner Accurately and reliably.
Present invention also offers and a kind of the special object in video frequency program with related information is added With the system and method presented, the object with link is shown with directly perceived, vivid form The most not affect the viewing of the attractive in appearance of picture and user, thus both facilitated user's Operation turn avoid and viewing video is caused excessive interference.
Accompanying drawing explanation
Accompanying drawing referenced in this specification is served only for the exemplary embodiments of the example present invention, Should not be considered as limiting the scope of the present invention.
Fig. 1 shows the operation chart according to one embodiment of the present of invention.
Fig. 2 shows the system block diagram according to one embodiment of the present of invention.
Fig. 3 shows the system block diagram according to an alternative embodiment of the invention.
Fig. 4 shows the flow chart in the present invention being modified programme televised live eigenvalue.
Fig. 5 shows in the present invention used " characteristic value data storehouse ", " object database " and " right As attribute database " manufacturing process.
Fig. 6 shows the example being presented the special object with related information, that is to The process that the object of related information is suitably marked.
Detailed description of the invention
In discussion below, it is provided that a large amount of concrete details are to help thoroughly to understand the present invention. It will be apparent, however, that to those skilled in the art, even if there is no these details, Have no effect on the understanding of the present invention.And it should be appreciated that use following any tool Body term is only used to conveniently describe, and therefore, the present invention should not necessarily be limited to be only used in In any application-specific that such term identified and/or implied.
Fig. 1 shows the operation chart according to one embodiment of the present of invention.User is using During video player provided by the present invention viewing video frequency program (step 101), at a certain picture Make player enter halted state (step 102) during face, now can select the most further Select required picture (step 103).The eigenvalue of selected picture is extracted (step by system 104) residing for the marks such as, this feature value includes but not limited to programm name, channel and this picture Time, frame number etc..Then the information prestored in this feature value and data base is compared by system, Therefrom extract the information (step 105) of the object with link corresponding to this picture.As Fruit does not retrieves corresponding object in data base, and system will be prompted to corresponding information (step 106), And providing user select other picture or continue viewing video, system also can be automatically into step Rapid 103, select other picture near current picture.In step 105, if system is examined Rope goes out one or more object, will be obtained the genus of these objects by step 107 from data base Property extremely link information, and according to the attribute of current picture and the attribute of object, object is fitted When mark (step 108).To again be shown (step with the picture of mark object simultaneously Rapid 109) operate (step 110) further for user.
Especially, according to the situations such as client and the performance of network, cost, step 105 and step Rapid 107 can select to realize in client, also may select and realize at server end.According to difference Implementation, corresponding use different data bases to select and update mechanism and strategy (step 111,112,113) to improve the performance of system and to reduce corresponding expense.Further, root According to different application demands and systematic function, eigenvalue also may specify the given zone in picture Territory, such as " upper left corner ", is positioned at a certain coordinate and specifies the geometric areas etc. of size.
Be only the artificial operating procedure selecting picture described by above example, in fact for Different application scenarios and systematic function, as another embodiment of the present invention, can also be to reality Time video pictures automatically carried out feature extraction and object marking by system and without video pause (step 102).
Fig. 2 shows the system block diagram according to one embodiment of the present of invention.In this embodiment In, the major function of system all realizes in client.Wherein 201 for run on client " depending on Frequently player ", or system manual by " frame selector " 202 users automatically selects need to be to be processed Video pictures." characteristics extraction unit " 203 for the eigenvalue of current picture is included but Being not limited to programm name, channel etc. identifies and time, frame number etc. residing for this picture extracts. The eigenvalue extracted is by " object matching unit " 204 and " characteristic value data storehouse " 205 In data compare, thus find the object with link information that this picture comprised. And from " object database " 206, obtain the link information corresponding to this object maybe can perform generation Code.Data in " characteristic value data storehouse " 205 and " object database " 206 are according to specifically By " characteristic value data storehouse updating block " 207 during strategy such as timing or channel switch or program transition And " object database updating block " 208 synchronizes from server or updates.By " object Matching unit " 204 objects with link information obtained, by " object marking unit " 209 are labeled.The mode of mark has two kinds, and one is by " notation methods selection unit " 210 are labeled according to the mode that predefined is good, as added shade, highlight, add square frame etc.. Another kind is to be obtained current picture from " frame selector " 202 by " image acquisition units " 211 The image in face and by " image analyzing unit " 212 according to the feature such as brightness, tone of this image Deng and object attribute such as size, shape, position, type etc. select be suitable for notation methods. The object marked is carried out by " object display unit " 213 showing and pass through " to use on the client Family response unit " 214 do further operation for users.
Fig. 3 shows the system block diagram according to an alternative embodiment of the invention.This embodiment with Partial function is transferred to server end in fact by client by differring primarily in that of a upper embodiment Now to reduce the requirement of client performance and taking of resource.
In this embodiment, the major function of system realizes at client and server end respectively. Wherein 301 is " video player " running on client, by " frame selector " 302 users Manual or system automatically selects and needs video pictures to be processed." characteristics extraction unit " 303 For the eigenvalue of current picture is included but not limited to programm name, channel etc. identifies and should Residing for picture, time, frame number etc. extract.The eigenvalue extracted is by " eigenvalue is sent out Send unit " 304 it is sent to " the eigenvalue reception unit " 305 of server end." object matching Unit " 306 compare with the data in " characteristic value data storehouse " 307, thus find this What picture was comprised has the object of link information.And obtain from " object database " 308 Link information corresponding to this object or executable code.Obtained by " object matching unit " 306 The object with link information taken, by " object marking unit " 309 according to " object belongs to Property data base " mode that 310 predefineds are good is labeled, as added shade, highlights, the side of adding Frame etc..The object marked and the link information of correspondence thereof are or/and perform code by " number of objects According to transmitting element " 311 " the object data reception unit " 312 being sent in client and by " object display unit " 313 carries out showing and pass through " user's response unit " 314 for user Do operation further.
In programme televised live, due to programme arrangement and the complex operations of broadcast system so that client End player is difficult to obtain the accurate feature information of current picture, thus is determined in video pictures The related information of object brings difficulty.For this situation, in " characteristic value data storehouse " 307 Data need revised in real time by " programme televised live eigenvalue amending unit " 315, thus Ensure that and determine that affiliated partner is accurately and reliably.
Fig. 4 shows the flow chart being modified programme televised live eigenvalue.Select to wait to revise After direct broadcast band (401), gather image sequence (402) and/or a section audio of this channel (403).The audio frequency and video collected are carried out with audio frequency and video in the program database (406) prestored Contrast (404), (405), the programme content mated according to " prestore program database " (406) And gather audio frequency and video moment " characteristic value data storehouse " can be revised accordingly.
Can carry out one by one also can carrying out by real-time synchronization for all direct broadcast band above procedure.This This process outer can realize also can realizing in client at server end.
" characteristic value data storehouse ", " object database " used in the present invention and " object genus Property data base " be for broadcast or stock's programme content make in advance, its manufacturing process as figure Shown in 5.First select a certain two field picture (step 502) of video frequency program, pass through image procossing In object extraction technology or obtained a certain object (step 503) by manual guidance of operator, Existing object it is referred in " object database " 505 (if any) when obtaining object Definition, or one brand-new object of new definition.If image does not has object in need, select Next frame image continues with, until finding useful object.Or take the association of this object then Information and markup information (step 504) are also respectively written into " object database " 505 and " right As attribute database " 506, acquisition process can be to manually enter, also can be by Internal retrieval Or image is further analysed or excavates.Carry out the eigenvalue of this picture being stored in " spy simultaneously Value indicative data base " 508 (steps 507), this feature value includes but not limited to programm name, frequently Time, frame number etc. residing for the mark such as road and this picture.Above procedure may be repeated until complete Portion's Video processing is complete.
Fig. 6 shows the example being presented the special object with related information, that is right The process suitably marked with the object of related information.To there is the object of link with directly See, the form of image does not the most affect the attractive in appearance of picture while of showing, thus both facilitates The operation of user is avoided again viewing video is caused excessive interference, and this needs the picture to be marked Carry out the image analysis algorithms of complexity.Certainly will be to client if being undertaken this work by client The performance of end and resource produce the highest requirement, if picture is passed to server process, need Consume more network traffics and transmission time.In of the present invention is embodied as, use Pictorial feature value (step 601) " the eigenvalue number by server end is provided by client According to storehouse " 603 determine that what picture to be marked extremely comprised has the right of link information As (step 602).Then from " image data base " 605 or other network services (606) Obtain picture (step 604) to be marked and obtain from " object attribute data storehouse " 608 The mark attribute of this object such as shape, color, position etc., also the most specific figure, profile Deng (step 607).Picture and the mark property calculation of object finally according to image to be marked Go out suitable notation methods and desired data (step 609) and send back client and be labeled (step 610).

Claims (10)

1. a video associated application system, obtains more information i.e. by specific " object " in video pictures or performs the application system of particular code.Wherein said " object " refers to user's any part of interest or a combination thereof in video pictures, such as the dress ornament etc. of personage, vehicle, garden, or personage.
2. a system described in claim 1, extracts specific " object " the device being associated with out of Memory or particular code from video frequency program to be broadcasted.Its object extracted comprises:
● the access information such as channel of object place picture, filename, URL (uniform resource locator) etc., moment residing for picture or frame number or its scope, and some specific region of picture, it is referred to as " eigenvalue ", is stored in " characteristic value data storehouse ";
● the physical attribute of object such as size, position, shape, profile etc. are referred to as " object properties ", are stored in " object attribute data storehouse ";
● access information such as URL or the executable code etc. of information associated by object, it is stored in " object database ".
3. a system described in claim 1, extracts " eigenvalue " of picture and searches the device of specific " object " with related information according to " eigenvalue " of picture and include when watching video:
● " eigenvalue " of current picture is extracted in client;
● search the attribute of " object " and related information thereof or executable code according to " eigenvalue " extracted at client server.
4. a system described in claim 1, the device at server end, " eigenvalue " of picture revised in real time for programme televised live.By at server end the sound of direct broadcast band, video being carried out Real-time Collection and comparing with the sound prestored, video thus obtain the correction of " eigenvalue ".
5. a system described in claim 1, carries out the system presented by " object " the extremely related information in current video with related information.Including:
● obtained " eigenvalue " of video pictures by client and send it to server;
● searched corresponding picture image and the object extremely attribute that comprised the object presentation mode that by object properties and graphical analysis determined applicable client according to " eigenvalue " obtained at server end by server;
● the object presentation mode determined by server sends back client and is presented " object " by client.
6. a video correlating method, obtains more information or the method performing particular code i.e. by specific " object " in video pictures, comprises the following steps:
● from video frequency program to be broadcasted, extract specific " object " and be associated with out of Memory or particular code.
● extract " eigenvalue " of picture when watching video and search specific " object " with related information according to " eigenvalue " of picture.
● " eigenvalue " of picture is revised in real time at server end for programme televised live.
● present video pictures has " object " extremely related information of related information with the form matched with picture.
Method the most according to claim 6, the object extracted comprises:
● the access information such as channel of " eigenvalue ", i.e. object place picture, filename, URL (uniform resource locator) etc., some specific region of moment residing for picture or frame number or its scope and picture;
● " object properties ", the physical attribute of object such as size, position, shape, profile etc.;
● " related information ", access information such as URL or the executable code etc. of information associated by object.
● information above is stored in " characteristic value data storehouse " respectively, in " object attribute data storehouse " and " object database ".
Method the most according to claim 6, searches in video pictures the step of specific " object " with related information:
● obtain " eigenvalue " of picture;
● according to " eigenvalue " obtained client from keep with server Tong Bus " characteristic value data storehouse " lookup specific " object " or,
● by client, eigenvalue is issued server and in " the characteristic value data storehouse " of server end, searched specific " object " by server.
Method the most according to claim 6, the method revised in real time at " eigenvalue " that client is obtained by server end for programme televised live:
● at server end, sound, the video of all direct broadcast bands are carried out Real-time Collection;
● compare with the sound prestored on the server, video;
● obtain and have been played out the exact time of each frame picture in program, thus obtain the correction of " eigenvalue ".
Method the most according to claim 6, carries out the step presented by " object " the extremely related information in current video with related information.Including:
● obtained " eigenvalue " of video pictures by client and send it to server;
● searched corresponding picture image and the object extremely attribute that comprised the object presentation mode that by object properties and graphical analysis determined applicable client according to " eigenvalue " obtained at server end by server;
● the object presentation mode determined by server sends back client and is presented " object " by client.
CN201510161599.1A 2015-04-08 2015-04-08 Video instant scene service-Engine Pending CN106162354A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510161599.1A CN106162354A (en) 2015-04-08 2015-04-08 Video instant scene service-Engine

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510161599.1A CN106162354A (en) 2015-04-08 2015-04-08 Video instant scene service-Engine

Publications (1)

Publication Number Publication Date
CN106162354A true CN106162354A (en) 2016-11-23

Family

ID=57338196

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510161599.1A Pending CN106162354A (en) 2015-04-08 2015-04-08 Video instant scene service-Engine

Country Status (1)

Country Link
CN (1) CN106162354A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108260016A (en) * 2018-03-13 2018-07-06 北京小米移动软件有限公司 Processing method, device, equipment, system and storage medium is broadcast live
CN110557675A (en) * 2018-05-30 2019-12-10 北京视连通科技有限公司 Method for analyzing, labeling and time base correcting video program content
WO2022096017A1 (en) * 2020-11-09 2022-05-12 北京达佳互联信息技术有限公司 Content display method and apparatus
WO2023060763A1 (en) * 2021-10-11 2023-04-20 深圳创维-Rgb电子有限公司 Television video searching method, television and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20020083887A (en) * 2001-04-26 2002-11-04 (주)엔써커뮤니티 Method for communicating audio and video data in multimedia communication system using h.323 protocol
CN101288069A (en) * 2005-10-14 2008-10-15 微软公司 Clickable video hyperlink
CN101753913A (en) * 2008-12-17 2010-06-23 华为技术有限公司 Method and device for inserting hyperlinks in video, and processor
CN103747368A (en) * 2013-01-25 2014-04-23 周良文 System and method for embedding network instant communication in video program
CN104065979A (en) * 2013-03-22 2014-09-24 北京中传数广技术有限公司 Method for dynamically displaying information related with video content and system thereof

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20020083887A (en) * 2001-04-26 2002-11-04 (주)엔써커뮤니티 Method for communicating audio and video data in multimedia communication system using h.323 protocol
CN101288069A (en) * 2005-10-14 2008-10-15 微软公司 Clickable video hyperlink
CN101753913A (en) * 2008-12-17 2010-06-23 华为技术有限公司 Method and device for inserting hyperlinks in video, and processor
CN103747368A (en) * 2013-01-25 2014-04-23 周良文 System and method for embedding network instant communication in video program
CN104065979A (en) * 2013-03-22 2014-09-24 北京中传数广技术有限公司 Method for dynamically displaying information related with video content and system thereof

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108260016A (en) * 2018-03-13 2018-07-06 北京小米移动软件有限公司 Processing method, device, equipment, system and storage medium is broadcast live
CN110557675A (en) * 2018-05-30 2019-12-10 北京视连通科技有限公司 Method for analyzing, labeling and time base correcting video program content
WO2022096017A1 (en) * 2020-11-09 2022-05-12 北京达佳互联信息技术有限公司 Content display method and apparatus
WO2023060763A1 (en) * 2021-10-11 2023-04-20 深圳创维-Rgb电子有限公司 Television video searching method, television and storage medium

Similar Documents

Publication Publication Date Title
US20200221163A9 (en) Method for receiving enhanced service and display apparatus thereof
CA2806842C (en) Transmission apparatus and method, reception apparatus and method and transmission and reception system
CN104509120B (en) It delivers in the broadband of customized information for advanced television service
KR100837580B1 (en) Transmission method and receiver
CN105992041A (en) Method and device for encoding a captured screenshot and controlling program content switching based on the captured screenshot
CN106162354A (en) Video instant scene service-Engine
KR20150003720A (en) Method, computer program, and reception apparatus for delivery of supplemental content
CN103975602A (en) Broadcast service receiving method and broadcast service receiving apparatus
CN107147959A (en) A kind of INVENTIONBroadcast video editing acquisition methods and system
KR101599465B1 (en) Server and method for providing synchronization information client apparatus and method for synchronizing additional information with broadcast program
KR20000058241A (en) Apparatus for editing moving images and method for providing fashion information employing the same
CN105103566A (en) Systems and methods for identifying video segments for displaying contextually relevant content
US9489421B2 (en) Transmission apparatus, information processing method, program, reception apparatus, and application-coordinated system
KR20130123750A (en) System and method for providing video service based on image data
MX2014012110A (en) Accelerating advertising decision resolution.
JP2016005015A (en) Content delivery system and content delivery device
US20090096925A1 (en) Method for providing additional information of digital broadcasting application
JP2013016030A (en) Program reproduction apparatus and program reproduction method
US20230334082A1 (en) System and method for providing additional information based on multimedia content being viewed
CN104429092B (en) Reception device handles the method for information, program, sending device and applies linked system
CN102625180A (en) Television apparatus and method for searching subtitles of television program
JP2010034675A (en) Program analyzing device, program analyzing method and program analyzing program
WO2018095161A1 (en) Method and system for acquiring digital television program scene information
KR20020093976A (en) Device and method for synchronizing broadcast audio-visual programmes and complementary data
US20150156560A1 (en) Apparatus for transmitting augmented broadcast metadata, user terminal, method for transmitting augmented broadcast metadata, and reproducing augmented broadcast metadata

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20161123