CN103247063A - Technology system for embedding of film and image information - Google Patents
Technology system for embedding of film and image information Download PDFInfo
- Publication number
- CN103247063A CN103247063A CN2012100316594A CN201210031659A CN103247063A CN 103247063 A CN103247063 A CN 103247063A CN 2012100316594 A CN2012100316594 A CN 2012100316594A CN 201210031659 A CN201210031659 A CN 201210031659A CN 103247063 A CN103247063 A CN 103247063A
- Authority
- CN
- China
- Prior art keywords
- film
- image
- label
- information
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention discloses a technology system for embedding of film and image information. In the daily life, people are always curious about the relevant information emerging in film or image contents, and the curiosities, about a few specific objects in the film/the image, of people cannot be satisfied in the prior art. Through the technology system, the information relevant to the specific objects in the film/image contents can be embedded in an interactive manner, so when people move mouse cursors on the interested objects, all the relevant information and auxiliary functions emerge and users can click freely to obtain more relevant information.
Description
Technical field
The invention provides a kind of film and image information and embed science technology system, refer to especially a kind of with interactively mode will be relevant with special object in film/picture material information embed, can allow the user freely click embedded system with the more heterogeneous pass of acquisition information.
Background technology
In daily life, people always can appear at the relevant information in film or the picture material and feel curious many, but existing science and technology can't allow people further understand the relevant information of special object in film/image.For instance, when viewing and admiring drama programs, may what brand people want to know that being through man, leading lady clothes, trousers, shoes or even ornaments on one's body on one's body is? to where buy? in addition, may people wonder also the delicacies of demonstrating at program in that road is of what special pan to make when watching cook-in? what are the flavoring that the cook uses, food materials? can where buy?
Regrettably, present science and technology but can't satisfy people to the curiosity of special object in film/image.The relevant information of special object also can't be obtained by people easily, can only see through passive type search, retrieve, try to find out to obtain.
See through the present invention, will embed wherein with the relevant information of special object in film/picture material, and allow to click extremely outside the binding.So when the user when watching film/image, as long as cursor is moved on on the special object that they are interested in, all information relevant for this object just can occur and can be for clicking to obtain more information.See through so interactive science and technology, the user can come to obtain more information in the mode of more convenient, simple and intuition from film/image.
In the past, all external informations relevant with film/picture material all can't directly be obtained.So, when the user to the certain content in some film/images, when special object is felt interest, they must see through mode indirect, passive, that separate (for example: Search engine) obtain these information.
At present, embed some relevant external informations [1] though some application program has had in image, some inborn restrictions are arranged: (a) these outside information all embed in advance, lack flexibility; And (b) do not extend to the application of film.
As for film, present existing embedded technology only has captions to embed or message embeds [2], and all lacks and user's interactive (for example: these external informations all can't be made a response according to user's interest and special attention).
[1]?Nick?Bilton,?“A?Peek?at?an?Interactive?Magazine?for?the?Apple?iPad”,?The?New?York?Times?(March?18,?2010)。
[2]?S.?Kenvin,?et?al.,?“Method?and?System?for?Annotative?Multimedia,”?US?2010/0095211。
Summary of the invention
So the present inventor is because above-mentioned disappearance is to collect related data, via assessing in many ways and considering, and to engage in the many years of experience of the industry accumulation, information that will be relevant with special object in film/picture material embeds wherein, and allows to click extremely outside the binding.So when the user when watching film/image, as long as cursor is moved on on the special object that they are interested in, all information relevant for this object just can occur and can be for clicking to obtain more information.See through so interactive science and technology, the user can come to obtain more information in the mode of more convenient, simple and intuition from image/film.
Description of drawings
Fig. 1 is the piecemeal block diagram of framework of the present invention (the horizontal line striped represent label generation person-user model, perpendicular line striped representative of consumer center mode, crossbanding represents the two kinds of patterns of using simultaneously).
Fig. 2 is the playing flow figure of the film/image of embedding external information.
Fig. 3 is the realization flow figure of embodiment 1.
Fig. 4 is the realization flow figure of embodiment 2.
The figure number explanation:
Client ... 110
Server end ... 120
Client-server interactive operation interface module ... 121
Film/image data base ... 122
The label database ... 123
Film/analysis of image content module ... 124
Film/image-external information relationship analysis module ... 125
The external information search engine ... 126
Client-server interactive operation interface module ... 111
Film/analysis of image content module ... 112
Label embeds engine ... 113
Original film/image data base ... 114
The label information database ... 115
The user interface module ... 116.
Embodiment
The invention provides brand-new interaction mode of user and obtain or embed associated external information about specific objective thing in film/picture material.The present invention can be used for advertisement and implants, and interactive external information such as provides at application.In the present invention, we show the form of all external informations that embed with label, and with it called after " label ".
The present invention mainly comprises two parts: client 110 and server end 120.Server end comprises client-server interactive operation interface module 121, film/image data base 122, label database 123, film/analysis of image content module 124, film/image-external information relationship analysis module 125, and external information search engine 126.Client then comprises client-server interactive operation interface module 111, film/analysis of image content module 112, and label embeds engine 113, original film/image data base 114, label information database 115, and user interface module 116.
At server end, client-server interactive operation interface module is used for providing the reciprocation between client and the server two ends, can finish to comprise that archives are uploaded/downloaded, user data is verified, the user logins operation, operational order transmission and other certain operations etc.Film/view data library storage film/view data, and the label database storage label archives that are produced out, these label archives have comprised the external information relevant with film/picture material.Generally speaking, each film/image has the label archives of a correspondence in the label database.The film of server end/analysis of image content module will accept to come from the operational order of client from client-server interactive operation interface module.When this module is triggered by operational order, it will cut apart, follow the trail of, reach actions such as identification to user's selected object in film/image.In addition, the external information search engine can be obtained information from film/analysis of image content module, and from the operational order of client-server interactive operation interface module acceptance from client.When this module is triggered by the client operation instruction, it will obtain object analysis result information from film/analysis of image content module, and retrieve the external information relevant with object from open Search engine, label database or other database.In addition, film/image-external information relationship analysis module then is to accept data from following three other modules, is respectively: external information search engine, film/analysis of image content module and client-server interactive operation interface module.After this module receives operational order from client-server interactive operation interface module, it will be further from the analysis result information of film/analysis of image content module reception about object, simultaneously from the external retrieval object information of external information search engine reception about object; After receiving these information, this module will generate the label information that the object in film/image with client instruction appointment is associated.The label information that generates will utilize client-server interactive operation interface module to be delivered to client.Simultaneously, this label information also will save as label archives and be stored in the label database of server end.
In addition in client, client-server interactive operation interface module is used for providing the reciprocation between client and the server two ends equally, can finish to comprise that archives are uploaded/downloaded, user profile is verified, the user logins operation, operational order transmission and some other operational motion etc.The user interface module be used for providing and user or label generation person between reciprocation, carry out film/image uploading, label information interpolation, set up film/image of embedding external information, play film/image of embedding external information, obtain user's interest object or object information and some other operation etc.Original film/the image data base of client has stored original film/image file data.In addition, new film/image file also can be from the film/image data base of server end, or the user adds in original film/image data base by the user interface module.The label information database has stored all available external informations that may be used to produce label.Same, new external information also can be added to the label information database by the user interface module from label database or the user of server end.The film of client/analysis of image content module receives operational order by the user interface module from user or label generation person aspect.When this module is triggered by operational order, it will cut apart, follow the trail of and action such as identification user's selected object in film/image.In addition, label embeds engine and receives information from following three modules, is respectively: film/analysis of image content module, label information database and user interface module.When this engine was triggered, it was at first from the label information database or directly obtain label information by the user interface module here from label generation person.Simultaneously, the object relevant information that this engine also can receiving and analyzing goes out from film/analysis of image content module.Henceforth, label embeds engine and will produce the object external information label relevant with the object of user's appointment.The label information that generates will be saved as archives and be stored in the label information database of client, in the label database of the end of perhaps uploading onto the server.
In addition, original film/image and its corresponding label news file have been formed a film/elementary area that embeds external information.Generally speaking, the film/elementary area of each embedding external information has comprised an original film/image file and label archives.Yet the film/elementary area that is not each embedding external information can only comprise an original film/image file and label archives, also can be the situation of an original film/image file and a plurality of label archives.Film/the elementary area that embeds external information can play to realize interactive external information Presentation Function by the user interface module.The label message file has comprised the position of object in film/image, area size, and all external informations relevant with object etc.When film/image was play, the player in the user interface module also carried out real-time analysis (for example: the example of user's operational circumstances is the position of user's cursor in film) according to user's operational circumstances to the label news file simultaneously.When user's moving cursor is specified in the object scope contain external information to some by the label archives, will be ejected automatically corresponding to the external information label of this object.Otherwise, do not have the external information label and eject, film/image is just as playing usually.
In the part below, we will specifically describe two specific embodiments (or two kinds of operational modes) about our invention framework, i.e. label producer-user model (embodiment 1) and customer center pattern (embodiment 2).
At embodiment 1(label producer-user model) in, in client, label producer (these labels producer comprises advertiser, brand company etc.) at first selects to select suitable film/image from original film/image data base or film/image of oneself uploading in addition.Then, the label producer will select them to want to embed the suitable object (the object example of these selections comprises clothes, object etc.) of external information from this film/image by the user interface module.Then, the user interface module will trigger film/analysis of image content module to the object of selecting cut apart automatically, operation such as tracking.Simultaneously, label generation person can or retrieve suitable methods such as label by direct input object associated external label information and obtain object label information from the label information database.Then, the user interface module will trigger label embedding engine label information will be embedded in film/image, and generate independently label archives.After the label archives generate, these archives and corresponding film/image file thereof will be uploaded to server end by client-server interactive operation interface module.
At server end, server receives film/image file and label archives from client-server interactive operation interface module.Simultaneously, they are saved in respectively in the film/image data base and label database of server end.
Film/image-watching person (being the user) is equally also watched film/image by the another one client.Film/image-watching person at first selects their interested film/image file by the user interface module.The user interface module is further directly obtained film/image and corresponding label archives thereof by client-server interactive operation interface module from the film/image data base of server end and label database.Obtained after these archives, just play in client.When playing, when the user moved to cursor in film/image their interested object, the corresponding label information that has embedded will be triggered from the label file and be ejected.See through such mode, all external informations relevant with object will be displayed in the label after the ejection confession and browse, click and provide the user to do further interaction.
In embodiment 2(customer center pattern) in, in client, film/image-watching person (being the user) is at first selected their interested film/image by the user interface module.At this moment, the user interface module will directly obtain this film/image and in client terminal playing from the film/image data base of server end.When user's moving cursor to or when selecting their interested object, the film of server end/analysis of image content module will be triggered and identification will be cut apart, follows the trail of, reached to selected object automatically.The output of film/analysis of image content module be object in film/image the position and object carried out information after the identification.After this step, the object information that picks out will be imported in the external information search engine, and this engine will utilize public's Search engine, label database or extra database to retrieve external information.The output of external information search engine will be the relevant external information of object that the user selectes.At last, the object external information that these retrieve and the object self-information that picks out all will be imported into film/image-external information relationship analysis module, this module will be analyzed the relation between external information and the object self-information, and generate the label that is fit to user's selected target thing.The label that produces will eject on the limit of user's selected target thing in film.Simultaneously, the label information of generation also can be saved in the label archives and deposit in the label database of server end.It should be noted that to generate label in advance different with embodiment 1 label generation person, among the embodiment 2, label information is dynamically to generate in real time.
The piecemeal block diagram of framework of the present invention will show in Fig. 1.The playing flow figure that embeds the film/image of external information will show in Fig. 2.The realization flow figure of embodiment 1 and embodiment 2 will show in Fig. 3 and Fig. 4 respectively.
Claims (10)
1. the interactive film/image information that embeds external information in film/picture material embeds science technology system, and this system comprises:
A server end comprises:
A client-server interactive operation interface module is used for and the client interaction;
A film/image data base is used for storing film/view data;
A label database is used for storing object associated external information;
Film/analysis of image content module is used for cutting apart, the specific objective thing of tracking, identification film/image;
An external information search engine is used for retrieving external information from public Search engine, label database or excessive data storehouse;
A film/image-external information relationship analysis module is used for the label of generation film/image specific objective thing in real time; And
A client comprises:
A client-server interactive operation interface module is used for and the server end interaction;
A user interface module is used for and user/label generation person interaction;
An original film/image data base is used for storing film/view data;
A label information database is used for storing the external information relevant with object;
Film/analysis of image content module is used for cutting apart, the specific objective thing of tracking, identification film/image;
A label embeds engine, for generation of the label archives corresponding with film/image.
2. interactive film as claimed in claim 1/image information embeds science technology system, and wherein this system can move under a plurality of patterns, comprising:
A label producer-user model (being embodiment 1), wherein, the label producer generates the label archives corresponding with film/image in client in advance, and with film/elementary area of this embedding external information end of uploading onto the server;
Film/image-watching person (being the user) is selected and is watched film/image and carry out interactively external information and show at server;
The pattern of a customer center (being embodiment 2), wherein, film/image-watching person (being the user) is select target thing on film/image directly, and the external information relevant with this object and label pass through the object identification and retrieval of real-time information generates with real-time.
3. interactive film as claimed in claim 1 or 2/image information embeds science technology system, and wherein this system embeds the film/elementary area of external information:
A film/elementary area comprises: (a) the label archives of film/image file, (b) correspondence have been specified the position of object in film/image, area size, have been reached relevant external information of object etc.;
When film/image is play, when will putting into effect according to the situation of user's operation information, corresponding label archives analyze;
When user's moving cursor is specified in the object scope contain external information to some by the label archives, will be ejected automatically corresponding to the external information label of this object;
Otherwise, do not have the external information label and eject, film/image is just as playing usually;
Film/the elementary area that embeds external information is single only to play by the user interface module in client, also can be directly at server end by user interface module and interconnected broadcast of client-server interactive operation interface module;
The Pop-up information label that this system sets up can utilize (lock)/release (unlock) button of locking, and closes (disable)/open the Pop-up information label function in (enable) film/image.
4. interactive film as claimed in claim 1 or 2/image information embeds science technology system, wherein this external information search engine can with interlink based on text or based on public Search engine, label database or the excessive data storehouse of image, the keyword that resulting analysis result for the specific objective thing can be used as retrieval usefulness in film/analysis of image content module is input in these databases or the Search engine like this, with the retrieval external information relevant with the specific objective thing.
5. interactive film as claimed in claim 1 or 2/image information embeds science technology system, wherein this film/analysis of image content module can be used simultaneously at the client and server end, is used for film/image specific objective thing is carried out the automatic or manual action such as identification of cutting apart, follows the trail of, reach.
6. interactive film as claimed in claim 1 or 2/image information embeds science technology system, wherein this label embedding engine or film/image-external information relationship analysis module can be used in client or server end, this engine or module can be imported the object analytical information that is produced by film/analysis of image content module and the label beyond the region of objective existence portion information that is generated by label information database or external information search engine, and final output produces the label archives.
7. interactive film as claimed in claim 1 or 2/image information embeds science technology system, and wherein the employed film/image data base of client and server end and label database are respectively applied to store film/view data and label archives.
8. embed science technology system as claim 1 or 2 or 3 interactive film/image information as described in described, wherein this system has two kinds of interface modules to be used, and comprising:
User interface module in client operation is used for and user or label producer are interactive and carry out film/image uploading, label information and add, generate film/image of embedding external information, play film/image of embedding external information, obtain user's interest object or object information and some other operation etc.;
A client-server interactive operation interface module that runs on client and server end simultaneously, be used for the interaction between the client and server end, can finish and comprise that file is uploaded/downloaded, user profile is verified, the user logins operation, operational order transmission and some other operation etc.
9. described interactive film as claimed in claim 1 or 2/image information embeds science technology system, and wherein the framework between this server end and the client is:
Comprise one or more can be simultaneously and a plurality of client interaction, a plurality of users are carried out that interactive information embeds and server that film/image broadcast etc. is operated simultaneously;
Client device comprises televisor, personal computer, mobile computer, mobile phone, intelligent mobile phone, flat computer, projector and other any film/image display etc.;
Server end equipment comprises workstation, server, high in the clouds computing platform etc.
10. embed science technology system as claim 1 or 2 or 3 interactive film/image information as described in described, wherein for the interesting target thing in film/image:
The interested especially object of user can be chosen or eject in many ways in the substance film, including but not limited to: cursor of mouse is moved on the object, clicks object, encloses and select object etc.;
The object that can be embedded into can be any target in film/image, including but not limited to: personage, dress ornament, clothing component, accessory, animal, various vehicle, cosmetics, cosmetics are presented in effect, background music, plant, geographic landscape, background, dining room, place, any object of face etc.;
For the object that embeds the information label, can use some marks or represent that this object can be clicked to obtain more external informations;
These marks or the performance including but not limited to: bottom line word, small-sized colored piece, dot, watermark, luminous lines are irised out this object, the profile of emersion etc.;
The Pop-up information label related with object can be closed by multiple mode, including but not limited to: with cursor of mouse from object remove, " closing " on the click information label (close) button, click other place film/image etc.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012100316594A CN103247063A (en) | 2012-02-13 | 2012-02-13 | Technology system for embedding of film and image information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012100316594A CN103247063A (en) | 2012-02-13 | 2012-02-13 | Technology system for embedding of film and image information |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103247063A true CN103247063A (en) | 2013-08-14 |
Family
ID=48926568
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012100316594A Pending CN103247063A (en) | 2012-02-13 | 2012-02-13 | Technology system for embedding of film and image information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103247063A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI636426B (en) * | 2017-08-23 | 2018-09-21 | 財團法人國家實驗研究院 | Method of tracking a person's face in an image |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1265211A (en) * | 1997-06-03 | 2000-08-30 | 数字营销通讯公司 | System and method for integrating message into graphical environment |
| WO2003050718A2 (en) * | 2001-12-11 | 2003-06-19 | Koninklijke Philips Electronics N.V. | System and method for retrieving information related to persons in video programs |
| CN1987857A (en) * | 2006-12-18 | 2007-06-27 | 于慧 | Method for realizing digital city system using virtual artificial comprehensive image and text information interaction |
| CN101267544A (en) * | 2007-03-15 | 2008-09-17 | 三星电子株式会社 | Method and apparatus for displaying interactive data in real time |
-
2012
- 2012-02-13 CN CN2012100316594A patent/CN103247063A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1265211A (en) * | 1997-06-03 | 2000-08-30 | 数字营销通讯公司 | System and method for integrating message into graphical environment |
| WO2003050718A2 (en) * | 2001-12-11 | 2003-06-19 | Koninklijke Philips Electronics N.V. | System and method for retrieving information related to persons in video programs |
| CN1703694A (en) * | 2001-12-11 | 2005-11-30 | 皇家飞利浦电子股份有限公司 | System and method for retrieving information related to persons in video programs |
| CN1987857A (en) * | 2006-12-18 | 2007-06-27 | 于慧 | Method for realizing digital city system using virtual artificial comprehensive image and text information interaction |
| CN101267544A (en) * | 2007-03-15 | 2008-09-17 | 三星电子株式会社 | Method and apparatus for displaying interactive data in real time |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI636426B (en) * | 2017-08-23 | 2018-09-21 | 財團法人國家實驗研究院 | Method of tracking a person's face in an image |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104574005B (en) | Collect augmented reality, body-sensing, the advertising display management system and method for scratching green technology | |
| Block et al. | Narrative bytes: Data-driven content production in esports | |
| Anderson | The long tail: How endless choice is creating unlimited demand | |
| CN107633441A (en) | Commodity in track identification video image and the method and apparatus for showing merchandise news | |
| KR101535579B1 (en) | Augmented reality interaction implementation method and system | |
| CN102244807B (en) | Adaptive video zoom | |
| CN109104639A (en) | Live broadcast system, the method, apparatus and electronic equipment for determining live video theme | |
| US20180098022A1 (en) | Storage and editing of video of activities using sensor and tag data of participants and spectators | |
| US20120185482A1 (en) | Methods, systems, and computer readable media for dynamically searching and presenting factually tagged media clips | |
| US20110113444A1 (en) | Index of video objects | |
| US20140108932A1 (en) | Online search, storage, manipulation, and delivery of video content | |
| CN101217640B (en) | A method and device realizing program collection in P2P VOD | |
| US20090259955A1 (en) | System and method for providing digital multimedia presentations | |
| US9449109B1 (en) | Visualizing, sharing and monetizing multimedia content | |
| US20100175031A1 (en) | Discovery of media content via user interface | |
| CN101441650A (en) | Apparatus, method and system for outputting video images | |
| CN104969146A (en) | Method and apparatus for developing and playing natural user interface applications | |
| AU2014209505A1 (en) | Storage and editing of video and sensor data from athletic performances of multiple individuals in a venue | |
| CN110139162A (en) | The sharing method and device of media content, storage medium, electronic device | |
| WO2013138370A1 (en) | Interactive overlay object layer for online media | |
| US20160180379A1 (en) | System and method for multimedia content composition | |
| CN104598602A (en) | Scene-based information recommendation method realized through computer and device | |
| US20140115622A1 (en) | Interactive Video/Image-relevant Information Embedding Technology | |
| CN108133057A (en) | For the editing in portable terminal and the device and method of shared content | |
| US20160035016A1 (en) | Method for experiencing multi-dimensional content in a virtual reality environment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20130814 |