WO2005098690A1 - Device and method for multimedia data retrieval - Google Patents
Device and method for multimedia data retrieval Download PDFInfo
- Publication number
- WO2005098690A1 WO2005098690A1 PCT/EP2005/051466 EP2005051466W WO2005098690A1 WO 2005098690 A1 WO2005098690 A1 WO 2005098690A1 EP 2005051466 W EP2005051466 W EP 2005051466W WO 2005098690 A1 WO2005098690 A1 WO 2005098690A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- multimedia
- multimedia data
- date
- information
- creation date
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
- G06F16/24575—Query processing with adaptation to user needs using context
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
- G06Q10/109—Time management, e.g. calendars, reminders, meetings or time accounting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/248—Presentation of query results
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/48—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/489—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using time information
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9535—Search customisation based on user profiles and personalisation
Definitions
- the invention concerns a method and a device to retrieve multimedia data.
- One of the challenges of multimedia asset management is to gather semantic information from the media in order to allow for easy data access.
- first products propose semantic access. For instance, temporal scenes in video are identified and allowing scene by scene video access.
- semantic elements in images such a "persons", "indoor scenes” or "mountains” are identified. Videos and images can thus be searched and retrieved by semantic keywords.
- Web- based search engines for audio files use semantic information such as artist name and title to retrieve audio items.
- creation date is an important feature to retrieve multimedia items. For songs it indicates the creation period and gives hints to the music style. Further, creation date can be close to the moment where users have first heard the song. For videos, creation date is often close to date of first appearance in movie theatres or emission on television. Thus, the term creation date can be extended. It may be also the date of first presentation in a country by a specific medium or the date of its comeback into public interest. Creation date may mean also the date of reception of a multimedia item. For example, one receives some video clips from a server during Christmas holidays. Creation date could be the date of reception, since this is first time when the user consumes the multimedia item. Creation date may even be extended to usage tracking information such as access history.
- the creation date is notably important for personal content.
- This type of content can be photos, video clips, audio clips, video films or other multimedia items that are produced or at least transformed at home by end users.
- User studies showed that creation date is one of the most important features for people to classify and retrieve their multimedia asset. Users often organize their multimedia items by creation date into directories. Search and retrieval is often done by remembering creation date and then retrieving the item by date.
- the creation date has affective meaning to users.
- the creation of multimedia items is often linked to events in the personal life of users. Photos are often taken during holiday trips, family meetings or week-ends. Also video clips are often created during holidays or at specific moments such as weddings or at Christmas. In this way, multimedia items and their creation have a high emotional value to users. They form a mirror of memory of personal life.
- Multimedia asset are often so large that even an asset management system would be too busy and don't have enough information to check at every moment the existence of item that could be interesting to a user in case of anniversary of an event.
- the invention proposes a device for multimedia data retrieval, said multimedia data being associated with an active component.
- some of the active components trigger an action that make the user aware of the multimedia data associated with said active components.
- the multimedia items stored in the database are active or comprise an active component which make the retrieval system intelligent in the sense that it is able to retrieve information automatically that could be ignored by the user, without any need on the user's side.
- the device can enable the user to access data in an easy way, without any active request from the user, and this is enabled by the fact that the mu ltimedia items are linked with active components, such as agents, which are activated upon events independent from the users.
- the following embodiment of the invention concerns a device where the external event is related to the date of the current day.
- this embodiment of the invention concerns a method and a device that allows multimedia data to remember their existence to the users in case of the anniversary of the creation date.
- creation date By creation date, one can also understand the first presentation of the multimedia element, the last day it was used, the date of reception of the multimedia element, or the date of storage of the multimedia element.
- This embodiment is also related to an action which consists in displaying the multimedia element onto a display. Other actions can be foreseen, such as the sending of the information to users, the music playing if the multimedia element comprises a music component...
- the multimedia data are stored on a huge capacity storage medium. In other embodiments, the multimedia data can also be stored on a remote storage medium and accessed through a network, such as internet for instance.
- the multimedia element is associated with information related to its creation date as well as with an active component.
- the active component is able to process the information on the creation date of the associated multimedia element as well as the information on the current date and time. Based on this processing, the active component triggers actions that make the user aware of the existence of the multimedia element.
- the active component may exploit other information agglomerated with the multimedia element to carry out specific actions such as generation of a remembering message or the display or playing of the multimedia element.
- Figure 1 shows a system including several components realizing an embodiment of the invention.
- the system comprises a multimedia asset management system 1 that manages the multimedia data stored on the storage medium 2.
- the storage medium 2 is a hard disk drive but can be also a DND, or any other storage means.
- the multimedia management system 1 is able to associate with the multimedia data sorted on the storage medium 2, creation date information and an active component.
- the active components are also known as agents.
- the multimedia data stored on the storage medium 2 are able to react to a user interface 3 by sending remembering information to a user interface or multimedia rendering information to a display 4.
- the use interface 3 can receive remembering information and transfers rendering information to a display 4.
- the user interface 3 can incorporate a remote control and the display 3 can be a digital set-top-box, also known as decoder, associated with a display.
- the multimedia Asset management system 1 sends a time information 7 to the storage medium 2 and its associated intelligent processing means.
- the time in- formation 8 is sent on request of the intelligent processing means.
- the agents associated with the multimedia items react on the time information 8 sent by the multimedia asset management system.
- the time information 7 corresponds to an anniversary of the creation date
- the corresponding agent will send the content of the multimedia item to the user interface 3 or will send to the user interface 3 a remembering information informing the user that the database contains a multimedia item, for instance a photo representing the first steps of his young daughter, on that day some years ago. This is the kind of event a user does not remember few years later and that such a system will be able to remember him automatically without any action on the user side. Other examples of anniversary are given later on.
- the user interface 3 transforms the remembering information into appropriate information for the display.
- the display renders, plays or displays an interface rendering information 5 as well as a multimedia rendering information 6 to the user.
- the multimedia rendering information 6 contains the multimedia element to be remembered to the user and the interface rendering information 5 contains the way to render this information.
- Each multimedia element is composed of several files. Some of the files contain the multimedia content itself, such as video, still images or sound. Other supplementary files contain supplementary information such as the creation date.
- the creation date includes the time and the date of creation of the multimedia element, or the modification date or the last access date to the multimedia element.
- These supplementary files also contain at least links to all files belonging to the same multimedia element , but also other information such as keywords or links to other related data such as other multimedia items or knowledge databases.
- the active component associated with each multimedia element is also a file containing a script in a platform independent language such as Java language.
- All files belonging to a multimedia element are organized in a common container. In other embodiments, they can be stored separately as files.
- the system contains an execution platform for the scripts associated with the multimedia data, for instance a JAVA execution environment.
- This JAVA execution environment is part of the intelligence associated with the storage medium 2.
- the script associated with each multimedia element will execute the following steps: - request of the current date and time to the multimedia asset management system, - looking all time information available in supplementary files of the multimedia items, - comparing the current date and time with the creation date information associated with the multimedia data stored on the storage medium 2, - detection of temporal events such as: * the current date is equal to or is close to the item creation date, * the current date equals to or is close to the anniversary of the multimedia element creation date, * the anniversary of the creation date of the multimedia element is within one week or in close future, * the anniversary of the creation date of the multimedia element is a particular anniversary (5* , 10* , 50* ..), - relating the detected temporal events with other supplementary information of the multimedia element such as type of event, annotation * detection of anniversaries of weddings, * detection of the anniversary of holidays trips, - relating the detected temporal events with other usage-related, supplementary information associated with the multimedia data such as a user profile, * detecting anniversaries of multimedia data
- the user interface 3 transforms the remembering information and integrates them in the rendering information for a display 4.
- the display 4 consists of a screen and of loudspeakers to display graphical information from the user interface 3 or to play sounds generated by the user interface 3.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- General Engineering & Computer Science (AREA)
- Human Resources & Organizations (AREA)
- Entrepreneurship & Innovation (AREA)
- Strategic Management (AREA)
- Computational Linguistics (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Quality & Reliability (AREA)
- Operations Research (AREA)
- Marketing (AREA)
- Economics (AREA)
- Library & Information Science (AREA)
- Multimedia (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Claims
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/547,372 US9239839B2 (en) | 2004-04-06 | 2005-03-31 | Device and method for multimedia data retrieval |
JP2007506770A JP2007531947A (en) | 2004-04-06 | 2005-03-31 | Device and method for retrieving multimedia data |
EP05729845A EP1735742A1 (en) | 2004-04-06 | 2005-03-31 | Device and method for multimedia data retrieval |
US14/965,437 US9665627B2 (en) | 2004-04-06 | 2015-12-10 | Method and device for multimedia data retrieval |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP04290920 | 2004-04-06 | ||
EP04290920.0 | 2004-04-06 | ||
EP04291655A EP1585044A1 (en) | 2004-04-06 | 2004-07-01 | Device and method for multimedia data retrieval |
EP04291655.1 | 2004-07-01 |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/547,372 A-371-Of-International US9239839B2 (en) | 2004-04-06 | 2005-03-31 | Device and method for multimedia data retrieval |
US14/965,437 Continuation US9665627B2 (en) | 2004-04-06 | 2015-12-10 | Method and device for multimedia data retrieval |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2005098690A1 true WO2005098690A1 (en) | 2005-10-20 |
Family
ID=34913498
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2005/051466 WO2005098690A1 (en) | 2004-04-06 | 2005-03-31 | Device and method for multimedia data retrieval |
Country Status (4)
Country | Link |
---|---|
US (2) | US9239839B2 (en) |
EP (2) | EP1585044A1 (en) |
JP (1) | JP2007531947A (en) |
WO (1) | WO2005098690A1 (en) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110087703A1 (en) * | 2009-10-09 | 2011-04-14 | Satyam Computer Services Limited Of Mayfair Center | System and method for deep annotation and semantic indexing of videos |
EP2579189A1 (en) * | 2011-10-06 | 2013-04-10 | Thomson Licensing | Method and apparatus for generating an explanation for a recommendation |
US20150143103A1 (en) * | 2013-11-18 | 2015-05-21 | Life of Two | Messaging and networking keepsakes |
TWI521959B (en) * | 2013-12-13 | 2016-02-11 | 財團法人工業技術研究院 | Method and system of searching and collating video files, method for establishing a semantic group, and program storage medium therefor |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030002390A1 (en) * | 2001-06-30 | 2003-01-02 | Sellen Abigail Jane | Electronic reminders |
US20030182170A1 (en) * | 2000-03-09 | 2003-09-25 | Thomas Rozsa | Computer sofware program for an interactive multi-media calendar |
Family Cites Families (31)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1995019008A1 (en) | 1994-01-05 | 1995-07-13 | Covey Peter J | Dynamic-state, multi-dimensional, multi-media database |
JPH08235193A (en) | 1995-02-28 | 1996-09-13 | Sony Corp | Data retrieval device |
JPH08314668A (en) | 1995-05-18 | 1996-11-29 | Hitachi Ltd | Information processor |
JPH10134030A (en) | 1996-05-22 | 1998-05-22 | Fujitsu Ltd | System and method for multimedia data presentation |
US5832499A (en) | 1996-07-10 | 1998-11-03 | Survivors Of The Shoah Visual History Foundation | Digital library system |
US5813014A (en) | 1996-07-10 | 1998-09-22 | Survivors Of The Shoah Visual History Foundation | Method and apparatus for management of multimedia assets |
JP2000041208A (en) * | 1998-07-23 | 2000-02-08 | Minolta Co Ltd | Image display device |
US6405215B1 (en) * | 1998-11-06 | 2002-06-11 | International Business Machines Corp. | Workflow agent for a multimedia database system |
WO2000033575A1 (en) | 1998-11-30 | 2000-06-08 | Yuen Henry C | Search engine for video and graphics |
US6957191B1 (en) * | 1999-02-05 | 2005-10-18 | Babcock & Brown Lp | Automated financial scenario modeling and analysis tool having an intelligent graphical user interface |
US6317152B1 (en) | 1999-07-17 | 2001-11-13 | Esco Electronics Corporation | Digital video recording system |
JP2001282813A (en) | 2000-03-29 | 2001-10-12 | Toshiba Corp | Multimedia data retrieval method, index information providing method, multimedia data retrieval device, index server and multimedia data retrieval server |
FR2810130B1 (en) | 2000-06-08 | 2004-04-16 | Hypnotizer | METHOD FOR STRUCTURING, TRANSFERRING AND INTERPRETATION OF A SET OF INFORMATION FOR THE DESIGN OF GRAPHIC INTERFACES |
JP4469518B2 (en) | 2000-07-06 | 2010-05-26 | 富士通株式会社 | Content usage control device, content usage control method, and content usage control program |
JP2002049392A (en) | 2000-07-31 | 2002-02-15 | Olympus Optical Co Ltd | Audio recording and reproducing device |
JP2002157110A (en) | 2000-09-08 | 2002-05-31 | Hagoromo:Kk | Digital calendar and storage medium |
JP3910794B2 (en) | 2000-11-14 | 2007-04-25 | 株式会社エヌ・ティ・ティ・ドコモ | Video search file creation method and homepage update method |
JP3838483B2 (en) | 2000-12-27 | 2006-10-25 | Kddi株式会社 | Audio summary information, audio video summary information extraction device, playback device, and recording medium |
US20060091203A1 (en) * | 2001-05-04 | 2006-05-04 | Anton Bakker | Systems and methods for the identification and presenting of information |
JP2002358306A (en) | 2001-06-01 | 2002-12-13 | Canon Inc | Retrieval method for image information, retrieval apparatus therefor, storage medium and program |
US7203693B2 (en) | 2001-06-12 | 2007-04-10 | Lucent Technologies Inc. | Instantly indexed databases for multimedia content analysis and retrieval |
CA2354768A1 (en) | 2001-08-03 | 2003-02-03 | North Plains Systems Corp. | Hybrid file system |
FR2830957B1 (en) | 2001-10-12 | 2004-01-23 | Commissariat Energie Atomique | METHOD AND SYSTEM FOR MANAGING MULTIMEDIA DATABASES |
JP3914747B2 (en) | 2001-11-07 | 2007-05-16 | オリンパス株式会社 | Image search device |
JP4143956B2 (en) | 2002-02-14 | 2008-09-03 | 富士フイルム株式会社 | Image display device and image management program |
US7009643B2 (en) * | 2002-03-15 | 2006-03-07 | Canon Kabushiki Kaisha | Automatic determination of image storage location |
JP2003281853A (en) | 2002-03-26 | 2003-10-03 | Kenwood Corp | Directory management method for recording and reproducing device |
US20040025033A1 (en) * | 2002-08-02 | 2004-02-05 | Todd Luke B. | System and method for preventing unauthorized installation, use and reproduction of software |
US20040044688A1 (en) * | 2002-08-30 | 2004-03-04 | Brudz John Jason | Patent asset management systems and methods |
US20050010516A1 (en) * | 2003-02-13 | 2005-01-13 | Ameritrade Holding Corporation | Dynamic rebalancing of assets in an investment portfolio |
US8078481B2 (en) * | 2003-12-05 | 2011-12-13 | John Steinbarth | Benefits administration system and methods of use and doing business |
-
2004
- 2004-07-01 EP EP04291655A patent/EP1585044A1/en not_active Withdrawn
-
2005
- 2005-03-31 US US11/547,372 patent/US9239839B2/en active Active
- 2005-03-31 WO PCT/EP2005/051466 patent/WO2005098690A1/en not_active Application Discontinuation
- 2005-03-31 EP EP05729845A patent/EP1735742A1/en not_active Ceased
- 2005-03-31 JP JP2007506770A patent/JP2007531947A/en active Pending
-
2015
- 2015-12-10 US US14/965,437 patent/US9665627B2/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030182170A1 (en) * | 2000-03-09 | 2003-09-25 | Thomas Rozsa | Computer sofware program for an interactive multi-media calendar |
US20030002390A1 (en) * | 2001-06-30 | 2003-01-02 | Sellen Abigail Jane | Electronic reminders |
Non-Patent Citations (1)
Title |
---|
See also references of EP1735742A1 * |
Also Published As
Publication number | Publication date |
---|---|
US20080288438A1 (en) | 2008-11-20 |
JP2007531947A (en) | 2007-11-08 |
EP1735742A1 (en) | 2006-12-27 |
US9665627B2 (en) | 2017-05-30 |
US9239839B2 (en) | 2016-01-19 |
US20160098458A1 (en) | 2016-04-07 |
EP1585044A1 (en) | 2005-10-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Hori et al. | Context-based video retrieval system for the life-log applications | |
CN1838300B (en) | Methods and systems for generating a subgroup of one or more media items from a library of media items | |
US9569533B2 (en) | System and method for visual search in a video media player | |
US7739597B2 (en) | Interactive media frame display | |
US7650563B2 (en) | Aggregating metadata for media content from multiple devices | |
KR101242664B1 (en) | Method and device for generating a user profile on the basis of playlists | |
EP1378910B1 (en) | Software and system for customizing a presentation of digital images | |
US8701022B2 (en) | Method and system for archiving and retrieving items based on episodic memory of groups of people | |
US20120041954A1 (en) | System and method for providing conditional background music for user-generated content and broadcast media | |
US20010056434A1 (en) | Systems, methods and computer program products for managing multimedia content | |
US20080306995A1 (en) | Automatic story creation using semantic classifiers for images and associated meta data | |
US20080028294A1 (en) | Method and system for managing and maintaining multimedia content | |
US20140304019A1 (en) | Media capture device-based organization of multimedia items including unobtrusive task encouragement functionality | |
US9665627B2 (en) | Method and device for multimedia data retrieval | |
US8145034B2 (en) | Contents replay apparatus and contents replay method | |
JP2007149332A (en) | Automated playlist generation | |
US20070112861A1 (en) | Selection of a subset of assets based upon unrelated user preferences | |
JP2008523539A (en) | How to automatically edit media records | |
JP2008521327A (en) | Recording and playback of video clips based on audio selection | |
US20070226432A1 (en) | Devices, systems and methods for creating and managing media clips | |
WO2008141109A1 (en) | Method and system for providing a slideshow to multiple platforms | |
JP5415516B2 (en) | Method and apparatus for reproducing one document preferred by user from a plurality of documents | |
JP2006512653A (en) | Data search method and apparatus | |
Güldenpfennig et al. | Capturing rich media through media objects on smartphones | |
US20090119332A1 (en) | Method And System For Providing A Media Transition Having A Temporal Link To Presentable Media Available From A Remote Content Provider |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
DPEN | Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed from 20040101) | ||
WWE | Wipo information: entry into national phase |
Ref document number: 200580010722.4 Country of ref document: CN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 11547372 Country of ref document: US |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2007506770 Country of ref document: JP |
|
REEP | Request for entry into the european phase |
Ref document number: 2005729845 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2005729845 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWW | Wipo information: withdrawn in national office |
Ref document number: DE |
|
WWP | Wipo information: published in national office |
Ref document number: 2005729845 Country of ref document: EP |