EP2596440A1 - Procédé et système permettant d'organiser et de visualiser des éléments multimédias - Google Patents

Procédé et système permettant d'organiser et de visualiser des éléments multimédias

Info

Publication number
EP2596440A1
EP2596440A1 EP11735849.9A EP11735849A EP2596440A1 EP 2596440 A1 EP2596440 A1 EP 2596440A1 EP 11735849 A EP11735849 A EP 11735849A EP 2596440 A1 EP2596440 A1 EP 2596440A1
Authority
EP
European Patent Office
Prior art keywords
media items
information
content
electronic device
similarity
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP11735849.9A
Other languages
German (de)
English (en)
Inventor
Thomas Lidy
Wolfgang Jochum
Ewald Peiszer
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Spectralmind GmbH
Original Assignee
Spectralmind GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Spectralmind GmbH filed Critical Spectralmind GmbH
Priority claimed from PCT/EP2011/062134 external-priority patent/WO2012010510A1/fr
Publication of EP2596440A1 publication Critical patent/EP2596440A1/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/44—Browsing; Visualisation therefor
    • G06F16/444—Spatial browsing, e.g. 2D maps, 3D or virtual spaces

Definitions

  • the present invention relates generally to a method and a system to organize and visualize electronic files comprising media items on an electronic device, the system comprising a user interface, a processing unit, and a storage unit.
  • Digital music databases are gaining popularity both in terms of professional repositories as well as personal audio collections. Ongoing advances in network bandwidth and popularity of internet services anticipate even further growth of the number of people involved and working with audio libraries. However, organization of large music repositories is a tedious and time- intensive task, especially when the traditional solution of manually annotating semantic data to the media item is chosen.
  • Such databases analyze, organize and visualize a large pool of media items, represented as image files, audio files, video files, or other electronically stored items.
  • Media pools can easily extend 1 00.000 distinct media items.
  • For a user it is therefore of paramount importance to be able to browse, search, and filter such large databases based on specific criteria such as title, genre, album, and so forth.
  • content- based features are increasingly useful for tasks like browsing by similarity, organization or classification of music.
  • Contentbased descriptors form the base for these tasks and are able to add semantic meta-data to music.
  • musical genre is probably the most popular metadata for the description of music content.
  • a method to organize and visualize electronic files comprising media items on an electronic device comprises the following steps: accessing and opening the electronic files and analysis of the media items to extract content and/or meta information; organization of media items according to their similarity in content and/or meta information; visualization of media items as visual entitites laid out and/or placed on a user interface according to their similarity.
  • the content can comprise an audio signal, an audio waveform, a video signal, video content, text content, image content, or combinations thereof. It can be any electronically accessible content, particularly audio tracks, video clips, digital pictures or ebooks.
  • the meta information can comprise fiie-specific information such as file size, attached information such as 1D3 tags, artist, or album, external information such as buying statistics, manually attached information such as tags, artist, album, or genre, automatically attached information such as usage statistics.
  • Spectral features such as the rhythmic, timbral or visual structure can be extracted from the content of the media items on one or more frequency bands to assess the similarity of media items.
  • To visualize the media items and/or the groups they can be placed on a grid, such as a two-dimensional grid or a three-dimensional grid. Since the media items according to the invention are characterized by a plurality of features based on content and/or meta information, the dimension of the feature vector has to be reduced for proper visualization. This can be performed by an iterative procedure known as self-organizing map training, by multidimensional scaling or by any other dimensionality reduction method.
  • multidimensional feature vectors is well known in the state of the art and is not described in detail.
  • the positions of the media items on the grid can be stored in a Geographic Information System (GIS) utilizing a spezial database format for spatial data.
  • GIS Geographic Information System
  • the positions can be stored in a PostGIS database. This placement on the grid creates a map of media items, where similar media items are placed close together, and media items which differ strongly are placed far apart.
  • the visualization can comprise the steps of processing the grid data with a kernel of arbitrary, preferably radial, shape decreasing in size and peak detetation to generate and place the visual entities.
  • the visualization can also comprise a step of conversion of a two-dimensional grid of media items to a grayscale image.
  • Image processing methods such as kernel correlation or smoothing can be used which are well known in the state of the art and are therefore not described in detail.
  • a count of media items per grid node can be performed, resulting in a matrix of frequencies per grid node.
  • the matrix can then be convoluted with a radial kernel along the x-axis and the y- axis (for a two-dimensional grid) with decreasing radius.
  • the chosen maximum kerne! radius can be determined by the zoom level. Then, peaks can be detected, which indicate the location of cluster centers.
  • the visualizations of predetermined zoom levels can be precomputed and stored in a database for faster user access.
  • the visual entitites can comprise circles, circular structures, rectangular structures, polygons, colored shapes, three-dimensional objects, or combinations thereof.
  • the meta information can preferably be visualized using descriptive labels. Since there is often a plurality of labels describing different media items, there is a need to reduce the complexity of labels as well. Particularly, a plurality of labels can be clustered and the clusters can be labeled as such. The placement of the label clusters can be determined by the steps of estimation of the number of clusters for each possible label; k-means clustering for each possible label; determination of label position by its cluster center.
  • a plurality of labels can be clustered and the number and placement of the label clusters can be determined by the steps of hierarchical agglomerative clustering for each possible metadata label; cutting the hierarchical tree at specific positions; determinating the label positions by location of centroids of remaining clusters.
  • the visualization can be adapted and/or changed through user input or automatically. Particularly, media items can be selected, retrieved, visualized, and/or played back, and/or moved into a shopping basket by user interaction.
  • a media item player can be integrated into the visualization, incorporating functionalities such as: play back, pause, next track, last track, volume control, display information about the track (such as artist, album, title, genre, etc.), and display of a time bar.
  • Extended functionalities include an equalizer, shuffle, repeat, and advanced visualization features (spectrum, etc.).
  • Artist information, other meta information or related media items including music videos can be displayed.
  • Search and filter functionalities can be provided, comprising a a search field, where users can input their search criterion. The resulting media items can be highlighted in the visualization window.
  • Additional information can be displayed, comprise information about the artist, song lyrics, links to videos, concerts, the cover, or comments of other users. These information might be provided by external databases, particularly from servers on the internet.
  • the invention further comprises a computer program implementing a method according to the invention, and a computer readable medium comprising such a computer program.
  • the steps in the method according to the invention can comprise:
  • filename, title, author, artist, category, genre, publisher, etc. - derived from information provided with the media items either attached to them (e.g. through file system information), stored with the data (e.g. inside MPEG Layer 3 files in the ID3 tags) or provided from external sources (device databases, databases provided from different sources) b) processing meta information attached to media items by
  • Clustering of data Use of content and/or meta information as outlined in 1 ) to conduct a grouping or clustering of the data and provide aggregated information about grouping/clustering of content. Grouping/clustering is performed on various levels of detail, creating layers of coarser or finer grouping of data into more or less similar entities. To achieve these similarities between items are computed based on different criteria.
  • Visual representation of data The clustering/grouping of data by similar content and/or meta information as defined in 1 ) and 2) is used to create a graphical visualization, in one of several forms. Groups/clusters of media items and/or individual media items are shown by visual entities, such as (for example, but not limited to) circles, circular structures, rectangular structures, colored shapes, three-dimensional objects. The placement and layout is based on similarity of various characteristics and cluster relationships according to the processing in 2).
  • the individual media items of a media item group are revealed on a different layer (see 2) and 4)). Individual media items may be visualized alongside groups of media items. Descriptive labels and other forms of visual enrichment (e.g. album cover arts) may be attached to the visualization, or media item groups or media items.
  • the visual representation is carried out on screens of devices such as, but not limited to, portable music players, mobile phones, smart phones, touch screen devices, tablet computers, portable computers, portable digital assistants, notebook computers, personal computers (including Web browsers), public screens, public terminals, Web terminals, video walls, interactive walls, etc.
  • the visual representation may also be projected by projecting devices, on walls and other objects.
  • the method according to the invention can further comprise one or both of the following steps:
  • interaction e.g., but not limited to,
  • pressing keys or buttons of a device touching the screen of a device, performing gestures, physical manipulation of objects, sensoric input, implicit input (walking by) etc.
  • User interaction changes and adapts the visual representation, particularly (but not limited to) the presentation of level of detail or different views or layers of the clustering and visualization process as described in 2) and 3).
  • Retrieval and Activation of Reproduction / Playback Through similar interaction as outlined in 4b), or other, the according media item(s) may be selected, retrieved, visualized and/or played back (reproduced), or handled in a different way (e.g., but not limited to, moved to a shopping basket, etc.).
  • the method may be carried out on any type of computing device including, but not limited to, portable music players, mobile phones, smart phones, touch screen devices, tablet computers, portable computers, portable digital assistants, notebook computers, personal computers, server computers, public terminals, Web terminals, television sets, interactive installations, etc.
  • the device performing the computing task may be identical to or different from the visualization device.
  • the visual representation is carried out on screens of devices such as, but not limited to, portable music players, mobile phones, smart phones, touch screen devices, tablet computers, portable computers, portable digital assistants, notebook computers, personal computers
  • the visual representation may also be projected by projecting devices, on walls and other objects.
  • the available items i.e. the placement
  • These detail levels can be thought of as zoom levels comparable to Google Maps where the contents is more and more aggregated the further one zooms out.
  • Visual objects such as circles, circular structures, rectangles, rectangular structures, shapes, polygons or three- dimensional objects can be used to visualize aggregated items.
  • An object represents a number of tracks and/or other objects, indicating the amount of tracks contained. The size might alternatively also depict other criteria such as usage frequency or other.
  • the invention further comprises an electronic device for organizing and visualizing electronic files comprising media items, comprising a user interface, a processing unit, and a storage unit, characterised in that media items are organized according to their similarity in content and/or meta information, and visualized as visual entitites laid out and/or placed according to their similarity.
  • the content can comprise an audio signal, an audio waveform, a video signal, video content, text content, image content, or combinations thereof.
  • the processing unit can comprise a feature extractor adapted to extract features from the content of the media items such as the rhythmic structure of the media item on one or more frequency bands to assess the similarity of media items.
  • the meta information can comprise file-specific information such as file size, attached information such as ID3 tags, external information such as buying statistics, manually attached information such as tags or genre, artist, album, automatically attached information such as usage statistics.
  • the visual entitites can comprise circles, circular structures, rectangular structures, colored shapes, polygons, three-dimensional objects, or combinations thereof.
  • the electronic device can comprise a portable music player, mobile phone, smart phone, touch screen device, tablet computer, portable computer, portable digital assistant, notebook computer, personal computer, computer with a web browser, public screen, public terminal, video wall, projecting device, Hi-Fi devices, television set or interactive wall.
  • the expression 'electronic device' comprises distinct single electronic devices as well as systems of two or more connected electronic devices performing functions according to the invention. It might be possible, for example, that the user interface and the storage unit are located in separate electronic devices.
  • the user interface can comprise means to select, retrieve, visualize, and/or play back the media items, and/or means to move the media items into a shopping basket.
  • the electronic device can further comprise means to access external processing units and/or external databases.
  • the visualization might be adaptable and/or changabie through user input or automatically.
  • the visualization window can be implemented as a self-organizing map, where each item is asiggned to one grid node.
  • the size of the grid can be chosen in relation to the size of the media pool (number of media items). Other clustering methods can also be used. Labels can be placed
  • the processing unit and the user interface might be located in separate electronic devices.
  • Fig. 1 shows a an exemplary embodiment of a media item according to the invention
  • Fig. 2 shows an exemplary embodiment of a method to organize and visualize media items according to the invention
  • Fig. 3a - 3b show different embodiments of the steps of grouping and visualizing the media items
  • Fig. 4a - 4b show different embodiments of the visualization of
  • Fig. 5 shows three zoom levels in a visualization example according to the invention.
  • Fig. 6a - 6b show different embodiments of the electronic device
  • Figs. 7a - 76 show different snapshots of an exemplary user interface according to the invention.
  • Figs. 8a - 8b show further different embodiments of the electronic
  • Fig. 1 shows an exemplary embodiment of a an electronic file 1 comprising a media item 2 according to the invention.
  • the media item 2 which is for example an audio track, a video, an ebook, a digital picture or any other electronic media item, comprises content 4 and meta information 5.
  • the content 4 might be a digital representation of an audio signal, an image, text or a video signal.
  • the meta information 5 comprises file-specific information 8, attached information 9, external information 10, manually attached information 1 1 , and automatically attached information 12.
  • the file-specific information 8 comprises the file name, the file size, and other file system information which is provided with the electronic file 1 .
  • the attached information 9 comprises information that is attached to the media item 2 such as the title, the artist, the label, and the record. There might be many more information that is attached to the media items 2, for example provided by ID3 tags.
  • the external information 10 comprises information that is provided from external sources, such as local databases or internet databases. The information stored in these external databases might comprise buying statistics or a rating value.
  • the manually attached information 1 1 comprises tags for the media item 2, the genre or genres added by the user, the emotional mood associated with the media item 2, or the personal rating such as a number of stars or a score.
  • the automatically attached information 12 comprises automatically generated information such as usage statistics or user/item relations in a multi-user environment.
  • Fig. 2 shows the basic steps of the proposed method
  • electronic files 1 comprising the the media items 2 are accessed.
  • the content 4 and the meta information 5 is extracted and analyzed.
  • a feature vector can be created, which may comprise particular or all parts of the meta information 5.
  • the step may also comprise a spectral analysis of the content to extract particular spectral features.
  • the multidimensional feature vectors are then grouped and organized according to their similarity. This can in practice be performed by building up a local or external database which comprises identifiers representing the media items and the corresponding multi-dimensional feature vectors. Further, the media items are visualized according to the similarity of their feature vectors. It is important to note that the similarity might be derived from the similarity in any specific part of the meta information (for example, only the genre), or by any combination of the available meta information and content. Groups or clusters of media items and/or individual media items are visualized by visual entities, such as circles, circular structures, rectangular structures, colored shapes, polygons, three-dimensional objects, and so on.
  • the visualization is adapted automatically or by user input (interaction). This might comprise a changing of the level of detail in visualization or an adaption of the displayed information.
  • respective media items can be selected, retrieved, visualized and/or played back (reproduced) or handled in a different way (for example, moved to a shopping basket).
  • Fig. 3a shows a first exemplary embodiment of the visualization method to organize and visualize media items according to the invention.
  • the media items which have been accessed and analyzed, are aligned on a two-dimensional grid by iterative SOM (self-organizing map) training based on their feature vectors.
  • a count of media items per grid node is performed, resulting in a matrix of frequencies per grid node.
  • the matrix is convoluted with a radiai kernel along the x-axis and the y-axis with decreasing radius.
  • the chosen maximum kernel radius is determined by the zoom level.
  • peaks are detected, which indicate the location of cluster centers.
  • the steps are repeated with decreasing kernel size. If the processing is finished for all zoom levels, the resulting images are aggregated and the size of visual entities is determined by the number of media items contained. The location of visual entities is determined by the peak location.
  • Fig. 3b shows a second exemplary embodiment of a method to organize and visualize media items according to the invention.
  • the media items which have been accessed and analyzed, are aligned on a two- dimensional grid by multi-dimensional scaling based on their feature vector.
  • the resulting two-dimensional grid is then processed in a similar manner as shown in Fig. 3a (kernel convolution with decreasing kernel size, peak detection, aggregation and placement of visual entities) with possibly different kernel shapes.
  • Figs. 4a and 4b show an embodiment of a method for the visualization of global and local labels. For the global labels ⁇ Fig. 4a), the number of clusters for each possible metadata label is estimated first.
  • a k-means clustering is performed, and the label position is determined by the k-means cluster center.
  • a tree structure is produced for each possible metadata label. The tree structure is cut off at specific positions based on chosen inconsistency coefficients. Then, the label locations are determined as the centroids of remaining clusters.
  • Fig. 5 shows three zoom levels in a visualization example according to the invention.
  • a very high level of detail is achieved by showing every single media item 2 in the visualization window 24.
  • individual media items 2 are grouped or clustered and form groups 13, which are provided with labels 14, for example denoting the artist, the genre, or the emotional mood of similar media items.
  • These labels 14 can be local labels, based on cutting off a precomputed tree of labels at specific positions, or global labels based on a k-mean filtering.
  • Fig. 6a shows an exemplary embodiment of an electronic device 3 according to the invention.
  • the electronic device 3 comprises a user interface 7, a processing unit 15, a storage unit 1 6, and a feature extractor 17. It can be connected to the internet to download specific information regarding the processed media items.
  • the user interface 7 allows interaction with the user.
  • Fig. 6b shows a further exemplary embodiment of the system according to the invention.
  • the user interface 7 is located in an electronic device 3, that is connected to the internet.
  • the media items 2 are stored on a server 19 connected to the internet.
  • the connection might also be provided as a local area net (LAN), a wireless LAN (WLAN), a wide area net (WAN) or any other electronic network such as a 3G or 4G mobile network.
  • LAN local area net
  • WLAN wireless LAN
  • WAN wide area net
  • Other data such as meta information 5 is stored on a database 18.
  • Figs. 7a - 7d show different snapshots of an exemplary user interface according to the invention.
  • the user interface 7 is divided into a top panel 20 which comprises a player, a side panel 21 which comprises functionalities for searching, filtering, creation of playlists, and purchasing of media items, the visualization window 24, and a lower panel 22 with information about the status.
  • the player incorporates the following functionalities: piay back, pause, next track, last track, volume control, display information about the track (such as artist, album, title, genre, etc.), and display of a time bar.
  • Functionalities include an equalizer, shuffle, repeat, and advanced visualization features (spectrum, etc.). Artist information, other meta information or related media items including music videos can be displayed.
  • the search and fi!ter functionalities comprise a search field, where users can input their search criterion.
  • the resulting media items are highlighted in the visualization window.
  • This also comprises a smart search functionality where potential search criterions are anticipated. For the filter functionality, only media items that match the filter criteria are shown in the visualization window.
  • Further search features comprise a 'new/recently' option to show media items that have been added recently, a 'popular' option to highlight popular media items, and a 'You may also like' option to highligh media items that match certain user-specific criteria.
  • the visualization is structured into hierarchical levels, with the individual media items at the lowest level, and the groups or clusters at the highest level.
  • the user can zoom between these levels.
  • the number of levels is not fixed but depends on the size and diversity of the media pool, i.e. the number and similarity of the media items.
  • certain groups are superscribed with labels.
  • a minimap might also be part of the visualization.
  • the placement of tracks in the visualization window is done by an algorithm which takes the similarity between media items into account.
  • the organization of media items (the placement) is stable, to ease orientation for the user. User find their preferred media items in general at the same place. However, the organization scheme might be adapted if users add or remove media items.
  • the different visualization levels can be accessed by interaction with buttons 23.
  • the start screen shown in Fig. 7a shows in the visualization window 24 both individual media items 2 and groups 13. Further, clusters of adjoining groups 3 are visible.
  • the user can directly interact with the media items 2, the groups 13 or the clusters (display meta information, piay back the media items or group, add them to a play list, and so on).
  • Labels 14 are used to denote certain groups (for example, by artist or genre) and therefore assist the user in navigating the media item pool. Users might also assign own labels to groups or clusters.
  • search and filter functionality user can exclude or search for particular features of media items in the pool. If media items are suppressed from the visualization, the groups or clusters including these media items shrink respectively. It is also stipulated that users create their own customized start screens, which provide sertain preferred media items, piay lists or groups ("top 10", "author's choice”, etc.). In a multi-user environment, registered users can change the settings of the visualization according to their preferences.
  • the change between zoom levels can be performed in a graphically animated fashion to indicate to give the user a feedback on the size of their media pool.
  • Nearby labels which are located outside of the current visualization window are shown at the edges of the visualization window, as shown in Fig. 7c.
  • Fig. 7d shows a detailed zoom at the level of individual media items 2. This level is the lowest level, where the specific meta information 5 of a media item 2 is shown next to the visual entity representing the media item 2. The user can directly interact with the individual media items, for example tracks. The media item that is currently played back is highlighted in a specific fashion.
  • Possible interactions with the media item 2 include clicking on it (to show information), double-clicking (to play it back), drag and drop the media item to the player (top panel 20) or play list (side panel 21 ), or clicking the right mouse button (or an equivalent user interaction) to display context information.
  • clicking on it to show information
  • double-clicking to play it back
  • drag and drop to the player
  • play list side panel 21
  • clicking the right mouse button or an equivalent user interaction
  • Additional information displayed might comprise information about the artist, song lyrics, links to videos, concerts, or comments of other users. These information might be provided by external databases, particularly from servers on the internet.
  • Fig. 7d shows a zoom level on which cover information 26 is shown.
  • a cover is represented on a grid of at least 60 pixels x 60 pixels.
  • certain functionalities are directly attached to the cover by buttons, such as playing back the media item or the album, or adding the media item or the album to the play list.
  • Figs. 8a and 8b show further embodiments of the electronic device 3, either as a tablet computer as shown in Fig. 8a, or as a smartphone in Fig. 8b.
  • the electronic devices have different user interfaces, but show a similar
  • the invention is not limited to the described embodiments, but comprises as well further embodiments that fall within the scope of the claims. Individual features and characteristics of the invention shown in particular embodiments can be combined and are not limited to the particular embodiment. In particular, the invention is not limited to a specific visualization and design of the user interface, nor to a specific kind of media item. The invention is also not limited as to the characteristic which is used for the assessment of similarity.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

L'invention concerne un procédé permettant d'organiser et de visualiser des fichiers électroniques (1) comprenant des éléments multimédias (2) sur un support électronique (3), caractérisé en ce que le procédé comprend les étapes d'accès et d'ouverture des fichiers électroniques (1) et d'analyse des éléments multimédias (2) pour extraire le contenu (4) et/ou des métadonnées (5) ; d'organisation des éléments multimédias (2) en fonction de leur similarité de contenu (4) et/ou de leurs métadonnées (5) ; de visualisation des éléments multimédias (2) en tant qu'entités visuelles (6) disposées et/ou placées sur une interface utilisateur (7) en fonction de leur similarité. L'invention concerne également un programme informatique mettant en œuvre un tel procédé et un support lisible par ordinateur comprenant ledit programme informatique, ainsi qu'un dispositif électronique pour organiser et visualiser des fichiers électroniques comprenant des éléments multimédias.
EP11735849.9A 2010-07-21 2011-07-15 Procédé et système permettant d'organiser et de visualiser des éléments multimédias Withdrawn EP2596440A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US366210P 2010-07-21 2010-07-21
PCT/EP2011/062134 WO2012010510A1 (fr) 2010-07-21 2011-07-15 Procédé et système permettant d'organiser et de visualiser des éléments multimédias

Publications (1)

Publication Number Publication Date
EP2596440A1 true EP2596440A1 (fr) 2013-05-29

Family

ID=48141699

Family Applications (1)

Application Number Title Priority Date Filing Date
EP11735849.9A Withdrawn EP2596440A1 (fr) 2010-07-21 2011-07-15 Procédé et système permettant d'organiser et de visualiser des éléments multimédias

Country Status (1)

Country Link
EP (1) EP2596440A1 (fr)

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2012010510A1 *

Similar Documents

Publication Publication Date Title
US20130110838A1 (en) Method and system to organize and visualize media
Neumayer et al. PlaySOM and PocketSOMPlayer, alternative interfaces to large music collections
KR101648204B1 (ko) 콘텐트 아이템들의 컬렉션과 연관하여 메타데이터 생성
Goto et al. Musicream: New Music Playback Interface for Streaming, Sticking, Sorting, and Recalling Musical Pieces.
US8739051B2 (en) Graphical representation of elements based on multiple attributes
US9817915B2 (en) System and method enabling visual filtering of content
US8782559B2 (en) Apparatus and method for displaying a three dimensional GUI menu of thumbnails navigable via linked metadata
US9311309B2 (en) Entertainment media visualization and interaction method
US20160004738A1 (en) Systems and methods of generating a navigable, editable media map
US20060282789A1 (en) Browsing method and apparatus using metadata
Schoeffmann et al. Video browsing interfaces and applications: a review
JP5226240B2 (ja) メタデータを利用したメディアコンテンツの探索装置および方法
KR100978689B1 (ko) 미디어 선택 방법 및 시스템
EP2208149A2 (fr) Classement d'un ensemble d'objets de contenu
Stober et al. Musicgalaxy: A multi-focus zoomable interface for multi-facet exploration of music collections
CN101918946A (zh) 数据项的布置
Kuhn et al. Social audio features for advanced music retrieval interfaces
Chen Exploratory browsing: enhancing the browsing experience with media collections
Julià et al. SongExplorer: A Tabletop Application for Exploring Large Collections of Songs.
Schedl et al. Music tower blocks: Multi-faceted exploration interface for web-scale music access
Schedl et al. Enlightening the sun: A user interface to explore music artists via multimedia content
EP2596440A1 (fr) Procédé et système permettant d'organiser et de visualiser des éléments multimédias
Bountouridis et al. Tonic: combining ranking and clustering dynamics for music discovery
Neumayer et al. Bringing Mobile Map-Based Access to Digital Audio to the End User
KR100746042B1 (ko) 컨텐츠 파일 브라우징 방법 및 장치

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20121123

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20140203

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20140617