WO2013010959A1 - Easy 2d navigation of video database - Google Patents

Easy 2d navigation of video database Download PDF

Info

Publication number
WO2013010959A1
WO2013010959A1 PCT/EP2012/063842 EP2012063842W WO2013010959A1 WO 2013010959 A1 WO2013010959 A1 WO 2013010959A1 EP 2012063842 W EP2012063842 W EP 2012063842W WO 2013010959 A1 WO2013010959 A1 WO 2013010959A1
Authority
WO
WIPO (PCT)
Prior art keywords
content item
content items
display
search
found
Prior art date
Application number
PCT/EP2012/063842
Other languages
French (fr)
Inventor
Mauro Barbieri
Serverius Petrus Paulus Pronk
Jan Korst
Original Assignee
Axel Springer Digital Tv Guide Gmbh
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Axel Springer Digital Tv Guide Gmbh filed Critical Axel Springer Digital Tv Guide Gmbh
Priority to RU2014106227A priority Critical patent/RU2608468C2/en
Priority to CN201280035776.6A priority patent/CN103718176B/en
Priority to US14/131,283 priority patent/US9779164B2/en
Priority to EP12733781.4A priority patent/EP2734932A1/en
Publication of WO2013010959A1 publication Critical patent/WO2013010959A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/73Querying
    • G06F16/738Presentation of query results
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/54Browsing; Visualisation therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/44Browsing; Visualisation therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53Querying
    • G06F16/532Query formulation, e.g. graphical querying

Definitions

  • the present invention relates to a method of operating an apparatus for displaying content items on a display, a corresponding computer program for operating an apparatus and to an apparatus for displaying content items on a display that is arranged for being coupled to the apparatus.
  • the present invention relates to an apparatus that is configured to display a plurality of content items in a two-dimensional grid in dependence of a respective relatedness between a selected content item and one of the content items to be displayed.
  • the invention furthermore relates to a user terminal that comprises such apparatus. Background of the invention
  • the amount of available content items such as videos, articles, music files, products that can be ordered, blogs etc., increase day by day, such that a user might encounter severe difficulties in finding content items that are of actual interest to him/her.
  • the user may, thus, end up spending a lot of time in browsing and searching for relevant content items.
  • finding content items There are two popular ways of finding content items, namely conventional keyword-based search on the one side and browsing through a content item database by similarity or by relatedness on the other side.
  • a keyword-based search a user specifies a query by entering one or more keywords in a search engine and is provided with a list of results matching somehow to the entered keywords. This way of finding content items is suitable if a user has a fairly precise idea of what he/she is looking for.
  • a user has not a specific idea of what he/she is looking for, or, re- spectively, if he/she has already found something of interest and wants to explore the content item database for related or similar content items, then browsing by similarity or by relatedness is performed. For instance, if a user selects one of a plurality of displayed content items on a website of a certain content item database, the website can be organized such that, after selection of the certain content item, the website displays further content items that are similar or related to the selected content item.
  • a user browses through a video database, such as YouTube.com, and watches a video about a Formula 1 race.
  • the video database website is often organized such that miniature graphical representations of similar/related videos are displayed in a display area, wherein the user can select one of these similar/related videos for viewing.
  • Many websites of content item databases are organized in a similar manner, e.g., Amazon.com or any other website of an online shop.
  • Some methods of computing a measure of similarity or relatedness between two content items are known. For instance, some approaches are based on metadata about content items, and others are based on co-visitation counts, wherein, e.g., a number of times a user watches two videos in a same viewing session is counted.
  • a relatedness score r(v,, v n ... iN ) can be computed.
  • Each video v has an associated set of related videos R, containing top-N videos ranked by their relatedness score r(Vj, v n ... iN ).
  • the related videos can be seen as inducing a directed graph over the set of videos.
  • Two videos v, and v n ... iN are connected by an edge e n ... iN , if v n ... iN belongs to the set R,, with the weight of the edge given by the relatedness score r(v,, v n ... iN ).
  • the search can apparently be enhanced with a simulation of the visually- created query, and the simulation may be transformed into a query suitable for distribution to one or more search engines.
  • the query may be refined using domain specific rules, vocabulary, expert systems, and the like. Search results may be browsed by a user, or employed to further refine subsequent searches.
  • United States patent application US 2006/0155684 A1 discloses a method of presenting web image search results for effective image browsing. So-called task-based attention objects for each of multiple images associated with image search results are generated. Thumbnail images from respective ones of the images are created as a function of at least the task-based attention objects. The thumbnail images shall emphasize image region(s) of greater priority to a user in view of a keyword or expanded keyword.
  • the technical object is achieved by a method of operating an apparatus for displaying content items on a display arranged for being coupled to the apparatus, wherein the method comprises the following steps: receiving an electronic selection command initiated by a user, the selection command designating a content item displayed on the display as having a type of selected status (selected content item), generating a search string in dependence of the selected content item, forwarding the search string to a search engine, the search engine being coupled to a content item database and configured to carry out a content item search based on the search string, - receiving search result data from the search engine, the search result data including data pairs that relate to found content items, wherein each of the data pairs includes a respective content item data piece representing a respective content item and a respective associated relatedness value, the respective associated relatedness value indicating a degree of relatedness between the respective content item and the selected content item, defining a two-dimensional grid comprising rows and columns on a display area of the display, wherein a graphical content item representation can be
  • the present invention includes the recognition that according to prior art displaying mechanisms, related content items are usually presented in an one-dimensional manner, wherein a top-ranked related content item is arranged in the first position and content items considered less related are arranged linearly after the top-ranked content item.
  • this approach does not provide a good overview of content items available and it does not provide enough visual structure for users to orientate themselves and navigate effectively and easily. Therefore, according to prior art displaying mechanism, a user eventually spends a lot of time browsing, thereby causing energy consumption and increased network load, as some processing means that operate a respective content item database have to process each search inquiry initiated by the user.
  • the operating method allows for easy navigation through related content items, in particular with a standard television (TV) remote control.
  • a display area is reserved for the two-dimensional grid comprising the rows and columns yielding a matrix (or tabular or array) like structure.
  • Each column of this structure includes a column group of related content items, wherein the found content item whose associ- ated relatedness value is the highest with respect to the relatedness values associated to the found content items of the column group is arranged in a centered position of the respective column.
  • content items of the column group whose associated relatedness values are less than the relatedness value of the content item graphically represented at the center position are arranged at an upper and at a lower position with re- spect to this center position.
  • This manner of arranging found content items provides a very organized overview and a visual structure to the user browsing by relatedness or by similarity. Therefore, browsing is more convenient for a user, as a user can quickly find content items of interest to him/her. Also, the time a user is operating the apparatus for finding content items can be reduced, which leads to energy saving and a significant reduction of network load on the side of the content item database.
  • the energy saving aspect is in particular relevant for mobile devices that are driven by battery.
  • the two-dimensional grid is built in such a way that it provides easy access to closely related content items as well as content items that are less closely related. This enables the discovery of less closely related but interesting content items, which would not be easily found by scrolling through a one-dimensional list of related content items, as the less closely related content items would be typically positioned in the later or last positions of the one-dimensional list.
  • the associated relatedness values included in the data pairs provided by the search engine does not have to be present in a separate data word, but can be delivered by the search engine implicitly, e.g., in the form of a list.
  • Such list can include, in a first list position, a content item data piece representing a content item with a highest relatedness degree and further content item data pieces in subsequent list position exhibiting a respective diminished relatedness degrees or, respectively, the list begins with a content item exhibiting a lowest relatedness degree and content items of subsequent list positions have respective increased relatedness degrees.
  • the associated relatedness values can be encoded in list positions of the search result data delivered in the form of a list.
  • the apparatus to be operated can be integrated in any kind of a user terminal, such as a mobile terminal, such as a mobile phone or a smartphone, a personal computer, a notebook, a television system, a set-top box, a multimedia player, an internet video portal, etc..
  • a user terminal such as a mobile terminal, such as a mobile phone or a smartphone, a personal computer, a notebook, a television system, a set-top box, a multimedia player, an internet video portal, etc.
  • the electronic selection command initiated by the user can be input, for instance, through a remote control, such as a conventional TV remote control, or by a mouse through a "point-and-click" mechanism, via a touch screen and so on. It is recognized which content item is selected and a search string is generated in response to this recognition.
  • a search is implemented based on the generated search string using a search engine.
  • the search string can be based on metadata of the selected content item. For instance, the search engine performs a search for related or similar content items.
  • the content item database coupled to the search engine can also be personal channel of the user, the personal channel storing personal channel data pieces indicative of preferred content of the user.
  • the wording "content item" can also mean such personal channel data piece.
  • the wording "relatedness” is supposed to follow its standard definition within recommender technology.
  • relatedness can mean similarity between two content items; however, there can also be some other kind of relatedness, e.g., economical relatedness or a relatedness that is deducted from a user account, a user behaviour and/or deducted from similarities between users and so on.
  • the present invention rather focuses on displaying related content items than on mechanisms for retrieving related content items.
  • the found content items are represented by data pairs, wherein each of these includes a data representation of one of the found content items and a respective associated relat- edness value.
  • the present invention includes the idea of converting the graph of related content items mentioned in the background of the invention into the two-dimensional grid that is easy to navigate through.
  • the set-up and the content of the two-dimensional grid is dependent on the selected content item that was selected prior to the creation of the two- dimensional grid.
  • the selected content item is also represented in the two-dimensional grid.
  • a column of the selected content item can be either kept empty or filled with other representations of content items.
  • the two-dimensional grid is used to represent a personal channel
  • the column of the selected content item can be filled with the content of the personal channel.
  • the initial central column can be filled with results of the search.
  • the operating method includes the additional step of arranging a graphical representation of the selected content item at a center position of the two- dimensional grid.
  • the center position of the two-dimensional grid is preferentially centered with respect to a vertical and horizontal direction. Therefore, the user is confronted with a visual represen- tation of found content items, wherein the initially selected content item is represented at a center and all the other related content items are represented in a manner, wherein the respective associated relatedness values decrease both in left and right direction and in up and down direction.
  • This way of representing found related content items makes it very easy for the user to follow even subliminal interests that the user is incapable of verbalizing, as he can now easily navigate through content items based on his visual impression only. In the outcome, such graphical representation allows a electrical energy and time efficient way of finding content items of interest.
  • the operating method includes the steps of: applying a clustering algorithm to the search result data for clustering the found content items into a plurality of clusters in dependence of a similarity of the found content items, and associating each cluster to a respective of the columns, wherein the graphical representations of the found content items are arranged such that each column of the two-dimensional grid includes graphical representations of found content items that belong to a respective associated cluster.
  • the arranging step of the operating method can be applied to rows instead of columns, e.g., depending on a point of view of the user.
  • the centered row thus includes a plurality of cluster representative content items. Therefore, by navigating in a horizontal direction, the user can skip from cluster to cluster and by navigating in a vertical direction, the user can browse through a respective cluster.
  • the user selects a video as a selected content item.
  • a set of re- lated videos is retrieved.
  • the videos of the set of related videos are divided into N clusters depending on their similarity.
  • the notion of related- ness can comprise other aspects of similarity, such as user account aspects, economically relatedness and so on.
  • Different clustering algorithms can be applied, wherein, in a preferred embodiment, the cluster algorithm includes at least one of a K-means clustering algorithm, a hierarchical clustering algorithm, a spectral clustering algorithm, or a combination thereof. For each cluster, one cluster-representative video is chosen and displayed in the same row as the selected video.
  • Graphical representations of the other videos belonging to the cluster are inserted in the columns corresponding to their cluster- representative video. It shall be understood, that the clustering algorithm can certainly be applied, if other content item types than videos are searched for. Moving in the horizontal direction on the two-dimensional grid allows discovering entire categories of related videos, while moving along the vertical direction allows exploring the content of a cluster.
  • the graphical representation of the selected content item is arranged at a column centered with respect to the two-dimensional grid and wherein the centered column includes only the graphical representation of the selected content item.
  • the overview of the two-dimensional grid is furthermore improved, as the user can easily detect which content item is the selected content item.
  • the graphical representations of the found content items are arranged such that a row centered with respect to the two-dimensional grid includes the graphical representation of the selected content item and graphical representations of found content items whose associated relatedness values decrease both in a left and in a right direction with respect to the graphical representation of the selected content items.
  • the relatedness value decreases both in a left and in a right direction, thereby deviating from a linear displaying of content items and allowing for an approved overview.
  • the selected content item being represented at a center position has as its first right neighbour a content item representation of a content item whose associated relatedness value is the highest.
  • a representation of content item who's associated relatedness value is a second highest.
  • a representation of a content item who's associated relatedness value is the third highest among the found content items. This manner of representation is preferentially preserved throughout the entire center row and correspondingly in each columns.
  • the two-dimensional grid includes an uneven number of rows and an uneven number of columns.
  • the operating method comprises the additional steps of: receiving an electronic position command initiated by a user, and designating one of the found content items displayed in the two-dimensional grid as having a type of marked status (marked content item) by adding a graphical mark to the marked content item.
  • a conventional remote control comprising buttons for submitting a move-right command, a move-left command, a move-up command, and a move-down command. This embodiment ensures that the user can easily navigate through the displayed content items, as he can see the actual position of a cursor.
  • the operating method comprises the additional step of - rearranging the graphical representation in dependence of the further selection command.
  • the two-dimensional grid is rearranged, such that the newly selected content item assumes the center position and a new search is performed based on the selected content item and the newly found content items are displayed in the two-dimensional grid in manner as explained above.
  • the selected content item can thus be changed by using the conventional four arrow keys on a remote control.
  • a newly content item can be marked, e.g., highlighted, and then selected, wherein set-up and content of the two-dimensional grid content is adapted after selection of the highlighted/marked content item to bring the newly selected content item into the center of the two-dimensional grid.
  • the two-dimensional grid is refilled depending on the newly selected content item. For instance, in the centered row of the selected content item, representations of new cluster representatives are inserted, and in the columns, content item representations of content items of respective cluster are inserted.
  • the operating method of the first aspect of the present invention facilitates in particular browsing through a video item database.
  • the content items do not have to be of the same type. For instance, it is possible to display both graphical representations of books, articles, videos, documents, blogs, products, music files etc., if a corresponding relatedness between the content items is high enough.
  • the search engine can be coupled to a plurality of different content item databases for retrieving relevant related content items. If the search engine has retrieved content items from two different content item databases, the method comprises, in an embodiment, the step of mapping the found content items in two different directions in the grid, for instance content items representing TV programs can be mapped in columns, while related internet videos can be inserted into rows.
  • the above identified technical object is achieved by a computer program for operating an apparatus for displaying content items on a display arranged for being coupled to the apparatus, the computer program comprising program code means for causing the apparatus to carry out the steps of the method of the first aspect of the invention, when the computer program is run on a computer controlling the apparatus.
  • the computer program of the second aspect of the invention may be stored/distributed on a suitable medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.
  • a suitable medium such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.
  • an apparatus for displaying content items on a display arranged for being coupled to the apparatus comprising: an input configured to receive an electronic selection command initiated by a user, the selection command designating a content item displayed on the display as having a type of selected status (selected content item), a search string generator configured to generate a search string in dependence of the selected content item, a sender configured to forward the search string to a search engine, the search engine being coupled to a content item database and configured to carry out a content item search based on the search string, a receiver configured to receive search result data from the search engine, the search result data including data pairs that relate to found content items, wherein each of the data pairs includes a respective content item data piece representing a respective content item and a respective associated relatedness value, the respective associated relatedness value indicating a degree of relatedness between the respective content item and the selected content item, a display driver unit configured to define a two-dimensional grid comprising rows and columns on a display
  • the apparatus of a third aspect of the present invention principally shares the advantages of the operating method of the first aspect of the present invention.
  • the apparatus of the third aspect has preferred embodiments that correspond to the steps of the preferred embodiments of the operating method of the first aspect described above.
  • the apparatus of the third aspect of the present invention can be operated with an operating method of the first aspect of the present invention.
  • the apparatus of the third aspect of the invention can implement the operating method of the first aspect of the invention.
  • a user terminal for internet browsing comprising: a user interface configured to receive a user command, a display configured to display internet websites, and an apparatus in accordance with the fourth aspect of the invention, wherein the apparatus is coupled to the user interface and to the display.
  • All aspects of the invention can be applied in the context of a social network consisting of PCs, set-top boxes, et cetera. On such devices, a recommender technology can be installed.
  • An application of an aspect of the invention increases the usability and user satisfaction of such recommenders. More specifically, they can be integrated into the personal channel concept that is believed to offer the ease-of-use that users are used to.
  • Fig. 1 shows a schematic graphical representation of a selected content item and related content items
  • Fig. 2 shows a flowchart illustrating an operating method in accordance with a first aspect of the invention
  • Fig. 3 shows a schematic representation of a two-dimensional grid for displaying related content items
  • Fig. 4 shows exemplary and schematically a block diagram representation of a user terminal for internet browsing in accordance with the fourth aspect of the present invention.
  • Fig. 2 shows a flowchart illustrating an operating method 200 in accordance with a first aspect of the invention.
  • the method 200 is a method for operating an apparatus for displaying content items on a display arranged for being coupled to the apparatus.
  • a first step 210 an electronic selection command initiated by a user is received, wherein the selection command designates a content item displayed on the display as having a type of selected status, in the following referred to as selected content item.
  • a search string is generated in dependence of the selected content item.
  • the search string is forwarded to a search engine that is coupled to a content item database and that carries out a content item search based on the search string.
  • search result data from the search engine is received, wherein the search result data includes data pairs that relate to found content items.
  • Each of the data pairs includes a respective content item data piece representing a respective content item and a respective associated relatedness value, the respective associated relatedness value indicating a degree of relatedness between the respective content item and the selected content item.
  • a two-dimensional grid comprising rows and columns on a display area of the display is defined, e.g., a two-dimensional grid 300 as depicted in Fig. 3, wherein a graphical content item representation can be arranged at each intersection field where a column intersects with a row.
  • This step can include reservation of a certain display part of the display for displaying the found content items, e.g. by communicating with a display driver driving the display.
  • a sixth step 260 graphical representations of the found content items are arranged in the two-dimensional grid in dependence of the associated relatedness values, such that a graphical representation of a found content item whose associated relatedness value is the highest of relatedness values associated to found content items to be displayed in a common column is arranged at a centered intersection field being centered in the common column.
  • a user has selected content item A while browsing through a content item database, e.g. a video database.
  • a content item database e.g. a video database.
  • the search engine delivers at least content items A-i to A 6 IV and associated relatedness values as depicted in Fig. 3.
  • a clustering algorithm is applied to the found content items, yielding clusters according to cluster representatives A-i to A 6 .
  • Each cluster is associated to one of the columns of the grid 300, wherein the graphical representations of the found content items are arranged such that each column of the two-dimensional grid includes graphical representations of found content items that belong to a respective associated cluster.
  • the center row includes, among a representation of the selected content item A, representations of cluster representative content items A-i , A 2 , A 3 , A4, A 5 and A 6 , the last mentioned content items are each the content item exhibiting the highest degree of relatedness to content item A with respect to their respective cluster.
  • the degree of relatedness decreases both in up and down direction.
  • the two-dimensional grid 300 there is always one selected content item.
  • the selected content item can be changed by the user, e.g., by using a TV remote control or by using a computer mouse.
  • the grid content is adapted to bring the newly selected video in the centre of the grid, wherein this adapting/rearranging step includes the generating step, the forwarding step, the receiving step, the defining step and the arranging step as elucidated above.
  • a set of related content items is calculated or retrieved.
  • the content items of the set are divided into N clusters depending on their similarity.
  • Different clustering algorithms can be used such as K-means clustering, hierar- chical clustering, spectral clustering, etc..
  • K-means clustering For each cluster, one cluster-representative content item is chosen and displayed in the same row as the selected content item.
  • the other content items belonging to a respective cluster are inserted in the columns corresponding to their cluster-representative content item.
  • Cluster-representative content items can be content items that are automatically selected as being representative for an entire cluster of related content items.
  • Moving in the horizontal direction on the grid allows discovering entire categories of related content items while moving along the vertical direction allow exploring the content of a cluster.
  • the content of the grid is dependent on the initial content item that was selected to create the grid.
  • the column of the first content item can be either left empty or filled with other content item. For example, if the grid is used to represent a personal channel, the column of A is filled with the content of the personal channel. If the grid shows the results of a search, the initial central column is filled with the results of the search.
  • Fig. 4 shows exemplary and schematically a block diagram representation of a user terminal 400 for internet browsing in accordance with the fourth aspect of the present invention.
  • the terminal 400 can also be used for browsing through a personal channel.
  • the terminal 400 can be a personal computer, a TV-set, a mobile phone, a smart phone, a laptop, a personal digital assistant, a notebook, a set-top box etc.
  • Websites visited by the user are displayed on a display 410 of the terminal 400.
  • the user can enter commands through a user interface 420.
  • the user interface is a remote control or a touch screen embedded in display 410 or a computer mouse or microphone arrangement for voice commands.
  • the terminal comprises an apparatus 100.
  • the apparatus is coupled to the user interface 420 and to the display 410 on the one side and to a search engine 440 on the other side.
  • the search engine can be implemented on a remote server of the internet.
  • the apparatus 100 comprises an input 1 10 that receives an electronic selection command initiated by a user.
  • the selection command designates a content item displayed on the display 410 as having a type of selected status, in the following referred to as selected content item.
  • a search string generator 120 of the apparatus 100 Based on the selected content item, a search string generator 120 of the apparatus 100 generates a search string and forwards this string to a sender 130.
  • the sender transmits the search string the search engine 440 that carries out a content item search within at least one content item database 430 correspondingly.
  • the selected content item can also be an item of a personal channel of the user.
  • the search engine and the content item database (e.g. electronic program guide data)can be internally implemented in the apparatus 100. If, however, the content item data base is a video or product data base, such as youtube.com or amazon.com, the search engine is rather implemented on a server that administrates the content item database.
  • a receiver 140 of the apparatus 100 receives search result data from the search engine 440.
  • the sender 130 and the receiver 140 can be united an internet communication unit that fulfils the sending and receiving function explained above.
  • sender 130 and receiver 140 are implemented in a conventional internet interface, e.g., the apparatus 100 can be wirelessly coupled to the internet, in particular wirelessly coupled to the search engine.
  • the search result data include data pairs that relate to found content items, wherein each of the data pairs includes a respective content item data piece representing a respective content item and a respective associated relatedness value, the respective associated relatedness value indicating a degree of relatedness between the respective content item and the selected content item.
  • the receiver 140 passes the result data to a display driver unit 150.
  • the display driver unit drives the display 410. After or before having received the search result data, it defines a two-dimensional grid in a display area, e.g. according to Fig. 3, wherein a graphical content item representation can be arranged at each intersection field where a column intersects with a row.
  • the display driver unit arranges graphical representations of the found content items in the two-dimensional grid in dependence of the associated relatedness values, such that a graphical representation of a found content item whose associated relatedness value is the highest of relatedness values associated to found content items to be displayed in a common column is arranged at a centered intersection field being centered in the common column.
  • the display driver unit 150 of the apparatus 100 can operate accordingly.
  • the apparatus 100 allows the user to navigate through the displayed content items and reacts to a selection of a new content item by initiating a new content item search and rearranging the displayed content items, in particular centring the newly selected content item and rearranging the related content item as described above with respect to the operating method.
  • the computer program of the second aspect of the invention may be stored/distributed on a suitable medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Physics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The present invention relates to a method of operating an apparatus for displaying content items on a display, a corresponding computer program for operating an apparatus and to an apparatus (100) for displaying content items on a display (410) that is arranged for being coupled to the apparatus (100). In particular, the present invention relates to an apparatus (100) that is configured to display a plurality of content items in a two-dimensional grid (300) in dependence of a respective relatedness between a selected content item (A) and one of the content items to be displayed. The selected content item is positioned at a center of the display (410) and the related content items are displayed such that associated relatedness values decrease both in left, right, up and down direction with respect to the center position. The invention furthermore relates to a user terminal (400) that comprises such apparatus.

Description

Easy 2D navigation of video database
Field of the invention
The present invention relates to a method of operating an apparatus for displaying content items on a display, a corresponding computer program for operating an apparatus and to an apparatus for displaying content items on a display that is arranged for being coupled to the apparatus. In particular, the present invention relates to an apparatus that is configured to display a plurality of content items in a two-dimensional grid in dependence of a respective relatedness between a selected content item and one of the content items to be displayed. The invention furthermore relates to a user terminal that comprises such apparatus. Background of the invention
The amount of available content items, such as videos, articles, music files, products that can be ordered, blogs etc., increase day by day, such that a user might encounter severe difficulties in finding content items that are of actual interest to him/her. The user may, thus, end up spending a lot of time in browsing and searching for relevant content items. There are two popular ways of finding content items, namely conventional keyword-based search on the one side and browsing through a content item database by similarity or by relatedness on the other side. In a keyword-based search, a user specifies a query by entering one or more keywords in a search engine and is provided with a list of results matching somehow to the entered keywords. This way of finding content items is suitable if a user has a fairly precise idea of what he/she is looking for.
If, in the other case, a user has not a specific idea of what he/she is looking for, or, re- spectively, if he/she has already found something of interest and wants to explore the content item database for related or similar content items, then browsing by similarity or by relatedness is performed. For instance, if a user selects one of a plurality of displayed content items on a website of a certain content item database, the website can be organized such that, after selection of the certain content item, the website displays further content items that are similar or related to the selected content item.
In an example, a user browses through a video database, such as YouTube.com, and watches a video about a Formula 1 race. The video database website is often organized such that miniature graphical representations of similar/related videos are displayed in a display area, wherein the user can select one of these similar/related videos for viewing. Many websites of content item databases are organized in a similar manner, e.g., Amazon.com or any other website of an online shop.
Some methods of computing a measure of similarity or relatedness between two content items are known. For instance, some approaches are based on metadata about content items, and others are based on co-visitation counts, wherein, e.g., a number of times a user watches two videos in a same viewing session is counted.
A principle of gathering related content items shall now be explained with respect to Fig. 1 , wherein the content item type shall be, in this example, a video. For each pair of videos (v., vn ... iN), a relatedness score r(v,, vn ... iN) can be computed. Each video v, has an associated set of related videos R, containing top-N videos ranked by their relatedness score r(Vj, vn ... iN). The related videos can be seen as inducing a directed graph over the set of videos. Two videos v, and vn ... iN are connected by an edge en ... iN, if vn ... iN belongs to the set R,, with the weight of the edge given by the relatedness score r(v,, vn ... iN).
When browsing by similarity or by relatedness, the user is presented with a list of content items that are related to a selected content item. When selecting another content item from the list of related content items, a new list of related content items is shown, thereby allowing further search for related content items. United States patent application US 2008/0097975 A1 describes a simulation-assisted search technique. A visually-oriented search system guides a search with non-verbal inputs. Instead of specifying discrete attributes (words) as input to a search engine, a user may create a visual model of a desired end result and apply the model as a general- ized input from which discrete attributes are extracted for submission to conventional search engines. The search can apparently be enhanced with a simulation of the visually- created query, and the simulation may be transformed into a query suitable for distribution to one or more search engines. The query may be refined using domain specific rules, vocabulary, expert systems, and the like. Search results may be browsed by a user, or employed to further refine subsequent searches.
United States patent application US 2006/0155684 A1 discloses a method of presenting web image search results for effective image browsing. So-called task-based attention objects for each of multiple images associated with image search results are generated. Thumbnail images from respective ones of the images are created as a function of at least the task-based attention objects. The thumbnail images shall emphasize image region(s) of greater priority to a user in view of a keyword or expanded keyword.
Given the large amount of available content items, the list of related or similar content items being displayed when browsing through a content item database can be rather long and may, thus, not provide a good overview to the user. Summary of the invention
It is a technical object of the present invention to provide technical means for automatically improving an overview of displayed related content items when browsing by similarity or by related ness.
According to a first aspect of the present invention, the technical object is achieved by a method of operating an apparatus for displaying content items on a display arranged for being coupled to the apparatus, wherein the method comprises the following steps: receiving an electronic selection command initiated by a user, the selection command designating a content item displayed on the display as having a type of selected status (selected content item), generating a search string in dependence of the selected content item, forwarding the search string to a search engine, the search engine being coupled to a content item database and configured to carry out a content item search based on the search string, - receiving search result data from the search engine, the search result data including data pairs that relate to found content items, wherein each of the data pairs includes a respective content item data piece representing a respective content item and a respective associated relatedness value, the respective associated relatedness value indicating a degree of relatedness between the respective content item and the selected content item, defining a two-dimensional grid comprising rows and columns on a display area of the display, wherein a graphical content item representation can be arranged at each intersection field where a column intersects with a row, and arranging graphical representations of the found content items in the two- dimensional grid in dependence of the associated relatedness values, such that a graphical representation of a found content item whose associated relatedness value is the highest of relatedness values associated to found content items to be displayed in a common column of the grid is arranged at a centered intersection field being centered in the common column. The present invention includes the recognition that according to prior art displaying mechanisms, related content items are usually presented in an one-dimensional manner, wherein a top-ranked related content item is arranged in the first position and content items considered less related are arranged linearly after the top-ranked content item. However, this approach does not provide a good overview of content items available and it does not provide enough visual structure for users to orientate themselves and navigate effectively and easily. Therefore, according to prior art displaying mechanism, a user eventually spends a lot of time browsing, thereby causing energy consumption and increased network load, as some processing means that operate a respective content item database have to process each search inquiry initiated by the user. For example, after having selected a certain video and having browsed through a couple of lists of related videos, it is difficult for the user to return to the video from which he/she had originally started browsing. These issues become even more serious when accessing a content item database from a device that does not support a point-and-click paradigm, such as TV-sets with standard remote controls, i.e. up-, down-, left-, right-commands only.
Due to the representation of found content items in the two-dimensional (2D) grid, the operating method allows for easy navigation through related content items, in particular with a standard television (TV) remote control. According to the operating method, a display area is reserved for the two-dimensional grid comprising the rows and columns yielding a matrix (or tabular or array) like structure. Each column of this structure includes a column group of related content items, wherein the found content item whose associ- ated relatedness value is the highest with respect to the relatedness values associated to the found content items of the column group is arranged in a centered position of the respective column. Thus, content items of the column group whose associated relatedness values are less than the relatedness value of the content item graphically represented at the center position are arranged at an upper and at a lower position with re- spect to this center position. This manner of arranging found content items provides a very organized overview and a visual structure to the user browsing by relatedness or by similarity. Therefore, browsing is more convenient for a user, as a user can quickly find content items of interest to him/her. Also, the time a user is operating the apparatus for finding content items can be reduced, which leads to energy saving and a significant reduction of network load on the side of the content item database. The energy saving aspect is in particular relevant for mobile devices that are driven by battery.
Furthermore, the two-dimensional grid is built in such a way that it provides easy access to closely related content items as well as content items that are less closely related. This enables the discovery of less closely related but interesting content items, which would not be easily found by scrolling through a one-dimensional list of related content items, as the less closely related content items would be typically positioned in the later or last positions of the one-dimensional list.
It shall be understood that the associated relatedness values included in the data pairs provided by the search engine does not have to be present in a separate data word, but can be delivered by the search engine implicitly, e.g., in the form of a list. Such list can include, in a first list position, a content item data piece representing a content item with a highest relatedness degree and further content item data pieces in subsequent list position exhibiting a respective diminished relatedness degrees or, respectively, the list begins with a content item exhibiting a lowest relatedness degree and content items of subsequent list positions have respective increased relatedness degrees. Thus, the associated relatedness values can be encoded in list positions of the search result data delivered in the form of a list. It is not mandatory for carrying out the invention that actual values in the form of numerical numbers are delivered by the search engine. Rather, values can be encoded in a list ordered by relevance and/or relatedness. Such delivery of search result data is common for many known search engines and such delivery does not have to be modified in order to allow for representing the content items on the display with use of the claimed method in the described manner. The apparatus to be operated can be integrated in any kind of a user terminal, such as a mobile terminal, such as a mobile phone or a smartphone, a personal computer, a notebook, a television system, a set-top box, a multimedia player, an internet video portal, etc..
The electronic selection command initiated by the user can be input, for instance, through a remote control, such as a conventional TV remote control, or by a mouse through a "point-and-click" mechanism, via a touch screen and so on. It is recognized which content item is selected and a search string is generated in response to this recognition. A search is implemented based on the generated search string using a search engine. The search string can be based on metadata of the selected content item. For instance, the search engine performs a search for related or similar content items. The content item database coupled to the search engine can also be personal channel of the user, the personal channel storing personal channel data pieces indicative of preferred content of the user. Within the scope of the description of the present invention, the wording "content item" can also mean such personal channel data piece. Within the scope of the description of the present invention, the wording "relatedness" is supposed to follow its standard definition within recommender technology. Thus, the notion "relatedness" can mean similarity between two content items; however, there can also be some other kind of relatedness, e.g., economical relatedness or a relatedness that is deducted from a user account, a user behaviour and/or deducted from similarities between users and so on. I shall be understood, though, that the present invention rather focuses on displaying related content items than on mechanisms for retrieving related content items. The found content items are represented by data pairs, wherein each of these includes a data representation of one of the found content items and a respective associated relat- edness value. The present invention includes the idea of converting the graph of related content items mentioned in the background of the invention into the two-dimensional grid that is easy to navigate through. The set-up and the content of the two-dimensional grid is dependent on the selected content item that was selected prior to the creation of the two- dimensional grid.
It is preferred that the selected content item is also represented in the two-dimensional grid. Depending on the selected content item, a column of the selected content item can be either kept empty or filled with other representations of content items. For instance, if the two-dimensional grid is used to represent a personal channel, the column of the selected content item can be filled with the content of the personal channel. If the two- dimensional grid shows the result of a search of a content item database, the initial central column can be filled with results of the search. In an embodiment, the operating method includes the additional step of arranging a graphical representation of the selected content item at a center position of the two- dimensional grid.
The center position of the two-dimensional grid is preferentially centered with respect to a vertical and horizontal direction. Therefore, the user is confronted with a visual represen- tation of found content items, wherein the initially selected content item is represented at a center and all the other related content items are represented in a manner, wherein the respective associated relatedness values decrease both in left and right direction and in up and down direction. This way of representing found related content items makes it very easy for the user to follow even subliminal interests that the user is incapable of verbalizing, as he can now easily navigate through content items based on his visual impression only. In the outcome, such graphical representation allows a electrical energy and time efficient way of finding content items of interest. Therefore, the user will eventually spend less time operating the apparatus, thereby significantly reducing energy consumption and network load. In a particularly preferred embodiment, the operating method includes the steps of: applying a clustering algorithm to the search result data for clustering the found content items into a plurality of clusters in dependence of a similarity of the found content items, and associating each cluster to a respective of the columns, wherein the graphical representations of the found content items are arranged such that each column of the two-dimensional grid includes graphical representations of found content items that belong to a respective associated cluster.
It shall be understood that the arranging step of the operating method can be applied to rows instead of columns, e.g., depending on a point of view of the user. In this embodiment, the centered row thus includes a plurality of cluster representative content items. Therefore, by navigating in a horizontal direction, the user can skip from cluster to cluster and by navigating in a vertical direction, the user can browse through a respective cluster.
In an example, the user selects a video as a selected content item. At first, a set of re- lated videos is retrieved. Next, the videos of the set of related videos are divided into N clusters depending on their similarity. As mentioned introductory, the notion of related- ness can comprise other aspects of similarity, such as user account aspects, economically relatedness and so on. Different clustering algorithms can be applied, wherein, in a preferred embodiment, the cluster algorithm includes at least one of a K-means clustering algorithm, a hierarchical clustering algorithm, a spectral clustering algorithm, or a combination thereof. For each cluster, one cluster-representative video is chosen and displayed in the same row as the selected video. Graphical representations of the other videos belonging to the cluster are inserted in the columns corresponding to their cluster- representative video. It shall be understood, that the clustering algorithm can certainly be applied, if other content item types than videos are searched for. Moving in the horizontal direction on the two-dimensional grid allows discovering entire categories of related videos, while moving along the vertical direction allows exploring the content of a cluster.
In an embodiment, the graphical representation of the selected content item is arranged at a column centered with respect to the two-dimensional grid and wherein the centered column includes only the graphical representation of the selected content item. In this embodiment, the overview of the two-dimensional grid is furthermore improved, as the user can easily detect which content item is the selected content item.
Taking into account that it is preferred that the selected content item is represented at a center, in a preferred embodiment, the graphical representations of the found content items are arranged such that a row centered with respect to the two-dimensional grid includes the graphical representation of the selected content item and graphical representations of found content items whose associated relatedness values decrease both in a left and in a right direction with respect to the graphical representation of the selected content items. In this preferred embodiment, the relatedness value decreases both in a left and in a right direction, thereby deviating from a linear displaying of content items and allowing for an approved overview. For instance, the selected content item being represented at a center position has as its first right neighbour a content item representation of a content item whose associated relatedness value is the highest. As its first left neighbour, there is arranged a representation of content item who's associated relatedness value is a second highest. As a second right neighbour of the centered selected content item representation there is positioned a representation of a content item who's associated relatedness value is the third highest among the found content items. This manner of representation is preferentially preserved throughout the entire center row and correspondingly in each columns.
In view of the preferred position of the representation of the selected content item being at a center position, it is preferred that the two-dimensional grid includes an uneven number of rows and an uneven number of columns.
In a particular preferred embodiment, the operating method comprises the additional steps of: receiving an electronic position command initiated by a user, and designating one of the found content items displayed in the two-dimensional grid as having a type of marked status (marked content item) by adding a graphical mark to the marked content item. This embodiment is particular preferred, if the user enters his commands through a conventional remote control comprising buttons for submitting a move-right command, a move-left command, a move-up command, and a move-down command. This embodiment ensures that the user can easily navigate through the displayed content items, as he can see the actual position of a cursor. This allows for easy submission of a further electronic selection command, e.g., submitted with an "o.k.'V'Enter" button on a remote control, wherein this further selection command designates the marked content item as having the type of selected status. Thereby, the user can easily select a new content item and, in a preferred embodiment, the operating method comprises the additional step of - rearranging the graphical representation in dependence of the further selection command.
In particular, the two-dimensional grid is rearranged, such that the newly selected content item assumes the center position and a new search is performed based on the selected content item and the newly found content items are displayed in the two-dimensional grid in manner as explained above. The selected content item can thus be changed by using the conventional four arrow keys on a remote control. By pressing one of the four arrow keys, a newly content item can be marked, e.g., highlighted, and then selected, wherein set-up and content of the two-dimensional grid content is adapted after selection of the highlighted/marked content item to bring the newly selected content item into the center of the two-dimensional grid. Accordingly, the two-dimensional grid is refilled depending on the newly selected content item. For instance, in the centered row of the selected content item, representations of new cluster representatives are inserted, and in the columns, content item representations of content items of respective cluster are inserted.
The operating method of the first aspect of the present invention facilitates in particular browsing through a video item database. It shall be understood, though, that the content items do not have to be of the same type. For instance, it is possible to display both graphical representations of books, articles, videos, documents, blogs, products, music files etc., if a corresponding relatedness between the content items is high enough. In other words, the search engine can be coupled to a plurality of different content item databases for retrieving relevant related content items. If the search engine has retrieved content items from two different content item databases, the method comprises, in an embodiment, the step of mapping the found content items in two different directions in the grid, for instance content items representing TV programs can be mapped in columns, while related internet videos can be inserted into rows.
According to a second aspect of the present invention, the above identified technical object is achieved by a computer program for operating an apparatus for displaying content items on a display arranged for being coupled to the apparatus, the computer program comprising program code means for causing the apparatus to carry out the steps of the method of the first aspect of the invention, when the computer program is run on a computer controlling the apparatus.
The computer program of the second aspect of the invention may be stored/distributed on a suitable medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.
According to a third aspect of the present invention, the above identified object is achieved by an apparatus for displaying content items on a display arranged for being coupled to the apparatus, the apparatus comprising: an input configured to receive an electronic selection command initiated by a user, the selection command designating a content item displayed on the display as having a type of selected status (selected content item), a search string generator configured to generate a search string in dependence of the selected content item, a sender configured to forward the search string to a search engine, the search engine being coupled to a content item database and configured to carry out a content item search based on the search string, a receiver configured to receive search result data from the search engine, the search result data including data pairs that relate to found content items, wherein each of the data pairs includes a respective content item data piece representing a respective content item and a respective associated relatedness value, the respective associated relatedness value indicating a degree of relatedness between the respective content item and the selected content item, a display driver unit configured to define a two-dimensional grid comprising rows and columns on a display area of the display, wherein a graphical content item representation can be arranged at each intersection field where a column intersects with a row, and - to arrange graphical representations of the found content items in the two- dimensional grid in dependence of the associated relatedness values, such that a graphical representation of a found content item whose associated relatedness value is the highest of relatedness values associated to found content items to be displayed in a common column is arranged at a centered intersection field being centered in the com- mon column.
The apparatus of a third aspect of the present invention principally shares the advantages of the operating method of the first aspect of the present invention. In particular, the apparatus of the third aspect has preferred embodiments that correspond to the steps of the preferred embodiments of the operating method of the first aspect described above. The apparatus of the third aspect of the present invention can be operated with an operating method of the first aspect of the present invention. In other words, the apparatus of the third aspect of the invention can implement the operating method of the first aspect of the invention.
According to a fourth aspect of the present invention, the above identified object is achieved by a user terminal for internet browsing, the user terminal comprising: a user interface configured to receive a user command, a display configured to display internet websites, and an apparatus in accordance with the fourth aspect of the invention, wherein the apparatus is coupled to the user interface and to the display. All aspects of the invention can be applied in the context of a social network consisting of PCs, set-top boxes, et cetera. On such devices, a recommender technology can be installed. An application of an aspect of the invention increases the usability and user satisfaction of such recommenders. More specifically, they can be integrated into the personal channel concept that is believed to offer the ease-of-use that users are used to.
It shall be understood that the operating method of the first aspect of the invention, the computer program of the second aspect of the invention, the apparatus of the third aspect of the invention and the user terminal of the fourth aspect of the invention have similar and/or identical preferred embodiments, in particular, as defined in the dependent claims.
It shall be understood that a preferred embodiment of the invention can also be any combination of the dependent claims with the respective independent claim.
These and other aspects of the invention will be apparent from and elucidated with reference to the embodiments described hereinafter.
Brief description of the drawings
In the following drawings:
Fig. 1 shows a schematic graphical representation of a selected content item and related content items,
Fig. 2 shows a flowchart illustrating an operating method in accordance with a first aspect of the invention,
Fig. 3 shows a schematic representation of a two-dimensional grid for displaying related content items, and
Fig. 4 shows exemplary and schematically a block diagram representation of a user terminal for internet browsing in accordance with the fourth aspect of the present invention.
Description of embodiments
Fig. 2 shows a flowchart illustrating an operating method 200 in accordance with a first aspect of the invention. The method 200 is a method for operating an apparatus for displaying content items on a display arranged for being coupled to the apparatus.
In a first step 210, an electronic selection command initiated by a user is received, wherein the selection command designates a content item displayed on the display as having a type of selected status, in the following referred to as selected content item.
In a second step 220, a search string is generated in dependence of the selected content item. In a following third step 230, the search string is forwarded to a search engine that is coupled to a content item database and that carries out a content item search based on the search string.
In a fourth step 240, search result data from the search engine is received, wherein the search result data includes data pairs that relate to found content items. Each of the data pairs includes a respective content item data piece representing a respective content item and a respective associated relatedness value, the respective associated relatedness value indicating a degree of relatedness between the respective content item and the selected content item. In a fifth step 250, a two-dimensional grid comprising rows and columns on a display area of the display is defined, e.g., a two-dimensional grid 300 as depicted in Fig. 3, wherein a graphical content item representation can be arranged at each intersection field where a column intersects with a row. This step can include reservation of a certain display part of the display for displaying the found content items, e.g. by communicating with a display driver driving the display.
In a sixth step 260 graphical representations of the found content items are arranged in the two-dimensional grid in dependence of the associated relatedness values, such that a graphical representation of a found content item whose associated relatedness value is the highest of relatedness values associated to found content items to be displayed in a common column is arranged at a centered intersection field being centered in the common column.
In the following, an example is described with respect to Fig. 2 und Fig. 3: A user has selected content item A while browsing through a content item database, e.g. a video database. According to the operating method 200, it is searched for related content items being related to content item A through a search engine. The search engine delivers at least content items A-i to A6 IV and associated relatedness values as depicted in Fig. 3. A clustering algorithm is applied to the found content items, yielding clusters according to cluster representatives A-i to A6. Each cluster is associated to one of the columns of the grid 300, wherein the graphical representations of the found content items are arranged such that each column of the two-dimensional grid includes graphical representations of found content items that belong to a respective associated cluster. The center row includes, among a representation of the selected content item A, representations of cluster representative content items A-i , A2, A3, A4, A5 and A6, the last mentioned content items are each the content item exhibiting the highest degree of relatedness to content item A with respect to their respective cluster. In each column, the degree of relatedness decreases both in up and down direction. In the two-dimensional grid 300, there is always one selected content item. The selected content item can be changed by the user, e.g., by using a TV remote control or by using a computer mouse. The grid content is adapted to bring the newly selected video in the centre of the grid, wherein this adapting/rearranging step includes the generating step, the forwarding step, the receiving step, the defining step and the arranging step as elucidated above.
Given a selected content item, first a set of related content items is calculated or retrieved. Next, the content items of the set are divided into N clusters depending on their similarity. Different clustering algorithms can be used such as K-means clustering, hierar- chical clustering, spectral clustering, etc.. For each cluster, one cluster-representative content item is chosen and displayed in the same row as the selected content item. The other content items belonging to a respective cluster are inserted in the columns corresponding to their cluster-representative content item.
The row corresponding to the selected content item is filled with cluster-representative content items A-i to A6. Cluster-representative content items can be content items that are automatically selected as being representative for an entire cluster of related content items.
Moving in the horizontal direction on the grid allows discovering entire categories of related content items while moving along the vertical direction allow exploring the content of a cluster.
The content of the grid is dependent on the initial content item that was selected to create the grid. Depending on the origin of the first content item, the column of the first content item can be either left empty or filled with other content item. For example, if the grid is used to represent a personal channel, the column of A is filled with the content of the personal channel. If the grid shows the results of a search, the initial central column is filled with the results of the search.
Fig. 4 shows exemplary and schematically a block diagram representation of a user terminal 400 for internet browsing in accordance with the fourth aspect of the present invention. However, the terminal 400 can also be used for browsing through a personal channel. The terminal 400 can be a personal computer, a TV-set, a mobile phone, a smart phone, a laptop, a personal digital assistant, a notebook, a set-top box etc. Websites visited by the user (not shown) are displayed on a display 410 of the terminal 400. The user can enter commands through a user interface 420. For instance, the user interface is a remote control or a touch screen embedded in display 410 or a computer mouse or microphone arrangement for voice commands. For displaying content items in a two-dimensional grid, for instance as indicated in Fig. 3 and suggested in Fig. 4, the terminal comprises an apparatus 100. The apparatus is coupled to the user interface 420 and to the display 410 on the one side and to a search engine 440 on the other side. The search engine can be implemented on a remote server of the internet. The apparatus 100 comprises an input 1 10 that receives an electronic selection command initiated by a user. The selection command designates a content item displayed on the display 410 as having a type of selected status, in the following referred to as selected content item.
Based on the selected content item, a search string generator 120 of the apparatus 100 generates a search string and forwards this string to a sender 130. The sender transmits the search string the search engine 440 that carries out a content item search within at least one content item database 430 correspondingly. As indicated, the selected content item can also be an item of a personal channel of the user. In this case, the search engine and the content item database (e.g. electronic program guide data)can be internally implemented in the apparatus 100. If, however, the content item data base is a video or product data base, such as youtube.com or amazon.com, the search engine is rather implemented on a server that administrates the content item database.
A receiver 140 of the apparatus 100 receives search result data from the search engine 440. The sender 130 and the receiver 140 can be united an internet communication unit that fulfils the sending and receiving function explained above. For instance, sender 130 and receiver 140 are implemented in a conventional internet interface, e.g., the apparatus 100 can be wirelessly coupled to the internet, in particular wirelessly coupled to the search engine.
The search result data include data pairs that relate to found content items, wherein each of the data pairs includes a respective content item data piece representing a respective content item and a respective associated relatedness value, the respective associated relatedness value indicating a degree of relatedness between the respective content item and the selected content item.
The receiver 140 passes the result data to a display driver unit 150. The display driver unit drives the display 410. After or before having received the search result data, it defines a two-dimensional grid in a display area, e.g. according to Fig. 3, wherein a graphical content item representation can be arranged at each intersection field where a column intersects with a row.
The display driver unit arranges graphical representations of the found content items in the two-dimensional grid in dependence of the associated relatedness values, such that a graphical representation of a found content item whose associated relatedness value is the highest of relatedness values associated to found content items to be displayed in a common column is arranged at a centered intersection field being centered in the common column.
Concerning the arrangement possibilities of arranging the representations of content items, it is referred to the description of the operating method 200 according to Fig. 2. The display driver unit 150 of the apparatus 100 can operate accordingly. In particular, the apparatus 100 allows the user to navigate through the displayed content items and reacts to a selection of a new content item by initiating a new content item search and rearranging the displayed content items, in particular centring the newly selected content item and rearranging the related content item as described above with respect to the operating method.
It shall be understood that an arrangement of elements of a respective figure predominately serves a purpose of an evident description; it does not relate to any actual geometric arrangement of parts of a manufactured apparatus/device according to the invention. In the claims, the word "comprising" does not exclude other elements or steps, and the indefinite article "a" or "an" does not exclude a plurality.
A single unit or device may fulfil the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage. Any reference signs in the claims should not be construed as limiting the scope. The computer program of the second aspect of the invention may be stored/distributed on a suitable medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.

Claims

Claims
1. A method (200) of operating an apparatus (100) for displaying content items on a display (410) arranged for being coupled to the apparatus (100), the method (200) corn-prising steps of: receiving (210) an electronic selection command initiated by a user, the selection command designating a content item displayed on the display (410) as having a type of selected status, in the following referred to as selected content item, generating (220) a search string in dependence of the selected content item, forwarding (230) the search string to a search engine (440), the search engine (440) being coupled to a content item database (430) and configured to carry out a content item search based on the search string, receiving (240) search result data from the search engine (440), the search result data including data pairs that relate to found content items, wherein each of the data pairs includes a respective content item data piece representing a respective content item and a respective associated relatedness value, the respective associated relatedness value indicating a degree of relatedness between the respective content item and the selected content item, defining (250) a two-dimensional grid (300) comprising rows and columns on a display area of the display (410), wherein a graphical content item representation can be arranged at each intersection field where a column intersects with a row, and arranging (260) graphical representations of the found content items in the two-dimensional grid (300) in dependence of the associated relatedness values, such that a graphical representation of a found content item whose associated relatedness value is the highest of relatedness values associated to found content items to be displayed in a common column is arranged at a centered intersection field being centered in the common column.
2. The method (200) of claim 1 , comprising the additional step of: arranging a graphical representation of the selected content item at a center posi-tion of the two-dimensional grid (300).
3. The method (200) of claim 1 or 2, comprising the additional steps of: applying a clustering algorithm to the search result data for clustering the found content items into a plurality of clusters in dependence of a similarity of the found content items, and associating each cluster to a respective of the columns, wherein the graphi- cal representations of the found content items are arranged such that each column of the two-dimensional grid (300) includes graphical representations of found content items that belong to a respective associated cluster.
4. The method (200) of one of the preceding claims 1 to 3, wherein the cluster algorithm includes at least one of a K-means clustering algorithm, a hierarchical cluster- ing algorithm, a spectral clustering algorithm, or a combination thereof.
5. The method (200) of one of the preceding claims 2 to 4, wherein the graphical representation of the selected content item is arranged at a column centered with respect to the two-dimensional grid (300) and wherein the centered column includes only the graphical representation of the selected content item.
6. The method (200) of one of the preceding claims 1 to 5, wherein the graphical representations of the found content items are arranged such that a row centered with respect to the two-dimensional grid (300) includes the graphical representation of the selected content item and graphical representations of found content items whose associated relatedness values decrease both in a left and in a right direction with respect to the graphical representation of the selected content items.
7. The method (200) of one of the preceding claims, wherein the two-dimensional grid (300) included an uneven number of rows and an uneven number of columns.
8. The method (200) of one of the preceding claims, comprising the additional steps of: receiving an electronic position command initiated by a user, and designating one of the found content items displayed in the two-dimensional grid (300) as having a type of marked status, in the following referred to as marked content item, by adding a graphical mark to the marked content item.
9. The method (200) of claim 8, wherein the position command includes at least one of a move-right command, a move-left command, a move-up command, a move- down command, or a combination thereof.
10. The method (200) of claim 8 or claim 9, additional comprising the additional steps of: receiving a further electronic selection command, the further selection command designating the marked content item as having the type of selected status, and - re-arranging the graphical representations in dependence of the further selection command.
1 1. A computer program for operating an apparatus for displaying content items on a display arranged for being coupled to the apparatus, the computer program comprising program code means for causing the apparatus to carry out the steps of one of the methods as defined in the preceding claims, when the computer program is run on a computer controlling the apparatus.
12. An apparatus (100) for displaying content items on a display (410) arranged for being coupled to the apparatus (100), the apparatus (100) comprising: an input (1 10) configured to receive an electronic selection command initi- ated by a user, the selection command designating a content item displayed on the display (410) as having a type of selected status, in the following referred to as selected content item, a search string generator (120) configured to generate a search string in dependence of the selected content item, a sender (130) configured to forward the search string to a search engine (440), the search engine (440) being coupled to a content item database (430) and configured to carry out a content item search based on the search string, a receiver (140) configured to receive search result data from the search engine (440), the search result data including data pairs that relate to found content items, wherein each of the data pairs includes a respective content item data piece representing a respective content item and a respective associated relatedness value, the respective associated relatedness value indicating a degree of relatedness between the respective content item and the selected content item, a display driver unit (150) configured to define a two-dimensional grid (300) comprising rows and columns on a display area of the display (410), wherein a graphical content item representation can be arranged at each intersection field where a column intersects with a row, and to arrange graphical representations of the found content items in the two- dimensional grid (300) in dependence of the associated relatedness values, such that a graphical representation of a found content item whose associated relatedness value is the highest of relatedness values associated to found content items to be displayed in a common column is arranged at a centered intersection field being centered in the common column.
A user terminal (400) for internet browsing, the user terminal (400) comprising: a user interface (420) configured to receive a user command, a display (410) configured to display internet websites, and an apparatus (100) according to claim 12, wherein the apparatus (100) is coupled to the user interface (420) and to the display (410).
PCT/EP2012/063842 2011-07-20 2012-07-13 Easy 2d navigation of video database WO2013010959A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
RU2014106227A RU2608468C2 (en) 2011-07-20 2012-07-13 Easy two-dimensional navigation of video database
CN201280035776.6A CN103718176B (en) 2011-07-20 2012-07-13 The simple two dimensional navigation of video database
US14/131,283 US9779164B2 (en) 2011-07-20 2012-07-13 Easy 2D navigation of video database
EP12733781.4A EP2734932A1 (en) 2011-07-20 2012-07-13 Easy 2d navigation of video database

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP11174748A EP2549389A1 (en) 2011-07-20 2011-07-20 Easy 2D navigation in a video database
EP11174748.1 2011-07-20

Publications (1)

Publication Number Publication Date
WO2013010959A1 true WO2013010959A1 (en) 2013-01-24

Family

ID=46506457

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2012/063842 WO2013010959A1 (en) 2011-07-20 2012-07-13 Easy 2d navigation of video database

Country Status (5)

Country Link
US (1) US9779164B2 (en)
EP (2) EP2549389A1 (en)
CN (1) CN103718176B (en)
RU (1) RU2608468C2 (en)
WO (1) WO2013010959A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103677541A (en) * 2013-12-25 2014-03-26 乐视网信息技术(北京)股份有限公司 Method and system for setting position of moving cursor in display page with links
US10318581B2 (en) * 2016-04-13 2019-06-11 Google Llc Video metadata association recommendation
US9916493B2 (en) 2016-08-03 2018-03-13 At&T Intellectual Property I, L.P. Method and system for aggregating video content
WO2019126949A1 (en) * 2017-12-25 2019-07-04 华为技术有限公司 Method, device, node, and system for providing media content

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060155684A1 (en) 2005-01-12 2006-07-13 Microsoft Corporation Systems and methods to present web image search results for effective image browsing
US20080097975A1 (en) 2006-05-19 2008-04-24 Louise Guay Simulation-assisted search

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB9818633D0 (en) * 1998-08-26 1998-10-21 Clifton Bligh Gervase Internet navigation
CN1304107A (en) 2000-01-10 2001-07-18 顾钧 Method for making information retrieval by utilizing picture on TV and its network service system
US7486294B2 (en) * 2003-03-27 2009-02-03 Microsoft Corporation Vector graphics element-based model, application programming interface, and markup language
US7511718B2 (en) * 2003-10-23 2009-03-31 Microsoft Corporation Media integration layer
US7831832B2 (en) * 2004-01-06 2010-11-09 Microsoft Corporation Digital goods representation based upon matrix invariances
US7660468B2 (en) * 2005-05-09 2010-02-09 Like.Com System and method for enabling image searching using manual enrichment, classification, and/or segmentation
US20070186177A1 (en) * 2006-02-03 2007-08-09 Yahoo! Inc. Content navigation interfaces and associated methods
US20080086687A1 (en) * 2006-10-06 2008-04-10 Ryutaro Sakai Graphical User Interface For Audio-Visual Browsing
US7941429B2 (en) * 2007-07-10 2011-05-10 Yahoo! Inc. Interface for visually searching and navigating objects
US20090019348A1 (en) * 2007-07-13 2009-01-15 Rodney Kuhn Haffnerson King Fractal Grid Hierarchical Presentation Of Information
RU2389062C2 (en) * 2008-03-12 2010-05-10 Дмитрий Владимирович Казунин Viewing and control method in complex topology network and system to this end
US8117564B2 (en) * 2009-04-10 2012-02-14 United Video Properties, Inc. Systems and methods for generating a media guidance application with multiple perspective views
US20110040740A1 (en) * 2009-08-15 2011-02-17 Alex Nugent Search engine utilizing flow networks
US8352465B1 (en) * 2009-09-03 2013-01-08 Google Inc. Grouping of image search results
US8606652B2 (en) * 2010-12-20 2013-12-10 Target Brands, Inc. Topical page layout

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060155684A1 (en) 2005-01-12 2006-07-13 Microsoft Corporation Systems and methods to present web image search results for effective image browsing
US20080097975A1 (en) 2006-05-19 2008-04-24 Louise Guay Simulation-assisted search

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2734932A1 *

Also Published As

Publication number Publication date
EP2549389A1 (en) 2013-01-23
CN103718176A (en) 2014-04-09
RU2014106227A (en) 2015-09-10
EP2734932A1 (en) 2014-05-28
RU2608468C2 (en) 2017-01-18
US9779164B2 (en) 2017-10-03
CN103718176B (en) 2018-01-12
US20140173436A1 (en) 2014-06-19

Similar Documents

Publication Publication Date Title
US11669577B2 (en) Systems and methods for organizing and displaying electronic media content
US9407965B2 (en) Interface for watching a stream of videos
KR101820256B1 (en) Visual search and three-dimensional results
US9940693B2 (en) Information processing for display of content based on importance level
US20090070321A1 (en) User search interface
US9990394B2 (en) Visual search and recommendation user interface and apparatus
US11789960B2 (en) Systems and methods for grouping search results from multiple sources
JP2006157899A (en) Indication of data associated with data items
US9779164B2 (en) Easy 2D navigation of video database
JP2004152110A (en) Method for establishing retrieval condition and device for establishing retrieval condition
JP2020519067A (en) System and method for presenting search results from multiple sources
EP3198477B1 (en) A method and apparatus for search query formulation
US10255294B2 (en) Search system interface
CN113360741A (en) Dynamically injecting relevant content in search results
US20220159327A1 (en) Video Streaming Platform
TW202117558A (en) Convergence information-labels retrieval method
WO2015034931A2 (en) Media organization recommendations based on user interaction with grouped media assets
de Silva et al. Interactive social, spatial and temporal querying for multimedia retrieval

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12733781

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 14131283

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2012733781

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2014106227

Country of ref document: RU

Kind code of ref document: A