EP2540016A1 - Method and server for detecting a video program received by a user - Google Patents

Method and server for detecting a video program received by a user

Info

Publication number
EP2540016A1
EP2540016A1 EP11704072A EP11704072A EP2540016A1 EP 2540016 A1 EP2540016 A1 EP 2540016A1 EP 11704072 A EP11704072 A EP 11704072A EP 11704072 A EP11704072 A EP 11704072A EP 2540016 A1 EP2540016 A1 EP 2540016A1
Authority
EP
European Patent Office
Prior art keywords
user
video program
signature
audio
identifying
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP11704072A
Other languages
German (de)
French (fr)
Inventor
Gerard Delegue
Sylvain Squedin
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alcatel Lucent SAS
Original Assignee
Alcatel Lucent SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alcatel Lucent SAS filed Critical Alcatel Lucent SAS
Publication of EP2540016A1 publication Critical patent/EP2540016A1/en
Withdrawn legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/56—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
    • H04H60/58—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54 of audio
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/61—Arrangements for services using the result of monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
    • H04H60/66—Arrangements for services using the result of monitoring, identification or recognition covered by groups H04H60/29-H04H60/54 for using the result on distributors' side
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/68—Systems specially adapted for using specific information, e.g. geographical or meteorological information
    • H04H60/72—Systems specially adapted for using specific information, e.g. geographical or meteorological information using electronic programme guides [EPG]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/68—Systems specially adapted for using specific information, e.g. geographical or meteorological information
    • H04H60/73—Systems specially adapted for using specific information, e.g. geographical or meteorological information using meta-information
    • H04H60/74—Systems specially adapted for using specific information, e.g. geographical or meteorological information using meta-information using programme related information, e.g. title, composer or interpreter
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H2201/00—Aspects of broadcast communication
    • H04H2201/30—Aspects of broadcast communication characterised by the use of a return channel, e.g. for collecting users' opinions, for returning broadcast space/time information or for requesting data
    • H04H2201/33—Aspects of broadcast communication characterised by the use of a return channel, e.g. for collecting users' opinions, for returning broadcast space/time information or for requesting data via the broadcast channel
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H2201/00—Aspects of broadcast communication
    • H04H2201/30—Aspects of broadcast communication characterised by the use of a return channel, e.g. for collecting users' opinions, for returning broadcast space/time information or for requesting data
    • H04H2201/37—Aspects of broadcast communication characterised by the use of a return channel, e.g. for collecting users' opinions, for returning broadcast space/time information or for requesting data via a different channel
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H2201/00—Aspects of broadcast communication
    • H04H2201/90—Aspects of broadcast communication characterised by the use of signatures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/76—Arrangements characterised by transmission systems other than for broadcast, e.g. the Internet
    • H04H60/81—Arrangements characterised by transmission systems other than for broadcast, e.g. the Internet characterised by the transmission system itself
    • H04H60/82—Arrangements characterised by transmission systems other than for broadcast, e.g. the Internet characterised by the transmission system itself the transmission system being the Internet

Definitions

  • a schedule (published in particular in the press) describes in advance the content of the programs of each video program package.
  • An electronic guide is associated with each bouquet to describe the current program on each video stream of this bouquet, at the moment this guide is consulted.
  • WO 2008/042953 describes a method for identifying an audio sequence, for example a song received by a mobile phone.
  • This known method consists of recording this audio sequence and then sending it to a server storing reference signatures respectively representing many audio sequences.
  • Each reference signature has been previously calculated from a known audio sequence, during a time interval having a duration of a few seconds to a few minutes.
  • Each signature is constituted, for example, by energy measurements respectively in a plurality of segments of the frequency spectrum.
  • the known identification method consists in calculating a sequence of signatures from the received audio sequence, and correlating each calculated signature with each reference signature in stock.
  • the server sends the user the identity associated with this reference signature (A song title) and an extract from the corresponding audio sequence (The song), which has previously stored with the reference signature, to ask the user to confirm the identification. Then, the server offers the user a service (Buy the song thus identified).
  • the disadvantage of the known methods is the slowness of the identification, due to the large number of reference signatures to be correlated with each signature calculated from a received audio sequence.
  • the purpose of the invention is to remedy this slowness, while allowing to easily change the choice of audio sequences to identify, to quickly adapt to new services to offer users.
  • the object of the invention is a method for identifying a video program received by a user, by identifying an audio sequence contained in this video program, comprising the steps of:
  • the method according to the invention also comprises:
  • the method according to the invention also consists in activating the selected service only in the case where the user has sent a message indicating that he wishes to benefit from additional services.
  • This single figure functionally represents an example of a conventional AS application server executing adapted software means for the implementation of the method according to the invention.
  • a user EU has a television connected to the Internet (not shown) by a gateway G.
  • This gateway G includes software means allow it to communicate via the Internet with the server AS and with a Internet service provider to receive a bouquet of video programs, and to benefit from additional web services in connection with the video program that it is receiving.
  • the EU user has a remote control to send commands to this gateway, to change receiving channel, or to request additional services.
  • This gateway G includes software means that allow it to receive these commands and transfer them:
  • the server AS is further connected to a satellite reception station R which receives all the programs of the bouquet that can receive a user such as the user UE.
  • This AS server includes:
  • a software module 1 constituting an interface enabling a television producer TVP to provide the server AS with information describing video programs to be identified (reference audio sequences, order of the audio sequences in the video program, respective identifiers of the reference audio sequences , and respective semantic descriptions of the reference audio sequences).
  • the semantic description of a reference audio sequence will allow the AS server to determine services to be offered to a user when an identical audio sequence will be identified in a video program received by that user.
  • the module 1 determines a signature for each reference audio sequence, and associates it with a reference audio sequence identifier.
  • a software module 2 constituting an interface enabling an SP service provider to provide the AS server with information describing additional services that may be offered during the identification of reference audio sequences, in the video program received by a user; .
  • a software module 3 for writing and reading in a memory a program guide (Titles, used channels, schedules). This guide is broadcast in parallel with each video program of the bouquet.
  • a software module 12 connected to the station R to be able to receive all the programs that a user can receive, in particular the UE user, and connected to the module 11 to receive the identifier of the channel that the user considered EU is in the process of to receive ; this module 12 comprising software means for:
  • TV producer TVP indicates the "product type” and "brand” that are the subject of this advertisement.
  • This semantic description is stored by the module 6.
  • this semantic description enables the module 10 to determine a list of services to be offered to the user, by searching via the module 7 for them. respective descriptions of additional services which correspond to this semantic description: for example a web page or a telephone number making it possible to obtain additional information on this type of product and this brand.
  • TV producer TVP does not directly associate audio clips with well-identified services. This allows independent management of services and audio sequences. For example, at the time of the first broadcast of an audio sequence associated with a TV series, it will be possible to propose the sale of the corresponding DVD, and thereafter it will be possible to offer other services. such as the sale of figurines, the sale of clothes identical to those worn by actors, etc.
  • the user can only issue a channel selection command, intended for the ISP and containing a channel identifier for changing channels.
  • the software module 10 activates an additional service for the user considered EU, as soon as a predetermined audio sequence has been detected, without the user having requested additional service.
  • the user can issue two types of command:
  • a channel selection command for the ISP and containing a channel identifier for changing channels or a request for additional services command, containing data identifying the user, identifying the channel that the user is receiving, and the date and time of the order.
  • the software module 8 for preselecting a series of reference audio sequence signature identifiers takes into account only the information provided by the program guide (Titles, used channels, schedules), via the module 3 , for the channel selected by the last channel select command.
  • the module 10 activates an additional service for the user considered EU without intervention of the module 11.
  • the software module 8 also takes into account the data contained in each service request command. Additional. He knows the date and time when the user expresses a wish to benefit from additional services. This date and this time correspond to a certain content of the received program, which has aroused the interest of the user for at least one additional service possibly associated with this content. This makes it possible to determine more precisely which additional service would interest the user.
  • the module 10 is connected to the module 11 in such a way that the module 10 activates an additional service only when it receives a control signal supplied by the module 11. that is to say when the module 1 1 receives an additional service request command, issued by the user EU.
  • the software module 8 makes a preselection of the most likely audio sequences.
  • the preselected identifiers are much less numerous than the identifiers corresponding to the set of signatures stored by the module 4.
  • the number of correlation calculations to be made for each audio sequence to be identified is therefore greatly reduced.
  • the identification of a video program is much faster than by known methods.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention relates to a method for identifying a video program received by a user (UE) by identifying an audio sequence contained in said video program, that comprises: receiving (1-6) a plurality of reference audio sequences and receiving, for each of said sequences, a signature and a reference audio signature identifier; preselecting (8) a series of reference audio signature identifiers; and correlating (9) the signatures corresponding respectively to said preselected identifiers with a signature representing an audio sequence contained in the video program received by the user, and selecting from said preselected identifiers the identifier that has the strongest correlation for identifying an audio sequence and thereby identifying the video program received by the user. The method further comprises, for preselecting a series of reference audio signature identifiers, taking into account the information describing in particular the video program received by the user and provided by a program guide broadcasted in parallel with the video program to be identified.

Description

Procédé et serveur pour détecter un programme vidéo reçu par un usager  Method and server for detecting a video program received by a user
L'invention concerne un procédé et un serveur pour identifier une séquence vidéo d'un programme vidéo dans un flux de programmes vidéo reçu par un usager, ce flux étant acheminé par un réseau hertzien de télévision, ou par un réseau câblé de télévision, ou par un réseau de téléphonie mobile, ou par Internet, etc, en mode diffusion ou en mode point à point. Si le mode diffusion est utilisé (voie hertzienne par exemple), des services additionnels propres à un usager donné peuvent être fournis via une autre voie, Internet par exemple. Si le mode point à point est utilisé, des services additionnels propres à un usager donné peuvent être fournis via la même voie, Internet par exemple. Par exemple, la société Activevideo (http: //www.activevideo.com) propose des flux vidés acheminés par Internet et qui combinent chacun un programme de télévision classique et des services web interactifs. Chaque flux est un flux MPEG unique construit par un serveur connecté à Internet, et envoyé à un usager unique. A method and a server for identifying a video sequence of a video program in a stream of video programs received by a user, which stream is carried by a television broadcast network, or a cable television network, or by a mobile telephone network, or the Internet, etc., in broadcast mode or in point-to-point mode. If the broadcast mode is used (radio channel for example), additional services specific to a given user can be provided via another channel, Internet for example. If the point-to-point mode is used, additional services specific to a given user can be provided via the same channel, for example the Internet. For example, Activevideo (http: //www.activevideo.com) offers streaming feeds over the Internet that combine a classic TV program with interactive web services. Each stream is a single MPEG stream built by a server connected to the Internet, and sent to a single user.
Si on parvient à identifier la séquence vidéo en cours de réception par un usager, il est possible de proposer à l'usager des services additionnels qui correspondent exactement à la séquence identifiée : offres commerciales, distractions, informations, publicité, etc.  If it is possible to identify the video sequence being received by a user, it is possible to offer the user additional services that correspond exactly to the sequence identified: commercial offers, entertainment, information, advertising, etc.
Cette identification est difficile. Pour cette identification, on peut utiliser deux outils qui ont été conçus pour permettre à un usager de choisir un programme vidéo :  This identification is difficult. For this identification, two tools can be used that have been designed to allow a user to choose a video program:
Un horaire (publié notamment dans la presse) décrit à l'avance le contenu des programmes de chaque bouquet de programmes vidéo. A schedule (published in particular in the press) describes in advance the content of the programs of each video program package.
Un guide électronique est associé à chaque bouquet pour décrire le programme en cours sur chaque flux vidéo de ce bouquet, à l'instant où on consulte ce guide. An electronic guide is associated with each bouquet to describe the current program on each video stream of this bouquet, at the moment this guide is consulted.
Cependant ces informations ne sont pas suffisamment précises pour identifier de manière certaine un programme, et a fortiori pour identifier une séquence vidéo dans un programme, parce que ces outils ne décrivent pas finement les programmes, séquence par séquence. En outre, de nombreux programmes sont retardés par rapport à l'horaire prévu, voire sont remplacés au dernier moment. Il est donc nécessaire de trouver un procédé plus précis pour identifier une séquence vidéo. However, this information is not precise enough to identify a certain program, and a fortiori to identify a video sequence in a program, because these tools do not describe the programs, sequence by sequence. In addition, many programs are delayed compared to the schedule, or are replaced at the last moment. It is therefore necessary to find a more precise method for identifying a video sequence.
II est envisageable d'identifier une séquence vidéo en identifiant la séquence audio qu'elle contient. Des procédés d'identification d'une séquence audio sont connus.  It is conceivable to identify a video sequence by identifying the audio sequence it contains. Methods of identifying an audio sequence are known.
Le document WO 2008/042953 décrit un procédé pour identifier une séquence audio, par exemple une chanson reçue par un téléphone portable. Ce procédé connu consiste à enregistrer cette séquence audio puis à l'envoyer à un serveur stockant des signatures de référence représentant respectivement de nombreuses séquences audio. Chaque signature de référence a été préalablement calculée à partir d'une séquence audio connue, pendant un intervalle de temps ayant une durée de quelques secondes à quelques minutes. Chaque signature est constituée, par exemple, par des mesures d'énergie respectivement dans une pluralité de segments du spectre des fréquences. Le procédé d'identification connu consiste à calculer une suite de signatures à partir de la séquence audio reçue, et corréler chaque signature calculée avec chaque signature de référence en stock. Quand une signature calculée correspond à une signature de référence en stock, le serveur envoie à l'usager l'identité associée à cette signature de référence (Un titre de chanson) et un extrait de la séquence audio correspondante (La chanson), qui a été préalablement stockée avec la signature de référence, pour demander à l'usager de confirmer l'identification. Ensuite, le serveur propose à l'usager un service (Acheter la chanson ainsi identifiée). WO 2008/042953 describes a method for identifying an audio sequence, for example a song received by a mobile phone. This known method consists of recording this audio sequence and then sending it to a server storing reference signatures respectively representing many audio sequences. Each reference signature has been previously calculated from a known audio sequence, during a time interval having a duration of a few seconds to a few minutes. Each signature is constituted, for example, by energy measurements respectively in a plurality of segments of the frequency spectrum. The known identification method consists in calculating a sequence of signatures from the received audio sequence, and correlating each calculated signature with each reference signature in stock. When a calculated signature corresponds to a reference signature in stock, the server sends the user the identity associated with this reference signature (A song title) and an extract from the corresponding audio sequence (The song), which has previously stored with the reference signature, to ask the user to confirm the identification. Then, the server offers the user a service (Buy the song thus identified).
L'inconvénient des procédés connus est la lenteur de l'identification, due au grand nombre de signatures de référence à corréler avec chaque signature calculée à partir d'une séquence audio reçue.  The disadvantage of the known methods is the slowness of the identification, due to the large number of reference signatures to be correlated with each signature calculated from a received audio sequence.
Le but de l'invention est de remédier à cette lenteur, tout en permettant de modifier facilement le choix des séquences audio à identifier, afin de les adapter rapidement à de nouveaux services à proposer aux usagers.  The purpose of the invention is to remedy this slowness, while allowing to easily change the choice of audio sequences to identify, to quickly adapt to new services to offer users.
L'objet de l'invention est un procédé pour identifier un programme vidéo reçu par un usager, en identifiant une séquence audio contenue dans ce programme vidéo, comportant les étapes consistant à : The object of the invention is a method for identifying a video program received by a user, by identifying an audio sequence contained in this video program, comprising the steps of:
- recevoir une pluralité de séquences audio de référence, et recevoir, pour chacune de ces séquences, une signature et un identifiant de signature audio de référence,  receiving a plurality of reference audio sequences, and receiving, for each of these sequences, a signature and a reference audio signature identifier,
- présélectionner une suite d'identifiants de signature audio de référence, en prenant en compte des informations décrivant le programme vidéo reçu par l'usager, et qui sont fournies par un guide de programmes qui est diffusé en parallèle avec le programme vidéo à identifier  preselecting a series of reference audio signature identifiers, taking into account information describing the video program received by the user, and which are provided by a program guide which is broadcast in parallel with the video program to be identified
- puis corréler les signatures correspondant respectivement à ces identifiants présélectionnés, avec une signature représentant une séquence audio à reconnaître contenue dans le programme vidéo reçu par l'utilisateur, et sélectionner parmi les identifiants présélectionnés celui qui présente la plus forte corrélation, pour identifier une séquence audio, et ainsi identifier le programme vidéo reçu par l'usager ; caractérisé en ce que, pour présélectionner une suite d'identifiants de signatures de séquence audio, il consiste en outre à : and then correlating the signatures respectively corresponding to these preselected identifiers, with a signature representing an audio sequence to be recognized contained in the video program received by the user, and selecting among the preselected identifiers the one with the strongest correlation, to identify a sequence audio, and thus identify the video program received by the user; characterized in that, to preselect a sequence of audio sequence signature identifiers, it further comprises:
- recevoir un message de commande indiquant que l'usager souhaite bénéficier de services additionnels, ce message contenant des donnée identifiant l'usager, identifiant le canal que l'usager est en train de recevoir, ainsi que la date et l'heure de la commande ;  receive a command message indicating that the user wishes to benefit from additional services, this message containing data identifying the user, identifying the channel that the user is receiving, as well as the date and time of the ordered ;
- et prendre en compte en outre ces données pour présélectionner une suite d'identifiants de signatures de séquence audio. Dans des modes de mise en œuvre préférés, le procédé selon l'invention consiste en outre à :  and furthermore taking into account these data to preselect a sequence of audio sequence signature identifiers. In preferred embodiments, the method according to the invention also comprises:
- recevoir une description sémantique de la séquence audio de référence correspondant à l'identifiant de la séquence audio reconnue,  receiving a semantic description of the reference audio sequence corresponding to the identifier of the recognized audio sequence,
- recevoir des descriptions correspondant respectivement à des services additionnels pouvant être proposés à l'usager,  - receive descriptions corresponding respectively to additional services that may be offered to the user,
- puis comparer cette description sémantique à des descriptions correspondant respectivement à des services additionnels pouvant être proposés à l'usager, et sélectionner ainsi au moins un service additionnel à proposer l'usager considéré ;  - Then compare this semantic description with descriptions respectively corresponding to additional services that can be offered to the user, and thus select at least one additional service to offer the user considered;
- et enfin activer ce service additionnel pour l'usager considéré.  - and finally activate this additional service for the user concerned.
Dans des modes de mise en œuvre préférés, le procédé selon l'invention consiste en outre à n'activer le service sélectionné que dans le cas où l'usager a émis un message indiquant qu'il souhaite bénéficier de services additionnels. L'invention sera mieux comprise et d'autres caractéristiques apparaîtront à l'aide de la description ci-dessous et de la figure unique l'accompagnant : Cette figure unique représente fonctionnellement un exemple de serveur d'applications AS classique exécutant des moyens logiciels adaptés pour la mise en œuvre du procédé selon l'invention. In preferred embodiments, the method according to the invention also consists in activating the selected service only in the case where the user has sent a message indicating that he wishes to benefit from additional services. The invention will be better understood and other characteristics will appear from the description below and from the accompanying single figure: This single figure functionally represents an example of a conventional AS application server executing adapted software means for the implementation of the method according to the invention.
Un utilisateur EU, considéré à titre d'exemple, possède un téléviseur relié à l'Internet (non représenté) par une passerelle G. Cette passerelle G comporte des moyens logiciels lui permettent de communiquer, via Internet, avec le serveur AS et avec un fournisseur d'accès Internet pour recevoir un bouquet de programmes vidéo, et pour bénéficier de services web additionnels en relation avec le programme vidéo qu'elle est en train de recevoir. L'usager EU dispose d'une télécommande pour envoyer des commandes à cette passerelle, afin de changer de canal de réception, ou pour demander à bénéficier de services additionnels. A user EU, considered as an example, has a television connected to the Internet (not shown) by a gateway G. This gateway G includes software means allow it to communicate via the Internet with the server AS and with a Internet service provider to receive a bouquet of video programs, and to benefit from additional web services in connection with the video program that it is receiving. The EU user has a remote control to send commands to this gateway, to change receiving channel, or to request additional services.
Cette passerelle G comporte des moyens logiciels qui lui permettent de recevoir ces commandes et les transférer :  This gateway G includes software means that allow it to receive these commands and transfer them:
- vers le fournisseur d'accès Internet, qui envoie un programme vidéo et d'éventuels services additionnels sur le canal choisi par l'usager considéré,  - to the ISP, who sends a video program and any additional services on the channel chosen by the user,
et vers le serveur AS qui exploite les informations contenues dans ces commandes afin de détecter une commande qui est une demande pour bénéficier de services additionnels, et pour faciliter l'identification de la séquence audio en cours de réception.  and to the AS server that exploits the information contained in these commands to detect a command that is a request for additional services, and to facilitate the identification of the audio sequence being received.
Le serveur AS est relié en outre à une station de réception satellitaire R qui reçoit tous les programmes du bouquet que peut recevoir un usager tel que l'usager UE. Ce server AS comporte :  The server AS is further connected to a satellite reception station R which receives all the programs of the bouquet that can receive a user such as the user UE. This AS server includes:
- Un module logiciel 1 constituant une interface permettant à un producteur de télévision TVP de fournir au serveur AS des informations décrivant des programmes vidéo à identifier (séquences audio de référence, ordre des séquences audio dans le programme vidéo, identifiants respectifs des séquences audio de référence, et descriptions sémantiques respectives des séquences audio de référence). La description sémantique d'une séquence audio de référence permettra au serveur AS de déterminer des services à proposer à un usager lorsqu'une séquence audio identique sera identifiée dans un programme vidéo reçu par cet usager. Le module 1 détermine une signature pour chaque séquence audio de référence, et l'associe à un identifiant de séquence audio de référence.  A software module 1 constituting an interface enabling a television producer TVP to provide the server AS with information describing video programs to be identified (reference audio sequences, order of the audio sequences in the video program, respective identifiers of the reference audio sequences , and respective semantic descriptions of the reference audio sequences). The semantic description of a reference audio sequence will allow the AS server to determine services to be offered to a user when an identical audio sequence will be identified in a video program received by that user. The module 1 determines a signature for each reference audio sequence, and associates it with a reference audio sequence identifier.
- Un module logiciel 2 constituant une interface permettant à un fournisseur de services SP de fournir au serveur AS des informations décrivant des services additionnels susceptibles d'être proposés lors de l'identification de séquences audio de référence, dans le programme vidéo reçu par un usager.  A software module 2 constituting an interface enabling an SP service provider to provide the AS server with information describing additional services that may be offered during the identification of reference audio sequences, in the video program received by a user; .
- Un module logiciel 3 pour écrire et lire dans une mémoire un guide de programmes (Titres, canaux utilisés, horaires). Ce guide est diffusé en parallèle avec chacun des programmes vidéo du bouquet.  - A software module 3 for writing and reading in a memory a program guide (Titles, used channels, schedules). This guide is broadcast in parallel with each video program of the bouquet.
- Un module logiciel 4 pour écrire et lire dans une mémoire une partie des informations (ordre des séquences audio, et identifiants respectifs des séquences audio de référence) décrivant les programmes vidéo à identifier. - Un module logiciel 5 pour écrire et lire dans une mémoire les signatures représentant les séquences audio de référence. A software module 4 for writing and reading in a memory part of the information (order of the audio sequences, and respective identifiers of the reference audio sequences) describing the video programs to be identified. A software module 5 for writing and reading in a memory the signatures representing the audio reference sequences.
- Un module logiciel 6 pour écrire et lire dans une mémoire les descriptions sémantiques des séquences audio.  A software module 6 for writing and reading in a memory the semantic descriptions of the audio sequences.
- Un module logiciel 7 pour écrire et lire dans une mémoire les descriptions des services additionnels.  A software module 7 for writing and reading in a memory the descriptions of the additional services.
- Un module logiciel 8 pour présélectionner une suite d'identifiants de signatures de séquence audio de référence, parmi les identifiants correspondant respectivement aux signatures stockées par le module 4, notamment en fonction d'informations décrivant le programme reçu par l'usager et qui sont fournies par un guide de programmes qui est diffusé en parallèle avec le programmes vidéo à identifier, ce guide des programmes (Titres, canaux utilisés, horaires) étant fourni par le module 3.  A software module 8 for pre-selecting a series of audio reference sequence signature identifiers, among the identifiers respectively corresponding to the signatures stored by the module 4, in particular as a function of information describing the program received by the user and which are provided by a program guide which is broadcast in parallel with the video programs to be identified, this program guide (Titles, used channels, timetables) being provided by the module 3.
- Un module logiciel 9 pour :  - A software module 9 for:
-- recevoir une signature représentant une séquence audio extraite du programme vidéo qu'un usager, par exemple EU, est en train de recevoir, -- recevoir la suite d'identifiants de signatures de séquence audio de référence présélectionnés par le module 8,  - receive a signature representing an audio sequence extracted from the video program that a user, for example EU, is receiving, - receive the suite of reference audio sequence signature identifiers preselected by the module 8,
-- aller lire les signatures correspondant respectivement à ces identifiants présélectionnés, via le module 5,  - go read the signatures corresponding respectively to these preselected identifiers, via module 5,
-- puis corréler les signatures de référence ainsi lues avec la signature représentant la séquence audio extraite du programme vidéo que l'usager EU est en train de recevoir,  and then correlating the reference signatures thus read with the signature representing the audio sequence extracted from the video program that the user UE is receiving,
-- et sélectionner parmi les identifiants présélectionnés celui qui présente la plus forte corrélation, pour identifier une séquence audio reçue, et ainsi identifier le programme vidéo en cours de réception par l' usager EU. and selecting from the preselected identifiers the one with the strongest correlation, to identify a received audio sequence, and thus identify the video program currently being received by the UE user.
- Un module logiciel 10 pour : - A software module 10 for:
-- lire, via le module 6, la description sémantique d'une séquence audio de référence correspondant à l'identifiant de la séquence audio reçue, -- puis lire, via le module 7, les descriptions des services additionnels et les comparer avec la description sémantique de la séquence audio reçue, et identifier ainsi un ou plusieurs services additionnels qui correspondent à cette description sémantique.  read, via module 6, the semantic description of a reference audio sequence corresponding to the identifier of the received audio sequence, then read, via module 7, the descriptions of the additional services and compare them with the semantically describing the received audio sequence, and thereby identifying one or more additional services that correspond to this semantic description.
-- et enfin proposer ce(s) service(s) additionnel(s) à l'usager considéré EU.  - and finally offer this (s) service (s) additional (s) to the user considered EU.
- Un module logiciel 1 1 pour : -- recevoir, en provenance de la passerelle G via l'Internet, tous les messages de commande émis par un usager, tel que l'usager EU, soit à destination du serveur AS, soit à destination du fournisseur d'accès Internet. - A software module 1 1 for: - Receive, from the gateway G via the Internet, all the command messages sent by a user, such as the user EU, either to the AS server or to the ISP.
-- mémoriser ces données puis les retransmettre au module 8 qui les prend en compte pour présélectionner une suite d'identifiants de signatures de séquence audio.  - Store these data and retransmit them to the module 8 which takes them into account to preselect a sequence of identifiers of audio sequence signatures.
- Un module logiciel 12 relié à la station R pour pouvoir recevoir tous les programmes que peut recevoir un usager, notamment l'usager UE, et relié au module 11 pour recevoir l'identifiant du canal que l'usager considéré EU est en train de recevoir ; ce module 12 comportant des moyens logiciels pour :  A software module 12 connected to the station R to be able to receive all the programs that a user can receive, in particular the UE user, and connected to the module 11 to receive the identifier of the channel that the user considered EU is in the process of to receive ; this module 12 comprising software means for:
-- sélectionner le programme qui est reçu par l'usager considéré EU, à l'instant où cet usager EU envoie une commande au serveur AS pour demander à bénéficier des services additionnels,  select the program which is received by the user considered EU, at the moment when this user sends a command to the server AS to request additional services,
-- calculer une suite de signatures représentant successivement des séquences audio contenues dans le programme qui est reçu par l'usager EU,  calculating a succession of signatures successively representing audio sequences contained in the program which is received by the user UE,
-- et fournir cette suite de signatures au module 9.  - and provide this suite of signatures to module 9.
Par exemple, pour une séquence audio accompagnant une publicité donnée, le producteur de télévision TVP indique le « type de produit » et la « marque >> qui sont l'objet de cette publicité. Cette description sémantique est stockée par le module 6. Au moment où cette séquence audio est identifiée par le module 9, cette description sémantique permet au module 10 de déterminer une liste de services à proposer à l'usager, en cherchant via le module 7 les descriptions respectives de services additionnels qui correspondent à cette description sémantique : par exemple une page web ou un numéro de téléphone permettant d'obtenir des informations supplémentaires sur ce type de produit et cette marque.  For example, for an audio sequence accompanying a given advertisement, TV producer TVP indicates the "product type" and "brand" that are the subject of this advertisement. This semantic description is stored by the module 6. At the moment when this audio sequence is identified by the module 9, this semantic description enables the module 10 to determine a list of services to be offered to the user, by searching via the module 7 for them. respective descriptions of additional services which correspond to this semantic description: for example a web page or a telephone number making it possible to obtain additional information on this type of product and this brand.
Le producteur de télévision TVP n'associe pas directement les séquences audio avec des services bien identifiés. Cela permet de gérer indépendamment les services et les séquences audio. Par exemple, au moment de la première diffusion d'une séquence audio associée à une série TV, on pourra proposer la vente du DVD correspondant, et par la suite on pourra proposer d'autres services tels que la vente de figurines, la vente de vêtements identiques à ceux portés par les acteurs, etc.. TV producer TVP does not directly associate audio clips with well-identified services. This allows independent management of services and audio sequences. For example, at the time of the first broadcast of an audio sequence associated with a TV series, it will be possible to propose the sale of the corresponding DVD, and thereafter it will be possible to offer other services. such as the sale of figurines, the sale of clothes identical to those worn by actors, etc.
Selon un premier mode de réalisation, l'usager ne peut émettre qu'une commande de sélection de canal, destinée au fournisseur d'accès Internet et contenant un identifiant de canal pour changer de canal. Le module logiciel 10 active un service additionnel pour l'usager considéré EU, dés qu'une séquence audio prédéterminée a été détectée, sans que l'usager ait demandé à bénéficier de service supplémentaire. Selon un second mode de réalisation, l'usager peut émettre deux types de commande : According to a first embodiment, the user can only issue a channel selection command, intended for the ISP and containing a channel identifier for changing channels. The software module 10 activates an additional service for the user considered EU, as soon as a predetermined audio sequence has been detected, without the user having requested additional service. According to a second embodiment, the user can issue two types of command:
une commande de sélection de canal, destinée au fournisseur d'accès Internet et contenant un identifiant de canal pour changer de canal ; ou une commande de demande de services additionnels, contenant des données identifiant l'usager, identifiant le canal que l'usager est en train de recevoir, ainsi que la date et l'heure de la commande.  a channel selection command for the ISP and containing a channel identifier for changing channels; or a request for additional services command, containing data identifying the user, identifying the channel that the user is receiving, and the date and time of the order.
Selon le premier mode de réalisation, le module logiciel 8 pour présélectionner une suite d'identifiants de signatures de séquence audio de référence prend en compte seulement les informations fournies par le guide des programmes (Titres, canaux utilisés, horaires), via le module 3, pour le canal sélectionné par la dernière commande de sélection de canal. D'autre part, le module 10 active un service additionnel pour l'usager considéré EU sans intervention du module 11. Selon le second mode de réalisation, le module logiciel 8 prend en compte en outre les données contenues dans chaque commande de demande de services additionnels. Il connaît ainsi la date et l'heure où l'usager exprime un souhait de bénéficier de services additionnels. Cette date et cette heure correspondent à un certain contenu du programme reçu, qui a suscité l'intérêt de l'usager pour au moins un service additionnel éventuellement associé à ce contenu. Ceci permet de déterminer plus précisément quel service additionnel intéresserait l'usager. Le service proposé sera probablement mieux adapté et sera donc plus apprécié par l'usager. D'autre part, le module 10 est relié au module 11 de telle façon que le module 10 active un service additionnel seulement lorsqu'il reçoit un signal de commande fourni par le module 11 , c'est à dire lorsque le module 1 1 reçoit une commande de demande de services additionnels, émise par l'usager EU. According to the first embodiment, the software module 8 for preselecting a series of reference audio sequence signature identifiers takes into account only the information provided by the program guide (Titles, used channels, schedules), via the module 3 , for the channel selected by the last channel select command. On the other hand, the module 10 activates an additional service for the user considered EU without intervention of the module 11. According to the second embodiment, the software module 8 also takes into account the data contained in each service request command. additional. He knows the date and time when the user expresses a wish to benefit from additional services. This date and this time correspond to a certain content of the received program, which has aroused the interest of the user for at least one additional service possibly associated with this content. This makes it possible to determine more precisely which additional service would interest the user. The proposed service will probably be better adapted and will be more appreciated by the user. On the other hand, the module 10 is connected to the module 11 in such a way that the module 10 activates an additional service only when it receives a control signal supplied by the module 11. that is to say when the module 1 1 receives an additional service request command, issued by the user EU.
Dans les deux modes de réalisation, grâce au fait qu'il prend en compte au moins les informations du guide, fournies par le module 3, le module logiciel 8 fait une présélection des séquences audio les plus vraisemblables. Les identifiants présélectionnés sont beaucoup moins nombreux que les identifiants correspondant à l'ensemble des signatures stockées par le module 4. Le nombre de calculs de corrélation à faire pour chaque séquence audio à identifier est donc fortement réduit. Par conséquent, l'identification d'un programme vidéo est beaucoup plus rapide que par les procédés connus. In both embodiments, thanks to the fact that it takes into account at least the information of the guide, provided by the module 3, the software module 8 makes a preselection of the most likely audio sequences. The preselected identifiers are much less numerous than the identifiers corresponding to the set of signatures stored by the module 4. The number of correlation calculations to be made for each audio sequence to be identified is therefore greatly reduced. As a result, the identification of a video program is much faster than by known methods.

Claims

REVENDICATIONS : CLAIMS:
1 ) Procédé pour identifier un programme vidéo reçu par un usager (EU), en identifiant une séquence audio contenue dans ce programme vidéo, comportant les étapes consistant à : 1) A method for identifying a video program received by a user (EU), by identifying an audio sequence contained in this video program, comprising the steps of:
- recevoir (1 -6) une pluralité de séquences audio de référence, et recevoir, pour chacune de ces séquences, une signature et un identifiant de signature audio de référence,  receiving (1 -6) a plurality of reference audio sequences, and receiving, for each of these sequences, a signature and a reference audio signature identifier,
- présélectionner (8) une suite d'identifiants de signature audio de référence, en prenant en compte des informations décrivant le programme vidéo reçu par l'usager, et qui sont fournies par un guide de programmes qui est diffusé en parallèle avec le programme vidéo à identifier  preselecting (8) a series of reference audio signature identifiers, taking into account information describing the video program received by the user, and which are provided by a program guide which is broadcast in parallel with the video program to identify
- puis corréler (9) les signatures correspondant respectivement à ces identifiants présélectionnés, avec une signature représentant une séquence audio à reconnaître contenue dans le programme vidéo reçu par l'utilisateur, et sélectionner parmi les identifiants présélectionnés celui qui présente la plus forte corrélation, pour identifier une séquence audio, et ainsi identifier le programme vidéo reçu par l'usager ;  and then correlating (9) the signatures respectively corresponding to these preselected identifiers, with a signature representing an audio sequence to be recognized contained in the video program received by the user, and selecting among the preselected identifiers the one that has the highest correlation, for identify an audio sequence, and thus identify the video program received by the user;
caractérisé en ce que, pour présélectionner (8) une suite d'identifiants de signatures de séquence audio, il consiste en outre à :  characterized in that, to preselect (8) a sequence of audio sequence signature identifiers, it further comprises:
- recevoir (11 ) un message de commande indiquant que l'usager souhaite bénéficier de services additionnels, ce message contenant des donnée identifiant l'usager, identifiant le canal que l'usager est en train de recevoir, ainsi que la date et l'heure de la commande ;  receiving (11) a command message indicating that the user wishes to benefit from additional services, this message containing data identifying the user, identifying the channel that the user is receiving, as well as the date and the time of the order;
- et prendre en compte (8) en outre ces données pour présélectionner une suite d'identifiants de signatures de séquence audio.  and taking into account (8) these data further to preselect a sequence of audio sequence signature identifiers.
2) Procédé selon la revendication 1 comportant en outre les étapes consistant : - recevoir (6) une description sémantique de la séquence audio de référence correspondant à l'identifiant de la séquence audio reconnue, 2) The method of claim 1 further comprising the steps of: - receiving (6) a semantic description of the reference audio sequence corresponding to the identifier of the recognized audio sequence,
- recevoir (7) des descriptions correspondant respectivement à des services additionnels pouvant être proposés à l'usager,  - receive (7) descriptions corresponding respectively to additional services that may be offered to the user,
- puis comparer (10) cette description sémantique à ces descriptions correspondant respectivement à des services additionnels pouvant être proposés à l'usager, et sélectionner ainsi au moins un service additionnel à proposer l'usager considéré,  and then comparing (10) this semantic description with these descriptions respectively corresponding to additional services that may be offered to the user, and thus selecting at least one additional service to propose the user in question,
- et enfin activer ce service additionnel pour l'usager considéré. 3) Procédé selon la revendication 2, dans lequel un service additionnel n'est activé que dans le cas où l'usager (EU) a émis un message indiquant qu'il souhaite bénéficier de services additionnels. - and finally activate this additional service for the user concerned. 3) Method according to claim 2, wherein an additional service is activated only in the case where the user (EU) has sent a message indicating that he wishes to benefit from additional services.
4) Serveur (AS) pour identifier un programme vidéo reçu par un usager donné (UE), en identifiant une séquence audio associée au programme vidéo à identifier, caractérisé en ce qu'il comporte des moyens logiciels pour mettre en œuvre le procédé selon l'une des revendications 1 à 3. 4) Server (AS) for identifying a video program received by a given user (UE), by identifying an audio sequence associated with the video program to be identified, characterized in that it comprises software means for implementing the method according to the one of claims 1 to 3.
EP11704072A 2010-02-24 2011-02-21 Method and server for detecting a video program received by a user Withdrawn EP2540016A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR1051309A FR2956787A1 (en) 2010-02-24 2010-02-24 METHOD AND SERVER FOR DETECTING A VIDEO PROGRAM RECEIVED BY A USER
PCT/EP2011/052482 WO2011104193A1 (en) 2010-02-24 2011-02-21 Method and server for detecting a video program received by a user

Publications (1)

Publication Number Publication Date
EP2540016A1 true EP2540016A1 (en) 2013-01-02

Family

ID=43064555

Family Applications (1)

Application Number Title Priority Date Filing Date
EP11704072A Withdrawn EP2540016A1 (en) 2010-02-24 2011-02-21 Method and server for detecting a video program received by a user

Country Status (7)

Country Link
US (1) US20130047177A1 (en)
EP (1) EP2540016A1 (en)
JP (1) JP5509347B2 (en)
KR (1) KR20120120369A (en)
CN (1) CN102783057A (en)
FR (1) FR2956787A1 (en)
WO (1) WO2011104193A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130173517A1 (en) * 2011-12-30 2013-07-04 Nokia Corporation Method and apparatus for coordinating content across devices based on stimuli
WO2015118431A1 (en) * 2014-02-05 2015-08-13 Edge Innovation, Lda. Method for capture and analysis of multimedia content

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001256234A (en) * 2000-03-10 2001-09-21 Steward Communications Kk System for searching information related to radio wave broadcasting, recording medium, broadcaster computer system and music selling system
JP4433594B2 (en) * 2000-10-05 2010-03-17 ソニー株式会社 Music identification apparatus and method
US6748360B2 (en) * 2000-11-03 2004-06-08 International Business Machines Corporation System for selling a product utilizing audio content identification
JP2002162973A (en) * 2000-11-24 2002-06-07 Univ Waseda Retrieving method for broadcasted music
JP2002328931A (en) * 2001-04-27 2002-11-15 Matsushita Electric Ind Co Ltd System and method for processing information
JP2003223171A (en) * 2002-01-30 2003-08-08 Mitsubishi Electric Corp Program related information providing system
US7448058B2 (en) * 2003-03-10 2008-11-04 Mark A. Heyner Method for enabling a television user to control operation of application programs on a programmable television controller
US20050097593A1 (en) * 2003-11-05 2005-05-05 Michael Raley System, method and device for selected content distribution
JP4933899B2 (en) * 2004-02-19 2012-05-16 ランドマーク、ディジタル、サーヴィセズ、エルエルシー Method and apparatus for broadcast source identification
JP2005274992A (en) * 2004-03-25 2005-10-06 Sony Corp Music identification information retrieving system, music purchasing system, music identification information obtaining method, music purchasing method, audio signal processor and server device
JP4642562B2 (en) * 2005-06-28 2011-03-02 富士フイルム株式会社 Ink tank manufacturing method and ink filling method
CN101517550B (en) * 2005-11-29 2013-01-02 谷歌公司 Social and interactive applications for mass media
CA2654933C (en) * 2006-06-15 2013-07-30 The Nielsen Company (Us), Llc Methods and apparatus to meter content exposure using closed caption information
ES2433966T3 (en) 2006-10-03 2013-12-13 Shazam Entertainment, Ltd. Method for high flow rate of distributed broadcast content identification
CN101669308B (en) * 2007-02-20 2013-03-20 尼尔森（美国）有限公司 Methods and apparatus for characterizing media
JP2009147775A (en) * 2007-12-17 2009-07-02 Panasonic Corp Program reproduction method, apparatus, program, and medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2011104193A1 *

Also Published As

Publication number Publication date
US20130047177A1 (en) 2013-02-21
WO2011104193A1 (en) 2011-09-01
KR20120120369A (en) 2012-11-01
CN102783057A (en) 2012-11-14
JP5509347B2 (en) 2014-06-04
FR2956787A1 (en) 2011-08-26
JP2013526095A (en) 2013-06-20

Similar Documents

Publication Publication Date Title
EP2039159B1 (en) Method for displaying a mosaic image in a receiver for the selection of audiovisual programs, receivers and related servers
EP3646548B1 (en) Method for transmitting interrupted audio content in a hybrid receiver, system, receiver, and program associated with said method
EP1762087B1 (en) Method for displaying audiovisual sequences at receiver level and receiver for displaying said sequences
EP3381196B1 (en) Method for synchronising an alternative audio stream
EP2979461A1 (en) Generation and delivery of a stream representing audiovisual content
EP1579319B1 (en) Devices and methods for conditional execution decision making in relation to services received and creation of information messages associated with said services, and associated products
WO2002001863A1 (en) Method for receiving and displaying thematic audio-visual programme sequences, and receiver therefor
EP1537747B1 (en) Audiovisual program synchronization system and method
EP1433322B1 (en) Method for transmitting audio-visual programmes proposed by users, terminal and server therefor
EP2540016A1 (en) Method and server for detecting a video program received by a user
WO2017158274A1 (en) Acquisition of extracts of a multimedia stream on a terminal
WO2001091462A1 (en) Device and method for synchronising broadcast audio-visual programmes and complementary data
WO2007065818A1 (en) Method for identifying a document recorded by a display, selection of key images and an associated receptor
EP1247365A1 (en) Method for audience measurement of interactive applications broadcast or integrated on a television receiver decoder
EP3363208A1 (en) Contextual enrichment by audio recognition
EP2362607B1 (en) Method for distributing content towards a user
EP2854415B1 (en) Method for dynamic transmission of information data relating to an audio and/or video programme
EP4254968A1 (en) Method for generating a virtual television channel for a user of at least one audiovisual content broadcast service, corresponding generation device, service equipment and computer program
EP4348985A1 (en) Apparatus and method for rendering audio content as part of an interactive digital service
EP3939330A1 (en) Method for managing the download of images associated with image jumps capable of being carried out during accelerated reading of multimedia content which is continuously broadcast
FR3055174A1 (en) METHOD FOR AUTOMATICALLY RELEASING A DIFFERED DIRECT MODE
EP2517385A1 (en) Method for transmitting and rendering digital sequences forming a programming schedule
WO2014106710A1 (en) Processing of a first broadcast data stream, coding a first audiovisual content associated with a second audiovisual content
FR3026593A1 (en) AUDIO CONTENT BROADCASTING METHOD WITH PROGRAMMING THE CUSTOMERS BY THE AUDITORS
FR2943876A1 (en) Method for viewing emission of audio-visual contents broadcasted in TV channel on TV set, involves downloading files containing marked TV emission from located addresses, and displaying downloaded TV emission on TV set screen

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20120924

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
111Z Information provided on other rights and legal means of execution

Free format text: AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

Effective date: 20130410

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: ALCATEL LUCENT

D11X Information provided on other rights and legal means of execution (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20150901