EP3959894A1 - Bestellung eines dienstes durch verarbeitung eines multimediadatenstroms - Google Patents

Bestellung eines dienstes durch verarbeitung eines multimediadatenstroms

Info

Publication number
EP3959894A1
EP3959894A1 EP20719664.3A EP20719664A EP3959894A1 EP 3959894 A1 EP3959894 A1 EP 3959894A1 EP 20719664 A EP20719664 A EP 20719664A EP 3959894 A1 EP3959894 A1 EP 3959894A1
Authority
EP
European Patent Office
Prior art keywords
service
timestamp
stream
ser
signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP20719664.3A
Other languages
English (en)
French (fr)
Inventor
Murièle LE BIHAN
Emmanuel SOYER
Dominique POITEVIN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Orange SA
Original Assignee
Orange SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Orange SA filed Critical Orange SA
Publication of EP3959894A1 publication Critical patent/EP3959894A1/de
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/47815Electronic shopping
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42203Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6587Control parameters, e.g. trick play commands, viewpoint selection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8126Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts
    • H04N21/8133Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/854Content authoring
    • H04N21/8547Content authoring involving timestamps for synchronizing content

Definitions

  • the present invention relates to the field of processing audiovisual data streams, in particular multimedia data, for the management of a service control signal.
  • such a service control signal is generated as follows.
  • a terminal STB connected to a TV playback device, receives a multimedia data stream F in order to restore on the TV device multimedia content corresponding to the multimedia data.
  • This stream F can for example be a real-time television data stream and the terminal STB can be for example of the “Set Top Box” type, connected to a television set TV as a playback device, allowing a user UT to watch a television program.
  • the STB terminal and the TV device can be integrated into the same connected equipment, of the tablet, PC or other type, to receive such a television data stream via a television application and an extended network RES of the Internet type via example.
  • the stream F can be a real-time radio broadcast data stream and the terminal STB can include a tuner and be integrated into a radio station as a playback device, allowing a user UT to listen to the program of a radio station.
  • the multimedia content may be any pre-recording and not necessarily stream content broadcast in real time or slightly delayed.
  • this multimedia content is likely to include one or more sequences containing information relating to respective services, at respective times when the content is returned.
  • these sequences can be advertising messages describing respective products.
  • messages usually, such messages last around ten seconds and can follow one another over time.
  • FIG. 1 illustrating in the example represented the case of a user viewing UT, watching a television program on the TV set
  • a man-machine interface HMI for example a voice interface
  • This control signal SC can be transmitted via the RES network to a SER management server.
  • the latter SER can for example request in return a CC command confirmation from the user UT, via an input interface (provided on a user equipment TER, such as for example a touch screen of a TER equipment such as a smartphone, tablet, PC or other).
  • a user equipment TER such as for example a touch screen of a TER equipment such as a smartphone, tablet, PC or other.
  • the SER server can transmit CC reference data of this well identified product, so that such references are displayed for example on the screen.
  • TER equipment An application installed on the aforementioned TER equipment comes to life in order to ask the user to enter a confirmation of validation of this product via the input interface of the TER equipment, which can then trigger the final registration of ordering the product from the SER server or another server (from a product distributor or other).
  • a natural way for the UT user to issue this command is to pronounce a word such as “I want this product” or “add” (to a pre-existing list of races for example).
  • a problem observed is that a user does not utter (or more generally does not wish to capture) all the characteristics of the product, the advertising sequence of which he sees being displayed. It is then difficult for the SER management server to identify precisely the product whose order is desired.
  • the present invention then improves the situation.
  • a method of purchasing an order for a service a sequence relating to said service being included in a stream of multimedia data restored by a reproduction device (TV), the multimedia data stream comprising a plurality of sequences relating to respective services and associated with respective return timestamps, the ordering method comprising:
  • a service identifier corresponding to a timestamp for restoring a sequence associated with said service, the timestamp for restoring the sequence associated with said service having been determined as a function of a timestamp of a control signal ( HRC) for purchasing a service, the command signal having been generated by a man-machine interface (HMI) and transmitted by the man-machine interface to a management server (SER) separate from a terminal (STB) receiving multimedia data stream; the service identifier to generate a purchase registration signal.
  • HRC control signal
  • SER management server
  • such an embodiment makes it possible to discriminate the service (or the product as presented previously) whose sequence has caused a control signal sent from the man-machine interface (HMI) and this, without forcing the user (UT) to this interface (HMI) to fill in all the characteristics necessary to identify this service.
  • HMI man-machine interface
  • control method comprises determining (S4), according to a predetermined criterion, a timestamp from among the timestamps for the programmed playback of sequences as corresponding to the timestamp of generation of the control signal.
  • the predetermined criterion consists in determining the closest scheduled restitution timestamp, prior to the control signal generation timestamp. As illustrated in FIG. 2 by way of example, in a succession of timestamps HR1, HR2, etc., of programmed reproduction of respective sequences, the closest timestamp prior to the HRC timestamp of generation of the control signal is HR2. In one embodiment, it is further possible to add a latency time which may be constant (for example five seconds) to the HR1, HR2, etc. timestamps, and to determine the timestamp thus augmented nearest before the HRC timestamp, in order to take account of any user reaction time. The duration of this latency can be adjusted according to tests carried out on a panel of users.
  • the method further comprises:
  • the supplemental information data may come from a connected database, listing service identifiers that match additional information data about respective services.
  • It can typically be a database connected to a server managed by an advertiser of the service or services offered in the multimedia content.
  • HMI voice assistant type interface
  • the aforementioned stream of multimedia data (F) can typically be a stream of television or radio data, broadcast in real time (or slightly delayed), or even in rebroadcast or “replay” (or else a broadcast data stream, recorded for example on a personal recorder (or “PVR”) and replayed).
  • PVR personal recorder
  • this stream may appear advertising spots corresponding to the aforementioned sequences containing information relating to respective services.
  • the expected broadcast time of these sequences (in real time compared to an instant when data was sent from a head end, or (still deferred with respect to an instant at the start of reading the stream) is known and a timestamp can thus be associated with each sequence and from there to each service identifier corresponding to this sequence.
  • the terminal can play a list (“playlist”) of several video streams often comprising a sequence of N streams starting with one or more advertising sequences and continuing with content.
  • a device for ordering the purchase of a service a sequence relating to said service being included in a stream of multimedia data restored by a reproduction device (TV), the multimedia data stream comprising a plurality of sequences relating to respective services and associated with respective restitution timestamps, the control device comprising:
  • a processor configured to determine a service identifier corresponding to a restitution timestamp of a sequence associated with said service, the restitution timestamp of the sequence associated with said service having been determined as a function of a timestamp of a control signal ( HRC) for purchasing a service, the command signal having been generated by a man-machine interface (HMI) and transmitted by the man-machine interface to a management server (SER) separate from a terminal (STB) receiving multimedia data stream; the service identifier to generate a purchase registration signal.
  • HRC control signal
  • Such a device can be implemented in a management server (SER) which, as indicated above, can be configured to receive control signals generated by the human machine interface (HMI).
  • the management server is in particular configured to implement steps of the above method and more particularly the aforementioned comparison of timestamps to choose the timestamp corresponding to the timestamp of generation of the control signal, and to determine the identifier. service corresponding to the determined timestamp.
  • the purchase order device comprises a timestamp comparator to determine the timestamp corresponding to the timestamp of generation of the control signal, and the determination of the service identifier corresponding to the chosen timestamp, at least, are carried out by the management server.
  • the purchase order device comprises a timestamp comparator for determining the timestamp corresponding to the timestamp of generation of the command signal, and determining the service identifier corresponding to the chosen timestamp, at less, are conducted by the management server (SER).
  • SER management server
  • the server (SER) interrogates the terminal (STB) receiving the stream to retrieve the timestamps of the sequences programmed in the stream, and to perform the aforementioned comparison.
  • the server can query a third-party server (SERA) making available a publication of the timestamps of the programmed sequences, with the corresponding identifiers, this third-party server (SERA) being able to be maintained by an advertising agency of a broadcasting channel TV, for example.
  • SERA third-party server
  • a transmitter configured to return the command registration signal to the equipment (TER) for confirmation of the registration of the order (COM OK) on receipt by the management server (SER) of a validation signal from the equipment (TER) following an entry of a validation by the user.
  • the command recording signal is in reality aimed at a pre-recording of the command, and this order is finally registered only after validation of the user.
  • the equipment (TER) can receive from the management server (SER) (or even a server managed by a service provider) an order confirmation request to be validated via for example a touch screen of the equipment. (TER).
  • the equipment (TER) can present on a screen a list of services whose command is to be confirmed and the user can choose to validate one by one by pressing on the touch screen the various services offered to him.
  • the SER management server can be a single server for the implementation of the various steps above or be connected to other servers (managed by the advertiser, by the service provider, and / or others), thus forming a “server entity” in general (also called “platform” in the detailed description which follows).
  • such a device can be implemented in a terminal (STB) for receiving a stream (F) of multimedia data.
  • the terminal is configured to implement steps of the above method and more particularly the comparison of the timestamps to choose the timestamp corresponding to the timestamp of generation of the control signal, the determination of the corresponding service identifier at the determined timestamp, and a transmission to the management server of the service identifier corresponding to the determined timestamp.
  • the terminal (STB) is configured to receive additional information data for rendering by the rendering device (TV), the additional information data having been obtained by the purchase order device according to the service identifier.
  • the purchase order device comprises a timestamp comparator (S3) for choosing (S4) the timestamp corresponding to the timestamp of generation of the order signal, and the determination (S5) of the service identifier corresponding to the chosen timestamp are carried out by the terminal (STB), and in which the terminal (STB) transmits to the management server the service identifier corresponding to the chosen timestamp.
  • S3 timestamp comparator
  • S4 the timestamp corresponding to the timestamp of generation of the order signal
  • S5 the determination of the service identifier corresponding to the chosen timestamp are carried out by the terminal (STB), and in which the terminal (STB) transmits to the management server the service identifier corresponding to the chosen timestamp.
  • This embodiment can be advantageous in particular in the case where simply a remote control button is pressed by the user to control the terminal (STB) instead of providing an HMI interface type voice assistant.
  • the terminal (STB) which performs the comparison between the timestamps of the sequences it receives and that of the event of pressing the remote control button, until it can thus retrieve the identifier of the service whose sequence has the closest timestamp and send this service identifier to the server (SER).
  • a man-machine interface connected to a management server separate from a terminal (STB) receiving a stream of multimedia data restored by a reproduction device (TV), the multimedia data stream comprising a plurality sequences relating to respective services and associated with respective restitution timestamps
  • the man-machine interface comprises a generator of a command signal (HRC) for purchasing a service and a transmitter of the command signal d 'purchase of the service from a management server (SER) separate from a terminal (STB) receiving the data stream, the control signal having a timestamp making it possible to determine a timestamp for restoring the sequence associated with said service, the timestamp restitution of the sequence associated with said service making it possible to determine a service identifier making it possible to generate a purchase registration signal.
  • HRC command signal
  • SER management server
  • the aforementioned man-machine interface can be a connected voice assistant (for example a connected speaker of the "djingo" ® type).
  • this voice assistant can be connected to a home gateway via a local network, which gateway can communicate with the SER management server via a wide network.
  • this voice assistant can be integrated into a device of smartphone or other type (the interface comprising a microphone of such device), this device being connected via the wide area network (cellular or wifi) to the SER server. It can be for example the same TER equipment (figure 1) comprising a input interface allowing the user to subsequently validate his order.
  • the generated control signal is then a speech signal.
  • the method may include a conversion of the speech signal into a text of a series of characters (so-called “speech to text” conversion) to identify at least one keyword characterizing a service command, such as for example the word “ Adds ”or other.
  • this or these keyword (s) may describe a type of service ordered: for example a product order ("Add this product", an order for a reduction coupon ("Add this reduction”), or others.
  • a voice assistant for the actuation of the aforementioned man-machine interface.
  • a remote control of the STB terminal comprising a specific button to be pressed to send the service command to the STB terminal. which can send the command request to the STB management server by a bidirectional link.
  • the aforementioned TER equipment can offer a computer application with a control button, the pressing of which causes this control request to be sent to the SER management server via the RES network.
  • a system for controlling a service comprising at least:
  • a reproduction device connected to the terminal, for reproducing multimedia content corresponding to multimedia data, said multimedia content comprising a plurality of sequences containing information relating to respective services, at respective times of reproduction of the content,
  • a man-machine interface available to a user to generate a command signal for a service, the sequence of which may be being restored by the device, and to transmit the command signal with a time stamp of generation of the control signal and a user reference
  • a management server able to process the service order signal with a view to recording a service order for this user
  • the terminal is arranged to receive, in addition to the multimedia data, data:
  • the terminal and the management server is designed to:
  • a computer program comprising instructions for the implementation of all or part of a method as defined herein when this program is executed by a processor.
  • a non-transient, computer readable recording medium on which such a program is recorded.
  • the instructions of such a computer program can be distributed among different entities of the above system (for example between the terminal (STB) and the management server).
  • the general flowchart of such a computer program can be represented by way of example in one of Figures 3 and 4 commented on below.
  • FIG. 3 shows a succession of steps that may include a process of the type defined above
  • FIG. 4 illustrates the exchanges between different entities of a system of the aforementioned type.
  • step S1 On receipt of the control signal SC in step S1, metadata describing time stamps of service description sequences (typically advertising spots for such services) are extracted from the stream F that the terminal STB receives in step S2.
  • the terminal STB itself performs the first steps of FIG. 3
  • the terminal STB extracts these metadata from the stream F that it receives in order to use them itself subsequently.
  • the SER server implements the steps of FIG. 3
  • the control signal SC is received in step S1 by the management server SER, which triggers a request from the SER server to the terminal STB, for retrieve this metadata for processing from the server.
  • the terminal STB analyzes and extracts from the stream a signal specific to the programmed advertising sequences and comprising markers of these sequences (timestamps and identifiers) inserted into the stream, with a "parsing" of descriptors associated with the thread. water, to store these data in a FIFO type buffer memory.
  • the SER server can trigger actions on the STB terminal side such as reconciliation on the timestamp and then reconciliation on the advertising campaign identifier (PublD) with an identifier of the product being advertised (GTIN), as described in detail.
  • the terminal STB and / or the management server SER are configured so as to allocate a time stamp HRC for receiving the control signal SC at step S1.
  • step S3 it is possible to compare this timestamp HRC with the timestamp data HR1, HR2, ..., HRi, etc. received in the stream F, as described above with reference to FIG. 2, in order then to identify, in step S4, the timestamp HRj which best corresponds to the timestamp HRC of the control signal.
  • the time stamps HR1, HR2, ..., HRi, etc. are received in stream F with respective service identifiers ID1, ID2, ..., IDi, etc.
  • step S5 it is possible in step S5 to determine the service identifier IDj corresponding to the time stamp determined in step S4 and specific to the service which is the object of the command SC.
  • the service identifier IDj corresponding to the time stamp determined in step S4 and specific to the service which is the object of the command SC.
  • a playlist in replay we can first determine which stream number of the playlist the timestamp corresponds to, and this stream number can then be associated with a service identifier (pub id).
  • the management server SER can then retrieve additional information CC specific to this identifier service IDj in step S6, or the terminal STB can ask the server SER for such information data, with a view to display for example. on the TV rendering device, in order to allow a user to definitively validate this command (via TER equipment such as a smartphone or other), a message of such validation then being transmitted to the SER management server with a view to storing it in step S7 to follow up on this command.
  • the steps of FIG. 3 can be implemented completely or partially by the terminal STB or by the management server SER. Nevertheless, in particular for bandwidth savings, it may be advantageous for the comparison of the timestamps to be carried out by the terminal STB, at the request of the server SER (when it receives the control signal SC) and for the terminal TER not to go up. to the SER server as the relevant service identifier IDj.
  • the man-machine interface HMI such as a voice assistant transmits the control signal SC (for example in the form of a speech signal) to the management server SER with the HRC time stamp of generation of this signal.
  • SC control signal
  • the HRC timestamp is assigned by the server SER upon receipt of the control signal SC.
  • the SER management server sends a REQ (SC, HRC) request to the STB terminal for comparing an HRC command time stamp with sequence time stamps in the stream F.
  • the SER management server keeps a user database matching identification data of HMI and STB terminal (and also TER equipment, as described below).
  • the terminal STB performs the comparison of the timestamps and for this purpose has a MEM memory (for example a FIFO type buffer memory for "first in - first out") to store the HRi timestamps received in the flow corresponding to the identifiers of IDi services.
  • a MEM memory for example a FIFO type buffer memory for "first in - first out"
  • the terminal STB sends back in response to the request REQ (SC, HRC) the identifier thus determined IDj in a response message REP (IDj ).
  • the SER server can then interrogate a third-party SERA server (for example managed by an advertiser) to reconcile a campaign identifier (PublD) corresponding to the identifier IDj with an identifier of the product that is the subject of this advertisement (GTIN identifier) ( in addition to visuals or reduction campaigns associated with this product). More generally, the server SER can thus recover additional data CC on this identifier service IDj and transmit them (arrow COM (CC)) to the terminal STB in order to play them by the reproduction device TV. For example, it may be a banner superimposed on a current image, which is displayed on the screen of a TV television, this banner indicating that an order has been placed for a given service (with characteristics precise).
  • the banner can also indicate that an order confirmation request message will be sent to the TER equipment (for example a touch screen smartphone) to definitively confirm the order. Confirmation of the addition of a product (for example in a shopping list) can also be considered in voice reproduction, and in this case the SER server sends the STB terminal a confirmation message to be vocalized by the TV playback device, for example of the type "product XX has been added to your shopping list".
  • the SER management server can communicate with a third-party SERB server of a service provider, for example a product distributor, to send back to the TER equipment a list of products awaiting an order confirmation by the user from TER equipment.
  • a third-party SERB server of a service provider for example a product distributor
  • the SER management server can communicate with a third-party SERB server of a service provider, for example a product distributor, to send back to the TER equipment a list of products awaiting an order confirmation by the user from TER equipment.
  • a third-party SERB server of a service provider for example a product distributor
  • Such an embodiment can be generalized to any broadcast stream (television, radio, rebroadcast or "replay", etc.) received by a broadcast content reception terminal STB which can be a "TV or radio decoder", a connected television. , a connected radio, or other.
  • the content broadcast can be any type of content relating to at least one marketable product: advertising, teleshopping, music program (purchase of the song), games (the proposed earnings can be purchased by viewers / listeners), etc.
  • the aforementioned voice assistant HMI can in particular be a voice assistant of the Djingo or Alexa type, or an assistant for a smartphone or a tablet separate from the STB terminal for receiving the broadcast content.
  • Such an HMI voice assistant can operate as follows. First, the user of the broadcast content can wake up his HMI assistant, which triggers the HMI assistant to trace a future command moment. Secondly, the broadcast content comprising a sequence relating to a marketable product, the user can indicate to his HMI assistant via a keyword (for example "Add”) the action to be taken:
  • the HMI assistant records the command and associates it with an HRC timestamp of the instant at which the user made his request, and sends to the SER platform of the HMI assistant a request to recognize the request required by the user. user. This can be a signal including an audio recording of the user commanded action and the HRC time stamp.
  • the SER platform performs a speech-to-text conversion of the user's request and can determine, for example, that the name of the product to be added to the shopping list is missing.
  • the platform SER directly or indirectly questions the broadcast content receiver STB which provides an identifier IDj corresponding to the advertising spot inserted in the broadcast content stream.
  • IDj the identifier corresponding to the advertising spot inserted in the broadcast content stream.
  • the data of this identifier can be declared by the variable "Pubid”.
  • the identifier can in particular be positioned in the flow at the start of the advertising spot or before the advertising spot.
  • the term “positioned in the stream” is understood here to mean the fact that the aforementioned identifier is presented as a marking signal (in the form of a command for example), for the start of an advertising sequence, positioned in the stream with which a descriptor (“segmentation descriptor”) containing the identifier IDj (or Pubid) can be associated.
  • the STB broadcast content receiver is able to check whether the HRC time stamp of the user's request is positioned in the broadcast range of a given advertising spot to find the identifier IDj corresponding to this advertising spot.
  • the broadcast content receiver keeps in a memory buffer MEM, the most recent identifiers IDi (or "Pubid") and the start and / or end time of broadcasting of the corresponding advertising sport.
  • the term “directly interrogate” means the fact that the SER platform is connected in a wide area network (WAN / API) with the broadcast content receiver STB in order to interrogate it directly.
  • WAN / API wide area network
  • the SER platform sends the Pubid identifier request to the HMI assistant intended for the broadcast content receiver STB.
  • the HMI assistant and the STB terminal are connected to a network local and thus the HMI assistant is connected via this local network (LAN / API) to the STB broadcast content receiver to which the HMI assistant can then transmit the request and from which it receives in return the Pubid identifier that it relays to the SER platform.
  • the third-party server of the SERA advertiser partner can provide a more complete product identifier (which can be declared by a GTIN variable) with the aforementioned additional data CC (equivalent to a "bar code" of the product corresponding to this Pubid identifier) or directly to the STB broadcast content receiver or to the SER platform.
  • the STB Receiver receives the GTIN Product ID, it sends this in addition to or instead of the Pubid ID to the SER platform.
  • the SER platform uses a server from a SERB vendor partner to add the product to the user's LST shopping list using the retrieved product ID GTIN.
  • the order can be for a product or a service.
  • it could be adding:
  • the proposed solution is based on a signaling of the advertising spot inserted in the stream F, for example by marking (or "frame accurate") of the start of the spot, to which is associated information concerning the campaign identifier of the advertising spot (typically the the aforementioned identifier Pubid or IDj in the figures).
  • the proposed solution is also based on synchronization between the STB decoder receiver and the HMI voice assistant so that this temporal information and descriptions on the sequence of the advertising spot, available from the STB receiver, are fed back to the SER platform directly (via WAN API) or possibly indirectly by the HMI assistant (via LAN API) to the platform.
  • the proposed solution makes it possible to avoid, if the voice interaction takes place at the end of the spot, that the product of the following spot is added to the list of races.
  • the proposed solution allows the product to be added "implicitly" to the user's shopping list (i.e. without the user having to fully voice the precise name of the product).
  • the user can thus add in a simplified and generic way the reference of a product and / or any commercial information (promotions, product visuals, etc.) in a mobile / internet application, aggregating all of his already recorded requests or pre-registered and not yet validated.
  • multimedia content comprising a plurality of sequences containing information relating to respective services, to respective moments of restitution of the content
  • the terminal receiving, in addition to multimedia data, data:
  • the process includes:
  • such an embodiment makes it possible to discriminate the service (or the product as presented previously) whose sequence has caused a control signal sent from the man-machine interface (HMI) and this, without forcing the user (UT) to this interface (HMI) to fill in all the characteristics necessary to identify this service.
  • HMI man-machine interface
  • the predetermined criterion consists in choosing the closest scheduled restitution timestamp, prior to the control signal generation timestamp.
  • the closest timestamp prior to the HRC timestamp of generation of the control signal is HR2.
  • the aforementioned man-machine interface can be a connected voice assistant (for example a connected speaker of the “djingo” ® type).
  • this voice assistant can be connected to a home gateway via a LAN, which gateway can communicate with the SER management server over a wide area network.
  • this voice assistant can be integrated into a device of smartphone or other type (the interface comprising a microphone of such device), this device being connected via the wide area network (cellular or wifi) to the SER server.
  • this can be the same TER equipment ( Figure 1) comprising an input interface allowing the user to subsequently validate his order.
  • the generated control signal is then a speech signal.
  • the method may include a conversion of the speech signal into a text of a series of characters (so-called “speech to text” conversion) to identify at least one keyword characterizing a service command, such as for example the word “ Adds ”or other.
  • this or these keyword (s) may describe a type of service ordered: for example a product order ("Add this product", an order for a reduction coupon ("Add this reduction”), or others.
  • a voice assistant for the actuation of the aforementioned man-machine interface.
  • a remote control of the STB terminal comprising a specific button to be pressed to send the service command to the STB terminal. which can send the command request to the STB management server by a bidirectional link.
  • the aforementioned TER equipment can offer a computer application with a control button, the pressing of which causes this control request to be sent to the SER management server via the RES network.
  • the method further comprises:
  • the supplemental information data may come from a connected database, listing service identifiers that match additional information data about respective services.
  • It can typically be a database connected to a server managed by an advertiser of the service or services offered in the multimedia content.
  • the aforementioned additional information data can be received from the terminal (STB) for playback by the playback device (TV).
  • TER user equipment
  • SER management server
  • the service order registration signal can be generated by the management server
  • the command recording signal is in reality aimed at a pre-recording of the command, and this command is finally recorded only after validation by the user.
  • the equipment (TER) can receive from the management server (SER) (or even a server managed by a service provider) an order confirmation request to be validated via for example a touch screen of the equipment. (TER).
  • the equipment (TER) can present on a screen a list of services whose command is to be confirmed and the user can choose to validate one by one by pressing on the touch screen the various services offered to him.
  • the SER management server can be a single server for the implementation of the various steps above or be connected to other servers (managed by the advertiser, by the service provider, and / or others), thus forming a “server entity” in general (also called “platform” in the detailed description which follows).
  • the aforementioned comparison of the timestamps to choose the timestamp corresponding to the timestamp of generation of the control signal, and the determination of the service identifier corresponding to the chosen timestamp, at least, are carried out by the server management (SER).
  • SER server management
  • the server (SER) interrogates the terminal (STB) receiving the stream to retrieve the timestamps of the sequences programmed in the stream, and to perform the aforementioned comparison.
  • the server can query a third-party server (SERA) making available a publication of the timestamps of the programmed sequences, with the corresponding identifiers, this third-party server (SERA) being able to be maintained by an advertising agency of a broadcasting channel TV, for example.
  • SERA third-party server
  • the comparison of the timestamps to choose the timestamp corresponding to the timestamp of generation of the control signal, and the determination of the service identifier corresponding to the chosen timestamp are carried out by the terminal (STB), and this terminal (STB) transmits to the management server the service identifier corresponding to the chosen timestamp.
  • This embodiment can be advantageous in particular in the case where simply a remote control button is pressed by the user to control the terminal (STB) instead of providing a voice assistant type HMI interface.
  • the terminal (STB) which performs the comparison between the timestamps of the sequences it receives and that of the event of pressing the remote control button, until it can thus retrieve the identifier of the service whose sequence has nearest timestamp and send that service identifier to the server (SER).
  • HMI voice assistant type interface
  • the aforementioned stream of multimedia data (F) can typically be a stream of television or radio data, broadcast in real time (or slightly delayed), or even in rebroadcast or “replay” (or else a broadcast data stream, recorded for example on a personal recorder (or “PVR”) and replayed).
  • PVR personal recorder
  • this stream may appear advertising spots corresponding to the aforementioned sequences containing information relating to respective services.
  • the expected broadcast time of these sequences (in real time relative to an instant at which data was sent from a station head end, or even deferred with respect to an instant at the start of reading of the stream) is known. and a timestamp can thus be associated with each sequence and thence with each service identifier corresponding to this sequence.
  • the terminal can play a list (“playlist”) of several video streams often comprising a sequence of N streams starting with one or more advertising sequences and continuing with content.
  • a device configured for, with a view to ordering a service and following:
  • multimedia content comprising a plurality of sequences containing information relating to respective services, at respective times of reproduction of the content
  • the terminal receiving, in addition to multimedia data, data:
  • Such a device can be a management server (SER) which, as indicated above, can be configured to implement steps of the above method and more particularly the aforementioned comparison of the timestamps to choose the timestamp corresponding to the timestamp of generating the control signal, and determining the service identifier corresponding to the selected timestamp.
  • SER management server
  • such a device can be a terminal (STB) for receiving a stream (F) of multimedia data, configured to implement steps of the above method and more particularly the comparison of the timestamps to choose the corresponding timestamp. at the time stamp of generation of the control signal, determining the service identifier corresponding to the time stamp chosen, and transmission to the management server of the service identifier corresponding to the chosen timestamp.
  • STB terminal
  • F stream
  • a system for controlling a service comprising at least:
  • a reproduction device connected to the terminal, for reproducing multimedia content corresponding to multimedia data, said multimedia content comprising a plurality of sequences containing information relating to respective services, at respective times of reproduction of the content,
  • a man-machine interface available to a user for generating a command signal for a service, the sequence of which may be being restored by the device, and transmitting the command signal with a time stamp for generating the command signal, and a user reference,
  • a management server able to process the service control signal with a view to recording a service order for this user
  • the terminal is arranged to receive, in addition to the multimedia data, data:
  • the terminal and the management server is designed to:
  • a computer program comprising instructions for the implementation of all or part of a method as defined. herein when this program is executed by a processor.
  • a non-transient, computer-readable recording medium on which such a program is recorded.
EP20719664.3A 2019-04-26 2020-04-24 Bestellung eines dienstes durch verarbeitung eines multimediadatenstroms Pending EP3959894A1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR1904469A FR3095563A1 (fr) 2019-04-26 2019-04-26 Commande d’un service utilisant le traitement d’un flux comprenant des données multimédias
PCT/EP2020/061503 WO2020216926A1 (fr) 2019-04-26 2020-04-24 Commande d'un service utilisant le traitement d'un flux comprenant des donnees multimedias

Publications (1)

Publication Number Publication Date
EP3959894A1 true EP3959894A1 (de) 2022-03-02

Family

ID=67660300

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20719664.3A Pending EP3959894A1 (de) 2019-04-26 2020-04-24 Bestellung eines dienstes durch verarbeitung eines multimediadatenstroms

Country Status (4)

Country Link
US (1) US20220232292A1 (de)
EP (1) EP3959894A1 (de)
FR (1) FR3095563A1 (de)
WO (1) WO2020216926A1 (de)

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004064393A1 (ja) * 2003-01-15 2004-07-29 Matsushita Electric Industrial Co., Ltd. 放送受信方法、放送受信システム、記録媒体、及びプログラム
US20090307092A1 (en) * 2008-06-04 2009-12-10 Dionytech, Inc. System and method for providing media content
US9955206B2 (en) * 2009-11-13 2018-04-24 The Relay Group Company Video synchronized merchandising systems and methods
US8689255B1 (en) * 2011-09-07 2014-04-01 Imdb.Com, Inc. Synchronizing video content with extrinsic data
US9621932B2 (en) * 2012-02-28 2017-04-11 Google Inc. Enhancing live broadcast viewing through display of filtered internet information streams
US9380282B2 (en) * 2012-03-26 2016-06-28 Max Abecassis Providing item information during video playing
US20130325466A1 (en) * 2012-05-10 2013-12-05 Clickberry, Inc. System and method for controlling interactive video using voice
CN105474248A (zh) * 2013-06-20 2016-04-06 塔拉里亚斯特公司 用于促销与节目内容相关的项目的系统和方法
US9693083B1 (en) * 2014-12-31 2017-06-27 The Directv Group, Inc. Systems and methods for controlling purchasing and/or reauthorization to access content using quick response codes and text messages
US10271109B1 (en) * 2015-09-16 2019-04-23 Amazon Technologies, LLC Verbal queries relative to video content
FR3049142A1 (fr) * 2016-03-16 2017-09-22 Orange Acquisition d'extraits d'un flux multimedia sur un terminal
US10299010B2 (en) * 2016-03-31 2019-05-21 Valeria Kachkova Method of displaying advertising during a video pause

Also Published As

Publication number Publication date
US20220232292A1 (en) 2022-07-21
WO2020216926A1 (fr) 2020-10-29
FR3095563A1 (fr) 2020-10-30

Similar Documents

Publication Publication Date Title
US11006157B2 (en) System and method for video conversations
US9256601B2 (en) Media fingerprinting for social networking
JP5230440B2 (ja) マルチメディアコンテンツのための選択的な広告表示
RU2632403C2 (ru) Оконечное устройство, устройство сервера, способ обработки информации, программа и система поставки связанного приложения
JP5651231B2 (ja) コンテンツを決定し検索するためのメディアフィンガープリント
US20080276266A1 (en) Characterizing content for identification of advertising
JP2010532519A (ja) 推奨情報に基づいて1つ以上のメディアを購入する方法およびその装置
CN111444415B (zh) 弹幕处理方法、服务器、客户端、电子设备及存储介质
US11540008B2 (en) Systems and methods for audio adaptation of content items to endpoint media devices
CN107659831A (zh) 媒体数据处理方法、客户端、及存储介质
US9288526B2 (en) Method and system for delivery of content over communication networks
EP1741294B1 (de) Verfahren und einrichtung für die automatische verarbeitung von spontandaten
FR3004054A1 (fr) Generation et restitution d'un flux representatif d'un contenu audiovisuel
US20100306073A1 (en) Identifying and purchasing pre-recorded content
EP3959894A1 (de) Bestellung eines dienstes durch verarbeitung eines multimediadatenstroms
EP2085894A1 (de) Verfahren, System und Server zur Datengenerierung, um komplementäre Information für Inhalte zu suchen
JP2002320214A (ja) 視聴管理方法、視聴管理システム
WO2023180274A1 (fr) Gestion perfectionnée d'un code visuel en cours d'affichage dans un contenu multimédia
WO2018226832A1 (en) Systems and methods for operating a streaming service to provide community spaces for media content items
WO2017064400A1 (fr) Enrichissement contextuel par reconnaissance audio
KR20220125950A (ko) 송출자가 녹음하고 있는 음성과 음성이 담고 있는 콘텐츠를 실시간 영상 방송으로 제공하는 방법 및 시스템
EP3753255A1 (de) Empfang eines einen multimediainhalt darstellenden stroms
KR20190102749A (ko) 서버 기반 광고 제공 방법 및 장치
KR20180087737A (ko) 비디오 클립에 대한 오디오 인지 기반의 실시간 상품 정보 중계 시스템 및 방법
FR3006542A1 (fr) Programmation d'enregistrement de contenus audiovisuels presents dans une grille de programmes electronique

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20211118

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20230920