EP3959894A1 - Commande d'un service utilisant le traitement d'un flux comprenant des donnees multimedias - Google Patents
Commande d'un service utilisant le traitement d'un flux comprenant des donnees multimediasInfo
- Publication number
- EP3959894A1 EP3959894A1 EP20719664.3A EP20719664A EP3959894A1 EP 3959894 A1 EP3959894 A1 EP 3959894A1 EP 20719664 A EP20719664 A EP 20719664A EP 3959894 A1 EP3959894 A1 EP 3959894A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- service
- timestamp
- stream
- ser
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/47815—Electronic shopping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42203—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/4722—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/65—Transmission of management data between client and server
- H04N21/658—Transmission by the client directed to the server
- H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8126—Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts
- H04N21/8133—Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Definitions
- the present invention relates to the field of processing audiovisual data streams, in particular multimedia data, for the management of a service control signal.
- such a service control signal is generated as follows.
- a terminal STB connected to a TV playback device, receives a multimedia data stream F in order to restore on the TV device multimedia content corresponding to the multimedia data.
- This stream F can for example be a real-time television data stream and the terminal STB can be for example of the “Set Top Box” type, connected to a television set TV as a playback device, allowing a user UT to watch a television program.
- the STB terminal and the TV device can be integrated into the same connected equipment, of the tablet, PC or other type, to receive such a television data stream via a television application and an extended network RES of the Internet type via example.
- the stream F can be a real-time radio broadcast data stream and the terminal STB can include a tuner and be integrated into a radio station as a playback device, allowing a user UT to listen to the program of a radio station.
- the multimedia content may be any pre-recording and not necessarily stream content broadcast in real time or slightly delayed.
- this multimedia content is likely to include one or more sequences containing information relating to respective services, at respective times when the content is returned.
- these sequences can be advertising messages describing respective products.
- messages usually, such messages last around ten seconds and can follow one another over time.
- FIG. 1 illustrating in the example represented the case of a user viewing UT, watching a television program on the TV set
- a man-machine interface HMI for example a voice interface
- This control signal SC can be transmitted via the RES network to a SER management server.
- the latter SER can for example request in return a CC command confirmation from the user UT, via an input interface (provided on a user equipment TER, such as for example a touch screen of a TER equipment such as a smartphone, tablet, PC or other).
- a user equipment TER such as for example a touch screen of a TER equipment such as a smartphone, tablet, PC or other.
- the SER server can transmit CC reference data of this well identified product, so that such references are displayed for example on the screen.
- TER equipment An application installed on the aforementioned TER equipment comes to life in order to ask the user to enter a confirmation of validation of this product via the input interface of the TER equipment, which can then trigger the final registration of ordering the product from the SER server or another server (from a product distributor or other).
- a natural way for the UT user to issue this command is to pronounce a word such as “I want this product” or “add” (to a pre-existing list of races for example).
- a problem observed is that a user does not utter (or more generally does not wish to capture) all the characteristics of the product, the advertising sequence of which he sees being displayed. It is then difficult for the SER management server to identify precisely the product whose order is desired.
- the present invention then improves the situation.
- a method of purchasing an order for a service a sequence relating to said service being included in a stream of multimedia data restored by a reproduction device (TV), the multimedia data stream comprising a plurality of sequences relating to respective services and associated with respective return timestamps, the ordering method comprising:
- a service identifier corresponding to a timestamp for restoring a sequence associated with said service, the timestamp for restoring the sequence associated with said service having been determined as a function of a timestamp of a control signal ( HRC) for purchasing a service, the command signal having been generated by a man-machine interface (HMI) and transmitted by the man-machine interface to a management server (SER) separate from a terminal (STB) receiving multimedia data stream; the service identifier to generate a purchase registration signal.
- HRC control signal
- SER management server
- such an embodiment makes it possible to discriminate the service (or the product as presented previously) whose sequence has caused a control signal sent from the man-machine interface (HMI) and this, without forcing the user (UT) to this interface (HMI) to fill in all the characteristics necessary to identify this service.
- HMI man-machine interface
- control method comprises determining (S4), according to a predetermined criterion, a timestamp from among the timestamps for the programmed playback of sequences as corresponding to the timestamp of generation of the control signal.
- the predetermined criterion consists in determining the closest scheduled restitution timestamp, prior to the control signal generation timestamp. As illustrated in FIG. 2 by way of example, in a succession of timestamps HR1, HR2, etc., of programmed reproduction of respective sequences, the closest timestamp prior to the HRC timestamp of generation of the control signal is HR2. In one embodiment, it is further possible to add a latency time which may be constant (for example five seconds) to the HR1, HR2, etc. timestamps, and to determine the timestamp thus augmented nearest before the HRC timestamp, in order to take account of any user reaction time. The duration of this latency can be adjusted according to tests carried out on a panel of users.
- the method further comprises:
- the supplemental information data may come from a connected database, listing service identifiers that match additional information data about respective services.
- It can typically be a database connected to a server managed by an advertiser of the service or services offered in the multimedia content.
- HMI voice assistant type interface
- the aforementioned stream of multimedia data (F) can typically be a stream of television or radio data, broadcast in real time (or slightly delayed), or even in rebroadcast or “replay” (or else a broadcast data stream, recorded for example on a personal recorder (or “PVR”) and replayed).
- PVR personal recorder
- this stream may appear advertising spots corresponding to the aforementioned sequences containing information relating to respective services.
- the expected broadcast time of these sequences (in real time compared to an instant when data was sent from a head end, or (still deferred with respect to an instant at the start of reading the stream) is known and a timestamp can thus be associated with each sequence and from there to each service identifier corresponding to this sequence.
- the terminal can play a list (“playlist”) of several video streams often comprising a sequence of N streams starting with one or more advertising sequences and continuing with content.
- a device for ordering the purchase of a service a sequence relating to said service being included in a stream of multimedia data restored by a reproduction device (TV), the multimedia data stream comprising a plurality of sequences relating to respective services and associated with respective restitution timestamps, the control device comprising:
- a processor configured to determine a service identifier corresponding to a restitution timestamp of a sequence associated with said service, the restitution timestamp of the sequence associated with said service having been determined as a function of a timestamp of a control signal ( HRC) for purchasing a service, the command signal having been generated by a man-machine interface (HMI) and transmitted by the man-machine interface to a management server (SER) separate from a terminal (STB) receiving multimedia data stream; the service identifier to generate a purchase registration signal.
- HRC control signal
- Such a device can be implemented in a management server (SER) which, as indicated above, can be configured to receive control signals generated by the human machine interface (HMI).
- the management server is in particular configured to implement steps of the above method and more particularly the aforementioned comparison of timestamps to choose the timestamp corresponding to the timestamp of generation of the control signal, and to determine the identifier. service corresponding to the determined timestamp.
- the purchase order device comprises a timestamp comparator to determine the timestamp corresponding to the timestamp of generation of the control signal, and the determination of the service identifier corresponding to the chosen timestamp, at least, are carried out by the management server.
- the purchase order device comprises a timestamp comparator for determining the timestamp corresponding to the timestamp of generation of the command signal, and determining the service identifier corresponding to the chosen timestamp, at less, are conducted by the management server (SER).
- SER management server
- the server (SER) interrogates the terminal (STB) receiving the stream to retrieve the timestamps of the sequences programmed in the stream, and to perform the aforementioned comparison.
- the server can query a third-party server (SERA) making available a publication of the timestamps of the programmed sequences, with the corresponding identifiers, this third-party server (SERA) being able to be maintained by an advertising agency of a broadcasting channel TV, for example.
- SERA third-party server
- a transmitter configured to return the command registration signal to the equipment (TER) for confirmation of the registration of the order (COM OK) on receipt by the management server (SER) of a validation signal from the equipment (TER) following an entry of a validation by the user.
- the command recording signal is in reality aimed at a pre-recording of the command, and this order is finally registered only after validation of the user.
- the equipment (TER) can receive from the management server (SER) (or even a server managed by a service provider) an order confirmation request to be validated via for example a touch screen of the equipment. (TER).
- the equipment (TER) can present on a screen a list of services whose command is to be confirmed and the user can choose to validate one by one by pressing on the touch screen the various services offered to him.
- the SER management server can be a single server for the implementation of the various steps above or be connected to other servers (managed by the advertiser, by the service provider, and / or others), thus forming a “server entity” in general (also called “platform” in the detailed description which follows).
- such a device can be implemented in a terminal (STB) for receiving a stream (F) of multimedia data.
- the terminal is configured to implement steps of the above method and more particularly the comparison of the timestamps to choose the timestamp corresponding to the timestamp of generation of the control signal, the determination of the corresponding service identifier at the determined timestamp, and a transmission to the management server of the service identifier corresponding to the determined timestamp.
- the terminal (STB) is configured to receive additional information data for rendering by the rendering device (TV), the additional information data having been obtained by the purchase order device according to the service identifier.
- the purchase order device comprises a timestamp comparator (S3) for choosing (S4) the timestamp corresponding to the timestamp of generation of the order signal, and the determination (S5) of the service identifier corresponding to the chosen timestamp are carried out by the terminal (STB), and in which the terminal (STB) transmits to the management server the service identifier corresponding to the chosen timestamp.
- S3 timestamp comparator
- S4 the timestamp corresponding to the timestamp of generation of the order signal
- S5 the determination of the service identifier corresponding to the chosen timestamp are carried out by the terminal (STB), and in which the terminal (STB) transmits to the management server the service identifier corresponding to the chosen timestamp.
- This embodiment can be advantageous in particular in the case where simply a remote control button is pressed by the user to control the terminal (STB) instead of providing an HMI interface type voice assistant.
- the terminal (STB) which performs the comparison between the timestamps of the sequences it receives and that of the event of pressing the remote control button, until it can thus retrieve the identifier of the service whose sequence has the closest timestamp and send this service identifier to the server (SER).
- a man-machine interface connected to a management server separate from a terminal (STB) receiving a stream of multimedia data restored by a reproduction device (TV), the multimedia data stream comprising a plurality sequences relating to respective services and associated with respective restitution timestamps
- the man-machine interface comprises a generator of a command signal (HRC) for purchasing a service and a transmitter of the command signal d 'purchase of the service from a management server (SER) separate from a terminal (STB) receiving the data stream, the control signal having a timestamp making it possible to determine a timestamp for restoring the sequence associated with said service, the timestamp restitution of the sequence associated with said service making it possible to determine a service identifier making it possible to generate a purchase registration signal.
- HRC command signal
- SER management server
- the aforementioned man-machine interface can be a connected voice assistant (for example a connected speaker of the "djingo" ® type).
- this voice assistant can be connected to a home gateway via a local network, which gateway can communicate with the SER management server via a wide network.
- this voice assistant can be integrated into a device of smartphone or other type (the interface comprising a microphone of such device), this device being connected via the wide area network (cellular or wifi) to the SER server. It can be for example the same TER equipment (figure 1) comprising a input interface allowing the user to subsequently validate his order.
- the generated control signal is then a speech signal.
- the method may include a conversion of the speech signal into a text of a series of characters (so-called “speech to text” conversion) to identify at least one keyword characterizing a service command, such as for example the word “ Adds ”or other.
- this or these keyword (s) may describe a type of service ordered: for example a product order ("Add this product", an order for a reduction coupon ("Add this reduction”), or others.
- a voice assistant for the actuation of the aforementioned man-machine interface.
- a remote control of the STB terminal comprising a specific button to be pressed to send the service command to the STB terminal. which can send the command request to the STB management server by a bidirectional link.
- the aforementioned TER equipment can offer a computer application with a control button, the pressing of which causes this control request to be sent to the SER management server via the RES network.
- a system for controlling a service comprising at least:
- a reproduction device connected to the terminal, for reproducing multimedia content corresponding to multimedia data, said multimedia content comprising a plurality of sequences containing information relating to respective services, at respective times of reproduction of the content,
- a man-machine interface available to a user to generate a command signal for a service, the sequence of which may be being restored by the device, and to transmit the command signal with a time stamp of generation of the control signal and a user reference
- a management server able to process the service order signal with a view to recording a service order for this user
- the terminal is arranged to receive, in addition to the multimedia data, data:
- the terminal and the management server is designed to:
- a computer program comprising instructions for the implementation of all or part of a method as defined herein when this program is executed by a processor.
- a non-transient, computer readable recording medium on which such a program is recorded.
- the instructions of such a computer program can be distributed among different entities of the above system (for example between the terminal (STB) and the management server).
- the general flowchart of such a computer program can be represented by way of example in one of Figures 3 and 4 commented on below.
- FIG. 3 shows a succession of steps that may include a process of the type defined above
- FIG. 4 illustrates the exchanges between different entities of a system of the aforementioned type.
- step S1 On receipt of the control signal SC in step S1, metadata describing time stamps of service description sequences (typically advertising spots for such services) are extracted from the stream F that the terminal STB receives in step S2.
- the terminal STB itself performs the first steps of FIG. 3
- the terminal STB extracts these metadata from the stream F that it receives in order to use them itself subsequently.
- the SER server implements the steps of FIG. 3
- the control signal SC is received in step S1 by the management server SER, which triggers a request from the SER server to the terminal STB, for retrieve this metadata for processing from the server.
- the terminal STB analyzes and extracts from the stream a signal specific to the programmed advertising sequences and comprising markers of these sequences (timestamps and identifiers) inserted into the stream, with a "parsing" of descriptors associated with the thread. water, to store these data in a FIFO type buffer memory.
- the SER server can trigger actions on the STB terminal side such as reconciliation on the timestamp and then reconciliation on the advertising campaign identifier (PublD) with an identifier of the product being advertised (GTIN), as described in detail.
- the terminal STB and / or the management server SER are configured so as to allocate a time stamp HRC for receiving the control signal SC at step S1.
- step S3 it is possible to compare this timestamp HRC with the timestamp data HR1, HR2, ..., HRi, etc. received in the stream F, as described above with reference to FIG. 2, in order then to identify, in step S4, the timestamp HRj which best corresponds to the timestamp HRC of the control signal.
- the time stamps HR1, HR2, ..., HRi, etc. are received in stream F with respective service identifiers ID1, ID2, ..., IDi, etc.
- step S5 it is possible in step S5 to determine the service identifier IDj corresponding to the time stamp determined in step S4 and specific to the service which is the object of the command SC.
- the service identifier IDj corresponding to the time stamp determined in step S4 and specific to the service which is the object of the command SC.
- a playlist in replay we can first determine which stream number of the playlist the timestamp corresponds to, and this stream number can then be associated with a service identifier (pub id).
- the management server SER can then retrieve additional information CC specific to this identifier service IDj in step S6, or the terminal STB can ask the server SER for such information data, with a view to display for example. on the TV rendering device, in order to allow a user to definitively validate this command (via TER equipment such as a smartphone or other), a message of such validation then being transmitted to the SER management server with a view to storing it in step S7 to follow up on this command.
- the steps of FIG. 3 can be implemented completely or partially by the terminal STB or by the management server SER. Nevertheless, in particular for bandwidth savings, it may be advantageous for the comparison of the timestamps to be carried out by the terminal STB, at the request of the server SER (when it receives the control signal SC) and for the terminal TER not to go up. to the SER server as the relevant service identifier IDj.
- the man-machine interface HMI such as a voice assistant transmits the control signal SC (for example in the form of a speech signal) to the management server SER with the HRC time stamp of generation of this signal.
- SC control signal
- the HRC timestamp is assigned by the server SER upon receipt of the control signal SC.
- the SER management server sends a REQ (SC, HRC) request to the STB terminal for comparing an HRC command time stamp with sequence time stamps in the stream F.
- the SER management server keeps a user database matching identification data of HMI and STB terminal (and also TER equipment, as described below).
- the terminal STB performs the comparison of the timestamps and for this purpose has a MEM memory (for example a FIFO type buffer memory for "first in - first out") to store the HRi timestamps received in the flow corresponding to the identifiers of IDi services.
- a MEM memory for example a FIFO type buffer memory for "first in - first out"
- the terminal STB sends back in response to the request REQ (SC, HRC) the identifier thus determined IDj in a response message REP (IDj ).
- the SER server can then interrogate a third-party SERA server (for example managed by an advertiser) to reconcile a campaign identifier (PublD) corresponding to the identifier IDj with an identifier of the product that is the subject of this advertisement (GTIN identifier) ( in addition to visuals or reduction campaigns associated with this product). More generally, the server SER can thus recover additional data CC on this identifier service IDj and transmit them (arrow COM (CC)) to the terminal STB in order to play them by the reproduction device TV. For example, it may be a banner superimposed on a current image, which is displayed on the screen of a TV television, this banner indicating that an order has been placed for a given service (with characteristics precise).
- the banner can also indicate that an order confirmation request message will be sent to the TER equipment (for example a touch screen smartphone) to definitively confirm the order. Confirmation of the addition of a product (for example in a shopping list) can also be considered in voice reproduction, and in this case the SER server sends the STB terminal a confirmation message to be vocalized by the TV playback device, for example of the type "product XX has been added to your shopping list".
- the SER management server can communicate with a third-party SERB server of a service provider, for example a product distributor, to send back to the TER equipment a list of products awaiting an order confirmation by the user from TER equipment.
- a third-party SERB server of a service provider for example a product distributor
- the SER management server can communicate with a third-party SERB server of a service provider, for example a product distributor, to send back to the TER equipment a list of products awaiting an order confirmation by the user from TER equipment.
- a third-party SERB server of a service provider for example a product distributor
- Such an embodiment can be generalized to any broadcast stream (television, radio, rebroadcast or "replay", etc.) received by a broadcast content reception terminal STB which can be a "TV or radio decoder", a connected television. , a connected radio, or other.
- the content broadcast can be any type of content relating to at least one marketable product: advertising, teleshopping, music program (purchase of the song), games (the proposed earnings can be purchased by viewers / listeners), etc.
- the aforementioned voice assistant HMI can in particular be a voice assistant of the Djingo or Alexa type, or an assistant for a smartphone or a tablet separate from the STB terminal for receiving the broadcast content.
- Such an HMI voice assistant can operate as follows. First, the user of the broadcast content can wake up his HMI assistant, which triggers the HMI assistant to trace a future command moment. Secondly, the broadcast content comprising a sequence relating to a marketable product, the user can indicate to his HMI assistant via a keyword (for example "Add”) the action to be taken:
- the HMI assistant records the command and associates it with an HRC timestamp of the instant at which the user made his request, and sends to the SER platform of the HMI assistant a request to recognize the request required by the user. user. This can be a signal including an audio recording of the user commanded action and the HRC time stamp.
- the SER platform performs a speech-to-text conversion of the user's request and can determine, for example, that the name of the product to be added to the shopping list is missing.
- the platform SER directly or indirectly questions the broadcast content receiver STB which provides an identifier IDj corresponding to the advertising spot inserted in the broadcast content stream.
- IDj the identifier corresponding to the advertising spot inserted in the broadcast content stream.
- the data of this identifier can be declared by the variable "Pubid”.
- the identifier can in particular be positioned in the flow at the start of the advertising spot or before the advertising spot.
- the term “positioned in the stream” is understood here to mean the fact that the aforementioned identifier is presented as a marking signal (in the form of a command for example), for the start of an advertising sequence, positioned in the stream with which a descriptor (“segmentation descriptor”) containing the identifier IDj (or Pubid) can be associated.
- the STB broadcast content receiver is able to check whether the HRC time stamp of the user's request is positioned in the broadcast range of a given advertising spot to find the identifier IDj corresponding to this advertising spot.
- the broadcast content receiver keeps in a memory buffer MEM, the most recent identifiers IDi (or "Pubid") and the start and / or end time of broadcasting of the corresponding advertising sport.
- the term “directly interrogate” means the fact that the SER platform is connected in a wide area network (WAN / API) with the broadcast content receiver STB in order to interrogate it directly.
- WAN / API wide area network
- the SER platform sends the Pubid identifier request to the HMI assistant intended for the broadcast content receiver STB.
- the HMI assistant and the STB terminal are connected to a network local and thus the HMI assistant is connected via this local network (LAN / API) to the STB broadcast content receiver to which the HMI assistant can then transmit the request and from which it receives in return the Pubid identifier that it relays to the SER platform.
- the third-party server of the SERA advertiser partner can provide a more complete product identifier (which can be declared by a GTIN variable) with the aforementioned additional data CC (equivalent to a "bar code" of the product corresponding to this Pubid identifier) or directly to the STB broadcast content receiver or to the SER platform.
- the STB Receiver receives the GTIN Product ID, it sends this in addition to or instead of the Pubid ID to the SER platform.
- the SER platform uses a server from a SERB vendor partner to add the product to the user's LST shopping list using the retrieved product ID GTIN.
- the order can be for a product or a service.
- it could be adding:
- the proposed solution is based on a signaling of the advertising spot inserted in the stream F, for example by marking (or "frame accurate") of the start of the spot, to which is associated information concerning the campaign identifier of the advertising spot (typically the the aforementioned identifier Pubid or IDj in the figures).
- the proposed solution is also based on synchronization between the STB decoder receiver and the HMI voice assistant so that this temporal information and descriptions on the sequence of the advertising spot, available from the STB receiver, are fed back to the SER platform directly (via WAN API) or possibly indirectly by the HMI assistant (via LAN API) to the platform.
- the proposed solution makes it possible to avoid, if the voice interaction takes place at the end of the spot, that the product of the following spot is added to the list of races.
- the proposed solution allows the product to be added "implicitly" to the user's shopping list (i.e. without the user having to fully voice the precise name of the product).
- the user can thus add in a simplified and generic way the reference of a product and / or any commercial information (promotions, product visuals, etc.) in a mobile / internet application, aggregating all of his already recorded requests or pre-registered and not yet validated.
- multimedia content comprising a plurality of sequences containing information relating to respective services, to respective moments of restitution of the content
- the terminal receiving, in addition to multimedia data, data:
- the process includes:
- such an embodiment makes it possible to discriminate the service (or the product as presented previously) whose sequence has caused a control signal sent from the man-machine interface (HMI) and this, without forcing the user (UT) to this interface (HMI) to fill in all the characteristics necessary to identify this service.
- HMI man-machine interface
- the predetermined criterion consists in choosing the closest scheduled restitution timestamp, prior to the control signal generation timestamp.
- the closest timestamp prior to the HRC timestamp of generation of the control signal is HR2.
- the aforementioned man-machine interface can be a connected voice assistant (for example a connected speaker of the “djingo” ® type).
- this voice assistant can be connected to a home gateway via a LAN, which gateway can communicate with the SER management server over a wide area network.
- this voice assistant can be integrated into a device of smartphone or other type (the interface comprising a microphone of such device), this device being connected via the wide area network (cellular or wifi) to the SER server.
- this can be the same TER equipment ( Figure 1) comprising an input interface allowing the user to subsequently validate his order.
- the generated control signal is then a speech signal.
- the method may include a conversion of the speech signal into a text of a series of characters (so-called “speech to text” conversion) to identify at least one keyword characterizing a service command, such as for example the word “ Adds ”or other.
- this or these keyword (s) may describe a type of service ordered: for example a product order ("Add this product", an order for a reduction coupon ("Add this reduction”), or others.
- a voice assistant for the actuation of the aforementioned man-machine interface.
- a remote control of the STB terminal comprising a specific button to be pressed to send the service command to the STB terminal. which can send the command request to the STB management server by a bidirectional link.
- the aforementioned TER equipment can offer a computer application with a control button, the pressing of which causes this control request to be sent to the SER management server via the RES network.
- the method further comprises:
- the supplemental information data may come from a connected database, listing service identifiers that match additional information data about respective services.
- It can typically be a database connected to a server managed by an advertiser of the service or services offered in the multimedia content.
- the aforementioned additional information data can be received from the terminal (STB) for playback by the playback device (TV).
- TER user equipment
- SER management server
- the service order registration signal can be generated by the management server
- the command recording signal is in reality aimed at a pre-recording of the command, and this command is finally recorded only after validation by the user.
- the equipment (TER) can receive from the management server (SER) (or even a server managed by a service provider) an order confirmation request to be validated via for example a touch screen of the equipment. (TER).
- the equipment (TER) can present on a screen a list of services whose command is to be confirmed and the user can choose to validate one by one by pressing on the touch screen the various services offered to him.
- the SER management server can be a single server for the implementation of the various steps above or be connected to other servers (managed by the advertiser, by the service provider, and / or others), thus forming a “server entity” in general (also called “platform” in the detailed description which follows).
- the aforementioned comparison of the timestamps to choose the timestamp corresponding to the timestamp of generation of the control signal, and the determination of the service identifier corresponding to the chosen timestamp, at least, are carried out by the server management (SER).
- SER server management
- the server (SER) interrogates the terminal (STB) receiving the stream to retrieve the timestamps of the sequences programmed in the stream, and to perform the aforementioned comparison.
- the server can query a third-party server (SERA) making available a publication of the timestamps of the programmed sequences, with the corresponding identifiers, this third-party server (SERA) being able to be maintained by an advertising agency of a broadcasting channel TV, for example.
- SERA third-party server
- the comparison of the timestamps to choose the timestamp corresponding to the timestamp of generation of the control signal, and the determination of the service identifier corresponding to the chosen timestamp are carried out by the terminal (STB), and this terminal (STB) transmits to the management server the service identifier corresponding to the chosen timestamp.
- This embodiment can be advantageous in particular in the case where simply a remote control button is pressed by the user to control the terminal (STB) instead of providing a voice assistant type HMI interface.
- the terminal (STB) which performs the comparison between the timestamps of the sequences it receives and that of the event of pressing the remote control button, until it can thus retrieve the identifier of the service whose sequence has nearest timestamp and send that service identifier to the server (SER).
- HMI voice assistant type interface
- the aforementioned stream of multimedia data (F) can typically be a stream of television or radio data, broadcast in real time (or slightly delayed), or even in rebroadcast or “replay” (or else a broadcast data stream, recorded for example on a personal recorder (or “PVR”) and replayed).
- PVR personal recorder
- this stream may appear advertising spots corresponding to the aforementioned sequences containing information relating to respective services.
- the expected broadcast time of these sequences (in real time relative to an instant at which data was sent from a station head end, or even deferred with respect to an instant at the start of reading of the stream) is known. and a timestamp can thus be associated with each sequence and thence with each service identifier corresponding to this sequence.
- the terminal can play a list (“playlist”) of several video streams often comprising a sequence of N streams starting with one or more advertising sequences and continuing with content.
- a device configured for, with a view to ordering a service and following:
- multimedia content comprising a plurality of sequences containing information relating to respective services, at respective times of reproduction of the content
- the terminal receiving, in addition to multimedia data, data:
- Such a device can be a management server (SER) which, as indicated above, can be configured to implement steps of the above method and more particularly the aforementioned comparison of the timestamps to choose the timestamp corresponding to the timestamp of generating the control signal, and determining the service identifier corresponding to the selected timestamp.
- SER management server
- such a device can be a terminal (STB) for receiving a stream (F) of multimedia data, configured to implement steps of the above method and more particularly the comparison of the timestamps to choose the corresponding timestamp. at the time stamp of generation of the control signal, determining the service identifier corresponding to the time stamp chosen, and transmission to the management server of the service identifier corresponding to the chosen timestamp.
- STB terminal
- F stream
- a system for controlling a service comprising at least:
- a reproduction device connected to the terminal, for reproducing multimedia content corresponding to multimedia data, said multimedia content comprising a plurality of sequences containing information relating to respective services, at respective times of reproduction of the content,
- a man-machine interface available to a user for generating a command signal for a service, the sequence of which may be being restored by the device, and transmitting the command signal with a time stamp for generating the command signal, and a user reference,
- a management server able to process the service control signal with a view to recording a service order for this user
- the terminal is arranged to receive, in addition to the multimedia data, data:
- the terminal and the management server is designed to:
- a computer program comprising instructions for the implementation of all or part of a method as defined. herein when this program is executed by a processor.
- a non-transient, computer-readable recording medium on which such a program is recorded.
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR1904469A FR3095563A1 (fr) | 2019-04-26 | 2019-04-26 | Commande d’un service utilisant le traitement d’un flux comprenant des données multimédias |
PCT/EP2020/061503 WO2020216926A1 (fr) | 2019-04-26 | 2020-04-24 | Commande d'un service utilisant le traitement d'un flux comprenant des donnees multimedias |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3959894A1 true EP3959894A1 (fr) | 2022-03-02 |
Family
ID=67660300
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP20719664.3A Pending EP3959894A1 (fr) | 2019-04-26 | 2020-04-24 | Commande d'un service utilisant le traitement d'un flux comprenant des donnees multimedias |
Country Status (4)
Country | Link |
---|---|
US (1) | US20220232292A1 (fr) |
EP (1) | EP3959894A1 (fr) |
FR (1) | FR3095563A1 (fr) |
WO (1) | WO2020216926A1 (fr) |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1757229A (zh) * | 2003-01-15 | 2006-04-05 | 松下电器产业株式会社 | 广播接收方法、广播接收系统、记录媒体及程序 |
US20090307092A1 (en) * | 2008-06-04 | 2009-12-10 | Dionytech, Inc. | System and method for providing media content |
US9955206B2 (en) * | 2009-11-13 | 2018-04-24 | The Relay Group Company | Video synchronized merchandising systems and methods |
US8689255B1 (en) * | 2011-09-07 | 2014-04-01 | Imdb.Com, Inc. | Synchronizing video content with extrinsic data |
US9621932B2 (en) * | 2012-02-28 | 2017-04-11 | Google Inc. | Enhancing live broadcast viewing through display of filtered internet information streams |
US9380282B2 (en) * | 2012-03-26 | 2016-06-28 | Max Abecassis | Providing item information during video playing |
US20130325466A1 (en) * | 2012-05-10 | 2013-12-05 | Clickberry, Inc. | System and method for controlling interactive video using voice |
KR20210063458A (ko) * | 2013-06-20 | 2021-06-01 | 더 탈라리애스트 인크. | 프로그래밍 콘텐츠에 관련되는 아이템들을 홍보하는 시스템 및 방법 |
US9693083B1 (en) * | 2014-12-31 | 2017-06-27 | The Directv Group, Inc. | Systems and methods for controlling purchasing and/or reauthorization to access content using quick response codes and text messages |
US10271109B1 (en) * | 2015-09-16 | 2019-04-23 | Amazon Technologies, LLC | Verbal queries relative to video content |
FR3049142A1 (fr) * | 2016-03-16 | 2017-09-22 | Orange | Acquisition d'extraits d'un flux multimedia sur un terminal |
US10299010B2 (en) * | 2016-03-31 | 2019-05-21 | Valeria Kachkova | Method of displaying advertising during a video pause |
-
2019
- 2019-04-26 FR FR1904469A patent/FR3095563A1/fr active Pending
-
2020
- 2020-04-24 EP EP20719664.3A patent/EP3959894A1/fr active Pending
- 2020-04-24 US US17/606,630 patent/US20220232292A1/en active Pending
- 2020-04-24 WO PCT/EP2020/061503 patent/WO2020216926A1/fr unknown
Also Published As
Publication number | Publication date |
---|---|
WO2020216926A1 (fr) | 2020-10-29 |
FR3095563A1 (fr) | 2020-10-30 |
US20220232292A1 (en) | 2022-07-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11006157B2 (en) | System and method for video conversations | |
US9256601B2 (en) | Media fingerprinting for social networking | |
JP5230440B2 (ja) | マルチメディアコンテンツのための選択的な広告表示 | |
RU2632403C2 (ru) | Оконечное устройство, устройство сервера, способ обработки информации, программа и система поставки связанного приложения | |
JP5651231B2 (ja) | コンテンツを決定し検索するためのメディアフィンガープリント | |
US20170013325A1 (en) | Apparatus and Method for Tagging Media Content and Managing Marketing | |
US20080276266A1 (en) | Characterizing content for identification of advertising | |
JP2010532519A (ja) | 推奨情報に基づいて1つ以上のメディアを購入する方法およびその装置 | |
JP2010503915A (ja) | ピアツーピア・メディア配布システムおよび方法 | |
CN111444415B (zh) | 弹幕处理方法、服务器、客户端、电子设备及存储介质 | |
US11540008B2 (en) | Systems and methods for audio adaptation of content items to endpoint media devices | |
CN107659831A (zh) | 媒体数据处理方法、客户端、及存储介质 | |
US20140294365A1 (en) | Method and System for Delivery of Content Over Communication Networks | |
FR3004054A1 (fr) | Generation et restitution d'un flux representatif d'un contenu audiovisuel | |
US20100306073A1 (en) | Identifying and purchasing pre-recorded content | |
EP1741294B1 (fr) | Procede et dispositif de traitement automatique d'informations spontanees | |
EP3959894A1 (fr) | Commande d'un service utilisant le traitement d'un flux comprenant des donnees multimedias | |
EP2085894A1 (fr) | Procédé de génération de donnés permettant la recherche de compléments de contenus, système et serveur pour la mise en oeuvre du procédé | |
WO2023180274A1 (fr) | Gestion perfectionnée d'un code visuel en cours d'affichage dans un contenu multimédia | |
WO2018226832A1 (fr) | Systèmes et procédés pour faire fonctionner un service de diffusion en continu pour fournir des espaces communautaires pour des éléments de contenu multimédia | |
EP3363208A1 (fr) | Enrichissement contextuel par reconnaissance audio | |
KR20220125950A (ko) | 송출자가 녹음하고 있는 음성과 음성이 담고 있는 콘텐츠를 실시간 영상 방송으로 제공하는 방법 및 시스템 | |
EP3753255A1 (fr) | Réception de flux représentatif d'un contenu multimédia | |
KR20190102749A (ko) | 서버 기반 광고 제공 방법 및 장치 | |
KR20180087737A (ko) | 비디오 클립에 대한 오디오 인지 기반의 실시간 상품 정보 중계 시스템 및 방법 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20211118 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20230920 |