EP3284260A1 - Procédé de remplacement d'un contenu principal par au moins un contenu secondaire, équipement de remplacement de contenus et programme d'ordinateur correspondants - Google Patents
Procédé de remplacement d'un contenu principal par au moins un contenu secondaire, équipement de remplacement de contenus et programme d'ordinateur correspondantsInfo
- Publication number
- EP3284260A1 EP3284260A1 EP16719287.1A EP16719287A EP3284260A1 EP 3284260 A1 EP3284260 A1 EP 3284260A1 EP 16719287 A EP16719287 A EP 16719287A EP 3284260 A1 EP3284260 A1 EP 3284260A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- video
- audio
- packet
- subtitle
- replacement
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 238000004590 computer program Methods 0.000 title claims description 9
- 230000002123 temporal effect Effects 0.000 claims description 18
- 230000006978 adaptation Effects 0.000 claims description 3
- 239000011800 void material Substances 0.000 claims description 2
- 235000013350 formula milk Nutrition 0.000 claims 5
- 230000001186 cumulative effect Effects 0.000 claims 1
- 238000003780 insertion Methods 0.000 description 9
- 230000037431 insertion Effects 0.000 description 6
- 230000003111 delayed effect Effects 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 238000009792 diffusion process Methods 0.000 description 2
- 238000007781 pre-processing Methods 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 241000238876 Acari Species 0.000 description 1
- 101001091379 Homo sapiens Kallikrein-5 Proteins 0.000 description 1
- 102100034868 Kallikrein-5 Human genes 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000001955 cumulated effect Effects 0.000 description 1
- 230000004907 flux Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000004321 preservation Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
- H04H20/10—Arrangements for replacing or switching information during the broadcast or the distribution
- H04H20/103—Transmitter-side switching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
- H04H20/10—Arrangements for replacing or switching information during the broadcast or the distribution
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/765—Media network packet handling intermediate
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/222—Secondary servers, e.g. proxy server, cable television Head-end
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/23608—Remultiplexing multiplex streams, e.g. involving modifying time stamps or remapping the packet identifiers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/23611—Insertion of stuffing data into a multiplex stream, e.g. to obtain a constant bitrate
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
- H04H20/65—Arrangements characterised by transmission systems for broadcast
- H04H20/67—Common-wave systems, i.e. using separate transmitters operating on substantially the same frequency
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/242—Synchronization processes, e.g. processing of PCR [Program Clock References]
Definitions
- a method of replacing a main content with at least one secondary content, content replacement equipment and corresponding computer program is a method of replacing a main content with at least one secondary content, content replacement equipment and corresponding computer program.
- the field of the invention is that of the dissemination of information, in a broadcast network comprising a fixed transmitter and a plurality of broadcast sites.
- the invention relates to the terrestrial broadcasting of television services.
- the invention relates to the "switching" or "stalling" of television services, making it possible to replace a main content (for example national television services such as TF1 ® , France 2 ® , etc.) with at least one secondary content.
- a main content for example national television services such as TF1 ® , France 2 ® , etc.
- secondary content for example, local local weather, local newspaper, local advertising, etc.
- the invention applies in particular to terrestrial broadcasting networks compliant with DVB-T or DVB-T2 ("Digital Video Broadcasting - Terrestrial" in English, for "digital terrestrial video broadcasting") or standards to come.
- DVB-T Digital Video Broadcasting - Terrestrial
- DVB-T2 Digital Video Broadcasting - Terrestrial
- the invention applies to SFN ("Single Frequency Network”) networks.
- all the channels associated with a multiplex / a frequency are managed centrally at a level of equipment commonly called "head end", in order to create a unique signal for all broadcast sites (ie transmitters), also called the transport stream.
- the distribution path used between the headend and the broadcast sites is generally a satellite link, but can also be an IP type link or "microwave".
- SFN technology is used in particular to improve the coverage of the territory / of a geographical area and to compensate for shadows linked to disruptive elements in the transmission (mountain, hills, valleys). , large furniture, ). It also makes it possible to reduce the number of frequencies used, and consequently to release certain frequency ranges.
- This SFN technology very effective, implies a perfect synchronization of the sites of diffusion between them, and a strictly identical structure of the content to be diffused by the various sites of diffusion.
- DVB-T The most widely used standard for broadcasting digital terrestrial television is the DVB-T standard. This standard is independent of the format of the content; for example, it allows the distribution of "normal” services as well as High Definition services.
- DVB-T2 A second version of DVB-T, DVB-T2, offers even more efficiency in terms of broadcast, coverage, transport capacity (throughput) and flexibility.
- TNT digital terrestrial television broadcasting
- stalling makes it possible to substitute a main content, such as a television program with national coverage on France 3 ® , with secondary content, such as a television program covering regional coverage on France 3. It is thus possible to switch from one broadcast to another. national head end, broadcasting the main content, to a regional broadcast site, broadcasting the secondary content.
- main content such as a television program with national coverage on France 3 ®
- secondary content such as a television program covering regional coverage on France 3. It is thus possible to switch from one broadcast to another. national head end, broadcasting the main content, to a regional broadcast site, broadcasting the secondary content.
- FIG. 1 illustrates an example of a terrestrial digital broadcasting network, comprising a Tx headend 11 feeding one or more broadcast sites 121, Rx2 122, Rx3 123, located at distinct geographical sites.
- Each broadcast site Rx1 121, Rx2 122, Rx3 123 comprises a receiver and a repeater, which can optionally be combined.
- the term "broadcast site” is thus understood to mean an equipment or system comprising a receiver followed by a retransmitter or integrated in a retransmitter.
- the headend Tx 11 generates a digital signal, also called transport stream, conveyed to the broadcast sites Rx1 121, Rx2 122, Rx3 123 via a distribution network 13, for example a network satellite distribution.
- a digital signal is for example of the type MPEG2-TS (in English "Motion Picture Expert Group 2 - Transport Stream") or T2-MI (in English "T2-Modulator Interface”) encapsulating a plurality of streams MPEG2-TS, and door the main content.
- One (or more) of the broadcast sites Rx1 121, Rx2 122, Rx3 123 can then "pick up", replacing the main content with secondary content in the transport stream, then broadcast the transport stream thus modified to receiving terminals.
- the invention proposes a new solution for the implementation of such a stall, in the form of a method of replacing a main content with at least one secondary content, the main content being carried by a transport stream from a fixed transmitter and for a plurality of broadcast sites, said original stream.
- the invention thus proposes a new solution for the "switchover" or "unhooking" of television services, making it possible to replace a main content with at least one secondary content.
- main content or secondary content audiovisual content comprising a video component and at least one component of another type, for example one or more audio components and / or one or more subtitle components.
- Each component is transmitted in the transport stream in the form of multiplexed packets.
- the video packets (respectively audio and / or subtitle) of the main content therefore describe the video component (respectively audio and / or subtitle) of the main content, and the video packets (audio and / or sub-title respectively).
- title) of the secondary content or contents therefore describe the video component or components (respectively audio and / or subtitle) of the secondary content or contents.
- the invention proposes a new content replacement technique, which makes it possible to cleverly update different fields of the transport stream (reference clock, continuity counters, reconstruction time information, etc.) so as to ensure deterministic behavior of content replacement equipment.
- the proposed solution therefore only modifies the transport layer and does not modify the elementary stream layer, unlike the currently proposed solutions. In addition, it does not require changing the transport stream at the headend.
- the proposed solution makes it possible to deterministically generate a modified stream, identical to the original stream in terms of structure and number of packets, but whose content is modified.
- Such a content replacement technique according to the invention provides many advantages.
- such a content replacement technique makes it possible to avoid the duplication of television content / service during the broadcast of the headend to the broadcast sites, and thus optimization of the distribution links.
- the invention makes it possible to avoid having as much distribution network as SFN regions / plates and is independent of the distribution paths between the headend and the broadcasting sites (satellite, IP, etc.) .
- the content replacement technique is implemented at the level of a content replacement equipment associated with at least one broadcast site, it offers flexibility in the network architecture, with the ability to manage local content in a network. different broadcast sites not linked to each other.
- the proposed content replacement technique guarantees SFN broadcast.
- the different broadcasting sites (re-transmission stations) of a region i.e. SFN cell
- main content includes several audio components (and / or subtitle)
- a separate audio timeout may be associated with each audio component (and / or subtitle).
- the invention allows an immediate stall of the main content to a secondary content, as soon as a suitable moment to switch is detected.
- the invention allows a delayed stall of the main content to a secondary content, at a predefined time.
- the first inserted image is chosen to be a reference image, and it replaces a reference image.
- preprocessing may be implemented so that the first inserted image is a reference image. The switch from the main content to the secondary content therefore occurs without disruption for the user.
- the values of the various fields of the modified stream are updated in a deterministic manner, which allows SFN operation of the broadcast network.
- the reference clock is carried by the video component. It can therefore be updated with the video reconstruction time information according to the invention.
- the reference clock may be carried by another component, such as an audio component or a component associated with a particular PID ("Packet Identifier"), and updated with the reconstruction time information associated with that component.
- PID Packet Identifier
- the content replacement method also comprises a step of determining a video return instant and at least one instant of audio return or subtitle, starting from a return packet of the modified stream.
- Such a return packet has for example the same structure as the stall package.
- such packets are of SCTE-35 type.
- the return packet is the same packet as the stall packet, if it defines the time of return video and / or audio and / or subtitle, or a stall duration from the instant of video and / or audio and / or subtitle stall.
- the invention allows an immediate return to the main content, as soon as a suitable moment to switch is detected.
- the invention allows a delayed return to the original stream at a predefined time.
- the return image is chosen to be a reference image, to improve the visual transition when returning to the original stream.
- the various steps of the content replacement method according to the invention are determined by instructions of computer programs.
- the invention also aims to protect a computer program comprising instructions adapted to the implementation of the steps of a content replacement method as described above when this program is executed by a processor, and a computer-readable information carrier having instructions from a computer program as mentioned above.
- the invention also relates to equipment that replaces a main content with at least one corresponding secondary content.
- Such equipment is particularly suitable for implementing the content replacement method described above.
- Such equipment may of course include the various features relating to the content replacement method according to the invention, which can be combined or taken separately. Thus, the features and benefits of this equipment are the same as those of the content replacement process. Therefore, they are not detailed further.
- such equipment can be located at each region / plate
- SFN severe broadcast sites belonging to the same plate type SFN
- This is for example a type of T2-Edge ® equipment marketed by the Applicant.
- the secondary content or contents are previously stored in the content replacement equipment.
- FIG. 1 illustrates an example of a digital terrestrial broadcasting network according to the prior art
- Figure 2 shows the main steps of a content replacement method according to a particular embodiment of the invention
- FIGS. 3 and 4 illustrate two examples of broadcast networks implementing content replacement equipment according to a particular embodiment of the invention. the invention
- FIGS. 5A to 5C respectively represent an example of original stream, modified stream, and return to the original stream
- Figure 6 shows the simplified structure of a content replacement equipment according to a particular embodiment of the invention.
- the general principle of the invention is based on the deterministic insertion, in a transport stream generated by a headend and intended for a plurality of broadcast sites, of video packets (respectively audio and / or subtitle). at least one secondary content, replacing video packets (respectively audio and / or subtitle) of a main content.
- the proposed solution is based on a particular update of different fields of the transport stream (reference clock, continuity counters, reconstruction time information, etc.), allowing only the transport stream to be modified, and not the elementary type flows. video, audio or subtitle.
- FIG. 2 shows the main steps implemented by a content replacement equipment according to one embodiment of the invention, for the replacement of a main content (for example a national audio-video service to be replaced), by less secondary content (eg one or more local advertisements).
- a main content for example a national audio-video service to be replaced
- less secondary content eg one or more local advertisements
- the main content is carried by a transport stream from a fixed transmitter and intended for a plurality of broadcast sites, and that the content replacement equipment is located between the fixed transmitter and at least one of the broadcast sites.
- the content replacement equipment can be located at each region / SFN plate.
- the headend 31 generates one or more transport streams, for example of the MPEG-TS or T2-M I type, and broadcasts them to the replacement equipment 32 and 33 via a path of distribution.
- Each replacement equipment 32, 33 can be connected to a content server or a database storing the secondary content to be broadcast.
- the replacement equipment 32 receives the original transport stream or streams, modifies them by inserting its own secondary contents, and transmits the modified stream (s) to one or more broadcast sites 321, 322, 323 (respectively 331, 332, 333).
- the content replacement equipment can be located at each broadcasting site.
- the headend 41 generates one or more transport streams, for example of the MPEG-TS or T2-MI type, and broadcasts it to the replacement equipment 42, 43, 44 and 45, via a distribution path.
- Each replacement equipment 42, 43, 44 and 45 can be connected to a content server or a database storing the secondary content to be broadcast.
- Each replacement equipment (42, 43, 44, 45 respectively) receives the original transport stream (s), modifies them by inserting its own secondary contents, and transmits the modified stream (s) to the broadcast site with which it is associated. (421, 431, 441, 451 respectively).
- the replacement equipment can be integrated into the broadcast site with which it is associated.
- the replacement equipment implements a step 21 of determining a video stall instant and at least one audio stall or sub-stall time.
- title one stall time per audio component and / or subtitle
- the origin transport stream carries information indicating the time of stall to the secondary content, also called secondary content insertion time, including for example one or more advertisements.
- these advertisements can be stored in the replacement equipment. For example, we consider that all advertisements start with a reference image. In this way, the switch from the main content to the secondary content is not perceived by a user. If the content to be inserted does not start with a reference image, preprocessing may be implemented so that the first inserted image is a reference image.
- the replacement equipment replaces (22) at least one video packet of the main content of the original stream, said video packet to be replaced, with at least one video packet of the secondary content or by a null packet, says replacement video packet.
- the replacement equipment replaces (22) at least one audio or subtitle packet with the main content of the original stream, said audio packet. or subtitle to be replaced by at least one audio packet or subtitle of the secondary content or by a void packet, called replacement audio or subtitle packet.
- different fields present in the modified stream are updated, and in particular a reference clock, a video packet continuity, audio and / or subtitle counter and at least one temporal information. video, audio and / or subtitle reconstruction.
- a service may in particular be composed of a video component and several audio components and / or subtitle.
- the reference clock is the PC clock ("program clock reference"), ie a time stamp expressed in number of clock ticks 27Mhz, carried by a 42 bit field
- the video reconstruction time information includes information a decoding time stamp (DTS) video decoding time, carried by a 33-bit field, and a PTS (Presentation Time Stamp) type video presentation time information, carried by a 33-bit field,
- DTS decoding time stamp
- PTS Presentation Time Stamp
- the audio reconstruction temporal information comprises a PTS type audio presentation temporal information, carried by a 33 bit field, and
- Step 1 Search for video and audio stall times
- FIG. 5A is first shown, illustrating the original transport stream (i.e. before replacing the main content with at least one secondary content).
- such an original stream comprises null packets, denoted Pid Nul ("Packet Identifier"), video packets, denoted Pid Video, audio packets, denoted Pid Audio.
- Each video packet is associated with a DC video continuity counter (ranging from 0 to 15, and incremented to each video packet), a DTS-type video decode time information, and a PTS video presentation time information.
- DC video continuity counter ranging from 0 to 15, and incremented to each video packet
- DTS-type video decode time information ranging from 0 to 15, and incremented to each video packet
- PTS video presentation time information ranging from 0 to 15, and incremented to each audio packet
- Some packages, video according to the example considered, carry a reference clock.
- the video packet 51 is associated with a continuity counter equal to 2, a video PTS equal to 19,300,688s, a video DTS equal to 19,300,488s, and a reference clock PC equal to 19,300,019s.
- stall packet 52 To switch from a main content to at least one secondary content, it is firstly necessary to determine a video stall time and an audio stall time. This information is encapsulated in a packet of the transport stream, called stall packet 52. Such stall packet 52 uses for example the SCTE-35 protocol. This stall packet indicates either the stall time at the original stream, or a stall at the original "immediate" stream.
- the stall packet 52 carries a stall presentation time information indicating the stall time, expressed in PTS time, and corresponds to a reference image.
- a reference image This is for example an IDR ("Instantaneous Decoder Refresh") image, which means that its decoding does not depend on other images.
- the stall package indicates a stall at the moment 19340,808s, noted PTS stall.
- Video stall is possible when the live video PTS of a video packet of the original stream is equal to the stall PTS.
- the video stall time is defined by:
- the first video packet to be replaced is therefore the video packet 53A.
- Audio stall is possible when the live audio PTS of an audio packet of the original stream is greater than or equal to the stall PTS.
- the audio stall time is defined by the live audio PTS, such that:
- the first audio packet to be replaced is therefore the audio packet 54A, which has an audio PTS equal to 19340.827s corresponding to the instant of audio stall.
- the stall package indicates an immediate stall. According to this example, we also choose the right moment to land.
- PTS video live The stall presentation time information associated with this first reference image, denoted PTS video live, corresponding to the instant of video stall, is stored:
- PTS stall PTS live video
- Audio stall is possible when the live audio PTS of an audio packet of the original stream is greater than or equal to the stall PTS.
- the video packets of the original stream are replaced by replacement video packets belonging to at least one secondary content.
- the audio packets of the original stream are replaced by replacement audio packets, belonging to at least one secondary content.
- the modified flux thus obtained is illustrated in FIG. 5B.
- the first video packet to be replaced 53A of the original stream has been replaced by a first replacement video packet 53B in the modified stream.
- the first audio packet to be replaced 54A of the original stream has been replaced by a first replacement audio packet 54B in the modified stream.
- Replacement packages appear hatched.
- a first counter representing a number of packets between two video packets of the secondary content, denoted nb_pkt_between_2video_ad_pkt, is initialized to a null value.
- the video ratio is defined by the ratio of an estimate of the bit rate of the original stream and an estimate of the video bit rate of the secondary content (for example an advertisement): estimated original flow rate
- the first inserted image is a reference image and replaces a reference image, so the change occurs without disruption to the user.
- the first counter nb_pkt_between_2video_ad_pkt is incremented. As soon as the first counter nb_pkt_between_2video_ad_pkt is greater than or equal to the first variable nb_pkt_next_video_insertion, then the insertion of a video packet of the secondary content is possible, replacing a video packet to be replaced by the original stream. As soon as the video package of the secondary content is inserted, the first variable nb_pkt_next_video_insertion is updated.
- a video packet to be replaced from the original stream is not replaced by a video packet of the secondary content (s), because the number of video replacement packets of the secondary content (s) is less than the number of video packets to be replaced by main content, then this video package to replace the main content is deleted and a null packet is put in its place in the modified stream.
- Step 3 Update CC, PTS, DTS and PCR fields
- the values of the audio and video continuity counters, PTS and DTS video, PTS audio, and the PCR reference clock are updated. in the replacement packets of the modified stream, as illustrated in FIG. 5B.
- PCR reference clock (which is associated with the video packets according to the illustrated example), is updated as follows:
- PCR (n) PCR (n-1) + number of packets between two PCR packets * not PCR
- the PCR step is the duration of a packet of the original stream expressed in PCR time, namely in number of taps clock at 27Mhz
- PCR (O) is equal to the last PCR value before the stall.
- video continuity (video DC) and audio (audio CC) counters are updated as follows:
- Video CC (1) 8
- CC video (n) (CC video (n-1) + 1) modulo 16
- the video DTS of the first replacement video packet 53B is initialized to the value of the DTS of the first video packet to be replaced, denoted DTS video live:
- DTS video inserted (n) we initialize the video DTS of this first replacement video package, noted DTS video inserted (n) according to the formula:
- Video DTS inserted (î) ⁇ DTS video inserted (n- 1) + ADTS video (n- 1)) modulo 2 33 with:
- ADTS video (x- 1) inserted video DTS (n-1) - inserted video DTS (n-2), and
- Video DTS inserted (n-1) and DTS video inserted (n- 2) the last two inserted DTS video values.
- DTS video cont sec (n) the DTS video value of the n-th DTS packet of the secondary content
- DTS video cont sec (n) - DTS video cont sec (n-1) the DTS step of the secondary content.
- PTS video For the update of video presentation time information (PTS video) of replacement packets, the following formula is used: PTS video inserted (ri)
- PTS video cont sec (n) the video PTS value of the n-th PTS packet of the secondary content.
- the audio PTS of the first audio replacement packet 54B is initialized to the value of the PTS of the first video packet to be replaced, noted PTS audio live:
- Audio PTS inserted (n) (fTS audio inserted (n- 1) + audio APTS (ji- 1)) modulo 2 33 with:
- APTS audio (n-1) inserted audio PTS (n-1) - audio PTS inserted (n-2), and
- Audio PTS inserted (n-1) and audio PTS inserted (n- 2) the last two audio PTS values inserted.
- PTS audio cont sec (n) the audio PTS value of the nth secondary content PTS packet
- PTS audio cont sec (n) - audio DTS cont sec (n- 1) the PTS step of the secondary content.
- FIG. 5C illustrating the return to the original stream.
- a moment of video return and a moment of audio return This information is, according to the example illustrated in FIG. 5C, encapsulated in a packet of the transport stream, called the return packet 58.
- Such a return packet 58 uses, for example, the SCTE-35 protocol. This return packet indicates either the time of return to the original stream, or a return to the original "immediate" stream.
- the return packet 58 carries a return presentation time information indicating the return time, expressed in PTS time, and corresponds to a reference image. This is for example an ID image.
- the return packet indicates a return to the instant 19460,808s, noted PTS back.
- the instant of video return is defined by:
- the first video packet back is therefore the video package 59.
- Audio return is possible when the live audio PTS of an audio packet of the modified stream is greater than or equal to an estimated audio return time presentation audio information, rated PTS estimated live audio return, determined from the return PTS and packets video and audio or subtitle replacement of the modified stream:
- the instant of audio return is defined by the live audio PTS, such as: PTS audio live ⁇ PTS live audio estimated return
- the first audio packet of return is therefore the audio packet 60, which has an audio PTS equal to 19460,817ss corresponding to the instant of audio return.
- the return packet indicates an immediate return. According to this example, one also chooses the opportune moment to hang up.
- the return image is chosen to be a reference image.
- the audio processing it is noted that if the number of audio frames belonging to the secondary content (s) to be inserted is equal to the number of audio frames to be replaced in the original stream, it is not necessary to implement a particular treatment.
- the number of audio frames belonging to the secondary content (s) to be inserted is less than the number of audio frames to be replaced in the original stream, all the audio packets of the secondary content (s) are inserted into the modified stream, and the return to the original stream is implemented as soon as the PTS of an audio packet of the modified stream, denoted PTS live audio, is greater than the PTS of the last replacement audio packet:
- video jam packets can be inserted in the modified stream.
- packet 62C is a video stuffing packet, also called "video stuffing”.
- the package 63C is an audio stuffing packet, also called “audio stuffing”.
- Such video / audio stuffing packets do not carry data, but allow the video / audio continuity counter of a unit to be incremented.
- the insertion of the video or audio stuffing packets can be implemented when it is detected that the next packet of the modified stream is the first video or audio return packet, for example by replacing null packets with video stuffing packets. or audio in the modified stream.
- Such content replacement equipment comprises a memory 71, for example a buffer memory, a processing unit 72, equipped for example with a ⁇ microprocessor, and driven by the computer program 73, implementing the method content replacement according to the invention.
- a memory 71 for example a buffer memory
- a processing unit 72 equipped for example with a ⁇ microprocessor, and driven by the computer program 73, implementing the method content replacement according to the invention.
- the code instructions of the computer program 73 are for example loaded into a RAM memory before being executed by the processor of the processing unit 72.
- the processing unit 72 receives as input a stream original transport, and at least one secondary content to be inserted into the stream.
- the microprocessor of the processing unit 72 implements the steps of the content replacement method described above, according to the instructions of the computer program 73, to switch from a main program to a secondary program.
- the content replacement equipment also includes:
- At least one video packet of the main content said video packet to be replaced, by at least one video packet of the secondary content or by a null packet, said replacement video packet, activated from the instant of video stall, and
- At least one audio packet or subtitle of the main content said audio or subtitle packet to be replaced, by at least one audio or subtitle packet of the secondary content or by a null packet, said packet alternative audio or subtitle, activated from the audio or subtitle time (s),
- These modules can be controlled by the microprocessor of the processing unit 72.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- Marketing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR1553260A FR3035288B1 (fr) | 2015-04-14 | 2015-04-14 | Procede de remplacement d'un contenu principal par au moins un contenu secondaire, equipement de remplacement de contenus et programme d'ordinateur correspondants |
PCT/EP2016/058230 WO2016166214A1 (fr) | 2015-04-14 | 2016-04-14 | Procédé de remplacement d'un contenu principal par au moins un contenu secondaire, équipement de remplacement de contenus et programme d'ordinateur correspondants |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3284260A1 true EP3284260A1 (fr) | 2018-02-21 |
EP3284260B1 EP3284260B1 (fr) | 2020-12-23 |
Family
ID=54140552
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP16719287.1A Active EP3284260B1 (fr) | 2015-04-14 | 2016-04-14 | Procédé de remplacement d'un contenu principal par au moins un contenu secondaire, équipement de remplacement de contenus et programme d'ordinateur correspondants |
Country Status (5)
Country | Link |
---|---|
US (1) | US10097289B2 (fr) |
EP (1) | EP3284260B1 (fr) |
ES (1) | ES2861392T3 (fr) |
FR (1) | FR3035288B1 (fr) |
WO (1) | WO2016166214A1 (fr) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR3036904B1 (fr) | 2015-06-01 | 2017-06-09 | Enensys Tech | Procede de traitement d'un flux global d'origine comprenant au moins un tunnel couche physique encapsulant un flux de transport, dispositif et programme d'ordinateur correspondants |
CN108282684A (zh) * | 2017-01-06 | 2018-07-13 | 北京视连通科技有限公司 | 一种基于场景或特定对象的多媒体广告播出方法 |
FR3101744B1 (fr) * | 2019-10-04 | 2023-07-21 | Enensys Tech | Procédé de signalisation d’une substitution à un terminal, procédé de substitution par un terminal, produits programme d'ordinateur, système et terminal correspondants |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2902591B1 (fr) * | 2006-06-20 | 2008-08-29 | Tdf Sa | Procede d'insertion d'au moins une c0mposante dans un flux numerique, dispositif d'insertion et produit programme d'ordinateur correspondants |
WO2010005416A1 (fr) * | 2008-07-09 | 2010-01-14 | Tandberg Television Inc. | Remplissage à débit constant de flux de transport mpeg |
US8781003B2 (en) * | 2008-07-17 | 2014-07-15 | Cisco Technology, Inc. | Splicing of encrypted video/audio content |
FR2937490B1 (fr) * | 2008-10-17 | 2010-12-17 | Tdf | Procede et dispositif d'horodatage d'un flux de donnees, procede et dispositif d'insertion et produits programme d'ordinateur correspondants. |
US8726310B2 (en) * | 2009-02-05 | 2014-05-13 | Purplecomm Inc. | Meta channel media system control and advertisement technology |
ES2632344T3 (es) * | 2011-03-02 | 2017-09-12 | Nevion Europe As | Remultiplexación determinística para redes SFN |
-
2015
- 2015-04-14 FR FR1553260A patent/FR3035288B1/fr not_active Expired - Fee Related
-
2016
- 2016-04-14 EP EP16719287.1A patent/EP3284260B1/fr active Active
- 2016-04-14 ES ES16719287T patent/ES2861392T3/es active Active
- 2016-04-14 WO PCT/EP2016/058230 patent/WO2016166214A1/fr active Application Filing
- 2016-04-14 US US15/566,939 patent/US10097289B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
EP3284260B1 (fr) | 2020-12-23 |
FR3035288B1 (fr) | 2018-04-13 |
US20180115375A1 (en) | 2018-04-26 |
ES2861392T3 (es) | 2021-10-06 |
WO2016166214A1 (fr) | 2016-10-20 |
US10097289B2 (en) | 2018-10-09 |
FR3035288A1 (fr) | 2016-10-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9414111B2 (en) | Caption data delivery apparatus and methods | |
EP3284260B1 (fr) | Procédé de remplacement d'un contenu principal par au moins un contenu secondaire, équipement de remplacement de contenus et programme d'ordinateur correspondants | |
FR2880749A1 (fr) | Methode de transmission de flux mpeg sur ip et appareil implementant la methode | |
AU2005309706B2 (en) | Pushing content in a two-way network | |
EP2243232A1 (fr) | Procede de diffusion d ' un flux de donnees dans un reseau comprenant une pluralite d ' emetteurs ainsi que produit programme d ' ordinateur, tete de reseau et systeme pour la mise en oeuvre de ce procede | |
EP3652953B1 (fr) | Procédé de signalisation d'une substitution à un terminal, procédé de substitution par un terminal, produits programme d'ordinateur, système et terminal correspondants | |
FR2980662A1 (fr) | Methode d'enregistrement d'un contenu dans un fichier sur un serveur et dispositif correspondant | |
EP4320871A1 (fr) | Procédés et dispositifs d'insertion d'un événement dans un flux de transport, de surveillance, de gestion et de réception du flux de transport, et programme d'ordinateur correspondants | |
EP3304775B1 (fr) | Procede de traitement d'un flux global d'origine comprenant au moins un tunnel couche physique encapsulant un flux de transport | |
EP3411968B1 (fr) | Procédé et équipement de génération d'un flux global d'origine, respectivement un flux global modifié, destiné à être diffusé par un site de diffusion, respectivement un site de rediffusion | |
EP4091331A1 (fr) | Procédé de décrochage d'un flux dans un multiplex à débit variable, ledit flux étant constitué d'une pluralité de chunks, site de diffusion et dispositifs associés | |
FR2930098A1 (fr) | Procede de transmission simplifie d'un flux de signaux entre un emetteur et un appareil electronique | |
FR2828976A1 (fr) | Terminal de reception et centre de diffusion de programmes interactifs, signal contenant de tels programmes et procede de surveillance de programmes interactifs recus dans un tel terminal | |
FR2992514A1 (fr) | Procede et dispositif d'horodatage d'un flux de donnees, procede et dispositif d'insertion, produits programme d'ordinateur et medium de stockage correspondants | |
FR2925814A1 (fr) | Dispositif et procede de reception de paquets de donnees video. | |
FR2906954A1 (fr) | Procede de retardement temporel de flux de contenus numeriques,dispositif,et produit programme d'ordinateur correspondants. | |
FR2827463A1 (fr) | Procede de controle d'un flux de signaux de television recu par un decodeur de television et decodeur associe | |
FR3034610A1 (fr) | Systeme de diffusion de contenus audio et/ou video par un reseau wifi local, et appareils mettant en œuvre le procede | |
EP2140614A1 (fr) | Procede de multiplexage temporel et de diffusion de flux audiovisuels, pour l'amelioration de qualite |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20170928 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20190215 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04N 21/222 20110101ALI20200526BHEP Ipc: H04N 21/234 20110101AFI20200526BHEP Ipc: H04H 20/67 20080101ALI20200526BHEP Ipc: H04N 21/858 20110101ALI20200526BHEP Ipc: H04N 21/236 20110101ALI20200526BHEP Ipc: H04L 29/06 20060101ALI20200526BHEP Ipc: H04H 20/10 20080101ALI20200526BHEP |
|
INTG | Intention to grant announced |
Effective date: 20200619 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: ENENSYS TECHNOLOGIES |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602016050184 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1348860 Country of ref document: AT Kind code of ref document: T Effective date: 20210115 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: FRENCH |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201223 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210323 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201223 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210324 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1348860 Country of ref document: AT Kind code of ref document: T Effective date: 20201223 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20201223 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201223 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210323 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201223 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201223 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201223 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210423 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201223 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201223 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201223 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201223 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201223 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201223 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201223 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201223 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602016050184 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210423 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2861392 Country of ref document: ES Kind code of ref document: T3 Effective date: 20211006 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201223 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201223 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201223 |
|
26N | No opposition filed |
Effective date: 20210924 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210414 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20210430 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210430 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210430 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201223 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210414 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210423 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210430 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20230321 Year of fee payment: 8 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20160414 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IT Payment date: 20230322 Year of fee payment: 8 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201223 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: ES Payment date: 20230502 Year of fee payment: 8 Ref country code: DE Payment date: 20230321 Year of fee payment: 8 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201223 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20240320 Year of fee payment: 9 |