EP2323438B1 - Procédé et appareil pour réduire la perte de données média pendant un procès de mobilité de tranfert intercellulaire - Google Patents

Procédé et appareil pour réduire la perte de données média pendant un procès de mobilité de tranfert intercellulaire Download PDF

Info

Publication number
EP2323438B1
EP2323438B1 EP10190878.8A EP10190878A EP2323438B1 EP 2323438 B1 EP2323438 B1 EP 2323438B1 EP 10190878 A EP10190878 A EP 10190878A EP 2323438 B1 EP2323438 B1 EP 2323438B1
Authority
EP
European Patent Office
Prior art keywords
handover
media data
terminal
amount
lost
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Not-in-force
Application number
EP10190878.8A
Other languages
German (de)
English (en)
Other versions
EP2323438A2 (fr
EP2323438A3 (fr
Inventor
Soung-Kwan Kim
Ji-Youn Jung
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Publication of EP2323438A2 publication Critical patent/EP2323438A2/fr
Publication of EP2323438A3 publication Critical patent/EP2323438A3/fr
Application granted granted Critical
Publication of EP2323438B1 publication Critical patent/EP2323438B1/fr
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W36/00—Hand-off or reselection arrangements
    • H04W36/02—Buffering or recovering information during reselection ; Modification of the traffic flow during hand-off
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44209—Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W28/00—Network traffic management; Network resource management
    • H04W28/02—Traffic management, e.g. flow control or congestion control

Definitions

  • the exemplary embodiments relate to a method and apparatus for reducing a loss of media data, and more particularly, to a method and apparatus for reducing a loss of media data by which information about a loss of media data during a handover is previously predicted by using information about a loss of media data of a past handover and the loss of media data is prevented by using the previously-predicted information so that the loss of media data does not occur during the handover and lowering of quality of media data is prevented.
  • multimedia data such as video or audio data
  • the mobile terminal transmits the multimedia data to the receiving terminal at predetermined time intervals, i.e., at each packet time.
  • a handover may be performed so that the mobile terminal may continue transmitting the multimedia data to a receiving terminal in the adjacent cell.
  • jitter may occur in packets or a loss of packets may occur until a base station in the adjacent cell is tuned to a new channel, and thus the quality of video or audio data is lowered.
  • US 2006/077994 discloses systems and methods for adapting a de-jitter buffer to conform to air link condition.
  • a subscriber station may schedule a handoff, and may provide the scheduling information to a de-jitter buffer then anticipates the handoff.
  • the de-jitter buffer may be adjusted to accommodate the impending handoff.
  • the system does not use information about an amount of media data lost during at least one past handover.
  • the exemplary embodiments provide a method and apparatus for reducing a loss of media data by which a loss of media data does not occur during a handover due to jitter or a loss of packets.
  • a method of reducing an amount of media data lost when a handover is performed wherein the method is performed by a first terminal for transmitting or receiving the media data to or from a second terminal, as defined by claim 1 appended hereto.
  • the method may further include: transmitting the control information to the second terminal; and notifying the second terminal that the handover is to be performed.
  • the method may further include transmitting data for performing forward error correction on the media data to the second terminal while the handover is performed.
  • the method may further include generating a channel for transmitting the data for performing the forward error correction when a connection is set up with the second terminal, wherein the transmitting the data for performing the forward error correction on the media data includes transmitting the data for performing the forward error correction to the second terminal by using the channel.
  • the method may further include, if the handover has been completed, notifying the second terminal that the handover has been completed.
  • the method may further include, if the handover has been completed, storing an amount of the media data lost during the handover.
  • a method of reducing an amount of media data lost when a handover is performed wherein the method is performed by a first terminal for transmitting or receiving the media data to or from a second terminal, as defined by claim 7 appended hereto.
  • the method may further include: receiving notification, from the second terminal, that the handover has been completed; and terminating the reducing the amount of the media data lost when the handover is performed by using the control information.
  • the control information may be generated by using the amount of the media data lost when a past handover is performed, and the amount of the media data lost when the handover is performed may include information about at least one of a predicted amount of packet loss, a predicted jitter value, and a predicted time skew value while the handover is performed.
  • the reducing the amount of the media data lost when the handover is performed may include: selecting a predetermined algorithm for recovering the packet loss according to the predicted amount of the packet loss by using the control information; and recovering the packet loss by using the selected algorithm for recovering the packet loss.
  • the reducing the amount of the media data lost when the handover is performed may include expanding a size of a jitter buffer of the first terminal by using the control information.
  • the method may further include: receiving, from the second terminal, data for performing forward error correction on the media data; and performing the forward error correction on the media data by using the data for performing the forward error correction.
  • the method may further include: receiving, from the second terminal, notification that the handover has been completed; and terminating the performing the forward error correction on the media data in response to the received notification.
  • a first terminal for transmitting or receiving media data to or from a second terminal when a handover is performed, the first terminal as defined by claim 9 appended hereto.
  • a first terminal for transmitting or receiving media data to or from a second terminal when a handover is performed, the first terminal as defined by claim 10 appended hereto.
  • a computer readable recording medium having recorded thereon a program for executing, by a first terminal receiving media data from a second terminal during a handover, a method as defined by claim 11 appended hereto.
  • a computer readable recording medium having recorded thereon a program for executing, by a first terminal receiving media data from a second terminal during a handover, a method of reducing an amount of the media data lost when the handover is performed, wherein the method includes: receiving, from the second terminal, control information for reducing the amount of the media data lost when the handover is performed; receiving notification, from the second terminal, that the handover is to be performed; and reducing the amount of the media data lost when the handover is performed by using the control information.
  • a system for reducing an amount of media data lost when a handover is performed including: a first terminal receiving the media data, the first terminal including: a communication unit which receives the media data, a prediction data processing unit which predicts an amount of the media data that may be lost when the handover is performed and which generates control information for reducing the amount of the media data lost when the handover is performed by using the predicted amount of the media data that may be lost when the handover is performed, and a controller which reduces the amount of the media data lost when the handover is performed by using the control information while the handover is performed; and a second terminal transmitting the media data.
  • a system for reducing an amount of media data lost when a handover is performed including: a second terminal transmitting the media data, the second terminal including: a second controller which predicts the amount of the media data that may be lost when then handover is performed, and which generates control information by using the predicted amount of the media data that may be lost when the handover is performed, and a second communication unit which transmits the control information, which transmits the media data, and which transmits notification that the handover is to be performed when the handover is to be performed; and a first terminal receiving the media data, the first terminal including: a first communication unit which receives the media data from the second terminal, which receives, from the second terminal, the control information, and which receives the notification, from the second terminal, that the handover is to be performed; and a first controller which reduces the amount of the media data lost when the handover is performed by using the control information.
  • FIG. 1 is a block diagram of a user terminal 100 according to an exemplary embodiment.
  • the user terminal 100 includes a controller 110, a transmission data processing unit 120, a communication unit 130, a received data processing unit 140, and a prediction data processing unit 150.
  • the user terminal 100 is a digital device that performs communication with an opponent terminal (not shown) via at least one of a wired and wireless communication network and transmits at least one of audio and video data in real-time.
  • the user terminal 100 and the opponent terminal may include a head set including a communication module, a personal data assistant (PDA), a portable multimedia player (PMP), a mobile phone, a navigation device, a personal computer (PC) or a notebook computer including an ultra mobile PC (UMPC).
  • PDA personal data assistant
  • PMP portable multimedia player
  • PC personal computer
  • UMPC ultra mobile PC
  • data that is transmitted and received by the user terminal 100 to and from the opponent terminal may include either or both audio data and video data.
  • multimedia data that is transmitted and received by the user terminal 100 to and from the opponent terminal is referred to as media data.
  • the transmission data processing unit 120 encodes media data and performs signal processing on the encoded media data in a format in which the encoded media data may be transmitted to the opponent terminal.
  • the communication unit 130 transmits and receives the media data to and from the opponent terminal via a communication network. Also, the communication unit 130 determines whether the user terminal 100 enters a handover region, and notifies the controller 110 that the user terminal 100 has entered the handover region if so determined.
  • the received data processing unit 140 decodes the media data that is received from the opponent terminal and performs signal processing to compensate for a loss of packets on the decoded media data in a format in which the user terminal 100 uses the media data.
  • the received data processing unit 140 includes a jitter buffer (not shown).
  • the jitter buffer temporarily stores the data received by the communication unit 130. When intervals between received packets are regular, the data may be temporarily stored using the jitter buffer, which has a predetermined size. However, when intervals between received packets are varied during a handover and jitter occurs, a loss of the media data may occur. In other words, when the media data is transmitted and received during a handover, jitter may occur or packets may be lost, and thus the reproduction quality of the media data, such as video or audio data, may be lowered. Also, packets to be received at a predetermined time may be received before or after the predetermined time and thus time skew may occur.
  • jitter or a loss of packets that may occur during a handover may be previously predicted before the handover is performed, and control information for preventing a predicted loss may be generated. Accordingly, by using the control information, a loss of media data during the handover may be prevented and the quality of the media data may be prevented from being lowered.
  • the prediction data processing unit 150 predicts an amount of media data that may be lost when a handover is performed, by using information about an amount of media data lost during a past handover.
  • the information about an amount of media data lost during a past handover is information that may be used to affect the predicted amount of media data that may be lost when a handover is performed.
  • the prediction data processing unit 150 predicts the amount of media data that may be lost when a handover is performed, by using the information about an amount of media data lost during a past handover.
  • the prediction data processing unit 150 may predict an amount of packets that may be lost when a handover is performed by using information about an amount of packets lost during a past handover or information about amounts of packets lost during a plurality of past handovers, or may predict a jitter value or a time skew value corresponding to when a handover is performed by using information about a jitter value or a time skew value that was obtained for a past handover or jitter values or time skew values that were obtained for the plurality of past handovers.
  • the prediction data processing unit 150 predicts the amount of media data that may be lost when a handover is performed and generates control information for reducing the predicted amount of media data that may be lost when the handover is performed by using the predicted amount of media data that may be lost when the handover is performed.
  • the prediction data processing unit 150 may generate control information for expanding the size of the jitter buffer included in the received data processing unit 140 for when the next handover is started.
  • the prediction data processing unit 150 may generate information for selecting a method to recover packets that may be lost by using the received data processing unit 140, i.e., an algorithm for recovering packets that may be lost, according to a packet loss rate or the predicted amount of packets that may be lost when the next handover is performed.
  • Algorithms for recovering packets that may be lost are different according to load on a central processing unit (CPU), sound quality, or image quality.
  • a program used to drive each algorithm for recovering packets that may be lost is stored in a memory unit (not shown) in the user terminal 100.
  • a program that is used by the user terminal 100 to perform communication with the opponent terminal may also be stored in the memory unit.
  • the prediction data processing unit 150 may select an algorithm that recovers a greater amount of packets that may be lost. Conversely, when the predicted amount of packets that may be lost when a handover is performed is less than the predetermined amount, the prediction data processing unit 150 may generate control information for selecting an algorithm in which the load on the CPU is small.
  • an algorithm for recovering packets of the audio data that may be lost may be double sided pitch waveform replication (DSPWR), waveform similarity overlap-add (WSOLA), modified WSOLA, time-proportion based pitch-waveform interpolation (TPBPWI) or non-linear oscillator model (NOM).
  • DSPWR double sided pitch waveform replication
  • WOLA waveform similarity overlap-add
  • TPBPWI time-proportion based pitch-waveform interpolation
  • NOM non-linear oscillator model
  • the prediction data processing unit 150 generates control information for selecting a predetermined algorithm for recovering packets that may be lost according to the packet loss rate or the predicted amount of packets that may be lost when a next handover is performed and transmits the control information to the controller 110 and the communication unit 130.
  • the prediction data processing unit 150 calculates an amount of media data that was lost during the handover, stores the calculated amount, and predicts the amount of media data that may be lost when a next handover is performed.
  • the controller 110 may control the user terminal 100 to perform a method of reducing the amount of media data that may be lost when a handover is performed.
  • the controller 110 includes an arithmetic logic unit (ALU) for performing calculation and a register for temporarily storing data and commands.
  • ALU arithmetic logic unit
  • the controller 160 may include an additional hardware component (such as a processor or microprocessor) executing a computer program stored in a computer-readable medium.
  • the controller 110 reduces the predicted amount of media data that may be lost when a handover is performed by using the control information received from the prediction data processing unit 150, thereby improving the quality of the media data that is received from the opponent terminal. Improvements in the quality of the media data refers to the media data, such as audio or video data, being better sent so that, for example, a mosaic phenomenon does not occur in video media data.
  • control information is information for selecting the algorithm for recovering packets that may be lost according to the predicted amount of packets that may be lost when a handover is performed
  • the controller 110 selects a predetermined algorithm for recovering packets that may be lost according to the predicted amount of packets that may be lost when a handover is performed by using the control information, extracts the program for driving the selected algorithm for recovering packets that may be lost, and recovers packets that may be lost by using the extracted program.
  • the controller 110 expands the size of the jitter buffer of the user terminal 100 for a handover so that a packet loss may not occur.
  • the communication unit 130 transmits the control information received from the prediction data processing unit 150 to the opponent terminal via a communication terminal. Also, the communication unit 130 determines whether the user terminal 100 enters a handover region, and notifies the opponent terminal that the user terminal 100 has entered a handover region if so determined. When a handover has been completed, the communication unit 130 notifies the opponent terminal that the handover has been completed.
  • the user terminal 100 may predict the amount of media data that may be lost when a next handover is performed, by using the information about the amount of media data lost during a past handover, and may generate the control information by using the predicted amount of media data that may be lost when a handover is performed. Accordingly, the user terminal 100 according to an exemplary embodiment reduces the predicted amount of media data that may be lost when a next handover is performed.
  • the opponent terminal may reduce the predicted amount of media data that may be lost when a handover is performed by using the control information that is received from the user terminal 100.
  • the opponent terminal reduces the predicted amount of media data that may be lost when a handover is performed by using the control information until it is notified by the user terminal 100 that the handover has been completed, so that a loss of transmitted or received data during the handover may be reduced.
  • the user terminal 100 may also perform the function described above with respect to the opponent terminal.
  • the user terminal 100 may receive control information from the opponent terminal.
  • the opponent terminal enters a handover region, the user terminal 100 is notified by the opponent terminal that a handover is to be performed.
  • the user terminal 100 expands the size of the jitter buffer thereof according to the control information that is received from the opponent terminal for when the handover is started, or selects other algorithms for recovering packets that may be lost, so that packets that may be lost may be recovered and a loss of media data may be prevented.
  • FIG. 2 is a detailed block diagram of the user terminal 100 of FIG. 1 .
  • the user terminal 100 according to the present exemplary embodiment includes the controller 110, the transmission data processing unit 120, the communication unit 130, the received data processing unit 140, and the prediction data processing unit 150. Redundant descriptions of the elements described in FIG. 1 among the elements of the user terminal 100 of FIG. 2 will not be repeated herein.
  • the transmission data processing unit 120 includes an analog to digital converter (ADC) 121, a preprocessor 123, and an encoder 125.
  • ADC analog to digital converter
  • the ADC 121 converts an analog signal input to the user terminal 100 into a digital signal.
  • the preprocessor 123 removes noise that may occur in the digital signal generated by the ADC 121, by using an echo canceller, and controls a gain thereof by using an automatic gain controller (AGC).
  • AGC automatic gain controller
  • the encoder 125 encodes a signal that is processed by the preprocessor 123 and transmits the encoded data to the communication unit 130.
  • the communication unit 130 transmits the media data to an opponent terminal (not shown).
  • the received data processing unit 140 includes a jitter buffer 141, a decoder 143, a packet loss compensation unit 145, and a digital to analog converter (DAC) 147.
  • DAC digital to analog converter
  • the jitter buffer 141 temporarily stores packets that are received via the communication unit 130.
  • the decoder 143 decodes packets stored in the jitter buffer 141 and transmits the decoded packets to the DAC 147.
  • the packet loss compensating unit 145 recovers packets that may be lost.
  • the packet loss compensating unit 145 may compensate for packets that may be lost by using any of various algorithms, and packets that may be lost may be compensated for according to an algorithm that is determined by the control information that is generated by the user terminal 100 or received from the opponent terminal.
  • the DAC 147 converts the packets that are decoded by the decoder 143 or recovered by the packet loss compensating unit 145 into an analog signal.
  • the prediction data processing unit 150 includes a loss data calculator 151, a loss data predictor 153, and a control information generator 155. As described above, while a handover is performed, the packets of media data that are received from the opponent terminal may be lost, jitter may occur in the packets, or time skew may occur.
  • the loss data calculator 151 calculates information about the amount of media data that was lost during a past handover and stores the calculated amount of the information.
  • the loss data predictor 153 predicts the amount of media data that may be lost when a next handover is performed, by using the calculated information about the amount of media data that was lost during a past handover stored in the loss data calculator 151.
  • the loss data predictor 153 may predict the amount of media data that may be lost when a next handover is performed by using a linear function.
  • the control information generator 155 generates control information by using the predicted amount of media data that may be lost when a next handover is performed predicted by the loss data predictor 153.
  • the control information generator 155 may generate the control information for selecting an algorithm for recovering packets that may be lost to be used by the packet loss compensating unit 145, according to the predicted packet loss rate, or may generate the control information for expanding the size of the jitter buffer 141 according to the predicted jitter value.
  • the control information generator 155 transmits the generated control information to the controller 110 and to the opponent terminal via the communication unit 130.
  • control information may be simultaneously transmitted to the opponent terminal with notification to the opponent terminal that the handover has started being performed, or the control information may be previously transmitted to the opponent terminal before notifying the opponent terminal that the handover has started being performed.
  • the controller 110 reduces the predicted amount of media data received from the opponent terminal that may be lost when a handover is performed by using the control information generated by the prediction data processing unit 150.
  • the controller 110 expands the size of the jitter buffer 141 to a size corresponding to the predicted jitter value, or compensates for the predicted amount of packets that may be lost when a handover is performed, according to one or more algorithms other than the algorithm for compensating for packets that may be lost that was performed before a handover.
  • the control information may be generated by the user terminal 100 or may be transmitted from the opponent terminal.
  • the opponent terminal may generate the control information by using the predicted amount of media data that may be lost when a handover is performed, may reduce the amount of media data that is input to the opponent terminal that may be lost by using the generated control information, and may transmit the control information to the user terminal 100.
  • the opponent terminal notifies the user terminal 100 that a handover is to be performed, the user terminal 100 reduces the amount of media data loss among data received from the opponent terminal by using the control information that is received from the opponent terminal.
  • the user terminal 100 stops performing the method of reducing the predicted amount of media data loss. In other words, if the handover has been completed, the controller 110 controls the user terminal 100 to return to an original controlled state before the handover was performed.
  • the user terminal 100 and the opponent terminal may perform a handover simultaneously according to circumstances.
  • the user terminal 100 when both the user terminal 100 and the opponent terminal enter respective handover regions, the user terminal 100 generates the control information for reducing the amount of media data loss that is input to the user terminal 100 and the opponent terminal generates the control information for reducing the amount of media data loss that is input to the opponent terminal.
  • Each of the user terminal 100 and the opponent terminal transmits respective control information to each other.
  • the user terminal 100 reduces the amount of media data loss by using both the control information generated by the user terminal 100 and the control information received from the opponent terminal.
  • the user terminal 100 expands the size of the jitter buffer 141 of the user terminal 100 to a size that is obtained by adding the size of the jitter buffer 141 corresponding to the control information received from the opponent terminal to the size of the jitter buffer 141 corresponding to the control information generated by the user terminal 100.
  • the user terminal 100 obtains a packet loss rate by using the control information generated by the user terminal 100 and the control information received from the opponent terminal and selects an algorithm for recovering packets that may be lost that is suitable for the obtained packet loss rate.
  • the user terminal 100 recovers packets that may be lost by using the selected algorithm for recovering packets that may be lost.
  • FIG. 3 is a block diagram of a user terminal 300 according to another exemplary embodiment.
  • the user terminal 300 includes a controller 310, a transmission data processing unit 320, a communication unit 330, a received data processing unit 340, a prediction data processing unit 350, and a forward error correction processing unit 360.
  • the user terminal 300 of FIG. 3 further includes the forward error correction processing unit 360 as well as the elements of the user terminal 100 of FIG. 1 . Redundant descriptions of the elements described in FIG. 1 among the elements of the user terminal 300 of FIG. 3 will not be repeated herein.
  • the forward error correction processing unit 360 generates redundancy data for performing forward error correction on the media data that is processed by the transmission data processing unit 320.
  • the generated redundancy data is to correct errors of the media data to be transmitted to the opponent terminal that may occur during a handover.
  • the forward error correction processing unit 360 generates the redundancy data for performing the forward error correction on the media data via the communication unit 330 from the time at which the handover is started until the handover has been completed, and the communication unit 330 transmits the data for performing the forward error correction on the media data to the opponent terminal.
  • the communication unit 330 generates a channel for transmitting the data for performing the forward error correction on the media data when a call is set up with the opponent terminal, i.e., when telephone or wireless connection starts, separately from a channel for transmitting audio or video data.
  • the communication unit 330 transmits the redundancy that is generated by the forward error correction processing unit 360 while a handover is performed to the opponent terminal by using a separate channel from the channel for transmitting audio and/or video data.
  • the opponent terminal receives the data for performing the forward error correction on the media data from the user terminal 300 and corrects errors of the media data that is received from the user terminal 300 by using the data for performing the forward error correction on the media data.
  • the forward error correction processing unit 360 terminates generating of the data for performing the forward error correction on the media data.
  • the opponent terminal When the opponent terminal includes the elements of FIG. 3 , if the opponent terminal enters a handover region, the opponent terminal transmits the data for performing the forward error correction on the media data as well as the media data to the user terminal 300.
  • the forward error correction processing unit 360 of the user terminal 300 performs error correction on the media data that is received from the opponent terminal by using the data for performing the forward error correction on the media data and transmits the error-corrected media data to the received data processing unit 340.
  • the redundancy data for performing forward error correction on the data to be transmitted is transmitted to the opponent terminal so that the errors of the media data to be transmitted and received to and from the opponent terminal may be reduced.
  • FIG. 4 is a flowchart illustrating a method of reducing the amount of media data that may be lost during a handover according to an exemplary embodiment, with reference to the user terminal 100 or 300 of FIGs. 1 or 3 .
  • the user terminal 100 or 300 predicts the amount of media data that may be lost during a handover by using information about the amount of information that was lost during a past handover.
  • the user terminal 100 or 300 generates control information by using the predicted amount of media data that may be lost during a handover.
  • the user terminal 100 or 300 When the user terminal 100 or 300 enters a handover region, the user terminal 100 or 300 reduces the predicted amount of media data that may be lost when a handover is performed by using the generated control information in Operation 430.
  • the user terminal 100 or 300 expands the size of the jitter buffer 141 according to the generated control information when performing signal processing on the input media data, or selects an algorithm for recovering packets that may be lost and recovers packets that may be lost by using the selected algorithm, thereby reducing the predicted amount of media data that may be lost when a handover is performed.
  • the user terminal 100 or 300 stores the amount of media data that was lost during the handover, i.e., information about at least one selected from the group consisting of a jitter value, an amount of packet loss, and a time skew value during the handover.
  • the forward error correction processing unit 360 When the forward error correction processing unit 360 is included in the user terminal 300, as illustrated in FIG. 3 , the user terminal 300 generates a forward error correction processing data for the media data to be transmitted and transmits the generated forward error correction processing data to the opponent terminal while the handover is performed.
  • FIG. 5 is a flowchart illustrating a method of reducing an amount of media data that may be lost according to another exemplary embodiment.
  • the opponent terminal in Operation 510, the opponent terminal generates control information for reducing the predicted amount of media data that may be lost when a handover is performed, and transmits the generated control information to the user terminal 100 or 300.
  • the opponent terminal when the opponent terminal enters a handover region, the opponent terminal notifies the user terminal 100 or 300 that the opponent terminal has entered the handover region.
  • the opponent terminal may simultaneously transmit the generated control information to the user terminal 100 or 300 and notify the user terminal 100 or 300 that the opponent terminal has entered the handover region.
  • the opponent terminal may previously transmit the generated control information to the user terminal 100 or 300 before notifying the user terminal 100 or 300 that the opponent terminal has entered the handover region.
  • the user terminal 100 or 300 adjusts the size of the jitter buffer 141 of the user terminal 100 or 300 by using the control information received from the opponent terminal or changes an algorithm for recovering packets that may be lost, thereby reducing the predicted amount of media data that may be lost when the handover is performed.
  • the user terminal 100 or 300 After being notified by the opponent terminal that the handover has been completed, the user terminal 100 or 300 returns the size of the jitter buffer 141 back to its original size and recovers packets that may be lost by using the algorithm for recovering packets that may be lost.
  • the user terminal 300 corrects errors of the media data that is received from the opponent terminal by using the forward error correction data and performs signal processing on the error-corrected media data.
  • the amount of media data that may be lost when a handover is performed is previously predicted, and control information for reducing the predicted amount of media data that may be lost when the handover is performed is generated using the predicted amount of media data that may be lost during the handover. Accordingly, the predicted amount of media data that may be lost during the handover during handover can be reduced and, thus, the quality of media data can be improved.
  • the exemplary embodiments can also be embodied as computer readable codes on a computer readable recording medium.
  • the computer readable recording medium is any data storage device that can store data which can be thereafter read by a computer system. Examples of the computer readable recording medium include read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, etc.
  • the computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion. Also, functional programs, codes, and code segments for accomplishing the exemplary embodiments can be easily construed by programmers skilled in the art to which the present invention pertains.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Mobile Radio Communication Systems (AREA)

Claims (11)

  1. Procédé pour réduire une quantité de données média perdues lorsqu'un transfert est effectué, lequel procédé est exécuté par un premier terminal pour transmettre ou recevoir les données média vers ou depuis un second terminal, le procédé consistant à :
    - prédire (S410) une quantité de données média qui peuvent être perdues lorsque le transfert est effectué en utilisant des informations sur une quantité de données média perdues pendant au moins un transfert passé, les informations comprenant l'une au moins d'une quantité de perte de paquets, d'une valeur de gigue et d'une valeur de distorsion temporelle obtenues pour ledit au moins un transfert passé ;
    - générer (S420) des informations de commande pour réduire la quantité de données média perdues lorsque le transfert est effectué en utilisant la quantité prédite de données média qui peuvent être perdues lorsque le transfert est effectué ; et
    - réduire (S430) la quantité de données média perdues lorsque le transfert est effectué en utilisant les informations de commande pendant que le transfert est effectué ;
    dans lequel la réduction de la quantité de données média perdues lorsque le transfert est effectué consiste à :
    - choisir un algorithme pour récupérer la perte de paquets en fonction de la quantité prédite de perte de paquets en utilisant les informations de commande et récupérer la perte de paquets en utilisant l'algorithme choisi pour récupérer la perte de paquets ; ou
    - étendre une taille d'un tampon de gigue du premier terminal en utilisant les informations de commande.
  2. Procédé selon la revendication 1, consistant en outre à :
    - transmettre les informations de commande au second terminal ; et
    - avertir le second terminal que le transfert doit être effectué par le premier terminal.
  3. Procédé selon la revendication 1, consistant en outre à transmettre des données pour effectuer une correction d'erreur avant sur les données média vers le second terminal lorsque le transfert est effectué.
  4. Procédé selon la revendication 1, consistant en outre à générer un canal pour transmettre les données pour effectuer la correction d'erreur avant lorsqu'une connexion est établie avec le second terminal,
    dans lequel la transmission des données pour effectuer la correction d'erreur avant sur les données média vers le second terminal consiste à transmettre les données pour effectuer la correction d'erreur avant au second terminal en utilisant le canal généré.
  5. Procédé selon la revendication 1, consistant en outre à, si le transfert est terminé, avertir le second terminal que le transfert est terminé.
  6. Procédé selon la revendication 1, consistant en outre à, si le transfert est terminé, stocker la quantité de données média perdues.
  7. Procédé pour réduire une quantité de données média perdues lorsqu'un transfert est effectué, lequel procédé est exécuté par un premier terminal pour transmettre ou recevoir les données média vers ou depuis un second terminal, le procédé consistant à :
    - recevoir du second terminal des informations de commande pour réduire la quantité de données média perdues lorsque le transfert est effectué, les informations de commande étant générées en utilisant des informations sur une quantité de données média perdues pendant au moins un transfert passé, les informations comprenant au moins l'une d'une quantité de perte de paquets, d'une valeur de gigue, et d'une valeur de distorsion temporelle obtenues pour ledit au moins un transfert passé ;
    - recevoir une notification du second terminal que le transfert doit être effectué par le second terminal ; et
    - réduire la quantité de données média perdues lorsque le transfert est effectué en utilisant les informations de commande,
    dans lequel la réduction de la quantité de données média perdues lorsque le transfert est effectué consiste à :
    - choisir un algorithme pour récupérer la perte de paquets en fonction de la quantité prédite de perte de paquets en utilisant les informations de commande et récupérer la perte de paquets en utilisant l'algorithme choisi pour récupérer la perte de paquets ; ou
    - étendre une taille d'un tampon de gigue du premier terminal en utilisant les informations de commande.
  8. Procédé selon la revendication 7, consistant en outre à :
    - recevoir du second terminal des données pour effectuer une correction d'erreur avant sur les données média ; et
    - effectuer la correction d'erreur avant sur les données média en utilisant les données pour effectuer la correction d'erreur avant.
  9. Premier terminal (100, 300) pour transmettre ou recevoir des données média vers ou depuis un second terminal lorsqu'un transfert est effectué, le premier terminal comprenant :
    - une unité de communication (130, 330) conçue pour transmettre ou recevoir les données média vers ou depuis le second terminal ;
    - une unité de traitement de données de prédiction (150, 350) conçue pour prédire une quantité de données média qui peuvent être perdues lorsque le transfert est effectué en utilisant des informations sur une quantité de données média perdues pendant au moins un transfert passé, les informations comprenant l'une au moins d'une quantité de perte de paquets, d'une valeur de gigue et d'une valeur de distorsion temporelle obtenues pour ledit au moins un transfert passé, et générer des informations de commande pour réduire une quantité de données média perdues lorsque le transfert est effectué en utilisant la quantité prédite de données média qui peuvent être perdues lorsque le transfert est effectué ; et
    - une unité de commande (110, 310) conçue pour réduire la quantité de données média perdues lorsque le transfert est effectué en utilisant les informations de commande pendant que le transfert est effectué, et conçue pour :
    - choisir un algorithme pour récupérer la perte de paquets en fonction de la quantité prédite de perte de paquets en utilisant les informations de commande et récupérer la perte de paquets en utilisant l'algorithme choisi pour récupérer la perte de paquets ; ou
    - étendre une taille d'un tampon de gigue du premier terminal en utilisant les informations de commande.
  10. Premier terminal (100, 300) pour transmettre ou recevoir des données média vers ou depuis un second terminal lorsqu'un transfert est effectué, le premier terminal comprenant :
    - une unité de communication (130, 330) conçue pour transmettre ou recevoir les données média vers ou depuis le second terminal qui reçoit du second terminal des informations de commande générées en utilisant une quantité prédite des données média qui peuvent être perdues lorsque le transfert est effectué, la quantité prédite étant générée en utilisant des informations sur une quantité de données média perdues pendant au moins un transfert passé, les informations comprenant l'une au moins d'une quantité de perte de paquets, d'une valeur de gigue et d'une valeur de distorsion temporelle obtenues pour ledit au moins un transfert passé, et conçue pour recevoir la notification du second terminal que le transfert doit être effectué ; et
    - une unité de commande (110, 310) conçue pour réduire une quantité de données média perdues lorsque le transfert est effectué en utilisant les informations de commande et conçue pour :
    - choisir un algorithme pour récupérer la perte de paquets en fonction de la quantité prédite de perte de paquets en utilisant les informations de commande et récupérer la perte de paquets en utilisant l'algorithme choisi pour récupérer la perte de paquets ; ou
    - étendre une taille d'un tampon de gigue du premier terminal en utilisant les informations de commande.
  11. Support d'enregistrement lisible par ordinateur sur lequel est enregistré un programme qui, lorsqu'il est exécuté au niveau d'un premier terminal émettant ou recevant des données média vers ou depuis un second terminal lorsqu'un transfert doit être effectué, fait que le terminal va exécuter un procédé pour réduire une quantité de données média perdues lorsque le transfert est effectué, lequel procédé consiste à :
    - prédire (410) une quantité de données média qui peuvent être perdues lorsque le transfert est effectué en utilisant des informations sur une quantité de données média perdues pendant au moins un transfert passé, les informations comprenant l'une au moins d'une quantité de perte de paquets, d'une valeur de gigue et d'une valeur de distorsion temporelle obtenues pour ledit au moins un transfert passé ;
    - générer (420) des informations de commande pour réduire la quantité de données média perdues lorsque le transfert est effectué en utilisant la quantité prédite de données média perdues lorsque le transfert est effectué ; et
    - réduire (430) la quantité de données média perdues lorsque le transfert est effectué en utilisant les informations de commande pendant que le transfert est effectué ;
    dans lequel la réduction de la quantité de données média perdues lorsque le transfert est effectué consiste à :
    - choisir un algorithme pour récupérer la perte de paquets en fonction de la quantité prédite de perte de paquets en utilisant les informations de commande et récupérer la perte de paquets en utilisant l'algorithme choisi pour récupérer la perte de paquets ; ou
    - étendre une taille d'un tampon de gigue du premier terminal en utilisant les informations de commande.
EP10190878.8A 2009-11-12 2010-11-11 Procédé et appareil pour réduire la perte de données média pendant un procès de mobilité de tranfert intercellulaire Not-in-force EP2323438B1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020090109178A KR101640847B1 (ko) 2009-11-12 2009-11-12 핸드오버 시 미디어 데이터 손실 감소 방법 및 장치

Publications (3)

Publication Number Publication Date
EP2323438A2 EP2323438A2 (fr) 2011-05-18
EP2323438A3 EP2323438A3 (fr) 2014-07-30
EP2323438B1 true EP2323438B1 (fr) 2016-10-05

Family

ID=43569671

Family Applications (1)

Application Number Title Priority Date Filing Date
EP10190878.8A Not-in-force EP2323438B1 (fr) 2009-11-12 2010-11-11 Procédé et appareil pour réduire la perte de données média pendant un procès de mobilité de tranfert intercellulaire

Country Status (3)

Country Link
US (1) US9031037B2 (fr)
EP (1) EP2323438B1 (fr)
KR (1) KR101640847B1 (fr)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2494644B (en) * 2011-09-13 2016-08-17 Skype Transmitting data over mulitiple networks
KR101340587B1 (ko) * 2012-11-23 2013-12-11 강원대학교산학협력단 마시는 곰취 식초의 제조방법
JP6484403B2 (ja) * 2014-03-28 2019-03-13 株式会社日立情報通信エンジニアリング 通信装置、通信プログラム、通信方法
CN106664628B (zh) * 2014-06-17 2020-06-16 华为技术有限公司 一种传输数据的方法和装置
KR101619262B1 (ko) * 2014-11-14 2016-05-18 현대자동차 주식회사 음성인식 장치 및 방법
US9998386B2 (en) * 2015-05-21 2018-06-12 At&T Mobility Ii Llc Facilitation of adaptive dejitter buffer
US9794842B2 (en) * 2015-05-21 2017-10-17 At&T Mobility Ii Llc Facilitation of handover coordination based on voice activity data
KR102555936B1 (ko) * 2020-12-29 2023-07-18 서울대학교산학협력단 딥러닝 기반 채널 손실 예측을 통한 전송 제어 장치 및 전송 제어 방법
US20230319663A1 (en) * 2022-03-09 2023-10-05 Qualcomm Incorporated Handover indication for data stream

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8085678B2 (en) * 2004-10-13 2011-12-27 Qualcomm Incorporated Media (voice) playback (de-jitter) buffer adjustments based on air interface
CA2649667C (fr) 2006-04-29 2014-08-26 Thomson Licensing Transfert transparent de sessions multi-diffusions dans des reseaux ip sans fil par diffusion echelonnee
JP2008005392A (ja) * 2006-06-26 2008-01-10 Kddi Corp 通信端末装置およびバッファ制御方法
KR101488015B1 (ko) * 2008-01-25 2015-01-29 엘지전자 주식회사 핸드오버 수행방법 및 데이터 생성방법
KR101169160B1 (ko) * 2008-02-27 2012-07-30 쿄세라 코포레이션 무선 통신 장치
US8165091B2 (en) * 2008-06-27 2012-04-24 Nix John A Efficient handover of media communications in heterogeneous IP networks using LAN profiles and network handover rules
US20100027503A1 (en) * 2008-07-31 2010-02-04 Qualcomm Incorporated Method and apparatus for reducing data loss during handover in a wireless communication system
US7590093B1 (en) * 2008-12-08 2009-09-15 Sprint Spectrum L.P. Conditioning removal of an overlay carrier frequency from a cellular wireless coverage system

Also Published As

Publication number Publication date
KR20110052229A (ko) 2011-05-18
KR101640847B1 (ko) 2016-07-19
US9031037B2 (en) 2015-05-12
EP2323438A2 (fr) 2011-05-18
US20110110330A1 (en) 2011-05-12
EP2323438A3 (fr) 2014-07-30

Similar Documents

Publication Publication Date Title
EP2323438B1 (fr) Procédé et appareil pour réduire la perte de données média pendant un procès de mobilité de tranfert intercellulaire
US20080028428A1 (en) Method and apparatus for video telephony in portable terminal
US9166735B2 (en) Correction data
EP2869488B1 (fr) Procédé et dispositif pour compenser la perte d'un paquet de données de voix
US20120131422A1 (en) Transmitting device, transmitting method, receiving device, receiving method, program, and transmission system
US8621311B2 (en) Data transfer device, method, and program
WO2004002091A1 (fr) Qualite d'amelioration evolutive pour diffusion en temps reel memorisee dans un environnement d'interconnexion sans fil
JPWO2007029618A1 (ja) 移動携帯端末およびその制御方法
JP2009278188A (ja) データ送信装置、データ送信方法、及びプログラム
US20210192934A1 (en) Remote control command transmission method, remote control device, mobile platform, and storage medium
US20060085552A1 (en) System and method to manage processing operations within a wireless terminal following receipt of a null page
US7970603B2 (en) Method and apparatus for managing speech decoders in a communication device
JP5300550B2 (ja) 無線通信機器及びその制御方法、並びにプログラム
JP4249756B2 (ja) 携帯情報端末および音声再生方法
US6873656B2 (en) Method for video encoding by utilizing intra updating technique based on error probabilities estimated from size of bit stream for each block
JP2001053690A (ja) 音声復号装置
JP5414086B2 (ja) 無線端末及び方法
JP4992222B2 (ja) 通話音声録音装置及びプログラム
EP2512052A1 (fr) Procédé et dispositif permettant d'établir un mode de décodage de signalisation intrabande
JP2004214902A (ja) ストリーミング再生携帯端末、ストリーミング再生方法、コンピュータプログラム、並びにコンピュータ読み取り可能な記録媒体
JPH1013239A (ja) 復号処理装置およびその復号処理方法
JP2006186797A (ja) ハンドオーバー制御方法／プログラム／プログラム記録媒体、無線通信端末局／基地局／システム
JP5355440B2 (ja) 通信制御装置及び通信制御プログラム
JP4230900B2 (ja) 音声通信端末
JP4632863B2 (ja) 無線通信システム及び無線通信方法

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SAMSUNG ELECTRONICS CO., LTD.

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIC1 Information provided on ipc code assigned before grant

Ipc: H04W 36/02 20090101AFI20140626BHEP

Ipc: H04N 21/44 20110101ALN20140626BHEP

17P Request for examination filed

Effective date: 20150130

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

17Q First examination report despatched

Effective date: 20150610

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 21/442 20110101ALI20160420BHEP

Ipc: H04N 21/414 20110101ALI20160420BHEP

Ipc: H04W 36/02 20090101AFI20160420BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20160603

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 835530

Country of ref document: AT

Kind code of ref document: T

Effective date: 20161015

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602010036900

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20161005

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161005

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20161130

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 835530

Country of ref document: AT

Kind code of ref document: T

Effective date: 20161005

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161005

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170106

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161005

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170105

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161005

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161005

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161005

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161005

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161005

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161005

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161005

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161005

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170205

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170206

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602010036900

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161005

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161005

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161005

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20161130

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161005

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161005

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20161130

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161005

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20170731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161005

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161005

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170105

26N No opposition filed

Effective date: 20170706

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20161130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20161205

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20161111

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161005

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20171018

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20171019

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20101111

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161005

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161005

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161005

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20161111

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602010036900

Country of ref document: DE

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20181111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190601

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161005