EP1744517B1 - Method and system for playing multimedia files - Google Patents

Method and system for playing multimedia files Download PDF

Info

Publication number
EP1744517B1
EP1744517B1 EP06014575A EP06014575A EP1744517B1 EP 1744517 B1 EP1744517 B1 EP 1744517B1 EP 06014575 A EP06014575 A EP 06014575A EP 06014575 A EP06014575 A EP 06014575A EP 1744517 B1 EP1744517 B1 EP 1744517B1
Authority
EP
European Patent Office
Prior art keywords
conference
media
console
audio
playing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Not-in-force
Application number
EP06014575A
Other languages
German (de)
French (fr)
Other versions
EP1744517A1 (en
Inventor
Caixia Huawei Adm. Building Miao
Qingchun Huawei Adm. Building Shen
Wenge Huawei Adm. Building Zhang
Xiaodong Huawei Adm. Building Chen
Lei Huawei Adm. Building Yuan
Wanjun Huawei Adm. Building Shang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of EP1744517A1 publication Critical patent/EP1744517A1/en
Application granted granted Critical
Publication of EP1744517B1 publication Critical patent/EP1744517B1/en
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications
    • H04L65/403Arrangements for multi-party communication, e.g. for conferences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • H04L65/1101Session protocols
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications
    • H04L65/403Arrangements for multi-party communication, e.g. for conferences
    • H04L65/4038Arrangements for multi-party communication, e.g. for conferences with floor control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • H04N7/155Conference systems involving storage of or access to video conference sessions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • H04N7/157Conference systems defining a virtual conference space and using avatars or agents

Definitions

  • the present invention generally relates to voice conference or multimedia conference services in the next generation network, and more specifically to a method for playing local multimedia files in a communication network.
  • the method for playing local audio/video files in a conference console is generally known to open and play the local audio/video files by use of a local player in the conference console, and the sound being magnified by the loud speakers in the conference console is broadcast through a phone speaker to the participators at the meeting.
  • the loudspeakers are required for playing the audio/video files directly, which causes limitations to the conference environment and facilities. Yet, it has large noises. Moreover, only audio files can be played, whereas video images of the video files cannot be transmitted to the participators.
  • US 2003 014488 A1 relates to the field of software systems, specifically in the area of Voice over IP, conferencing, instant messging and presence and availability management.
  • the present invention provides a system and method for enabling multimedia, real-time group communications on real-time communications platforms.
  • the present invention takes advantage of the properties available in real-time communications platforms to provide multimedia, real-time conferencing and communications services.
  • GB 2363543 A discloses a method of completing a voice call from a telecommunications terminal 7 in a switched telecommunications network is described in which a call is redirected from a target telecommunications terminal 3 to a call management server 9.
  • the identification of the voice call is transmitted to a user operable terminal 1 over a data network.
  • a request for a voice session to be set up over the data network is generated and transmitted to a voice over data server 10.
  • a voice over data channel is reserved and the call is completed be redirecting the call to the voice over data server and opening the reserved voice over data channel to the user operable terminal.
  • the data network may be the internet. Arrangements for setting up a voice call via the internet, the transmission of advertisements and setting a voice call to a call centre are also disclosed.
  • An aspect of the present invention provides a method for playing audio/video files stored in a conference console, which is applied to conference services in a next generation network.
  • the conference console sends a request for playing the audio/video files to a conference application server; determining a media channel, wherein the media resource server determines whether there is an existing media channel between the media resource server and the conference console, and if so, using the existing media channel; if not, the conference application server requesting the media resource server to establish a new media channel between the media resource server and the conference console; the conference console converts the format of media streams of the audio/video files into a format supported by the media resource server, and transfers the converted media streams to the media resource server via the media channel; and the media resource server plays media stream information of the audio/video files to conference terminals.
  • a system for playing audio/video files (multimedia files) stored in a conference console in a communication network comprising:
  • a conference console comprising a component configured to: store audio/video files; convert the format of media streams of the stored audio/video files into a format supported by a media resource server; and transfer the converted media streams to the media resource server via a media channel between the media resource server and the conference console established in response to a request from conference application server.
  • the user conference console as a licensed Next Generation Network (NGN) soft terminal is admitted to the conference; and through a media channel established between the media resource server and the conference console, the audio/video files stored in the conference console can be converted into those of a media stream format supported by the media resource server and then transferred to the media resource sever, where the media streams are broadcast to the conference terminals.
  • NTN Next Generation Network
  • the method according to the present invention is able to play both the audio files and the video files. Besides, since the present invention is constituted based on the NGN network architecture, it is conveniently possible for the conference application server to charge for playing the audio/video files.
  • SIP session initiation protocol
  • the present invention provides the conference services by using a Next Generation Network (NGN) architecture, which includes network entities such as a conference console, a conference application server, a soft switch, a media resource server (MRS) and a conference terminal, etc..
  • NTN Next Generation Network
  • MRS media resource server
  • the conference console provides an interface for a user to initiate and control a conference via WEB or a client.
  • the user may utilize related functions provided by the conference services, such as inviting other user to join the conference, playing local audio/video files for participators, and terminating the conference, etc., so as to control the conference.
  • the conference console may communicate with the conference application server under HTTP/SOAP protocol, and may communicate with the soft switch under the standard SIP protocol.
  • the conference application server is a server for conference service loading and operating, which may control conference calls, and implement corresponding functions of the conference.
  • the soft switch performs functions such as service triggering, routing and call connection, etc.. Typically, the soft switch triggers calls to the conference application server, and the conference application server takes over the subsequent control of the calls.
  • the media resource server provides media resources, such as conference hall, announcement and collecting information, etc., for the conference application server.
  • the conference terminal such as a phone terminal, is used by the user to attend the conference and talk with other participators.
  • a method for playing the audio/video files stored in the conference console including the following steps.
  • the conference console While playing the audio/video files, the conference console sends a request to the conference application server for applying a phone number and the conference application server allocates one phone number dynamically and returns that to the conference console. After that, the conference console attends the conference temporarily as a soft phone terminal, simulates a participator to speak, converts the format of media streams of the audio/video files desired to a format supported by the media server resource server, and plays the media streams.
  • Fig.2 A detailed signaling flow of the present embodiment is shown in Fig.2 , which includes the following steps.
  • step 1 if the chairman of the conference desires to play an audio/video file stored in the conference console to participators at a conference, he/she may send a request for playing the file to the conference application server via the conference console.
  • the conference application server selects an unallocated phone number which is not open to the users (i.e. a virtual phone number) and can be dynamically maintained and allocated by the conference application server, and returns the phone number to the conference console; and further, after playing the local audio/video files, the conference application server withdraws the phone number for reuse.
  • the conference console binds the phone number returned by the conference application server with an IP address and a port number of the conference console and registers the bound phone number, IP address and port number in the soft switch.
  • the soft switch notifies the conference console of a result for the registering by a register response (200 OK); and if registering successfully, the conference console may participate the conference as an internal soft phone terminal of the NGN network and communicate with other phone terminals or internal soft phone terminals to receive and deliver signaling and media streams.
  • the conference console sends a request to the conference application server for admitting the soft phone registered by itself to the conference.
  • the conference application server determines whether the soft phone number is authenticated, and if so, the conference application server requests the MRS to connect the soft phone terminal (i.e. the conference console) to the conference.
  • the MRS answers the request from the conference application server and notifies the conference application server of the result that the soft phone terminal (i.e. the conference console) has been admitted to the conference.
  • the soft phone terminal i.e. the conference console
  • the conference application server notifies the conference console of the result that the soft phone terminal (i.e. the conference console) has been admitted to the conference.
  • the conference console sends an acknowledge message (ACK) to the conference application server to confirm that the local audio/video file is ready for playing.
  • ACK acknowledge message
  • the conference application server returns the acknowledge message (ACK) to the MRS to accomplish negotiation of the media channel.
  • ACK acknowledge message
  • the conference application server starts to charge for playing the local audio/video files.
  • the conference console opens the local audio/video file stored in the conference console, converts the format of media streams of the audio/video file to a format supported by the MRS, and transfers the media streams in the converted format to the MRS through the media channel established between them, whereby the MRS can perform audio mixing or playing video files to the participators.
  • the conference console sends an instruction for stop to the conference application server.
  • the conference application server sends a BYE message to the MRS to notify the MRS to release media resources occupied by the media channel.
  • the MRS returns a 200 OK response message to the conference application server.
  • the conference application server sends a stop response message to the conference console.
  • the conference application server stops charging for playing the local audio/video files, and withdraws the virtual phone number allocated for the conference console, whereby the current process of playing the local audio/video files is ended.
  • the conference console In the case that the conference console is provided with a function as a soft phone and a user has participated the conference by using the soft phone as a conference phone, it may use an existing media channel between the media resource server and the conference console to transfer the media streams while playing the local audio/video file stored in the conference console. In such a case, there is no necessity for the conference application server to allocate a phone number dynamically for registering. In this way, the existing media channel between the media resource server and the conference console is used for both playing the local files and communicating between the users. If the conference console provides a function of sound mixing, the user may communicate normally while the local files are playing. Contrarily, if the conference console provides no function of sound mixing, the user may not speak for the moment while the local files are playing. Moreover, if one requires playing a local video file, it should switch the current conference video images at the user side to images of the local video files.
  • Fig. 3 shows a detailed signaling flow according to the present embodiment, including the following steps.
  • step 1 in the case that the user is speaking by use of the soft phone terminal provided by the conference console at the conference, if the user desires to play the local audio/video files stored in the conference console, the user may select a function of playing local files by the conference console, and the conference console will send a request for playing the files to the conference application server while simultaneously carrying the media resource information required for playing the desired files.
  • the conference application server determines whether the media resource required for playing the files is identical with the current media resource occupied by the media channel used by the user for communication. If not, proceed to steps 3-8 to request the MRS and the conference console again to allocate the media resource required for playing the files; otherwise, proceed to step 9.
  • the conference application server requests the MRS to modify the media resource allocated for the media channel, so as to ensure the media resource required for playing the local audio/video files.
  • the MRS returns a response for modifying the media resource to the conference application server.
  • the conference application server requests the soft phone terminal (i.e. the conference console) to modify its media resource into the media resource for playing the local files.
  • the soft phone terminal returns a response for modifying the media resource to the conference application server.
  • the conference application server upon receiving the response from the MRS, the conference application server sends an acknowledge message to the MRS.
  • the conference application server upon receiving the response from the soft phone terminal, the conference application server sends an acknowledge message to the soft phone terminal.
  • the conference application server starts charging for playing the local audio/video files stored in the conference console if required.
  • the soft phone terminal starts the function of audio mixing (if provided) to mix the audio streams of the local audio files and the speeches of the user and send the mixed audio streams to the MRS for broadcasting to the participators.
  • the conference console may switch the video images at the user side to images for playing the local files, and send the video images for playing the local files to the MRS for broadcasting to all the participators.
  • the conference console plays the local audio/video files through the soft phone terminal.
  • the conference console sends an instruction for stop to the conference application server.
  • the conference application server determines whether the media resource has been modified while playing the local audio/video files, and if so, proceed to steps 14-19 to recover the media resource for normal communication of the user; if not, proceed to step 20.
  • the conference application server requests the MRS to recover the media resource allocated for the soft phone terminal.
  • the conference application server requests the soft phone terminal to recover the media resource for normal communication.
  • the MRS returns an answer message for recovering the media resource for normal communication to the conference application server.
  • the soft phone terminal returns a response message for recovering the media resource for normal communication to the conference application server.
  • the conference application server upon receiving the answer message from the MRS, the conference application server sends an acknowledge message to the MRS.
  • the conference application server upon receiving the response message from the soft phone terminal, the conference application server sends an acknowledge message to the soft phone terminal.
  • the conference application server stops charging for playing the local audio/video files.
  • the conference console stops the function of audio mixing and switches the video images for playing local files to the conference video images for the user.
  • the existing media channel between the media resource server and the soft phone terminal i.e. conference console
  • the conference console is provided with a function of soft phone and it has participated the conference as a soft phone terminal.
  • the media resource occupied by the existing media channel cannot satisfy for playing the local audio/video files, it requires modifying the media resource allocated for the same media channel to meet the requirement for playing the local audio/video files.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Telephonic Communication Services (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Description

    Field of the Invention
  • The present invention generally relates to voice conference or multimedia conference services in the next generation network, and more specifically to a method for playing local multimedia files in a communication network.
  • Background
  • With the development of communication techniques, the integration of telecommunications and Internet is continuously being applied, which takes the functional advantages of both computers and telephones. The appearance of various novel telecommunication services has brought many new functions into the telecommunication field. Currently, a service of voice conference or voice chat room that is initiated and controlled via WEB or intelligent terminal is widely applied, which enables a chairman of the conference or the chat room to perform control operation via WEB or intelligent terminal so as to implement various functions. At the conference, the chairman may select to play local audio/video files in the conference console for each participator. The files may include WAVE files of someone's speech recorded in real time, or music files in MP3 format, etc.
  • At present, the method for playing local audio/video files in a conference console is generally known to open and play the local audio/video files by use of a local player in the conference console, and the sound being magnified by the loud speakers in the conference console is broadcast through a phone speaker to the participators at the meeting.
  • In this method, primarily, the loudspeakers are required for playing the audio/video files directly, which causes limitations to the conference environment and facilities. Yet, it has large noises. Moreover, only audio files can be played, whereas video images of the video files cannot be transmitted to the participators.
  • US 2003 014488 A1 relates to the field of software systems, specifically in the area of Voice over IP, conferencing, instant messging and presence and availability management. In particular, the present invention provides a system and method for enabling multimedia, real-time group communications on real-time communications platforms. The present invention takes advantage of the properties available in real-time communications platforms to provide multimedia, real-time conferencing and communications services.
  • GB 2363543 A discloses a method of completing a voice call from a telecommunications terminal 7 in a switched telecommunications network is described in which a call is redirected from a target telecommunications terminal 3 to a call management server 9. The identification of the voice call is transmitted to a user operable terminal 1 over a data network. A request for a voice session to be set up over the data network is generated and transmitted to a voice over data server 10. Within the voice over data server a voice over data channel is reserved and the call is completed be redirecting the call to the voice over data server and opening the reserved voice over data channel to the user operable terminal. The data network may be the internet. Arrangements for setting up a voice call via the internet, the transmission of advertisements and setting a voice call to a call centre are also disclosed.
  • Summary of the Invention
  • An aspect of the present invention provides a method for playing audio/video files stored in a conference console, which is applied to conference services in a next generation network. In the method: the conference console sends a request for playing the audio/video files to a conference application server; determining a media channel, wherein the media resource server determines whether there is an existing media channel between the media resource server and the conference console, and if so, using the existing media channel; if not, the conference application server requesting the media resource server to establish a new media channel between the media resource server and the conference console; the conference console converts the format of media streams of the audio/video files into a format supported by the media resource server, and transfers the converted media streams to the media resource server via the media channel; and the media resource server plays media stream information of the audio/video files to conference terminals.
  • In another aspect, a system for playing audio/video files (multimedia files) stored in a conference console in a communication network, comprising:
    • a conference console configured to send a request f to a conference application server for playing the stored audio/video files, convert the format of media streams of the stored audio/video files into a format supported by a media resource server, and transfer the converted media streams to the media resource server via a media channel ;
    • a conference application server configured to receive the request for playing audio/video files sent by the conference console, determine whether there is an existing media channel between the conference console and the media resource server, if so, using the existing media channel; otherwise, sending a request to the media resource server to establish a new media channel; and
    • the media resource server configured to establish a new media channel between the media resource server and the conference console in response to the request for establishing a new media channel from the conference application server, receive over the media channel the converted media streams of the audio/video files from the conference console, and broadcast the audio/video files to conference terminals upon receiving the multimedia files from the conference console.
  • In another aspect, a conference console comprising a component configured to: store audio/video files; convert the format of media streams of the stored audio/video files into a format supported by a media resource server; and transfer the converted media streams to the media resource server via a media channel between the media resource server and the conference console established in response to a request from conference application server.
  • According to the present invention, the user conference console as a licensed Next Generation Network (NGN) soft terminal is admitted to the conference; and through a media channel established between the media resource server and the conference console, the audio/video files stored in the conference console can be converted into those of a media stream format supported by the media resource server and then transferred to the media resource sever, where the media streams are broadcast to the conference terminals. As a result, the audio/video files can be played irrespective of whether the local facilities are provided with corresponding playing functions or not. Since the negotiation on media resource between the soft terminal and the media resource server is conducted under the session initiation protocol (SIP), and the audio/video files desired for playing are converted into media streams and transferred through NGN network, the method according to the present invention is able to play both the audio files and the video files. Besides, since the present invention is constituted based on the NGN network architecture, it is conveniently possible for the conference application server to charge for playing the audio/video files.
  • Brief Description of the Drawings
    • Fig. 1 is a schematic diagram showing an architecture of a network applied in the present invention;
    • Fig. 2 is a flowchart showing a method according to a first embodiment of the present invention;
    • Fig. 3 is a flowchart showing a method according to a second embodiment of present invention.
    Detailed Description of the Invention
  • As shown in Fig. 1, the present invention provides the conference services by using a Next Generation Network (NGN) architecture, which includes network entities such as a conference console, a conference application server, a soft switch, a media resource server (MRS) and a conference terminal, etc..
  • In particular, the conference console provides an interface for a user to initiate and control a conference via WEB or a client. The user may utilize related functions provided by the conference services, such as inviting other user to join the conference, playing local audio/video files for participators, and terminating the conference, etc., so as to control the conference. Additionally, the conference console may communicate with the conference application server under HTTP/SOAP protocol, and may communicate with the soft switch under the standard SIP protocol.
  • The conference application server is a server for conference service loading and operating, which may control conference calls, and implement corresponding functions of the conference.
  • The soft switch performs functions such as service triggering, routing and call connection, etc.. Typically, the soft switch triggers calls to the conference application server, and the conference application server takes over the subsequent control of the calls.
  • The media resource server (MRS) provides media resources, such as conference hall, announcement and collecting information, etc., for the conference application server.
  • The conference terminal, such as a phone terminal, is used by the user to attend the conference and talk with other participators.
  • According to the network architecture mentioned above, it is provided in the present invention a method for playing the audio/video files stored in the conference console, including the following steps.
    1. 1) The conference console sends a request for playing the audio/video files to the conference application server.
    2. 2) The conference application server sends a request to the media resource server for establishing a media channel between the conference console and the media resource server.
    3. 3) The conference console converts the format of media streams of the audio/video files stored therein into a format supported by the media resource server, and transfers them to the media resource server via the media channel.
    4. 4) The media resource server plays the media streams to the conference terminals.
  • Detailed descriptions of the above method will be given as below with reference to the accompanying drawings.
  • Hereinafter, a method according to a first embodiment of the present invention will be described.
  • While playing the audio/video files, the conference console sends a request to the conference application server for applying a phone number and the conference application server allocates one phone number dynamically and returns that to the conference console. After that, the conference console attends the conference temporarily as a soft phone terminal, simulates a participator to speak, converts the format of media streams of the audio/video files desired to a format supported by the media server resource server, and plays the media streams. A detailed signaling flow of the present embodiment is shown in Fig.2, which includes the following steps.
  • At step 1, if the chairman of the conference desires to play an audio/video file stored in the conference console to participators at a conference, he/she may send a request for playing the file to the conference application server via the conference console.
  • At step 2, the conference application server selects an unallocated phone number which is not open to the users (i.e. a virtual phone number) and can be dynamically maintained and allocated by the conference application server, and returns the phone number to the conference console; and further, after playing the local audio/video files, the conference application server withdraws the phone number for reuse.
  • At step 3, the conference console binds the phone number returned by the conference application server with an IP address and a port number of the conference console and registers the bound phone number, IP address and port number in the soft switch.
  • At step 4, the soft switch notifies the conference console of a result for the registering by a register response (200 OK); and if registering successfully, the conference console may participate the conference as an internal soft phone terminal of the NGN network and communicate with other phone terminals or internal soft phone terminals to receive and deliver signaling and media streams.
  • At step 5, after registering the soft phone terminal successfully, the conference console sends a request to the conference application server for admitting the soft phone registered by itself to the conference.
  • At step 6, the conference application server determines whether the soft phone number is authenticated, and if so, the conference application server requests the MRS to connect the soft phone terminal (i.e. the conference console) to the conference.
  • At step 7, the MRS answers the request from the conference application server and notifies the conference application server of the result that the soft phone terminal (i.e. the conference console) has been admitted to the conference.
  • At step 8, the conference application server notifies the conference console of the result that the soft phone terminal (i.e. the conference console) has been admitted to the conference.
  • At step 9, upon receiving the result, the conference console sends an acknowledge message (ACK) to the conference application server to confirm that the local audio/video file is ready for playing.
  • At step 10, the conference application server returns the acknowledge message (ACK) to the MRS to accomplish negotiation of the media channel.
  • At step 11, the conference application server starts to charge for playing the local audio/video files.
  • At step 12, the conference console opens the local audio/video file stored in the conference console, converts the format of media streams of the audio/video file to a format supported by the MRS, and transfers the media streams in the converted format to the MRS through the media channel established between them, whereby the MRS can perform audio mixing or playing video files to the participators.
  • At step 13, if the conference console interrupts playing the audio/video files or the playing is completed, the conference console sends an instruction for stop to the conference application server.
  • At step 14, the conference application server sends a BYE message to the MRS to notify the MRS to release media resources occupied by the media channel.
  • At step 15, the MRS returns a 200 OK response message to the conference application server.
  • At step 16, the conference application server sends a stop response message to the conference console.
  • At step 17, the conference application server stops charging for playing the local audio/video files, and withdraws the virtual phone number allocated for the conference console, whereby the current process of playing the local audio/video files is ended.
  • Hereinafter, references will be made to a method according to a second embodiment of present invention.
  • In the case that the conference console is provided with a function as a soft phone and a user has participated the conference by using the soft phone as a conference phone, it may use an existing media channel between the media resource server and the conference console to transfer the media streams while playing the local audio/video file stored in the conference console. In such a case, there is no necessity for the conference application server to allocate a phone number dynamically for registering. In this way, the existing media channel between the media resource server and the conference console is used for both playing the local files and communicating between the users. If the conference console provides a function of sound mixing, the user may communicate normally while the local files are playing. Contrarily, if the conference console provides no function of sound mixing, the user may not speak for the moment while the local files are playing. Moreover, if one requires playing a local video file, it should switch the current conference video images at the user side to images of the local video files. Fig. 3 shows a detailed signaling flow according to the present embodiment, including the following steps.
  • At step 1, in the case that the user is speaking by use of the soft phone terminal provided by the conference console at the conference, if the user desires to play the local audio/video files stored in the conference console, the user may select a function of playing local files by the conference console, and the conference console will send a request for playing the files to the conference application server while simultaneously carrying the media resource information required for playing the desired files.
  • At step 2, upon receiving the request for playing the files, the conference application server determines whether the media resource required for playing the files is identical with the current media resource occupied by the media channel used by the user for communication. If not, proceed to steps 3-8 to request the MRS and the conference console again to allocate the media resource required for playing the files; otherwise, proceed to step 9.
  • At step 3, the conference application server requests the MRS to modify the media resource allocated for the media channel, so as to ensure the media resource required for playing the local audio/video files.
  • At step 4, the MRS returns a response for modifying the media resource to the conference application server.
  • At step 5, the conference application server requests the soft phone terminal (i.e. the conference console) to modify its media resource into the media resource for playing the local files.
  • At step 6, the soft phone terminal returns a response for modifying the media resource to the conference application server.
  • At step 7, upon receiving the response from the MRS, the conference application server sends an acknowledge message to the MRS.
  • At step 8, upon receiving the response from the soft phone terminal, the conference application server sends an acknowledge message to the soft phone terminal.
  • At step 9, after the media resource of the soft phone terminal and the MRS are ready, the conference application server starts charging for playing the local audio/video files stored in the conference console if required.
  • At step 10, in order to ensure that the users communicate normally while the local files are playing, the soft phone terminal starts the function of audio mixing (if provided) to mix the audio streams of the local audio files and the speeches of the user and send the mixed audio streams to the MRS for broadcasting to the participators. In the case that a video file is desired for playing, the conference console may switch the video images at the user side to images for playing the local files, and send the video images for playing the local files to the MRS for broadcasting to all the participators.
  • At step 11, the conference console plays the local audio/video files through the soft phone terminal.
  • At step 12, if the conference console interrupts playing the audio/video files or the playing is completed, the conference console sends an instruction for stop to the conference application server.
  • At step 13, in order for the conference application server to recover the media resource used by the user in normal communication, the conference application server determines whether the media resource has been modified while playing the local audio/video files, and if so, proceed to steps 14-19 to recover the media resource for normal communication of the user; if not, proceed to step 20.
  • At step 14, the conference application server requests the MRS to recover the media resource allocated for the soft phone terminal.
  • At step 15, the conference application server requests the soft phone terminal to recover the media resource for normal communication.
  • At step 16, the MRS returns an answer message for recovering the media resource for normal communication to the conference application server.
  • At step 17, the soft phone terminal returns a response message for recovering the media resource for normal communication to the conference application server.
  • At step 18, upon receiving the answer message from the MRS, the conference application server sends an acknowledge message to the MRS.
  • At step 19, upon receiving the response message from the soft phone terminal, the conference application server sends an acknowledge message to the soft phone terminal.
  • At step 20, the conference application server stops charging for playing the local audio/video files.
  • At step 21, the conference console stops the function of audio mixing and switches the video images for playing local files to the conference video images for the user.
  • In the second embodiment, it is possible to use the existing media channel between the media resource server and the soft phone terminal (i.e. conference console) to transfer the media streams while playing the local audio/video files, since the conference console is provided with a function of soft phone and it has participated the conference as a soft phone terminal. Certainly, when the media resource occupied by the existing media channel cannot satisfy for playing the local audio/video files, it requires modifying the media resource allocated for the same media channel to meet the requirement for playing the local audio/video files.
  • It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing the spirit and the scope of the invention. Thus, it is intended that the present invention covers the modifications and variations of this invention provided they come within the scope of the appended claims.

Claims (12)

  1. A method for playing audio/video files stored in a conference console, which is applied to conference services in a next generation net work, comprising processes of:
    sending, by the conference console, a request for playing the audio/video files to a conference application server;
    determining (2), by the conference application server, whether there is an existing media channel between a media resource server and the conference console, and if so, using the existing media channel; if not, the conference application server requesting the media resource server to establish a new media channel between the media resource server and the conference console;
    converting, by the conference console, the format of media streams of the audio/video files into a format supported by the media resource server, and transferring, by the conference console, the converted media streams to the media resource server via the media channel; and
    playing (12), by the media resource server, the media stream information of the audio/video files to conference terminals.
  2. The method according to claim 1, wherein the process of establishing a new media channel between the media resource server and the conference console further comprises:
    allocating a virtual phone number for the conference console by the conference application server upon receiving the request for playing the audio/video files from the conference console;
    binding the virtual phone number with an IP address and a port number of the conference console and registering the bound virtual phone number, IP address and port number to a soft switch as a soft phone terminal, by the conference console;
    sending a request to the conference application server for admitting the soft phone terminal to a conference by the conference console; and
    the conference application server requesting the media resource server to admit the conference console as the soft phone terminal to the conference after authentication and establish the media channel between the media resource server and the conference console.
  3. The method according to the claim 2, further comprising processes of:
    sending (13), by the conference console, an instruction for stopping to the conference application server after the conference console interrupts playing the audio/video files or the playing is completed; and
    notifying (14), by the conference application server, in response to the instruction for stopping, the media resource server to release the media channel and withdrawing the current virtual phone number allocated for the conference console.
  4. The method according to the claim 1, further comprising
    if there is existing media channel between the conference resource server and the conference console, carrying, by the conference console, media resources required for playing the audio/video files in the request for playing the audio/video files to the conference application server;
    determining, by the conference application server, whether the existing media channel suffices the required media resources, and if so, using, by the conference application server, the existing media channel; if not, requesting, by the conference application server, the media resource server and the conference console to modify the media resources allocated for the existing media channel to the media resources required for playing the audio/video files.
  5. The method according to claim 4, further comprising processes of:
    the conference console sending a terminating playing instruction to notify the conference application server after completing playing the files or a user stops playing the files; and
    recovering the media resources to an original status before modifying if the media resource server and the conference console modify the media resources allocated for the media channel.
  6. The method according to claim 4, wherein the existing media channel between the media resource server and the conference console is a media channel established between the soft phone terminal and the media resource server.
  7. The method according to claim 6, wherein if the conference console is provided with a function of audio mixing, the conference console mixes the media streams of the audio/video files and user speeches and transfers the mixed media steams to the media resource server via the media channel.
  8. The method according to claim 1, further comprising the conference application server charging for playing the audio/video files.
  9. A system for playing audio/video files stored in a conference console in a communication network, comprising:
    a conference console configured to:
    send a request to a conference application server for playing the stored audio/video files,
    convert a format of media streams of the stored audio/video files into a format supported by a media resource server, and
    transfer the converted media streams to the media resource server via a media channel and ;
    a conference application server configured to:
    receive the request for playing audio/video files sent by the conference console;
    determine whether there is an existing media channel between the conference console and the media resource server, if so, using the existing media channel; otherwise, sending a request to the media resource server to establish a new media channel; and
    a media resource server configured to:
    establish a new media channel between the media resource server and the conference console in response to the request for establishing a new media channel from the conference application server,
    receive over the media channel the converted media streams of the audio/video files from the conference console, and
    broadcast the audio/video files to conference terminals.
  10. The system according to claim 9, wherein
    the conference application service is further configured to allocate a virtual phone number for the conference console upon receiving the playing request from the conference console;
    the conference console is further configured to bind the virtual phone number with an IP address and a port number of the conference console and register the bound virtual phone number, IP address and port number to a soft switch as a soft phone terminal, and further send a request to the conference application server for admitting the soft phone terminal to a conference; and
    the conference application server is further configured to request the media resource server to admit the conference console as the soft phone terminal to the conference after authentication and establish the media channel between the media resource server and conference console.
  11. The system according to claim 9, wherein the conference console is further configured to mix audio by mixing the media streams of the audio/video files and user speeches and transfer the mixed media streams to the media resource server via the media channel.
  12. A conference console comprising a component configured to:
    store audio/video files;
    send a request for playing the audio/video Files to a conference application server; convert the format of media streams of the stored audio/video files into a format supported by a media resource server; and
    transfer the converted media streams to the media resource server via a media channel between the media resource server and the conference console established by a request from the conference application server in response to the request by the conference console.
EP06014575A 2005-07-14 2006-07-13 Method and system for playing multimedia files Not-in-force EP1744517B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2005100839440A CN100479416C (en) 2005-07-14 2005-07-14 Audio/video document play-back method and system

Publications (2)

Publication Number Publication Date
EP1744517A1 EP1744517A1 (en) 2007-01-17
EP1744517B1 true EP1744517B1 (en) 2012-10-03

Family

ID=37020672

Family Applications (1)

Application Number Title Priority Date Filing Date
EP06014575A Not-in-force EP1744517B1 (en) 2005-07-14 2006-07-13 Method and system for playing multimedia files

Country Status (5)

Country Link
US (1) US20070038778A1 (en)
EP (1) EP1744517B1 (en)
CN (2) CN100479416C (en)
ES (1) ES2392858T3 (en)
WO (1) WO2007006201A1 (en)

Families Citing this family (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101202947B (en) * 2006-12-14 2011-01-05 中兴通讯股份有限公司 Method for realizing timing remind in a mobile network
CN101056320B (en) * 2007-05-29 2010-08-18 中兴通讯股份有限公司 A file transfer method and its system in the data meeting
CN101102211B (en) * 2007-07-09 2010-07-14 中兴通讯股份有限公司 A method for sharing the document in data conference and its system
CN101626482B (en) * 2008-07-11 2011-11-09 华为技术有限公司 Method, device and system for implementing video conference
CN101345630B (en) * 2008-08-15 2011-04-06 华为技术有限公司 Method and system for implementing virtual media function, and single plate server
US20100111101A1 (en) * 2008-11-06 2010-05-06 Verizon Business Network Service Inc. Method and system for managing content for access during a media session
CN101795391B (en) * 2010-04-15 2014-07-16 中兴通讯股份有限公司 Message playing method used for video conference and video conference system
CN102447875A (en) * 2010-09-30 2012-05-09 中兴通讯股份有限公司 Method and system for centralized monitoring of video session terminals and relevant devices
US8156239B1 (en) 2011-03-09 2012-04-10 Metropcs Wireless, Inc. Adaptive multimedia renderer
CN102158615B (en) * 2011-04-12 2013-07-10 迈普通信技术股份有限公司 LINUX-based media server in (Voice Over Internet Protocol) system and playback method of media server
CN102394991B (en) * 2011-09-28 2017-04-19 中兴通讯股份有限公司 Method and system for realizing sound playing for assembly room in multimedia meeting business
US10250939B2 (en) 2011-11-30 2019-04-02 Elwha Llc Masking of deceptive indicia in a communications interaction
US20130139256A1 (en) * 2011-11-30 2013-05-30 Elwha LLC, a limited liability corporation of the State of Delaware Deceptive indicia profile generation from communications interactions
US9378366B2 (en) 2011-11-30 2016-06-28 Elwha Llc Deceptive indicia notification in a communications interaction
US9965598B2 (en) 2011-11-30 2018-05-08 Elwha Llc Deceptive indicia profile generation from communications interactions
US9832510B2 (en) 2011-11-30 2017-11-28 Elwha, Llc Deceptive indicia profile generation from communications interactions
US8934383B1 (en) * 2012-02-22 2015-01-13 West Corporation Internet SIP registration/proxy service for audio conferencing
CN103780868A (en) * 2012-10-23 2014-05-07 中兴通讯股份有限公司 Data transmission method based on spatial position, controller and equipment
TWI672690B (en) * 2018-03-21 2019-09-21 塞席爾商元鼎音訊股份有限公司 Artificial intelligence voice interaction method, computer program product, and near-end electronic device thereof
CN110401809B (en) * 2018-04-25 2021-06-29 视联动力信息技术股份有限公司 Method and device for forcibly stopping video networking conference
CN111526145B (en) * 2020-04-24 2022-04-08 广州华多网络科技有限公司 Method, device, system, equipment and storage medium for audio transmission feedback
CN113612759B (en) * 2021-07-29 2024-02-13 世邦通信股份有限公司 High-performance high-concurrency intelligent broadcasting system based on SIP protocol and implementation method
CN114520687B (en) * 2022-02-17 2023-11-03 深圳震有科技股份有限公司 Audio data processing method, device and equipment applied to satellite system

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU5027200A (en) * 1999-05-20 2000-12-12 Intensifi, Inc. Method and apparatus for access to, and delivery of, multimedia information
US6782412B2 (en) * 1999-08-24 2004-08-24 Verizon Laboratories Inc. Systems and methods for providing unified multimedia communication services
US6671262B1 (en) * 1999-12-30 2003-12-30 At&T Corp. Conference server for automatic x-way call port expansion feature
GB2363543A (en) 2000-06-12 2001-12-19 Witchity Dev Ltd Making voice calls in a data network
JP2002111663A (en) * 2000-09-28 2002-04-12 Nippon Telegraph & Telephone West Corp Electronic conference system and information distribution method therein
US6976055B1 (en) * 2001-01-18 2005-12-13 Cisco Technology, Inc. Apparatus and method for conducting a transfer of a conference call
US20030014488A1 (en) * 2001-06-13 2003-01-16 Siddhartha Dalal System and method for enabling multimedia conferencing services on a real-time communications platform
US7103644B1 (en) * 2001-06-29 2006-09-05 Bellsouth Intellectual Property Corp. Systems for an integrated data network voice-oriented service and non-voice-oriented service converged creation and execution environment
TW567726B (en) * 2002-06-12 2003-12-21 Syshubs Global Service Inc Method and system providing remote conference between at least two parties
US7451207B2 (en) * 2002-06-28 2008-11-11 Intel Corporation Predictive provisioning of media resources
US20040006595A1 (en) * 2002-07-03 2004-01-08 Chiang Yeh Extended features to conferencing system using a web-based management interface
NZ520986A (en) * 2002-08-23 2005-04-29 Ectus Ltd Audiovisual media encoding system
JP2004336388A (en) * 2003-05-07 2004-11-25 Chie Sosha:Kk Electronic conference system
US8659636B2 (en) * 2003-10-08 2014-02-25 Cisco Technology, Inc. System and method for performing distributed video conferencing
US7460493B1 (en) * 2004-07-22 2008-12-02 Sprint Communications Company L.P. Video conferencing system with dynamic call management and set-up

Also Published As

Publication number Publication date
EP1744517A1 (en) 2007-01-17
CN100571367C (en) 2009-12-16
CN1852219A (en) 2006-10-25
WO2007006201A1 (en) 2007-01-18
US20070038778A1 (en) 2007-02-15
ES2392858T3 (en) 2012-12-14
CN100479416C (en) 2009-04-15
CN101164338A (en) 2008-04-16

Similar Documents

Publication Publication Date Title
EP1744517B1 (en) Method and system for playing multimedia files
JP4819923B2 (en) Session setting protocol based early media service providing method and session setting protocol based early media service providing application server
US9787844B2 (en) Conference bridge server
CN110012366B (en) Wide-narrow band converged communication system and method used under public and private network IP interconnection
WO2013163951A1 (en) Method, server, user terminal, and system for data presentation in multi-person conversation
WO2009052746A1 (en) A method for initiating conferences, an application service proxy, a conference server and system
US8311201B2 (en) Method and system for controlling a conference
US6522645B1 (en) Computer telephony integration system and operation method therein
WO2011109972A1 (en) Method and system for implementing multimedia conference
CN101090417A (en) Method and system for constructing multimedium calling centre on gateway by parlay
US9531883B2 (en) Providing an announcement for a multiparty communication session
KR101589195B1 (en) METHOD AND APPARATUS FOR SEAMLESSlY IMPLEMENTING TRNASFERRING DUAL-PARTY CALL INTO CONFERENCE
WO2009065308A1 (en) A method and apparatus for calling user to join conference
US20090299735A1 (en) Method for Transferring an Audio Stream Between a Plurality of Terminals
US8149741B2 (en) Apparatus and method for asymmetrical conferencing between local and external transceivers
EP2204945B1 (en) Method, device and system of creating conference and conference operating
EP2019557A1 (en) Method and apparatus for implementing multi-party communication
JP3765014B2 (en) System architecture for linking packet-switched and circuit-switched clients
CN102118354A (en) Call center cooperative implementation method and call center cooperative system
WO2006081728A1 (en) A method and system for implementing the present speaker up-reporting in the meeting place
WO2016183774A1 (en) Call recording method, device and system
US20070268891A1 (en) Method and entities for providing call enrichment of voice calls and semantic combination of several service sessions to a virtual combined service session
CN108632476B (en) PSTN-fused mobile internet voice platform system and communication method thereof
WO2012152116A1 (en) Call forwarding method and system and web server

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK YU

17P Request for examination filed

Effective date: 20070516

AKX Designation fees paid

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

17Q First examination report despatched

Effective date: 20090610

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: AT

Ref legal event code: REF

Ref document number: 578435

Country of ref document: AT

Kind code of ref document: T

Effective date: 20121015

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602006032219

Country of ref document: DE

Effective date: 20121129

REG Reference to a national code

Ref country code: SE

Ref legal event code: TRGR

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2392858

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20121214

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 578435

Country of ref document: AT

Kind code of ref document: T

Effective date: 20121003

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121003

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20121003

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121003

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130203

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121003

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121003

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121003

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130204

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130104

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121003

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121003

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121003

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121003

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121003

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121003

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121003

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130103

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121003

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121003

26N No opposition filed

Effective date: 20130704

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602006032219

Country of ref document: DE

Effective date: 20130704

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121003

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20140331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130731

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130713

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20140611

Year of fee payment: 9

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FI

Payment date: 20140710

Year of fee payment: 9

Ref country code: DE

Payment date: 20140709

Year of fee payment: 9

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: SE

Payment date: 20140711

Year of fee payment: 9

Ref country code: GB

Payment date: 20140709

Year of fee payment: 9

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121003

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130713

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20060713

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602006032219

Country of ref document: DE

REG Reference to a national code

Ref country code: SE

Ref legal event code: EUG

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20150713

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20150713

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160202

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20150713

Ref country code: SE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20150714

REG Reference to a national code

Ref country code: ES

Ref legal event code: FD2A

Effective date: 20160826

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20150714