EP1662821B1 - Method and System For Filtering Wavetable Information for Wireless Devices - Google Patents

Method and System For Filtering Wavetable Information for Wireless Devices Download PDF

Info

Publication number
EP1662821B1
EP1662821B1 EP04106055A EP04106055A EP1662821B1 EP 1662821 B1 EP1662821 B1 EP 1662821B1 EP 04106055 A EP04106055 A EP 04106055A EP 04106055 A EP04106055 A EP 04106055A EP 1662821 B1 EP1662821 B1 EP 1662821B1
Authority
EP
European Patent Office
Prior art keywords
wavetable
samples
wireless device
metadata
instrument
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP04106055A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP1662821A1 (en
Inventor
Connor O'rourke
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BlackBerry Ltd
Original Assignee
Research in Motion Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Research in Motion Ltd filed Critical Research in Motion Ltd
Priority to EP04106055A priority Critical patent/EP1662821B1/en
Priority to DE602004016351T priority patent/DE602004016351D1/de
Priority to AT04106055T priority patent/ATE407529T1/de
Priority to CA002527066A priority patent/CA2527066C/en
Publication of EP1662821A1 publication Critical patent/EP1662821A1/en
Priority to HK06111298A priority patent/HK1090787A1/xx
Application granted granted Critical
Publication of EP1662821B1 publication Critical patent/EP1662821B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/18—Selecting circuits
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/0033—Recording/reproducing or transmission of music for electrophonic musical instruments
    • G10H1/0041—Recording/reproducing or transmission of music for electrophonic musical instruments in coded form
    • G10H1/0058—Transmission between separate instruments or between individual components of a musical system
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H7/00—Instruments in which the tones are synthesised from a data store, e.g. computer organs
    • G10H7/02—Instruments in which the tones are synthesised from a data store, e.g. computer organs in which amplitudes at successive sample points of a tone waveform are stored in one or more memories
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2240/00—Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
    • G10H2240/121—Musical libraries, i.e. musical databases indexed by musical parameters, wavetables, indexing schemes using musical parameters, musical rule bases or knowledge bases, e.g. for automatic composing methods
    • G10H2240/145—Sound library, i.e. involving the specific use of a musical database as a sound bank or wavetable; indexing, interfacing, protocols or processing therefor
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2240/00—Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
    • G10H2240/171—Transmission of musical instrument data, control or status information; Transmission, remote access or control of music data for electrophonic musical instruments
    • G10H2240/201—Physical layer or hardware aspects of transmission to or from an electrophonic musical instrument, e.g. voltage levels, bit streams, code words or symbols over a physical link connecting network nodes or instruments
    • G10H2240/241—Telephone transmission, i.e. using twisted pair telephone lines or any type of telephone network
    • G10H2240/251—Mobile telephone transmission, i.e. transmitting, accessing or controlling music data wirelessly via a wireless or mobile telephone receiver, analogue or digital, e.g. DECT, GSM, UMTS
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2240/00—Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
    • G10H2240/171—Transmission of musical instrument data, control or status information; Transmission, remote access or control of music data for electrophonic musical instruments
    • G10H2240/281—Protocol or standard connector for transmission of analog or digital data to or from an electrophonic musical instrument
    • G10H2240/295—Packet switched network, e.g. token ring
    • G10H2240/305—Internet or TCP/IP protocol use for any electrophonic musical instrument data or musical parameter transmission purposes

Definitions

  • This invention relates to the field of wavetable information, and more specifically, to filtering wavetable information prior to downloading to a wireless device.
  • Wireless mobile communication devices include microprocessors, memory, soundcards, and run one or more software applications. Examples of software applications used in these wireless devices include micro-browsers, address books, email clients, and wavetable instruments. Additionally, wireless devices have access to a plurality of services via the Internet.
  • a wireless device may, for example, be used to browse web sites on the Internet, to transmit and receive graphics, and to execute streaming audio and/or video applications.
  • the transfer of Internet content to and from wireless device is typically facilitated by the Wireless Application Protocol ("WAP"), which integrates the Internet and other networks with wireless network platforms.
  • WAP Wireless Application Protocol
  • a wavetable instrument is an application that digitally models a real instrument (e.g., a piano, etc.) using information from a wavetable file.
  • a waveable instrument may allow a user to "play" songs by depressing one or more keyboard keys, etc., thus providing interactive audio.
  • the content of the wavetable file includes captured audio samples of the instrument combined with various configuration settings in order to provide an approximation of the sound of the instrument at any note or pitch.
  • Downloadable wavetable content is wavetable content stored in a file having a specific file format that can be downloaded to a user system, such as a wireless device or personal computer, for storage in system memory or in the memory of the system's soundcard or audio synthesizer.
  • downloadable wavetable content can be used for applications such as music for games, web pages, and polyphonic ringtones.
  • Downloadable wavetable content can provide consistent sounding audio across all platforms while requiring only a fraction of the storage resources required by other audio files such as MP3s. Examples of downloadable wavetable data file formats include the Downloadable Sounds (“DLS”) file format from the Musical Instruments Digital Interface (“MIDI”) Manufacturers Association and the SoundFont® file format from Creative Labs, Inc.
  • DLS Downloadable Sounds
  • MIDI Musical Instruments Digital Interface
  • SoundFont® file format from Creative Labs, Inc.
  • wavetable content may be downloaded from a network such as the Internet by a wireless device for playback through a wavetable instrument application via the device's soundcard or audio synthesizer.
  • one shortcoming of present wireless devices and wireless communications systems is their inability to efficiently download such wavetable content to wireless devices. For example, optimizing the size and level of detail when creating wavetable instruments that are to be downloaded via network communications onto a push-enabled wireless device cannot be done in advance because capabilities of different wireless devices vary and the amount of resources (e.g., flash memory, remaining carrier-enforced data limits, etc.) available is limited and constantly changing due to the arrival of new messages, calendar appointments, etc. The need to efficiently download wavetable content is increasing in importance with the increase in the number of applications being run on wireless devices.
  • resources e.g., flash memory, remaining carrier-enforced data limits, etc.
  • EP-A-1251488 discloses a system for downloading music data as content distribution data from a distribution centre via the general telephone network into mobile telephones. Downloaded content distribution data are stored in a memory of a mobile telephone.
  • US2004/0044781 discloses a service provider network including a memory for storing subscriber information of a subscriber device and a data engine for receiving a generic data request from the subscriber device.
  • the network includes an intelligent proxy server for receiving the data from the data engine in response to a subscriber device request, manipulating or filtering the data as a function of the subscriber information to thin the content of the data, and outputting the filtered data to the subscriber device.
  • US6525256 describes a method of compressing MIDI files on a computer.
  • the computer is directly coupled to an appliance, such as mobile phone, via a cable.
  • the method comprises the steps of: converting the MIDI file to a reduced format; reducing the number of MIDI instruments from as many as 128 to 16; reducing multiple events with a single event; determining the reproduction characteristics of the target mobile phone; the optional step of re-centring (adjusting) the notes to account for notes in the MIDI file that cannot by reproduced on the mobile pHone, the re-centred notes being capable of reproduction on the phone; and the optional step of reducing polyphony, i.e. more than one note being reproduced at the same time, if the reproduction capabilities of the mobile phone are insufficient for reproducing the multiple sounds.
  • a method in a proxy server for providing wavetable information to a wireless device from a content server over a wireless network comprising a plurality of samples corresponding to a plurality of notes
  • the method comprising: in response to a request from the wireless device, receiving at the proxy server the wavetable information from the content server; filtering the wavetable information in accordance with a selection of samples usable by a wavetable instrument on the wireless device contained in the request; and, transmitting the filtered wavetable information for the wavetable instrument to the wireless device.
  • the method further comprises the proxy server receiving a request for metadata for the wavetable information from the wireless device, the metadata comprising sample sizes for the samples.
  • the method further comprises, in response to the request for metadata, the proxy server transmitting the metadata to the wireless device.
  • the method further comprises the proxy server receiving the metadata from the content server.
  • the method further comprises the proxy server extracting the metadata from the wavetable information.
  • the wireless device is adapted for calculating a desired number of samples for the selection of samples from a maximum of the sample sizes and an amount of available memory in the wireless device.
  • the wireless device is further adapted for determining the selection of samples by forming groups of notes based on spacings between the notes, allocating one of the desired number of samples to each group, and selecting a sample for the notes in each group that corresponds to a note at a midpoint of the group to reduce distortion.
  • a method for providing wavetable information to a wireless device from a content server over a wireless network comprising: in response to a request from the wireless device, receiving at a proxy server the wavetable information from the content server; filtering the wavetable information in accordance with an amount of available memory in the wireless device as contained in the request; and, transmitting the filtered wavetable information to the wireless device.
  • the filtering further comprises calculating a desired number of samples from a maximum of the sample sizes and the amount of available memory in the wireless device.
  • the filtering further comprises determining a selection of samples by forming groups of notes in accordance with spacings between the notes, allocating one of the desired number of samples to each group, and selecting a sample for the notes in each group that corresponds to a note at a midpoint of the group to reduce distortion.
  • FIG. 1 is a block diagram illustrating a proxy server system adapted for implementing an embodiment of the invention
  • FIG. 2 is a block diagram illustrating a wireless communications system adapted for implementing an embodiment of the invention
  • FIG. 3 is a flow chart illustrating operations of modules within the wireless communications system and wireless device for filtering wavetable content in accordance with an embodiment of the invention
  • FIG. 4 is a block diagram illustrating a wavetable instrument (e.g., a piano) containing a single keysplit region over a two octave range in accordance with an embodiment of the invention
  • FIG. 5 is a block diagram illustrating a wavetable instrument containing two keysplit regions over a two octave range in accordance with an embodiment of the invention
  • FIG. 6 is a block diagram illustrating a wavetable instrument containing two keysplit regions over a two octave range in accordance with an embodiment of the invention
  • FIG. 7 is a block diagram illustrating a wavetable instrument containing two keysplit regions having ranges that span the notes starting at the D note of the first octave through the A note of the second octave in accordance with an embodiment of the invention
  • FIG. 8 is a block diagram illustrating a wavetable instrument containing two keyplit regions having ranges that span two disjoint subsets of notes starting at the D note of the first octave through the A note of the second octave in accordance with an embodiment of the invention
  • FIG. 9 is a flow chart illustrating operations of modules within the wireless communications system for determining keysplit regions and associated samples for a wavetable instrument in accordance with an embodiment of the invention.
  • FIG. 10 is a flow chart illustrating operations of modules within the wireless communications system for adjusting the keysplit regions and associated samples in accordance with an embodiment of the invention
  • FIG. 11 is a block diagram illustrating an exemplary wireless device adapted in accordance with an embodiment of the invention.
  • FIG. 12 is a block diagram illustrating a memory of the wireless device of FIG. 11 in accordance with an embodiment of the invention.
  • the following detailed description of the embodiments of the present invention does not limit the implementation of the invention to any particular computer programming language.
  • the present invention may be implemented in any computer programming language provided that the operating system ("OS") provides the facilities that may support the requirements of the present invention.
  • a preferred embodiment is implemented in the JAVATM computer programming language (or other computer programming languages such as C or C++). (JAVA and all JAVA-based trademarks are the trademarks of Sun Microsystems Corporation.) Any limitations presented would be a result of a particular type of operating system or computer programming language and would not be a limitation of the present invention.
  • the present invention is directed to resource availability problems such as may be encountered when downloading wavetable information onto a wireless device for use with audio playback applications.
  • Wavetable data files are generally considered to be compact when compared to alternative audio formats.
  • the files may contain compact disc ("CD") quality samples, while the wireless device hardware may not be capable of CD quality audio output. The size and detail of the samples in this case would be wasteful.
  • CD compact disc
  • Embodiments of the invention provide a method for a mobile wireless device to request a remote proxy server to download and filter out samples from a wavetable data file available from a content server. Requesting a proxy server to perform the filtering is a more economical use of the wireless device's airtime.
  • the wavetable data file transferred from the proxy to the device in accordance with the invention is typically smaller than if that same wavetable data file was downloaded directly from the content server.
  • the filtering is performed based on information regarding which samples should be kept in the wavetable instrument (the rest are filtered out). This information is calculated by the wireless device or client based on variables such as the desired maximum size of a resulting wavetable instrument and which MIDI instructions will be used by the wireless device to play the wavetable instrument. Knowing which MIDI data will be used to drive the instrument allows for efficient filtering for the instrument in order to retain as much audio quality as possible.
  • the download process can be automated. For example, if a user downloads a game, the game application can follow up by automatically downloading wavetable content to be used for the game's background music upon the first run of the application.
  • the download process can be interactive. For example, a user may wish to download a wavetable instrument that will be used to generate the sound for a specific set of MIDI/SP-MIDI ringtones. If the wavetable data file to be downloaded is one specified by a user, very little interaction is required in the download process. The user specifies the remote location of the wavetable data file desired for download and a set of MIDI files which will be used to play the wavetable instrument.
  • the present invention provides an automated method of reducing the size of a wavetable data file at runtime without manual editing.
  • a user if a user wishes to reduce the size of a wavetable file, the user would have to download the entire file and manually edit the resource file using editing software. Not only is downloading the entire file before local editing uneconomical, it is not a trivial task as it requires knowledge of the specific file format and how wavetables operate.
  • FIG. 1 is a block diagram illustrating a proxy server system 100 adapted for implementing an embodiment of the invention.
  • the proxy server system 100 includes an input device 110, a central processing unit or CPU 120, memory 130, a display 140, and an interface 150.
  • the input device 110 may include a keyboard, mouse, trackball, remote control, or similar device.
  • the CPU 120 may include dedicated coprocessors and memory devices.
  • the memory 130 may include RAM, ROM, or disk devices.
  • the display 140 may include a computer screen, terminal device, or a hardcopy producing output device such as a printer or plotter.
  • the interface 150 may include a network connection including an Internet connection.
  • the proxy server 100 is adapted for filtering and downloading wavetable information to wireless devices 210 over a wireless network 220 (see FIG. 2 ).
  • the proxy server system 100 may be a server system or a personal computer ("PC") system.
  • the CPU 120 of the system 100 is operatively coupled to memory 130 which stores an operating system (not shown), such as IBM Corporation's OS/2TM, UNIX, etc., for general management of the system 100.
  • the interface 150 may be used for communicating to external data processing systems 230, 250 through a network 240 (see FIG. 2 ), such as the Internet. Examples of suitable platforms for the proxy server system 100 include iSeriesTM servers and ThinkCentreTM personal computers available from IBM Corporation.
  • the system 100 may include application server software (not shown), such as WebLogic® Server available from BEA Systems, Inc., for developing and managing distributed applications.
  • the proxy server system 100 may include a database system 160 for storing and accessing programming information.
  • the database system 160 may include a database management system ("DBMS") and a database and is stored in the memory 130 of the proxy server system 100.
  • DBMS database management system
  • the proxy server system 100 includes computer executable programmed instructions for directing the system 100 to implement the embodiments of the present invention.
  • the programmed instructions may be embodied in one or more software modules 170 resident in the memory 130 of the proxy server system 100.
  • the programmed instructions may be embodied on a computer readable medium (such as a CD disk or floppy disk) which may be used for transporting the programmed instructions to the memory 130 of the proxy server system 100.
  • the programmed instructions may be embedded in a computer-readable, signal-bearing medium that is uploaded to a network by a vendor or supplier of the programmed instructions, and this signal-bearing medium may be downloaded through the interface 150 to the proxy server system 100 from the network by end users or potential buyers.
  • the CPU 120 of the system 100 is typically coupled to one or more devices 110 for receiving user commands or queries and for displaying the results of these commands or queries to the user on a display 140.
  • the memory 130 may include a variety of storage devices including internal memory and external mass storage typically arranged in a hierarchy of storage as understood to those skilled in the art.
  • GUI 180 may be web-based and may be used for monitoring, managing, and accessing the proxy server system 100.
  • GUIs are supported by common operating systems and provide a display format which enables a user to choose commands, execute application programs, manage computer files, and perform other functions by selecting pictorial representations known as icons, or items from a menu through use of an input or pointing device such as a mouse 110.
  • a GUI is used to convey information to and receive commands from users and generally includes a variety of GUI objects or controls, including icons, toolbars, drop-down menus, text, dialog boxes, buttons, and the like.
  • a user typically interacts with a GUI 180 presented on a display 140 by using an input or pointing device (e.g., a mouse) 110 to position a pointer or cursor 190 over an object 191 and by "clicking" on the object 191.
  • an input or pointing device e.g., a mouse
  • a GUI based system presents application, system status, and other information to the user in "windows" appearing on the display 140.
  • a window 192 is a more or less rectangular area within the display 140 in which a user may view an application or a document. Such a window 192 may be open, closed, displayed full screen, reduced to an icon, increased or reduced in size, or moved to different areas of the display 140. Multiple windows may be displayed simultaneously, such as: windows included within other windows, windows overlapping other windows, or windows tiled within the display area.
  • FIG. 2 is a block diagram illustrating a wireless communications system 200 adapted for implementing an embodiment of the invention.
  • the wireless communications system 200 includes a wireless device 210 in communication with the proxy server system 100 over a wireless network 220.
  • the wireless network 220 is coupled to a wireless network gateway 230 which provides an interface to a wide area network (“WAN") 240 to which the proxy server 100 is coupled.
  • the proxy server 100 is also in communication with a content server system 250 over the WAN 240.
  • WAN wide area network
  • FIG. 11 is a block diagram illustrating an exemplary wireless device 210 adapted in accordance with an embodiment of the invention.
  • the wireless device 210 is a two-way communication device having at least voice and advanced data communication capabilities, including the capability to communicate with other computer systems. Depending on the functionality provided by device 210, it may be referred to as a data messaging device, a two-way pager, a cellular telephone with data messaging capabilities, a wireless Internet appliance, or a data communication device (with or without telephony capabilities).
  • Device 210 may communicate with any one of a plurality of fixed transceiver stations 220 within its geographic coverage area.
  • Device 210 will normally incorporate a communication subsystem 111, which includes a RF receiver, a RF transmitter, and associated components, such as one or more (preferably embedded or internal) antenna elements and, local oscillators ("LOs"), and a processing module such as a digital signal processor (“DSP”) (all not shown).
  • a communication subsystem 111 which includes a RF receiver, a RF transmitter, and associated components, such as one or more (preferably embedded or internal) antenna elements and, local oscillators (“LOs”), and a processing module such as a digital signal processor (“DSP”) (all not shown).
  • LOs local oscillators
  • DSP digital signal processor
  • Device 210 requires a Subscriber Identity Module (or "SIM" card) 162 to be inserted in a SIM IF 164 in order to operate in the network.
  • SIM Subscriber Identity Module
  • Device 210 is a battery-powered device so it also includes a battery IF 154 for receiving one or more rechargeable batteries 156. Such a battery 156 provides electrical power to most if not all electrical circuitry in device 210, and battery IF 154 provides for a mechanical and electrical connection for it.
  • the battery IF 154 is coupled to a regulator (not shown) which provides power V+ to all of the circuitry.
  • Device 210 includes a microprocessor 138 which controls overall operation of device 210. Communication functions, including at least data and voice communications, are performed through communication subsystem 111. Microprocessor 138 also interacts with additional device subsystems such as a display 122, a flash memory 124 or other persistent store, a random access memory (“RAM”) 126, auxiliary input/output (“I/O") subsystems 128, a serial port 131, a keyboard 132, a speaker 134, a microphone 136, a short-range communications subsystem 141, and any other device subsystems generally designated at 142. Some of the subsystems shown in FIG. 1 perform communication-related functions, whereas other subsystems may provide "resident" or on-device functions.
  • RAM random access memory
  • I/O auxiliary input/output
  • keyboard 132 and display 122 may be used for both communication-related functions, such as entering a text message for transmission over a communication network, and device-resident functions such as a calculator or task list.
  • Operating system software used by microprocessor 138 is preferably stored in a persistent store such as flash memory 124, which may alternatively be a read-only memory (“ROM”) or similar storage element (not shown).
  • flash memory 124 may alternatively be a read-only memory (“ROM”) or similar storage element (not shown).
  • ROM read-only memory
  • RAM 126 volatile store
  • Microprocessor 138 in addition to its operating system functions, preferably enables execution of software applications on device 210.
  • a preferred application that may be loaded onto device 210 may be a personal information manager (“PIM”) application having the ability to organize and manage data items relating to the user such as, but not limited to, instant messaging (“IM”), e-mail, calendar events, voice mails, appointments, and task items.
  • PIM personal information manager
  • IM instant messaging
  • SIM 162 to facilitate storage of PIM data items and other information.
  • the PIM application preferably has the ability to send and receive data items via the wireless network 220.
  • PIM data items are seamlessly integrated, synchronized, and updated via the wireless network, with the mobile station user's corresponding data items stored and/or associated with a host computer system thereby creating a mirrored host computer on device 210 with respect to such items. This is especially advantageous where the host computer system is the mobile station user's office computer system.
  • Additional applications may also be loaded onto device 210 through network 220, an auxiliary I/O subsystem 128, serial port 131, short-range communications subsystem 141, or any other suitable subsystem 142, and installed by a user in RAM 126 or preferably a non-volatile store (not shown) for execution by microprocessor 138.
  • Such flexibility in application installation increases the functionality of device 210 and may provide enhanced on-device functions, communication-related functions, or both.
  • secure communication applications may enable electronic commerce functions and other such financial transactions to be performed using device 210.
  • a received signal such as a text message, an e-mail message, or web page download will be processed by communication subsystem 111 and input to microprocessor 138.
  • Microprocessor 138 will preferably further process the signal for output to display 122 and/or to auxiliary I/O device 128.
  • a user of device 210 may also compose data items, such as e-mail messages, for example, using keyboard 132 in conjunction with display 122 and possibly auxiliary I/O device 128.
  • Keyboard 132 is preferably a complete alphanumeric keyboard and/or telephone-type keypad. These composed items may be transmitted over a communication network through communication subsystem 111 or short range communication subsystem 141.
  • the overall operation of device 210 is substantially similar, except that the received signals would be output to speaker 134 and signals for transmission would be generated by microphone 136.
  • Alternative voice or audio I/O subsystems such as a voice message recording subsystem, may also be implemented on device 210.
  • voice or audio signal output is preferably accomplished primarily through speaker 134, display 122 may also be used to provide an indication of the identity of a calling party, duration of a voice call, or other voice call related information, as some examples.
  • Serial port 131 in FIG. 11 is normally implemented in a personal digital assistant ("PDA")-type communication device for which synchronization with a user's desktop computer is a desirable, albeit optional, component.
  • Serial port 131 enables a user to set preferences through an external device or software application and extends the capabilities of device 210 by providing for information or software downloads to device 210 other than through a wireless communication network.
  • the alternate download path may, for example, be used to load an encryption key onto device 210 through a direct and thus reliable and trusted connection to thereby provide secure device communication.
  • Short-range communications subsystem 141 of FIG. 11 is an additional optional component which provides for communication between device 210 and different systems or devices, which need not necessarily be similar devices.
  • subsystem 141 may include an infrared device and associated circuits and components, or a BluetoothTM communication module to provide for communication with similarly-enabled systems and devices.
  • BluetoothTM is a registered trademark of Bluetooth SIG, Inc.
  • FIG. 12 is a block diagram illustrating a memory 201 of the wireless device 210 of FIG. 11 in accordance with an embodiment of the invention.
  • the memory 201 has various software components for controlling device 210.
  • Memory 201 may be flash memory 124, RAM 126 or a ROM (not shown), for example.
  • device 210 is intended to be a multi-tasking wireless communications device configured for sending and receiving data items and for making and receiving voice calls.
  • an operating system (“O/S”) 202 resident on device 210 provides a basic set of operations for supporting various applications typically operable through a graphical user interface ("GUI”) 204.
  • GUI graphical user interface
  • O/S 202 provides basic input/output system features to obtain input from Auxiliary I/O 108, keyboard 132 and the like and for facilitating output to the user.
  • software modules 206 for wavetable instrument applications as will be described below. Though not shown, one or more applications for managing communications or providing personal digital assistant like functions may also be included.
  • the wireless device 210 includes computer executable programmed instructions for directing the device 210 to implement the embodiments of the present invention.
  • the programmed instructions may be embodied in one or more software modules 206 resident in the memory 201 of the wireless device 210.
  • the programmed instructions may be embodied on a computer readable medium (such as a CD disk or floppy disk) which may be used for transporting the programmed instructions to the memory of the wireless device 210.
  • the programmed instructions may be embedded in a computer-readable, signal-bearing medium that is uploaded to a network by a vendor or supplier of the programmed instructions, and this signal-bearing medium may be downloaded through an interface 111, 131, 141 to the wireless device 210 from the network by end users or potential buyers.
  • the wireless device 210 has software modules for running client software for downloading wavetable data files.
  • This software may be a standalone application, browser plugin, etc.
  • the proxy server 100 runs wavetable data file filtering software.
  • the proxy server 100 handles requests from wireless clients 210, downloads wavetable data files from the content server 250, and filters the downloaded wavetable data files locally.
  • the proxy server 100 does not face the same memory and bandwidth constraints that the mobile devices 210 do.
  • the content server 250 is a remote machine that provides access to pre-created wavetable data files.
  • FIG. 3 includes flow charts illustrating operations 300, 400 of modules within a wireless device and proxy server system 210, 100, respectively, for downloading filtered wavetable content to the wireless devices 210 from the proxy server system 210 in accordance with an embodiment of the invention.
  • the operations 300 start.
  • a query message 301 is sent from the wireless device 210 to the proxy server 100 requesting a description of the required wavetable data file.
  • a description message 302 is received from the proxy server 100.
  • This description, or metadata typically contains information pertaining to the instrument(s) in the file and details with respect to the size, notes, etc., of the samples in the wavetable instrument (s) .
  • step 320 if there is more than one wavetable instrument in the data file, then a choice is made as to which instruments in the wavetable data file should be contained in the filtered data file.
  • the "instrument slot(s)" are chosen for the wavetable instrument(s) that will be loaded into the wireless device's hardware or software synthesizer's memory. These correspond to a MIDI instrument program number also referred to as a "patch”.
  • step 350 using the information regarding the desired maximum size of each wavetable instrument, and the previously queried metadata, a determination is made as to how many samples each wavetable instrument will contain. This is performed by using the size of the largest sample in the instrument and calculating how many samples of that size can be included such that they are below the desired maximum size. The result is a good estimate, as in most cases all the samples within a source wavetable instrument will be approximately the same size. If there are significant differences in the sizes of samples contained in the source wavetable instrument, performing the estimate as if every sample is as large as the largest sample ensures that no underestimate of the combined size of the samples that will be chosen in the selection process of step 360. Underestimating could result in downloading a filtered wavetable instrument that is larger than the desired maximum.
  • step 360 using the number of desired samples for each wavetable instrument, and the set of MIDI notes that will be used to play the instrument (see step 330 above), a determination is made as to which samples are to be filtered out.
  • the filtering algorithm is described in more detail below.
  • step 370 information regarding which instruments the returned wavetable data file is to contain and which samples these instruments are to include is sent to the proxy server 100 as a request to filter the wavetable data file message 303.
  • steps 380 operations 300 end with the return of filtered wavetable data 304 from the proxy server 100.
  • step 410 the operations 400 start.
  • a request 301 is received from the wireless device for metadata.
  • step 420 metadata is downloaded to the proxy server 100 from the content server 250. If there is no metadata to download, then the wavetable data file is downloaded to the proxy server 100 from the content server 250 and the metadata is extracted from it.
  • the metadata 302 is sent to the client 210.
  • a request 303 to filter a wavetable data file is received by the proxy server 100 from the client wireless device 210.
  • the wavetable data file obtained is filtered, if necessary, and the resulting filtered file 304 is sent to the client 210. As will be described below, how this is accomplished depends on the wavetable data file format that is to be filtered.
  • MIDI Musical Instrument Digital Interface
  • the MIDI protocol is an entire music description language in binary form. Each word describing an action of musical performance is assigned a specific binary code. To sound a note in the MIDI protocol a "Note On” message is sent followed by an assigned “Velocity” which determines how loud the note will play.
  • Other MIDI messages include selecting which instrument to play, mixing and panning sounds, and controlling various aspects of electronic musical instruments.
  • MIDI messages When MIDI messages are stored on disk, they are commonly saved in the Standard MIDI file format, which is slightly different from the native MIDI protocol, because the events are also time-stamped for playback in the proper sequence. Music delivered by MIDI files is the most common use of MIDI today. MIDI is the primary source of music in many popular PC games and CD-ROM entertainment titles, and thousands of MIDI files are available on the Internet for recreational use. Just about every personal computer is now equipped to play Standard MIDI files.
  • MIDI files are very much smaller than digital audio files, and the events are also editable, allowing the music to be rearranged, edited, even composed interactively, if desired.
  • the Downloadable Sounds (“DLS”) format allows MIDI files to be combined with standardized samples of musical instruments, sound effects, or even dialogue, to recreate a copy of the sound intended by the composer.
  • MIDI files with DLS are one solution for composers who want the predictable playback of digital audio, but also need the compactness and/or interactivity of Standard MIDI files for delivering their music.
  • DLS provides a means for game developers and composers to add their own custom sounds to the General MIDI ("GM") sound set (e.g., a list of sound names or "patches") stored in a sound card's ROM.
  • GM General MIDI
  • DLS-compatible devices generally download these custom sounds from card, disk or CD-ROM into system RAM, allowing MIDI music to be freely augmented with new instrument sounds, dialog or special effects thus providing a universal interactive playback experience, along with an enhanced palette of sounds.
  • GM General MIDI
  • GM General MIDI
  • the DLS file format generally follows the standard Microsoft® RIFF layout (with a form type of "DLS"), utilizing chunks and sub-chunks and incorporating standard WAVE files.
  • the DLS file format is used to store both the digital sound data and articulation parameters needed to create one or more instruments.
  • An instrument contains "regions" which point to WAVE files or samples also embedded in the DLS file. Each region specifies a MIDI note and velocity range which will trigger the corresponding sound and also contains articulation information such as envelopes and loop points. Articulation information can be specified for each individual region or for the entire instrument.
  • the flexible file structure utilized by DLS means that a single sample may serve as different regions within different instruments. For example, a given sample can serve as region “1b" for instrument "1" while at the same time acting as region "2a” for instrument "2.”
  • any transposing, or pitch shifting, used to reproduce tones for which there is no corresponding sample in the wavetable instrument's sample set will introduce some distortion of the timbres. Just how much distortion is determined by the number of samples included in the wavetable instrument, as well as the notes corresponding to those samples.
  • Each keysplit region has an assigned sample which can be pitch shifted to reproduce all notes within the region. Having multiple keysplit regions and samples helps limit distortion as the pitch shifts required are not as large. That is, pitch shifting of a particular sample is limited to a specific range of notes. As an example of how the number of samples affects distortion, consider FIG. 4 .
  • FIG. 4 is a block diagram illustrating a wavetable instrument 460 (e.g., a piano) containing a single keysplit region 470 over a two octave range 480 in accordance with an embodiment of the invention.
  • the sample 490 for the keysplit region 470 is of a sound that has the same pitch as the C note of the first octave. The further away a particular MIDI note X is from the C note of the sample 490, the more pitch shifting that will be required to play note X , and thus the more distorted it will be.
  • FIG. 5 is a block diagram illustrating a wavetable instrument 500 containing two keysplit regions 510, 520 over a two octave range 530, 540 in accordance with an embodiment of the invention.
  • the sample 550 for region 1 510 is of a sound that has the same pitch as the C note of the first octave
  • the sample 560 for region 2 520 is of a sound that has the same pitch as the D note of the first octave. Since there is more than one sample that can be shifted, the sample whose note is closest to the MIDI note X that is to be played can be pitch shifted, thus reducing the distortion when playing certain notes. That is, the notes starting from D in the first octave and above will all be less distorted when played on the wavetable instrument 500 of FIG. 5 than when played on the wavetable instrument 460 of FIG. 4 .
  • FIG. 6 is a block diagram illustrating a wavetable instrument 600 containing two keysplit regions 610, 620 over a two octave range 630, 640 in accordance with an embodiment of the invention.
  • the keysplit regions 610, 620 and samples 650, 660 are distributed evenly over the range 630, 640.
  • the wavetable instrument 600 of FIG. 6 is arranged so that the amount of pitch shifting required in playing the C note of the second octave is reduced.
  • the largest pitch shift required to play any of the notes is 6 semitones compared to a largest pitch shift of 21 semitones for the wavetable instrument 500 of FIG. 5 .
  • a good distribution of keysplit regions with samples includes an even distribution.
  • a wavetable instrument will be used to play a specific set of notes, it can be further optimized.
  • a method for determining an optimized set of keysplits and samples for playback of a particular set of notes and a method of adapting this optimized set to fit the content contained in a pre-existing wavetable instrument will be described. These methods allow for the filtering out of the M samples that are least helpful with respect to playback quality.
  • a set of notes that will be played using the wavetable instrument, and knowing the number N of samples to be contained in the resulting wavetable instrument, creating an optimal balance of size and detail includes the following steps. First, a determination is made as to the preferred N keysplit regions and associated preferred samples that the resulting wavetable instrument should contain in order to have the highest quality playback of the set of notes that will be used to drive the wavetable instrument. By preferred samples it is meant the samples that would be desired if a sample of every note was available to choose from. Second, an adjustment is made to the preferred model to fit the samples contained in the wavetable instrument to be filtered. Typically, the available samples will not contain a sample for every corresponding MIDI note.
  • the method of determining the preferred splits and samples includes the following steps.
  • the largest gaps between consecutive MIDI notes is found. For example, if the list of notes contains MIDI note 60 (middle C) and MIDI note 63 (D#) without having notes 61 or 62 in the list, then the gap between them is of magnitude 2.
  • the set of MIDI notes should be subdivided into subsets, up to a maximum of N subsets, where each subset would be made its own keysplit region and would have its own sample, or whether evenly divided keysplits and evenly distributed samples should be created.
  • a gap is sufficiently large so that it should be subdivided when the magnitude of the gap is greater than half the distance spanned by the range of MIDI notes to the left of the gap, or greater than half the distance spanned by the range of MIDI notes to the right of the gap. This is so because in these cases, dividing and isolating into subsets and assigning samples to each subset would result in the MIDI notes being closer to a sample than they would be had a even distribution been chosen. For example, compare the wavetable instruments shown in FIGS. 7 and 8 .
  • FIG. 7 is a block diagram illustrating a wavetable instrument 700 containing two keysplit regions 710, 720 having ranges 730, 740 that span the notes starting at the D note of the first octave through the A note of the second octave in accordance with an embodiment of the invention.
  • the keysplit regions 710, 720 and samples 750, 760 are distributed evenly over the ranges 730, 740.
  • FIG. 8 is a block diagram illustrating a wavetable instrument 800 containing two keyplit regions 810, 820 having ranges 830, 840 that span two disjoint subsets of notes starting at the D note of the first octave through the A note of the second octave in accordance with an embodiment of the invention.
  • the grey shaded keys 770, 870 represent notes that are contained in the desired list of MIDI notes.
  • the N largest gaps can be checked, and if each gap is large enough, the MIDI notes to the left of the gap can be isolated from those to the right of the gap. This will in essence provide a method to create keysplit regions. That is, those to the left of the gap will be contained in their own keysplit region, as will those to the right of the gap. If at each iteration it is determined that the largest gap is within a keysplit region created in one of the previous iterations, that keysplit region can also be subdivided into two new keysplit regions. At this point, specific samples for these keysplit regions are not being chosen. Rather, a sample is being granted to each region. This basically means that the value of a "pending sample count" variable for each region is being set to 1. This is done because, in the following step, any remaining samples will be granted to some of the regions, and how many samples a region has will affect which samples are chosen.
  • N is greater than the number of keysplit regions created in the previous step, then it will be repeatedly determined which of the keysplit regions should be granted an additional sample (i.e., a "pending sample count” variable for that region will be incremented) until there are no more samples left to grant.
  • a sample is granted to the region with the largest distance between an endpoint note and the nearest sample note if the region's "pending sample count" number of samples have already been distributed evenly.
  • the regions with more than one sample granted to them will be subdivided evenly. Once the final set of keysplit regions is obtained, the preferred sample note for each region will be the region's midpoint note.
  • an initialization phase can be used to perform tasks such as arranging the input MIDI data and source wavetable data into data structures that can be used to access information quickly.
  • a data structure can be used to maintain information regarding the distance between consecutive MIDI notes (gaps).
  • a tie breaker algorithm may be used to determine which of those gaps is the one to be processed next.
  • An example may be to assign a greater priority to the gap that is contained in the region that has the most notes.
  • the preferred model calculated using the method described above can be adjusted to fit the samples available in the source wavetable instrument. This is performed by realigning the preferred keysplit regions and samples in order to derive a wavetable instrument that is the best quality given the source wavetable content that is available. Once the preferred model is adjusted, so that the finalized keysplit regions and samples are selected, the samples that are remaining are implicitly filtered out.
  • the method of adjusting the preferred model involves the following steps.
  • the list of samples to be chosen from is narrowed. It can be known ahead of time whether some samples will never be chosen in the sample selection process. This is particularly true for samples whose note values are significantly less than the lowest note in the range of MIDI notes that will be used to play the wavetable instrument, and those whose note values are significantly higher. Choosing which samples should be included in the selection process can be performed as follows. If there are no samples within the MIDI note range, there are at most two samples that will be selected from, namely, the closest sample to the left of the range (if any) and the closest sample to the right (if any). If there are samples within the MIDI note range, it may still be desirable to include with them some samples from outside of the range in the selection process.
  • the left most and right most samples within the range are found.
  • the distance from the left end of the range to the leftmost sample within the range, minus one, is how far to the left of the note range that will be included in the search for samples. The same operation is performed with respect to the right side.
  • new samples for each of the preferred keysplit regions are selected. This is performed as follows. Until all regions have been processed, find the region that will have to be skewed/adjusted the most. That is, the region that has the longest distance between the preferred sample and the closest of the two nearest samples to the right and the left of the preferred sample. Then, set the sample for this range to be the closer of the two samples on either side. If one end of the range is closer to the sample that was not chosen than to the sample that was chosen, mark the region as a potential "split-region". That is, add the region to a split-region list. After all of the regions have been adjusted, it will then be determined from the list of split-regions whether any of them should be split into their own region.
  • the effect of the split has to be evaluated to determine whether it is wise to make the split. This is performed by determining how far away the end of the range which is closest to the sample "x" that was chosen previously is from the sample "y" of the next region beside it. That is, the region that will be potentially joined. If the distance is greater than or equal to the distance between the other end of the range and the sample "z" that is closest to that end, then the split is not required. If it is less than that distance, that endnote and its adjacent notes whose distance is also less can join the region for sample "y”. The rest can join the region for sample "z".
  • a limit can be determined for how large the wavetable instrument is to be in order to fit the resources available. Or, a user can choose to set a predefined limit. After requesting metadata regarding the contents of the wavetable data file, using the limit, a determination can be made as to the maximum number of samples N contained in the wavetable instrument that can be downloaded to the wireless device while still having a combined size that is under the limit.
  • the set of MIDI files can be specified by a user or application
  • N sampled notes contained in the wavetable instrument are the best ones to keep in the wavetable instrument when it is downloaded.
  • the proxy server 100 downloads the unmodified wavetable data file from the content server 250, filters it locally, and then returns the resulting file to the wireless device client 210.
  • FIG. 9 is a flow chart illustrating operations 900 of modules within the wireless communications system for determining keysplit regions and associated samples for a wavetable instrument in accordance with an embodiment of the invention.
  • the operations 900 start. A determination is made as to whether the wavetable to be downloaded has more than one sample.
  • step 1-2 if the wavetable does not have more than one sample then no filtering is required and the operations 900 end.
  • step 1-3 if the wavetable does have more than one sample, then an initialization operation (see above) is performed.
  • step 1-5 a determination is made as to whether the number of desired samples is equal to one.
  • the preferred wavetable has one region spanning the MIDI note range with the preferred sample being at the midpoint of the range. Operations then proceed to step 2.
  • step 1-6 if the number of desired samples is not equal to one, then a determination is made as to whether the number of desired samples is greater than or equal to the number of MIDI notes.
  • step 1-7 if the number of desired samples is greater than or equal to the number of MIDI notes, then the preferred wavetable has a keysplit region and corresponding preferred sample note for every MIDI note. Operations then proceed to step 2.
  • step 1-8 if the number of desired samples is less than the number of MIDI notes, then a determination is made as to whether all the samples have been granted.
  • step 1-9 if all the samples have been granted, then the preferred regions are committed and operations proceed to step 2.
  • step 1-10 if all the samples have not been granted, then a determination is made as to whether all the gaps have been processed. If all the gaps have not been processed, then the largest unprocessed gap is processed and operations proceed to step 1-12.
  • the sample is granted to the region with the largest distance between an endpoint note and the nearest sample note if the region's "pending sample count" number of samples were to have been distributed evenly.
  • step 1-12 a determination is made as to whether there is a tie with respect to the largest gap. If there is no tie, operations proceed to step 1-14.
  • a tiebreaker mechanism (see above) is used to choose which gap should be processed next.
  • step 1-14 a determination is made as to whether the gap is large enough to be subdivided. If not, operations return to step 1-10.
  • step 1-15 if the gap is large enough to be subdivided, then a determination is made as to whether the gap is contained in a region created in a previous step.
  • step 1-16 if the gap is contained in a region created in a previous step, then the container region is subdivided and operations return to step 1-8.
  • step 1-17 if the gap is not contained in a region created in a previous step, then one keysplit region is created spanning all notes to the left of the gap and one keysplit region is created spanning all notes to the right of the gap. Operations then return to step 1-8.
  • step 2 operations end when the preferred model is adjusted to fit samples contained in the wavetable to be filtered (see FIG. 10 ).
  • FIG. 10 is a flow chart illustrating operations 1000 of modules within the wireless communications system for adjusting the keysplit regions and associated samples in accordance with an embodiment of the invention.
  • step 2-1 the operations 1000 start.
  • the list of samples contained in the wavetable to be chosen from is narrowed.
  • step 2-2 a determination is made as to whether all regions have been processed. If all regions have not been processed, the region that has to be skewed the most is processed and operations proceed to step 2-3. If all regions have been processed, then operations proceed to step 2-8 described below.
  • a sample is chosen for the region that has to be skewed the most.
  • step 2-4 a determination is made as to whether a sample chosen for the present region has been chosen for another region. If not, then operations proceed to step 2-6.
  • step 2-5 if a sample chosen for the present region has been chosen for another region, then the "joins in-hand" count is incremented and operations proceed to step 2-6.
  • step 2-6 a determination is made as to whether one end of the region range is closer to a sample that was not chosen. If not, then operations return to step 2-2.
  • step 2-7 if one end of the region range is closer to a sample that was not chosen, then the region is marked as a "split-region" and operations return to step 2-2.
  • step 2-8 a determination is made as to whether all "split-regions" have been processed. If not, the worst of the unprocessed split regions is processed and operations proceed to step 2-10.
  • step 2-9 if all the "split-regions" have been processed then the filtering process is complete and the operations end.
  • step 2-10 a determination is made as to whether there are any "joins in-hand" remaining. If so, then operations proceed to step 2-11. If not, then operations proceed to step 2-12.
  • step 2-11 a determination is made as to whether the unchosen sample that is closest to part of the region range is already the chosen sample of another range. If not, then operations proceed to step 2-13. If so, then operations proceed to step 2-12.
  • step 2-12 a determination is made as to whether it is worthwhile to have part of the range moved to a different existing region. If so, then operations proceed to step 2-14. If not, then operations return to step 2-8.
  • step 2-13 proceeding from step 2-11, the region is split so that the part of the range that was closer to a sample other than the chosen sample becomes its own region whose sample is the closer sample. Operations then proceed to step 2-15.
  • step 2-14 proceeding from step 2-12, the region is split so that the part of the range that was closer to a sample other than the chosen sample becomes part of the region owning that sample. Operations then return to step 2-8.
  • step 2-15 proceeding from step 2-13, the "joins in-hand" count is decremented. Operations then proceed to step 2-8.
  • the wireless device 210 provides information pertaining to its available memory to the proxy server 100.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Mobile Radio Communication Systems (AREA)
  • Dc Digital Transmission (AREA)
  • Radar Systems Or Details Thereof (AREA)
EP04106055A 2004-11-24 2004-11-24 Method and System For Filtering Wavetable Information for Wireless Devices Active EP1662821B1 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
EP04106055A EP1662821B1 (en) 2004-11-24 2004-11-24 Method and System For Filtering Wavetable Information for Wireless Devices
DE602004016351T DE602004016351D1 (de) 2004-11-24 2004-11-24 Verfahren und System zum Filtrieren von Wellenformdaten für drahtlosen Geräten
AT04106055T ATE407529T1 (de) 2004-11-24 2004-11-24 Verfahren und system zum filtrieren von wellenformdaten für drahtlosen geräten
CA002527066A CA2527066C (en) 2004-11-24 2005-11-15 A method and system for filtering wavetable information for wireless devices
HK06111298A HK1090787A1 (en) 2004-11-24 2006-10-14 Method and system for filtering wavetable information for wireless devices

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP04106055A EP1662821B1 (en) 2004-11-24 2004-11-24 Method and System For Filtering Wavetable Information for Wireless Devices

Publications (2)

Publication Number Publication Date
EP1662821A1 EP1662821A1 (en) 2006-05-31
EP1662821B1 true EP1662821B1 (en) 2008-09-03

Family

ID=34929929

Family Applications (1)

Application Number Title Priority Date Filing Date
EP04106055A Active EP1662821B1 (en) 2004-11-24 2004-11-24 Method and System For Filtering Wavetable Information for Wireless Devices

Country Status (5)

Country Link
EP (1) EP1662821B1 (xx)
AT (1) ATE407529T1 (xx)
CA (1) CA2527066C (xx)
DE (1) DE602004016351D1 (xx)
HK (1) HK1090787A1 (xx)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8697978B2 (en) 2008-01-24 2014-04-15 Qualcomm Incorporated Systems and methods for providing multi-region instrument support in an audio player
US8759657B2 (en) 2008-01-24 2014-06-24 Qualcomm Incorporated Systems and methods for providing variable root note support in an audio player
US8030568B2 (en) 2008-01-24 2011-10-04 Qualcomm Incorporated Systems and methods for improving the similarity of the output volume between audio players
CN112382269B (zh) * 2020-11-13 2024-08-30 北京有竹居网络技术有限公司 音频合成方法、装置、设备以及存储介质

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW495735B (en) * 1999-07-28 2002-07-21 Yamaha Corp Audio controller and the portable terminal and system using the same
JP3982787B2 (ja) * 1999-10-08 2007-09-26 ヤマハ株式会社 コンテンツデータ配布方法および電話端末装置
FR2808370A1 (fr) * 2000-04-28 2001-11-02 Cit Alcatel Procede de compression d'un fichier midi
US6832259B2 (en) * 2002-08-29 2004-12-14 Motorola, Inc. Dynamic adjustment of transmitted data size for a subscriber device

Also Published As

Publication number Publication date
ATE407529T1 (de) 2008-09-15
EP1662821A1 (en) 2006-05-31
CA2527066A1 (en) 2006-05-24
HK1090787A1 (en) 2006-12-29
CA2527066C (en) 2009-09-15
DE602004016351D1 (de) 2008-10-16

Similar Documents

Publication Publication Date Title
AU757950B2 (en) System and method for enabling multimedia production collaboration over a network
US7551896B2 (en) Method, system and computer readable medium for providing an output signal having a theme to a device in a short distance wireless network
US6928261B2 (en) Music data distribution system and method, and storage medium storing program realizing such method
US6835884B2 (en) System, method, and storage media storing a computer program for assisting in composing music with musical template data
KR100841026B1 (ko) 사용자 신청에 응답하는 동적 내용 전달
CA2434777C (en) Music data providing apparatus, music data reception apparatus and program
EP1286515B1 (en) Network system of distributing protected contents through secured carrier server
US9065931B2 (en) Systems and methods for portable audio synthesis
US20050108319A1 (en) Information processing apparatus, information processing method, and information processing system
JP2003015665A (ja) 音楽情報提供システム及び方法
US20030110211A1 (en) Method and system for communicating, creating and interacting with content between and among computing devices
US20030075036A1 (en) Electronic music apparatus that enables user to purchase music related product from server
CN100456268C (zh) 内容分发服务器和内容分发方法
CA2527066C (en) A method and system for filtering wavetable information for wireless devices
US8014766B2 (en) Method and system for filtering wavetable information for wireless devices
US7167730B2 (en) Communication terminal apparatus and method of controlling the same, server apparatus and method of controlling the same, and storage media
CN1741129A (zh) 乐曲数据编辑重放装置及移动信息终端
JP4436449B2 (ja) 音楽情報配信システムとカラオケシステムとの連携システム

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20041214

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LU MC NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL HR LT LV MK YU

REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1090787

Country of ref document: HK

AKX Designation fees paid

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LU MC NL PL PT RO SE SI SK TR

AXX Extension fees paid

Extension state: LT

Payment date: 20041214

Extension state: LV

Payment date: 20041214

Extension state: AL

Payment date: 20041214

Extension state: MK

Payment date: 20041214

Extension state: HR

Payment date: 20041214

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAC Information related to communication of intention to grant a patent modified

Free format text: ORIGINAL CODE: EPIDOSCIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LU MC NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL HR LT LV MK

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REF Corresponds to:

Ref document number: 602004016351

Country of ref document: DE

Date of ref document: 20081016

Kind code of ref document: P

REG Reference to a national code

Ref country code: HK

Ref legal event code: GR

Ref document number: 1090787

Country of ref document: HK

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080903

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20081214

LTIE Lt: invalidation of european patent or patent extension

Effective date: 20080903

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080903

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080903

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080903

NLV1 Nl: lapsed or annulled due to failure to fulfill the requirements of art. 29p and 29m of the patents act
PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080903

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20081203

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080903

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080903

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20090103

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20090203

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080903

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20081130

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080903

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080903

26N No opposition filed

Effective date: 20090604

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080903

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20081130

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20081124

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20081130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20081203

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080903

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20081124

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080903

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20090304

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080903

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20081204

REG Reference to a national code

Ref country code: DE

Ref legal event code: R082

Ref document number: 602004016351

Country of ref document: DE

Representative=s name: MERH-IP MATIAS ERNY REICHL HOFFMANN, DE

Ref country code: DE

Ref legal event code: R079

Ref document number: 602004016351

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: H04Q0007320000

Ipc: H04W0088020000

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602004016351

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: H04Q0007320000

Ipc: H04W0088020000

Effective date: 20140925

Ref country code: DE

Ref legal event code: R081

Ref document number: 602004016351

Country of ref document: DE

Owner name: BLACKBERRY LIMITED, WATERLOO, CA

Free format text: FORMER OWNER: RESEARCH IN MOTION LTD., WATERLOO, ONTARIO, CA

Effective date: 20140925

Ref country code: DE

Ref legal event code: R082

Ref document number: 602004016351

Country of ref document: DE

Representative=s name: MERH-IP MATIAS ERNY REICHL HOFFMANN, DE

Effective date: 20140925

Ref country code: DE

Ref legal event code: R082

Ref document number: 602004016351

Country of ref document: DE

Representative=s name: MERH-IP MATIAS ERNY REICHL HOFFMANN PATENTANWA, DE

Effective date: 20140925

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 12

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 13

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 14

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20231127

Year of fee payment: 20

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20231127

Year of fee payment: 20

Ref country code: DE

Payment date: 20231129

Year of fee payment: 20

REG Reference to a national code

Ref country code: DE

Ref legal event code: R082

Ref document number: 602004016351

Country of ref document: DE

Ref country code: DE

Ref legal event code: R081

Ref document number: 602004016351

Country of ref document: DE

Owner name: MALIKIE INNOVATIONS LTD., IE

Free format text: FORMER OWNER: BLACKBERRY LIMITED, WATERLOO, ONTARIO, CA