JP2005510763A - Multimedia presentations to assist users when playing musical instruments - Google Patents

Abstract

  A system and method for delivering a multimedia presentation of an audio file to a computing device (102) for display to a user and allowing the user to play an instrument (112) in time with the multimedia presentation Disclosed. In response to a user's selection of a song at the computing device (102), the server (104) transmits a session file associated with the song to the computing device (102) via the computer network (105). To do. The session file includes the audio file and multimedia data so that the computing device (102) can process the session file to present a multimedia presentation of the audio file to the user. . The interface device (106) is connected to the computing device (102) and the user instrument (112). The interface device (106) couples the musical instrument (112) to the computing device (102) so that the user can play the musical instrument (112) in time with the multimedia presentation of the audio file.

Description

  The present invention relates to delivering multimedia presentations to users. In particular, the present invention relates to delivering a multimedia presentation of audio files to a user so that the user can play an instrument in time with the multimedia presentation.

  Many software packages that use digital signal processing (DSP) algorithms have been developed to allow computer users to create and edit music using the computer. In addition, the development of the MIDI (Musical Performance Digital Interface) standard protocol has allowed music information to be exchanged between musical instruments, synthesizers, and computers. The MIDI protocol defines codes for musical events including musical attributes such as melody start, pitch, main melody, volume, and vibrato. A computer with a MIDI interface can be used to record a music session, but instead of recording analog sound waves as in a tape recorder, the computer stores the music as keystrokes and control codes. In this case, the recording can be edited using the software package in a completely different manner than a conventional recording. For example, the rhythm can be changed by editing the time code of the MIDI message. As another example, a computer can easily transpose a performance from one key to another. There are virtually infinite number of ways that MIDI recordings can be edited.

  In addition, the uniqueness may or may not involve the use of MIDI so that the user can use his computer to create music by inputting his instrument (eg, keyboard or guitar) into his computer Software programs have been developed. In general, an analog audio signal from a musical instrument undergoes analog-to-digital (A / D) conversion (for example, a sound card is executed on a computer), and the digital version of the audio signal is then changed by a computer program So that it can be subjected to digital signal processing by a computer. This change can be made under user control (eg, for music editing) or in a way predetermined by a software program. This digitally modified signal is then converted back to analog form for playback to the user (eg, digital to analog (D / A) conversion). For example, a user playing a guitar hooked to his computer chooses to digitally change the guitar's audio signal to play in a modified manner.

  Unfortunately, even with all the advantages of digital signal processing where users use their own computer to create and edit music, the computer is such a way that the user learns how to play music effectively. It is not yet fully utilized. Moreover, users currently do not have fast and easy access to a wide range of music options to learn.

  The present invention relates to a system and method for delivering a multimedia presentation of an audio file to a computing device for display to a user, and further allows the user to play an instrument in time with the multimedia presentation.

  In one embodiment, in response to the user selecting a song on the computing device, the server sends a session file associated with the song to the computing device over the computer network. The session file includes the audio file and multimedia data so that the computing device can process the session file to present a multimedia presentation of the audio file to the user. An interface device is connected to the computing device and the user's instrument. The interface device couples the instrument to the computing device so that the user can play the instrument in time with the multimedia presentation of the audio file. Thus, the user is provided with fast and easy access to a wide variety of music that can be downloaded from the server. In this case, the user can play along with the downloaded music presented in a multimedia presentation format to facilitate learning.

  The features and advantages of the invention will become apparent from the following description of the invention.

  In the following description, various embodiments of the present invention will be described in detail. However, such details are included to facilitate an understanding of the present invention and to describe examples of embodiments for carrying out the present invention. Such details should not be used to limit the invention to the particular embodiments described, as other variations and embodiments are possible without departing from the scope of the invention. Moreover, although numerous details have been set forth in order to provide a thorough understanding of the present invention, it will be apparent to those skilled in the art that these specific details are not necessarily required in order to practice the invention. Become. In other instances, details such as well known methods, data types, protocols, procedures, components, network equipment, processes, interfaces, electrical structures, circuits, etc. are described in detail so as not to obscure the present invention. Not shown in block diagram format. Furthermore, although aspects of the invention are described in specific embodiments, these forms can be implemented in hardware, software, firmware, middleware, or combinations thereof.

  Reference is now made to FIG. FIG. 1 shows a block diagram illustrating an example system 100 for delivering a multimedia presentation of an audio file to a computing device 102 according to one embodiment of the invention. One or more servers 104 are coupled to the computing device 102 via a computer network (eg, the Internet) 105. In one embodiment, in response to a user's selection of a song on computing device 102, server 104 sends a session file associated with the song to the computing device via computer network (eg, the Internet) 105. 102. The session file includes a digital audio file and multimedia data. The computing device 102 processes the session file to present a multimedia presentation of the audio file to the user as will be discussed later. One or more servers 104 are also coupled via a network connection to an asset database 107 that stores session files and other assets and a user information database 109 that stores information about users, as will be discussed later. ing.

  An interface device 106 that includes a security device 110 is connected to the computing device 102 and a user instrument 112 (eg, a guitar). Interface device 106 may provide an input / output (I / O) link 114 (e.g., a musical instrument 112) for a user to play in time with a multimedia presentation of a digital audio file being processed by computing device 102. The instrument 112 is coupled to the computing device 102 via a universal serial bus link. In addition, the interface device 106 may use an amplified speaker 120 or an audio speaker 120 to play back an audio file associated with the selected song in tune with the sound from the user's instrument 112 when the user plays back to the user's own instrument. It can be connected to an analog sound device such as headphones 122.

  More specifically, the interface device 106 performs analog-to-digital (A / D) conversion of the audio signal from the musical instrument 112 and passes the digitized audio signal of the musical instrument 112 via the I / O link 114. To the computing device 102. The digitized audio signal of the musical instrument 112 is a digital signal that is executed by the software module to create a processed digital audio signal for the musical instrument, for example, to match the signal to an audio file of a song selected by the user. Receive processing (DSP). The computing device 102 creates a mixed digital signal of both the digital audio file and the instrument's processed digital signal and sends it from the computing device 102 via the I / O link 114 to the interface device. Return to 106. The mixed digital signal is converted into an analog format (D / A conversion) to become a mixed analog audio signal that is output via an analog sound device such as the speaker 120 or the headphones 122. Thus, the user can play along with the downloaded music presented in a multimedia presentation format on the computing device to facilitate learning by the user. Further, as will be discussed later, the user is provided with fast and easy access to a wide variety of music that can be downloaded from the server 104.

  Network affiliates may use computing device 102 and one or more servers 104 directly or dialed using a modem pool (not shown) or via an additional network or gateway (not shown). It will be appreciated that the computer network 105 can be coupled in a variety of ways, including through an up-phone or other network transmission line. For example, the computing device 102 may be a simple old-fashioned telephone system (POTS), cellular telephone system, cable, digital subscriber line, integrated digital communications network, satellite connection, computer network (eg, Internet, wide area network (WAN), Or a local area network (LAN), etc.), or in general, can communicate with the server 104 via a link using one or more of any type of private or public communications lines, and combinations thereof. Examples of transmission media for these links include, but are not limited to, cable, including wire, optical fiber, stranded wire, or radio channel (eg, radio frequency (RF), terrestrial, satellite, or any Other wireless signal transmission methods) are included.

  More specifically, computer network 105 typically includes transmission control protocol / Internet protocol (TCP / IP), asynchronous transfer mode (ATM), frame relay (FR), point-to-point (PPP), In a network such as packetized, packet-switched, or connection-oriented that can use System Network Architecture (SNA), Voice over Internet Protocol (VoIP), or any other type of protocol A computer network, such as the Internet, a wide area network (WAN), or a local area network (LAN). The computer network 105 allows communication of data traffic between the computing device 102 and one or more servers 104 using packets. Data traffic through network computer 105 can be of any type, including audio, text, graphics, video, email, fax, multimedia, documents, voice, and other common formats of data. Good. Computer network 105 is typically a data network that can include switching or routing facilities designed to transport digital data traffic. It should be understood that the environment of FIG. 1 is exemplary only and that embodiments of the invention may be used with any type of communication system and / or computer network, protocol, and combinations thereof. Furthermore, network connections between one or more servers 104, asset database 107, and user information database 109 can be combined in the manner described by the above example.

  Having briefly described an exemplary network environment in which embodiments of the present invention may be implemented, FIG. 2a illustrates a conventional data processing or computer system 200 that can be used with embodiments of the present invention. More specifically, FIG. 2a is a generalized example for use as an example of a computing device 102 (eg, a personal computer) or server computer system 104 that may use various aspects of the present invention. An example of a simple data processing or computing system 200 is shown.

  As shown, the data processing or computer system 200 is comprised of a system unit 202, a display device 204, an output device such as a printer 210, and input devices such as a keyboard 208 and a mouse 206. The data processing system 200 operates by manipulating the input devices 208, 206, from a fixed or removable media storage device such as a disk 212, or directly from a network connection interface (not shown). Receive data. The data processing system 200 then processes the data and outputs the resulting output data to a display device 204, an output device such as a printer 210, a fixed or removable media storage device such as a disk 212, or Present via network connection interface. The computing device 102 may be any kind of computer system or computing device (eg, a personal computer (laptop / desktop), network computer, handheld computing device, server computer, or any other type). It should be understood that it may be a computer). Further, in the case of computing device 102, data processing system 200 may use serial I / O port 113 to accommodate input / output data from interface device 102 via I / O link 114 (eg, a USB link). (For example, a USB port).

  Reference is now made to FIG. A high level block diagram of the components of the data processing system 200 as described by FIG. 2a is shown. In a conventional computer system, the system unit 202 can store various types of cache, random access memory via a local or system bus 214 or other communication means for communicating data between such devices. (RAM) or a processing unit such as processor 220 in communication with main memory 222, which may include other high speed dynamic storage devices. The processor processes information to perform the functions of the embodiments of the present invention. As an illustrative example, a “processor” has any type of architecture such as a complex instruction set computer (CISC), reduced instruction set computer (RISC), very long instruction word (VLIW), or hybrid architecture. Central processing units or digital signal processors, microcomputers, state machines, etc. can be included.

  Main memory 222 can store data as well as instructions executed by processor 220 and can be used to store temporary numeric variables or other intermediate information during execution of instructions by processor 220. Computer system 200 also includes read-only memory (ROM) and / or other static storage devices 224 that are coupled to local bus 214 for storing static information and instructions for processor 220. Examples of non-volatile memory 224 include a hard disk, flash memory, battery-backed random access memory, read only memory (ROM), etc., and volatile main memory 222 includes random access memory (RAM). ), Dynamic random access memory (DRAM), or static random access memory (SRAM).

  The system unit 202 of the data processing system 200 also features an expansion bus 216 that communicates between various devices and devices attached to the system bus 214 via the bus bridge 218. A data storage device 228 and its corresponding drive, such as magnetic disk 212 or an optical disk such as a CD-ROM or DVD, are coupled to data processing system 200 for storing data and instructions via expansion bus 216. Yes. The computer system 200 also extends to a display device 204 such as a cathode ray tube (CRT) or liquid crystal display (LCD) to display data such as a package description and associated images generated for a computer user. Coupled via bus 216. An alphanumeric input device 208, which typically includes alphanumeric characters and other keys, is coupled to the bus 216 for communicating information and / or command selections to the processor 220. Other types of user input devices, such as conventional mice, trackballs, or cursor direction keys for communicating direction information and command selections to the processor 220 and controlling cursor movement on the display 204. This is a cursor control device 206. Further, for computing device 102, data processing system 200 receives serial I / O port 113 for receiving input / output data from interface device 106 via serial I / O link 114 (eg, a USB link). (For example, a USB port).

  Communication device 226 is also coupled to bus 216 for accessing a remote computer or server, such as server 104, or other server, eg, via the Internet. Communication device 226 may include a modem, network interface card, or other well-known interface device such as used to interface with Ethernet, Token Ring, or other types of networks. it can. In any case, in this manner, computer system 200 can be coupled to multiple servers 104 via a network interface as shown in FIG. 1 and described above.

  Continuing with the example of conventional data processing or computer system 200, both computing device 102 and server 104 boot into device memory for execution when the device is powered on or reset. Can operate under the control of a designated operating system. Furthermore, the operating system controls the execution of one or more software modules or computer programs. These software modules typically include application programs that assist the user in using the computing device 102 and the server 104, as well as musical instruments for display to the user and for the multimedia presentation by the user. Various functions associated with delivering a multimedia presentation of an audio file to computing device 102 to allow performance, and other functions related to security and commercial methods as discussed later including.

  These functions can be implemented as one or more instructions (eg, code segments) to perform the desired functions of the present invention. When implemented in software (eg, by a software module), elements of the present invention are instruction / code segments for performing the necessary tasks. The instructions, when read and executed by a machine or processor (eg, processor 220), cause the machine or processor to perform the operations necessary to implement and / or use the embodiments of the invention. Even if the instructions or code segments are stored on a machine-readable medium (eg, a processor-readable medium or a computer program product), the transmission medium or communication is performed by a computer data signal or a signal modulated by the carrier wave. It may be transmitted via a link. A machine-readable medium may include any medium that can store or transfer information in a form readable and executable by a machine (eg, a processor, a computer, etc.). Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable programmable ROM (EPROM), floppy diskette, compact disk CD-ROM, optical disk, hard disk, optical fiber Media, radio frequency (RF) links, etc. are included. A computer data signal may be any signal that can propagate through a transmission medium such as an electronic network channel, optical fiber, air, electromagnetic, RF link, and the like. The code segment can be downloaded over a network such as the Internet, an intranet, or the like.

  Reference is now made to FIG. FIG. 3a shows a top view of the interface device 106 according to one embodiment of the present invention. The interface device 106 provides input / output (I / O) to the computing device 102 so that the user can play the instrument 112 in time with the multimedia presentation of the audio file being processed by the computing device 102. O) The musical instrument 112 is coupled via the link 114. As shown in the plan view of FIG. 3a, the interface device 106 includes a volume dial or knob 304 for adjusting the volume of the instrument 112 and the audio file, and the operational state (ie, powered on) of the interface device. LED indicator 308 that indicates whether it is broken or not. The interface device 106 includes a housing of metal, plastic, metal plated plastic, etc., for containing internal electronic components. Returning briefly to 3b, which shows a front view of the interface device 106 according to one embodiment of the present invention, the interface device may be connected to the input jack (or from the instrument 112) so that the instrument is electrically coupled to the interface device 106. An input port 310 is included to accept other input devices.

  Reference is now made to FIG. FIG. 3c shows a rear view of the interface device 106 according to one embodiment of the invention. The interface device 106 includes left and right speaker output ports 320, 322 that can be used to accept a speaker jack for the amplified speaker 120 so that the interface device 106 can be connected to the amplified speaker. This allows a user playing his instrument 112 to hear both the instrument and the audio file associated with the song being processed by the computing device 102. In addition, interface device 106 includes an additional line for port 323. For example, from the sound card of the computing device 102 so that sounds from games and other software programs from the computing device 102 can simply be routed to the speaker 120 or headphones 122 via the interface device 106. An additional line on port 323 can be used to support

  The interface device 106 also includes a headphone output port 326 that can be used to accept a headphone jack on the headphones 122 so that the user can listen to his instrument 112 and audio files using the headphones 122. . The interface device 106 has an I / O connector (eg, USB connector) so that an I / O link 114 (eg, USB link) can be formed between the interface device 106 and the computing device 102. It further includes a serial I / O port 330 (eg, a USB port) for receiving. It should be understood that the interface device 106 can include any number of other inputs and outputs.

  Reference is now made to FIG. FIG. 3d is a schematic diagram of the internal components 334 of the interface device 106 according to one embodiment of the invention. The interface device 106 functions as related to A / D and D / A conversion of signals between the instrument 112 and the computing device 102, as well as security using the security device 110, as discussed in more detail below. A microprocessor 340 is included that controls the components of the interface device 106 to perform functions.

  As shown in FIG. 3 d, interface device 106 includes an Instrument in line from input port 310 connected to amplifier 336. Therefore, as an example, an analog audio signal from the instrument 112 coming from the input port 310 is amplified by the amplifier 336. Amplifier 336 is connected to analog-to-digital (A / D) converter 338 so that the amplified analog audio signal is processed by A / D converter 338 and converted to a digitized audio signal of the instrument. .

  The microprocessor 340 of the interface device 106 is coupled to the security device 110, the buffer RAM 344, and the digital audio interface 346 components. Microprocessor 340 controls component 334 of interface device 106 to perform functions related to A / D and D / A conversion of signals between instrument 112 and computing device 102. The digital audio interface 346 performs conventional functions related to formatting and timing the digitized audio signal. The digital audio interface 346 can include multiple timing clocks to perform these functions. Thus, continuing with this example, the digitized audio signal of instrument 112 is then formatted by digital audio interface 346. In addition, the digital audio interface 346 is coupled to a buffer RAM 344 that is used to store a portion of the digitized audio signal for speed matching.

  Further, the buffer RAM 344 is connected to the microprocessor 340 and the serial I / O controller 348. Serial I / O controller 348 controls the flow of digital data to / from computing device 102 along serial I / O link 114. In one example, the serial I / O controller 348 may be a USB controller and the serial I / O link 114 may be a USB link. Digital data that is controlled by the serial I / O controller 348 is received directly from the instrument 112 and is digitized audio signals being transmitted to the computing device 102 for digital signal processing (DSP); A mixed digital signal of both the processed digital audio signal of a musical instrument that has already undergone DSP by the computing device 102 and the digital audio file associated with the selected song coming from the computing device 102 Can be included. However, the digitized signal of the instrument need not be passed through the computing device 102 for DSP processing, but directly to the DAC 350 so that the user can still play with the audio file. It should be understood that it can be passed to an analog sound device. Buffer RAM 344 is also used to store instrument digital audio signals (pre-DSP processing), digital audio files, and mixed digital signals for conventional purposes such as speed matching. .

  The digital audio interface 346 is further connected to a digital to analog converter (DAC) 350. The processed digital audio signal of the instrument and from the computing device 102 so that the mixed analog audio signal can be played back through an analog sound device such as an amplified speaker 120 or headphones 122. Both mixed digital signals of the digital audio file are processed by the DAC 350 to convert this mixed digital signal into an analog form, ie, a mixed analog audio signal. However, as noted above, the digitized signal of the instrument need not be passed through the computing device 102 for DSP processing, and the DAC can be played by the user to the audio file. It should be understood that 350 can be passed directly to an analog sound device.

  A mixer 352 is connected to the output section of the DAC 350. The mixer 352 receives analog audio signal input from other lines of the source, such as the line of port 323 that is amplified by amplifiers 358 and 360, respectively. As a result, they can also be reproduced via the amplification speaker 120 or the headphones 122.

  These additional analog audio signal inputs from the port 323 line can be mixed with the instrument's analog audio signal and audio file or simply routed to the speaker 120 or headphones 122 via the interface device. Good. For example, sound from the game and other software programs from the computing device 102 can be routed from the line at port 323 so that they can simply be routed to the speaker 120 or headphones 122 via the interface device 106. The additional line at the input may be from the sound card of the computing device 102. In this way, other software programs can still be used with the interface device 106 that is hooked to the computing device 102 (eg, a personal computer) so that the user can use the interface device and interface -No need to reconfigure your own personal computer system to switch from not using the device.

  The analog signal from the mixer 352 is then passed to the amplified speaker 120 via line out (eg, left, right) 360, 362 via speaker ports and 320,322. Specifically, the analog signal can be amplified by amplifiers 364, 366 under the control of volume controller 368, and volume controller 368 is controlled by volume dial 304. Similarly, an analog signal from the mixer 352 is also passed to the headphones 122 via the headphone port 326 via lines out 360 and 362 (eg, left, right). Similarly, the analog signal can be amplified by amplifiers 374, 376 under the control of volume controller 368, which is controlled by volume dial 304.

  Accordingly, the interface device 106 is connected to the instrument via the input / output (I / O) link 114 so that the user can play the instrument 112 in time with the multimedia presentation of the audio file being processed by the computing device 102. 112 is coupled to computing device 102. More specifically, as described above, the interface device 106 performs analog-to-digital (A / D) conversion of the audio signal from the musical instrument 112 and converts the digitized audio signal of the musical instrument to the I / O link 114. To the computing device 102 where the digitized audio signal of the instrument 112 is subjected to digital signal processing (DSP) performed by the software module (e.g. To match the audio file). A mixed digital signal of both the digital audio file and the instrument's processed digital signal is returned from the computing device 102 along the I / O link 114 to the interface device 106 where the mixed digital signal is transmitted. It is converted into an analog format, that is, a mixed analog audio signal (D / A conversion), and is output via the speaker 120 or the headphones 122. Thus, to facilitate learning by the user, the user can play along with downloaded music presented in a multimedia presentation format on the computing device as described below.

  The interface device 106 also includes a security device 110. The security device 110 should be used to uniquely identify the interface device 106 to the server 104 so that access to the server 104 is only allowed for users operating on authorized interface devices. Includes components that can In addition, the security device 110 with the server 104 ensures that the audio file is properly encrypted and decrypted so that the properly authorized interface device 106 can receive and use the audio file. used. This protects against unauthorized copying of authorized material and provides a secure revenue opportunity for content (eg, audio file) providers.

  The security device includes a microprocessor 340, a secure memory 379 having security logic 380, a program storage 382 for storing security firmware 383, and a non-volatile memory (eg, EEPROM) 384. In general, when executed by microprocessor 340 with secure memory 379 or non-volatile memory 384, security firmware 383 causes server 104 to uniquely identify interface device 106 and allow interface device 106 to It provides a secure operation that allows the computing device 102 to decrypt the audio file that is specifically encrypted for use with the interface device 106. Secured memory 379 includes both read only memory (ROM) and writable memory that can be locked and unlocked for reading and writing using security logic 380 implemented in hardware.

  A user key 387 associated with the serial number 386 of the interface device 106 is used by the security logic 380 to cause the server device 104 to authenticate the interface device 106. Memory key 389 is also used by security logic 380 to initially unlock secure memory 379. Serial number 386, user key 387, and memory key 389 are sealed to secure memory 379 during manufacture. Once the secure memory 379 is sealed, it cannot be written again. Server 104 first generates a request and response to uniquely authenticate interface device 106, and opens and locks secure memory 379 and non-volatile memory 384, as discussed in more detail below. As can be done, a serial number 386, a user key 387, and a memory key 389 are also stored in the user information database 109 of the server.

  Non-volatile memory 384 is used as an extension to secure memory 379. Firmware 383 prevents access to non-volatile memory 384 unless secure memory 379 is also unlocked. Non-volatile memory 384 has hardware write protection controlled by firmware 383. Non-volatile memory 384 includes a key 388, such as an asset encryption key (eg, audio file key) associated with a particular purchased asset (eg, audio file), a purchase for an asset 390 with the current date. The application date and asset information (for example, information about the asset) 392 are stored. Serial number 386, user key 387, memory key 389, key 388, date 390, asset information 392, firmware 383, etc., security device memory, program storage 382, secure memory 379, or non-volatile memory Any of 384, ie, program storage 382, secure memory 379, or non-volatile memory 384 can be placed in or co-located, but this specific configuration is only one embodiment. Please understand that.

  As will be discussed in more detail below, along with many other features, the security device 110, along with the computing device 102 and server 104, allows the server 104 to uniquely identify the interface device 106, and the computing device Allows the decoding device 102, along with the interface device 106, to decrypt a specially encrypted audio file for use by the authorized interface device 106.

  FIG. 4 is a more detailed example system 100 for delivering a multimedia presentation of an audio file to a computing device 102 showing exemplary software modules being used, according to one embodiment of the invention. FIG. Briefly, as described above, one or more servers 104 are coupled to the computing device 102 via a computer network (eg, the Internet) 105. In addition, interface device 106 is coupled to computing device 102 and instrument 112 is coupled to the interface device. In one embodiment, in response to a user's selection of a song on computing device 102, server 104 retrieves a session file associated with the song over computing network 102 (eg, the Internet) 105. Send to. The session file includes audio files and multimedia data. The computing device 102 presents the multimedia presentation of the audio file to the user so that the user can play the instrument 112 in time with the multimedia presentation of the audio file being processed by the computing device 102. Process the session file for

  More specifically, as shown in FIG. 4, computing device 102 and server 104 each include a plurality of software modules that implement the functionality of the embodiments of the present invention. These software modules are typically displayed to the user as discussed below and application programs to assist the user in using the computing device 102 and the server 104, and the user can enter a multimedia presentation. It includes a variety of functions related to delivering a multimedia presentation of audio files to the computing device 102 that can be played together and other functions related to security and commercial methods. For example, the computing device 102 includes an application software module 402 that further includes an embedded browser 404, an audio playback software module 406, and a security software module 408. The computing device 102 further includes a device driver software module 410 and an audio DSP software module 412. On the server side, server 104 includes server software module 415, application software module 416, database software module 418, commercial software module 420, and security software module 422.

  The application software module 402 of the computing device 102 includes an embedded browser 404 and all other software modules (eg, audio DSP software module 412, audio playback software module 406, device driver software software). Interface with and control embodiments of module 410 and security software module 408). This provides an embodiment of the present invention for displaying a multimedia presentation of an audio file to a user to allow the user to play the instrument in time for the multimedia presentation, as well as security and other commercial functions. Appropriately implemented. In one embodiment, the application software module 402, together with the embedded browser 404, first displays to the user a web page (eg, a home page) that provides the user with a plurality of songs to select. The embedded browser 404 is specifically tailored with respect to the application software module 402 and its various functions, and can be based on any type of browser known in the art such as Microsoft Explorer.

  The application software module 402 also displays a control panel graphical interface to the instrument 112 that includes settings that define the sound characteristics of the instrument. The control panel graphical interface also allows the user to set the sound characteristics for the instrument 112. Further, in response to the multimedia data of the session file for the selected instrument (eg, selected by the user) transmitted by the server 104 to the computing device 102, the application software module 402 may be Set the control panel graphical interface settings to predefined values to model the sound characteristics of the instrument associated with the audio file for the selected song. Similarly, the application software module 402 selects a song that the user has selected (eg, and sent from the server 104 to the computing device 102) and that has removed tracks associated with the user's instrument from the audio file. Can be played. As a result, the user can play his / her instrument 112 in accordance with the multimedia presentation of the audio file that does not include the user's instrument. In addition, the application software module 402 processes the multimedia presentation of the session file to display to the user the score associated with the music audio file. The multimedia presentation can be displayed on the display device 204 of the computing device 102, and the sound can be routed through the amplified speaker 120 of the interface device 106.

  To achieve these functions, the application software module 402 uses a conventional device driver software module 410, an audio DSP software module 412, and an audio playback software module 406. The audio DSP software module 412 processes the audio signal of the instrument 112 (eg, using a DSP algorithm) so that the user can set the sound characteristics of the instrument. Application software module to model the sound characteristics of the instrument and set the control panel graphical interface settings to predefined values so that they are properly associated with the user-selected instrument as described above The audio DSP software module 412 can be used by 402. In addition, the audio DSP software module 412 combines both the digital audio file and the instrument's processed digital audio signal to create the mixed digital audio signal. The application software module 402 also interfaces the digital audio file and the mixed digital signal of the digitally processed sound of the instrument 112 to the user through the amplified speaker 120 or headphones 122. In order to control the return to the device 106, the audio playback software module 406 is controlled. However, if the instrument is routed for processing only through the interface device 106 and not the computing device 102, the application software module 402 plays the audio to control the transmission of only the digital audio file. The software module 406 can also be controlled. It should be understood that audio DSP software modules for a variety of different instruments are well known in the art. For example, a common type of DSP software module that can modify MIDI files is well known (eg, MIDI SHOP). Audio playback software modules used to play audio files and audio signals from musical instruments are also well known.

  In a specific embodiment used to describe aspects of the present invention below, application software module 402, audio DSP software module 412, web page where the user logs on, and control panel graphical interface. Is instructed to support the guitar as the instrument 112. In particular, it should be understood that DSP algorithms for modifying audio signals from a guitar are well known in the art and can be easily implemented in the computing device 102 software. For example, a DSP algorithm for modifying the audio signal from the guitar to model various amplifier and speaker cabinet configurations that can be used in the audio DSP software module 412 to implement aspects of the present invention. One example is specifically described in Patent Application No. 5,789,689, entitled “Tube Modeling Programmable Digital Guitar Amplification System,” incorporated herein by reference. In addition, there is a known control panel graphical interface implemented with a wide variety of software for several different instruments, and several basic control panel graphical interfaces are known for guitars. Yes. For example, AMP FARM includes one type of control panel graphical interface implemented in guitar software. However, none of these include many of the new and unobvious features of the guitar control panel graphical interface described in more detail below. Furthermore, the form of security software module 408 of computing device 102 is also described in further detail below.

  In one embodiment of the invention, the server 104 includes a server software module 415, an application software module 416, a database software module 418, a commercial software module 420, and a security software module 422. Application software module 416 is server 104 of server software module 415 and all other software modules (eg, database software module 418, commercial software module 420, and security software module 422). Interfacing with and controlling embodiments. This results in the user playing the instrument in time with the multimedia presentation and displaying the multimedia presentation of the audio file to the user to allow other functions related to security and commercial functions. Embodiments of the present invention are suitably implemented.

  As discussed below, at the server 104, the application software module 416, along with the server software module 415, provides the computing device 102 with the data necessary to implement the functionality of the present invention. Server software module 415 may be conventional server software for sending / receiving data to / from computing device 102. For example, using the Hypertext Transfer Protocol (HTTP) and Hypertext Markup Language (HTML) or Extensible Markup Language (XML), the server 104 uses a computer network to provide various functions and data to the user. Communicating with computing device 102 via 105. The computing device 102 includes an embedded browser 404 that is part of the application software module 402, or possibly Netscape ™ Navigator ™, Microsoft, available from Netscape ™ (Mountain View, Calif.). Internet Explorer (TM) from America, Inc. (Redmond, WA), the user interface of America Online (TM), or any other browser from a well-known supplier or other browser such as an HTML / XML translator , The computing device 102 provides data to the server 104 and accesses processed or unprocessed data on the server 104 Rukoto can.

  As described above, in accordance with one embodiment of the present invention, the server software module 415 under the control of the application software module 416 is a computer in response to the user's selection of music on the computing device 102. Send the session file to the computing device 102 via the network 105. The session file includes an audio file and multimedia data. This allows the computing device 102 to provide a session presentation to the user so that the user can play his instrument 112 (eg, guitar) in time with the multimedia presentation of the audio file. The file can be processed. Further, as will be discussed later, server software module 415 under the control of application software module 416 receives a variety of different types of data from computing device 102 to implement the functionality of the present invention. Send to / from.

  The database software module 418 is configured to control the input and output of data in the asset database 107 and user information database 109 under the control of the application software module 416, as discussed in more detail below. Conventional database software such as Further, aspects and functions of the commercial software module 420 and the security software module 422 are discussed in more detail below.

  Data communicated between server 104 and computing device 102 to track session files with multimedia data and audio files, user information, purchase of audio files and other items, and licensing constraints Commercial information, security information including encrypted keys and encrypted assets and audio files, multimedia data for website display, along with several other data. Much of the information about session files, multimedia data, audio files, commercial information, and other assets can be stored in the asset database 107 for later consideration. User name, email address, home address, computer connection speed, credit card number, purchase information, computer type, user musical preference type, and user serial number for the user or security device 110, user User information, including security information, including keys, memory keys, and other user information, can be stored in the user information database 109 for later consideration. For related businesses, the asset database 107 and user information database 109 are stored on storage devices including various mass storage devices such as one or more DASD arrays, tape drives, optical drives, etc. It will be readily appreciated that the above information can be stored in any one of a variety of formats or data structures.

  In a specific embodiment used to describe some of the aspects of the invention below, computing device 102, server 104 and associated asset and user information databases 107, 109, and interface device 106 are shown. Are used with the associated software modules to support the guitar 112 as a musical instrument. However, those skilled in the art will appreciate that the present invention can be used to support any type of musical instrument. Furthermore, it should be understood that the present invention can support the case where a microphone is used as a musical instrument and the input audio signal is a human voice so that embodiments of the present invention can function as a virtual karaoke machine. These forms will be better understood upon further reading of this disclosure.

  Refer to FIG. FIG. 5a is a flow diagram illustrating a method 500 for delivering a multimedia presentation to a user according to one embodiment of the present invention using the example system 100 previously described of FIG. At block 502, after the user loads the application software module 402 to the user's own computing device 102, the application software module 402 displays the control panel graphical interface 600 to the user as shown in FIG. 6a. Present. For example, the control panel graphical interface 600 can be displayed on the display device 204 of the computing device 102. The computing device 102 then uses the application software module 402 to authorize the user to log on to the server 104 and access the server. According to one specific guitar embodiment discussed below, the server presents the user with a guitar related website, hereinafter referred to as the GUITARPORT website. That is, the user is first presented with a GUITARPORT home page and then with another GUITARPORT web page.

  Similarly, referring to FIG. 6 a, logging on to the server 104 can be accomplished by the user selecting the GUITARPORT online button 606. For example, the computing device 102 can contact the server 104 via a computer network (eg, the Internet) using a standard computer network protocol (eg, TCP / IP). At block 506, the server 104 under control of the application software module 416 along with the security software module 422 from the security device 110 to determine whether access to the server 104 should be permitted. The user is identified based on a unique identifier (eg, the serial number of interface device 106). These security features will be discussed in more detail later. If the user is not authorized by the server 104, the session ends at block 508. However, if the user is authorized to use the server 104, the method 500 moves to block 510.

  At block 510, the application software module 402 uses the embedded browser 404 to display the GUITARPORT home page received from the server 104 as shown in FIG. 6b. The GUITARPORT home page is initially displayed under the guitar control panel graphical interface 600. Referring also to FIG. 6b, the GUITARPORT home page includes Features, News, Discusion, User Page, Guitar Tools, Musical Pieces (eg, Newest Jamtrack), and Tones. The GUITARPORT homepage will be discussed in detail later. Further, based on information about the user stored in the user information database 109 in the server 104 (for example, specifically, the user's music preference), the server 104 regenerates the GUITARPORT homepage to suit the user's music preference. be able to. For example, if the user preference is rock and roll, a Newest Jamtrack (e.g., a song) is directed to a rock and roll song with a specific Rock and Roll Tones. Furthermore, other components of the GUITARPORT homepage, such as News, Features, etc., can be linked with user preferences. At block 512, the user can select Tone or a song (eg, Jamtrack). If the user selects Tone, at block 514, the method 500 proceeds to Figure 5b. On the other hand, if the user selects a song (eg, Jamtrack), at block 516, the method 500 proceeds to FIG. Jamtrack is one type of music that can be downloaded from the server 104.

  To help explain the method of the present invention and the associated control panel interface, a portion of the control panel graphical interface will now be considered. Reference is now made to FIG. FIG. 6 a is a screen shot specifically illustrating the control panel graphical interface for guitar 600. As described above, the application software module 402 generates the control panel graphical interface 600 and, along with the audio DSP software module 412, the user changes (or configures) the settings of the control panel graphical interface. Can be set to a predetermined setting determined by a session file or a predefined patch). This causes the audio DSP software module 412 to process the audio signal from the guitar 112 to match the desired setting. Next, the setting of the control panel graphical interface 600 for guitar will be described.

  The control panel graphical interface 600 includes a number of standard controller knobs 604 common to most guitar amplifiers, including a drive control knob 606, a bus control knob 608, a middle control control. A knob 610, a treble control knob 612, a sense of presence control knob 614, and a volume control knob 616 are included. These control knobs are selectable by the user to change the sound of the guitar. The control panel graphical interface 600 further includes a boost switch 620 to increase the power of the audio signal from the guitar. When the bypass button 622 is selected, DSP processing is turned off so that the raw audio signal from the guitar is used. When the compare button 624 is selected, two different control panel graphical interface configurations can be compared side by side. When collapse button 628 is selected, it reduces the size of control panel graphical interface 600. When the mute guitar button 630 is selected, the audio signal from the guitar is muted.

  The Master Volume dial 632 controls both the volume of the guitar 112 audio signal and the volume of any other audio signal currently being processed (eg, from an audio file). Selecting the hum reduction button 634 allows the user to reduce hum interference between the guitar 112 and the display device 204. Once the hum reduction button 634 is selected and the learn button 636 is depressed, the computing device 102 measures the hum interference between the guitar 112 and the display device 204 (eg, the user displays the user's own guitar). The DSP process compensates for the hum interference and removes it). When the noise gate button 638 is selected, it attenuates the input audio signal from the guitar if it is below the threshold, but does not attenuate the audio signal from the guitar if it is above the threshold. Thus, the noise gate button 638 can be used to remove something like noise when handling a guitar. A guitar pan slide 640 can be used to pan the guitar sound between the left and right speakers.

  Further, as described above, the user can select a tone, or the user can automatically select a tone to match the user's own selection of music. The type of tone selected is shown in the tone field 642. Almost any type of guitar amplifier (eg, MARSHALL, FENDER, VOX, ROLAND, etc.), almost any type of speaker cabinet, and any number of tones representing an amplifier model based on almost any type of effect can be played. For example, the user selects the tone for AC / DC's hells bells rhythm section, heavy fan clock lead, '64 Fender Deluxe or any other tone (see, eg, Top 10 Tones 685 (Figure 6b)) Or can be created. In particular, it should be understood that DSP algorithms for modifying the audio signal from the guitar 112 are well known to those skilled in the art and can be easily implemented in software on the computing device 102. For example, a DSP algorithm for modifying audio signals from a guitar to model various amplifier and speaker cabinet configurations that can be used in the audio DSP software module 412 to implement aspects of the present invention. An example is specifically described in Patent Application No. 5,789,689, entitled “Tube Modeling Programmable Digital Guitar Amplification System,” incorporated herein by reference.

  Typically, tones can be defined by guitar amplifiers, speaker cabinets, and a number of different effects and other settings. Again, the tone can be selected by the user, created by the user, or preset to suit the selected song. The type of guitar amplifier tone being modeled is shown in the amplifier model field 644 (eg, '90 Marshall JCM-800). The speaker cabinet configuration tone being modeled is shown in the speaker cabinet model field 646 (eg, 4 × 12′78 Marshall with Stock 70s). The speaker cabinet configuration 646 emulates the effects of a speaker cabinet with amplified guitar sound. In addition, a plurality of digitally played well-known effects boxes are provided by the control panel graphical interface 600 for creating tones. Specifically, a compression effect box 650, a delay effect box 652, a modulation effect box 654 (eg, including chorus, flanger, rotary, tremolo, etc.) and a reverb effect box 656 are provided. The effects box is usually in an additional digital audio instrument processor that is coupled to a guitar and a standard amplifier. This particular control panel graphical interface 600 also shows that the delay effect box 652 is currently selected, and delay effects such as delay time 660, feedback percentage 662, and level percentage 664. The specific attributes of are shown. Further, as described above, the user can log on to the GUITARPORT website by selecting the GUITARPORT online button 606.

  Reference is now made to FIG. FIG. 6b is a screenshot of a display shown to the user when the user successfully logs on to the server 104, according to one embodiment of the present invention. Specifically, the browser 404 embedded with the application software module 402 displays the GUITARPORT homepage 670 received from the server 104. It is placed under the control panel graphical interface 600 and performs many of the functions requested by the user along with the data received from the server 104. The control panel graphical interface 600 is shown in FIG. 6a except that in this case the compression effect box is already selected and a compression effect window is shown (eg, considering the selection of different compression ratios). Note that this is the same as shown in.

  As shown in FIG. 6 b, the GUITARPORT home page 670 includes a Home button 671, a Feature button 672, a News button 673, a Discussion button 674, a Users button 675, and a Guitar Tools button 676. If the user selects the Home button 671, the GUITARPORT home page is returned to the user. Depressing the Features button 672 takes you to the Features page, which includes artist interviews, studio notes, and other articles about music areas that the user may find useful. Selecting the News button 673 takes you to the News page, which provides news articles specifically about the field of music and the guitar. When the user selects the Discus button 674, they move to a bulletin board, which may be of any subject, but usually displays messages specifically related to music and guitar (eg, questions, answers, news, articles, etc.). it can. Selecting the Users button 675 provides the user with a user page that allows the user to update his / her own profile (eg, name, address, purchase type, music preferences, etc.). By depressing the Guitar Tools button 676, the user goes to the utility page, which provides the user with information about playing the guitar, such as what the fingering is for C code and how to set up the amplifier. This can be accomplished by listing frequently asked questions (FAQs), searchable databases, questions by e-mail to guitar experts, and so on.

  The GUITARPORT home page has selectable icons representing links to new articles, interviews, news, chords, guitar licks, Newest Jamtracks (eg songs), and the most popular tones. For example, FIG. 6b shows selectable Studio Notes icon links 678, 679, selectable Interview icon link 680, selectable Today's News icon link 681, Chord of the Week icon link 682, and Lick of. A the Week icon link 683, as well as a Newest Jamtracks (eg, song) link 684, and a Tone link 685 are shown. Further, as described above, the GUITARPORT website can be tailored to the user based on user information (for example, specifically the user's music preference) stored in the user information database 109 by the server 104. With this information, the server 104 can recreate the GUITARPORT website to suit the user's music preferences. For example, if the user's preference is rock and roll, then Newest Jamtracks 684 (eg, music) is directed to rock and roll music and a specific Tones 685. In addition, other components of the GUITARPORT website can be linked to user preferences, such as Studio Notes, Interviews, News, Chord of the Week, Lick of the Week, and the like.

  In addition, the control panel graphical interface 600 has several selectable buttons that interact with the GUITARPORT website. As shown in FIG. 6b, the GUITARPORT online button 606 for connecting to the GUITARPORT website has already been depressed. An Artist and Gear button 687 is provided that, when selected, provides the user with a list of selectable artists. This allows the user to see articles written about the artist providing the biography of the artist and the type of instrument they are using. When the Track button 688 is selected, it provides the user with a list of songs (eg, Jamtracks) that the user can select. In response to the user selecting a song (eg, Jamtracks), the server 104 transmits a session file associated with the selected song to the computing device 102 via the computer network (eg, the Internet) 105. . The session file includes an audio file and multimedia data. The computing device 102 processes the session file to present a multimedia presentation of the audio file to the user, as will be discussed later. When the Tone button 689 is selected, it provides the user with a list of tones that the user can select. In response to the user's selection of a tone, the server 104 sends patch information (eg, amplifier type, speaker cabinet, effect settings, etc.). This allows the control panel graphical interface 600 to be properly configured and the DSP software module 412 to properly process the guitar signal to emulate the appropriate tone. However, it should be understood that the user can use pre-stored tones and songs (eg, Jamtracks) with or without a connection to the GUITARPORT website.

  The control panel graphical interface 600 also has a tuner button 690 that, when selected, causes the computing device to act as a color tuner so that the user can tune his own guitar. be able to. The control panel graphical interface 600 also includes a Help button 691, which provides a standard help function to the user when selected. In addition, the control panel graphical interface 600 includes standard forward and back arrows 692 and 693 that allow the user to toggle back and forth all web pages of the previously visited GUITARPORT website.

  As described above, if the user selects Tone, the method 500 proceeds to FIG. 5b (block 514). For example, the user can select one of the Tones provided by selecting one of the Tones button 689 or Top Tones 685 (eg, Heavy Funk Rock Lead (FIG. 6b), see FIG. 5b. 5b is a flow diagram illustrating a method 501 for providing a tone to a user according to one embodiment of the present invention.Depending on the user's selection of a tone, the server 104 may provide patch information (eg, amplifier type, speaker cabinet, etc.). , Effect settings, etc.) to the computing device 102 (block 518) The application software module 402 controls the control panel graphical interface to model the sound characteristics of the tone for the instrument (eg, guitar). Set 600 to the appropriate configuration (block 520) In addition, the DSP software module 412 properly processes the guitar audio signal to emulate the appropriate tone, so that the user can control the interface device 106. The user's own guitar 112 connected to the computing device 102 can be played in appropriate tones, for example, patches can be recorded by various recording artists (eg, Jim Hendrix, Eric Clapton, Jerry Garcia, Chet Atkins). , Robert Cray, etc.) created specifically for the GUITARPORT website to represent various guitar styles such as rock, country, jazz, etc. May be.

  As described above, if the user selects a song, the method 500 proceeds to FIG. 5c (block 516). For example, the user can select one of the songs (eg, Jamtracks) provided by selecting one of the Tracks button 688 or one of the Newest Jamtracks 684 (eg, Welcome to the Jungle (FIG. 6b)). Refer to FIG. FIG. 5c is a flow diagram illustrating a method 503 for providing music to a user according to one embodiment of the invention. Specifically, in response to the user's selection of a song (eg, Jamtrack), the server 104 sends a session file associated with the selected song (eg, Jamtrack) via the computer network (eg, the Internet) 105. To the computing device 102 (block 524). The session file includes an audio file and multimedia data.

  Refer briefly to FIG. FIG. 5d is a diagram illustrating the contents of a session file 539, according to one embodiment of the present invention. Session file 539 includes an audio file 540 associated with a song (eg, Jamtrack). The music audio file 540 is usually a song that the user wishes to accompany. Audio file 540 may be a full song (ie, having all instrument tracks and vocal tracks). Alternatively, the audio file 540 can remove one or more tracks. For example, one or more guitar tracks can be removed, one or more vocal tracks can be removed, one or more bass tracks can be removed, one or more For example, multiple drum tracks can be removed. For example, as discussed later, the user can select a song (eg, Jamtrack) from which the guitar track has been removed. This allows the audio file 540 to be removed by the computing device 102 and the interface device 106 (eg, by the amplified speaker 120) so that the user can accompany the song with the guitar track removed. And played.

  In addition, the session file 539 has a multimedia block 542 that includes HTML data embedded with JavaScript to present and display multimedia information to the user. Specifically, referring briefly to FIG. 6c, which will be discussed in more detail later, the multimedia data may be stored in a song or song 601 so that the user can perform along with the audio file 540 being played. By the application software module 402 of the computing device 102 and the embedded browser 404 (other software modules of the computing device 102) to represent the name and score 603 associated with the lead sheet 605 Can be processed). Multimedia data block 542 also includes all other necessary data to accomplish these functions.

  Session file 539 also includes a patch block 544 that includes patch information so that guitar 112 is associated with and has the appropriate tone or sound for the selected song / audio file 540. The patch information includes the amplifier type, speaker cabinet, effect settings, etc. so that the guitar settings in the control panel interface 600 are set to match the selected music / audio file. The application software module 402 sets the control panel graphical interface 600 to the appropriate configuration to model the sound characteristics of the guitar tone for a particular song / audio file 540. In addition, the DSP software module 412 properly processes the guitar signal to emulate the appropriate tone so that the guitar sound matches the song / audio file 540.

  Further, the session file 539 includes a MIDI file 546 representing tempo changes, program changes, key signature changes, position markers, etc. for the selected music / audio file 540. MIDI files are well known in the art. The computing device 102 (eg, using the application software module 402) determines the current audio playback position for the purpose of determining what event will occur in the MIDI file and the corresponding audio file in the MIDI file. Interpret the tempo map from MIDI during playback to change to file position. For amplifier control of the control panel graphical interface 600 required for a specific location in the audio file (eg, a specific tone for a guitar being emulated using the DSP software module 412), Program changes from the MIDI file are used to select patch information 544 for selecting amplifiers, speaker cabinets, effect settings, and the like. The key signature change from MIDI file 546 is used to display the current key signature to the user. Markers in the MIDI file 546 are used to display events at various points in the song. A text label is assigned to each marker of the MIDI file 546. This label corresponds to the JavaScript function to be executed when that label is reached.

  For example, referring briefly to FIG. 6c, a lead sheet 605 has already been selected and shown by the user along with a song (eg, Jamtrack) LA Smooth Jazz in C 601 and its associated score 603. A MIDI marker is associated with the LA Smooth Jazz song. A text label 609 for the MIDI marker 607 is displayed above the score 603 and comes from the MIDI file 546 of the session file 539. In this example, the text label 609 of the MIDI marker 607 represents different parts of the song / audio file 540 as shown, ie, intro, lyrics, bridge, chorus, solo 1, etc. For example, the MIDI marker 607 may have the text label 609 “Chorus”. A MIDI marker 607 for the text label 609 “Chorus” causes the score 603 to be displayed whenever the song chorus begins (eg, chord, score, guitar tablature, lyrics, etc.). As another example, an intro score 603 (eg, a chorus) is shown, as shown in FIG. 6c. Thus, when the computing device 102 receives a MIDI marker 607 from the associated session file 539, it retrieves the corresponding function and processes the MIDI marker using JavaScript to execute the script for it. JavaScript usually loads a picture or draws something on the display device. In this example, when JavaScript receives the “Intro” MIDI marker 607, Java Script displays the intro score 603 (for example, chord) of the selected music, LA Smooth Jazz in C.

  Referring to FIG. 5c illustrating the method 503, at block 528, a session file 539 (eg, an audio file) is presented to present a multimedia presentation of the audio file 540 to the user (eg, including the score 603). 540 and the rest of the multimedia data) are processed. This allows the user to play the guitar 112 in time with the multimedia presentation of the audio file 540 (block 530).

  Referring also to FIG. 6c, the computing device 102 may display pictures, text, and graphics during playback (eg, on the display device 204). For example, the computing device can display the score 603. This allows the current position of the song, usually the lyrics, key signature, and guitar tablature (eg chord, score, figure ring diagram, etc.) during playback of the song / Jamtrack (eg, including the audio file 540). , Etc.), allowing the user to play his / her own guitar 112 in time with the multimedia presentation of the audio file 540.

  For example, in this example of FIG. 6c, a lead sheet 605 having a song (eg, Jamtrack) LA Smooth Jazz in C 601 and its associated score 603 has already been selected by the user and displayed on the GUITARPORT display 671. In this example, a text label 609 of a MIDI marker 607 is displayed, representing different parts of the song / audio file 540, such as intro, lyrics, bridge, chorus, solo 1, etc., as shown. As shown in FIG. 6c, an intro score 603 (eg, chord) is shown. In this example, when JavaScript receives the “Intro” MIDI marker 607, it displays an intro score 603 (eg, chord) of the selected song LA Smooth Jazz in C.

  Therefore, the user can play his / her own guitar 112 in accordance with the score 603 and the audio file 540. As the audio file 540 progresses, the score 603 can be automatically updated so that the user can read the score and perform accordingly (eg, the next part of the song, bridge, chorus, solo, etc.). . In addition, the user can select a version of the song / audio file 540 with or without a guitar track to allow learning and improvisation. Further, as described above, a music / audio file from which vocals, drums, bass, etc. are removed can be selected.

  In addition, the patch block 544 includes patch information so that the guitar 112 has the appropriate tone or sound that matches the associated music / audio file 540. The patch information is set to match the guitar settings in the control panel interface 600 with the selected song / audio file, and the amplifier type, speaker cabinet, and effect settings so that even changes to the song itself can be dealt with. Etc. This can be triggered by a MIDI marker as described above. Application software module 402 sets the control panel graphical interface 600 to the appropriate configuration to model the sound characteristics of the guitar tone for a particular song or piece of music, and the DSP software module 412 appropriately processes the guitar signal to emulate the appropriate tone so that the guitar sound matches the song / audio file 540. As described above, the user's guitar is electrically routed by the computing device 102, which can control the sound of the guitar that the computing device 102 is playing. This allows the model of the amplifier, its settings, and any effects to be changed dynamically through the music / audio file 540 as appropriate. As shown in FIG. 6c, an amplifier model based on a delay set '90 Marshall JCM-800 amplifier is used to emulate the jazz sound to match the intro of the selected LA Smooth Jazz in C song. Thus, a matching patch for each piece of music / Jamtrack is automatically provided, for example, to transition from one tone in the chorus to another in the solo.

  With reference to FIG. 6c, specific aspects of the GUITARPORT display 671 will be discussed to point out other specific features of the present invention. As shown in the drawing, the Track button 688 has already been selected, and the music LA Smooth Jazz in C 601 has been selected by the user. Therefore, the lead sheet 605 with the score 603 related to LA Smooth Jazz in C 601 is further displayed on the GUITARPORT display 671. Below the selected song (eg, Jamtrack) LA Smooth Jazz in C 601 are buttons that control how the song can be selected. Web Load button 611 allows the user to select a song from the GUITARPORT website and load it into the user's computing device 102 (eg, store it in local memory). The Hard Disk button 613 allows the user to select a song that is already stored locally on the computing device 102 (eg, on the user's hard disk). The CD button 615 allows the user to select a song from the CD with the CD drive of the user's computing device 102. If a song on the CD is selected, GUITARPORT server 104 determines whether it has a session file 539 associated with the song, and if so, if the user so chooses, Provide multimedia presentations (eg, patch files, music scores, etc.).

  The Jam button 617, when selected by the user, initiates a multimedia presentation of the song (eg, Jamtrack) so that the user can improvise accordingly. A mixer slide 619 controls the volume of the music. Using pre-determined patch settings in the control panel graphical interface 600 (ie, amplifier settings) automatically selected for the currently playing multimedia presentation (eg, autoselect on) It can be used to toggle the autoselect on / off button 621, contrary to the user setting the control panel graphical interface 600 settings (ie, amplifier settings) themselves to the user's own preferences. it can.

  Typical timer displays 623 for songs (eg, Jamtracks) and loops are provided along with conventional digital multimedia control functions 625 (eg, play, record, stop, rewind, fast forward, etc.). When the Lick Learner button 627 is selected, the tempo of the currently playing music (for example, Jamtrack) is reduced without changing the pitch of the sound to facilitate learning. Also, a Loop button 629 that loops the current part of the music / Jamtrack (for example, intro, chorus, etc.) (ie, plays iteratively) is provided to facilitate learning of that part of the music. In addition, track details 631 that provide information about the song can be selected. For example, if recorded, information about the artist, what type of guitar, amplifier, and effect was used. A credit 633 can be selected that provides information about the origin of the song, such as Sony, Arista, etc., or whether (and by whom) the song was created specifically for the GUITARPORT website. For example, only on the GUITARPORT website, songs (eg, Jamtracks) can be custom created to facilitate the learning of specific types of music, eg, rock, blues, jazz, country, and the like.

  Thus, the present invention allows the user to couple his / her own guitar 112 to the computing device 102 via the interface device 106 so that the user can download tones and songs from the GUITARPORT website. With the purchase, the interface device 106 needs to obtain an online purchase service (eg, downloading music and tones). The interface device 106 uniquely identifies the user, along with the rest of the system 100, authorizes the user to consider in more detail below, encrypts and decrypts audio files, and tracks asset purchases. Used for. Further, in response to the user selecting a song (eg, Jamtrack), the server 104 transmits a session file 539 associated with the song to the computing device 102 via the computer network 105. Session file 539 includes the audio file and multimedia data so that the computing device can process the session file to present a multimedia presentation of the audio file to the user. The computing device 102 allows the user to play a multimedia presentation of the audio file (e.g., the score of the score 603) so that the user can play his / her own guitar 112 in time with the multimedia presentation of the audio file. Process the session file 539 to present (including crawling). In addition, an intuitive control panel graphical interface 600 for a friendly guitar device that resembles a guitar is provided. The control panel graphical interface 600 includes an amplifier panel with standard controls that allows the user to select from a number of different types of amplifiers to achieve different tones. Similarly, a set of effect boxes is also provided.

  As described above, the user can listen to the music while watching the score 603 (for example, chord, melody, tabuture (fingering), lyrics, etc.). The songs can include both commercial songs and songs created solely for use by the GUITARPORT website to facilitate guitar learning. To facilitate practice, the user can improvise to the music version with and without the original guitar track. Thus, the user is provided with fast and easy access to a wide variety of songs (e.g., Jamtracks) that can be downloaded from the server 104. In this case, the user can play along with the downloaded music presented in a multimedia presentation format to facilitate learning.

  Provide users with access to multiple songs (eg, Jamtracks) in a variety of different styles. Music can be recorded on existing sound recordings, remixes of existing sound recordings (examples without guitar or vocal tracks), re-recorded versions of previously published copyright-protected songs, on the GUITARPORT website Original songs provided (eg, songs created to facilitate guitar learning), drum loops, grooves, etc. can be included. In addition, grooves (eg, rhythm sections, drum beats, etc.) can be provided to facilitate improvisation and practice. In addition to music (eg, Jamtracks), the GUITARPORT website includes CDs from multiple recording artists, print sheet music, tabuture, guitar notation, chord charts, lyrics, digital sheet music, The sale of many other music related assets such as T-shirts, music related articles, etc. can also be provided. In addition, as discussed in detail below, each downloaded unique song or tone, or any type of purchase, is tracked for accurate reporting to content licensing partners (eg, copyright owners). And re-recorded.

  Embodiments of the present invention further provide a security device 110 for uniquely identifying a user and decrypting an encrypted asset for use by the computing device 102. Thus, the security device protects authorized material from unauthorized copying and provides a secure revenue opportunity for content providers. Assets typically relate to music (eg, Jamtracks), including audio files (eg, copyright-protected sound recordings), but assets can be any type of data transmitted over a computer network. It should be understood that it may be (eg, multimedia, video, movie, audio, software, general data format, etc.). As discussed in detail below, the security device 110 along with the computing device 102 and server 104, in addition to many other functions, allows the server 104 to uniquely identify the security device 110; A computing device 102 coupled to an authorized security device 110 can decrypt a specially encrypted asset for use by the authorized security device 110. As will be discussed later, the security device 110 is an asset that uniquely identifies each security device 110 to the server 104 and only at the computing device 102 coupled to the authorized security device. Includes a user key combined with an embedded electronic serial number, hardware encryption and key storage circuitry to ensure that it operates and thereby provide a secure revenue opportunity for the content provider.

  Reference is now made to FIG. FIG. 7a illustrates a security system 700 according to one embodiment of the present invention. As described above, the server 104 is coupled to the computing device 102 via the computer network 105, and the computing device 102 is connected to the security device 110 via an I / O link (eg, a USB link). It is connected to the.

  The server 104 shown to highlight the security form of the security system 700 includes a security software module 422, an application software module 416, a server software module 415, a database software module 418, and the present specification. Although not shown in the document, it includes a commercial software module 420. Furthermore, an asset database 107 and a user information database 109 are coupled to the server 104 via a computer network connection.

  The computing device 102 further illustrated to highlight the security aspects of the security system 700 includes an application software module 402 that includes a security software module 408 and security hardware interface software 704. Security device 110 includes security service 706 and security component 710 to implement security service 706. Further, local asset storage 712, for example local memory such as a hard drive, is coupled to or is part of computing device 102 via I / O link 714. . Local asset storage 712 can be used to store assets (eg, audio files) that the user has already downloaded.

  Security device 110 includes a security component 710 that can be used to implement security services 706. Such a security service 706 uniquely identifies the security device 110 to the server 104 so that only users working on the authorized security device 110 are allowed to access the server 104. including. Another security service 706 performed by the security device 110 in conjunction with the server 104 allows only computing devices 102 coupled to a properly authorized security device 110 to receive and use the asset. And ensure that assets (eg, audio files) are properly encrypted and decrypted.

  Looking at the server 104 in detail, the server 104 includes a security software module 422 that includes security programs and algorithms for performing security functions as will be discussed later. The security software module 422 authenticates the user and distributes the encrypted assets to the authenticated user, such as the server 104 clock / calendar and various databases, namely the user information database 109 and the asset database 107. Adjust information from. The clock / calendar is a typical part of the server computer 104 that can accurately determine the date and time. In addition, the server 104 operates in a secure operating environment (eg, using Secure Sockets Layer (SSL), S-HTTP, etc.).

  The user information database 109 is registered to access the server 104 (e.g., a GUITARPORT website purchaser in one embodiment) and includes purchase and registration information for each user with an authorized security device 110. . The purchase information for each user, as will be discussed later, determines the reliability of each security device 110 and the user's purchase due date and the user's security device required to encrypt and decrypt the asset. Contains the user's unique serial number for 110, a user key, and a memory key.

  The asset database 107 contains assets (eg, multimedia presentations associated with songs and audio files such as Jamtracks above, including full songs and songs with various instrument tracks removed) and any other kind of digital Includes data assets. In addition, the asset database 107 includes a unique asset encryption key for each asset (eg, for each audio file). It should also be appreciated that the asset database 107 can include any other asset that can be purchased or borrowed and downloaded to the computing device 102 via the computer network 105.

  Looking at the computing device 102 in detail, the computing device 102 specifically includes an application software module 402 and a security software module 408. The security software module 408 includes standard encryption and decryption routines for encrypting and decrypting assets, as will be discussed later. Any suitable block mode cipher that uses a pseudo-random number generator to XOR pseudo-random numbers with data can be used. Some examples include data encryption standard (DES), international date encryption algorithm (IDEA), and the like. Further, the security software module 408 may be used as a conduit for interaction between the server 104 and the security device 110, specifically authenticating the service device 110, as will be discussed later. it can. However, the application software module 402 and the security software module 408 are not assumed to run in a secure operating environment.

  The security hardware interface software 704 provides a standard input / output interface (eg, USB interface) between the computing device 102 and the security device 110. In addition, the computing device provides a standard clock / calendar (ie, almost all) that allows the application software module 402 to accurately determine the date and time of interaction between the computing device 102 and the security device 110. Common to all computing devices).

  Turning now to FIG. 7b, looking at the security device 110 in detail. FIG. 7b illustrates the attached security component 710 of the security device 110 according to one embodiment of the present invention. As shown in FIG. 7b, the security device 110 includes a microprocessor 340, a secure memory 379 having security logic 380, a program storage 382 that stores security firmware 383, and a non-volatile memory 384 (eg, EEPROM). )including. The I / O controller 716 also controls the flow of digital data to / from the computing device 102 along the serial I / O link 114. In one embodiment, serial I / O controller 716 may be a USB controller and serial I / O link 114 may be a USB link. The digital data controlled by the serial I / O controller 716 can include keys, asset information, and other data as will be discussed later.

  In general, security firmware 383, when executed by microprocessor 340 with secure memory 379 and non-volatile memory 384, allows server 104 to uniquely identify security device 110 and computing device. Providing a secure operation where 102 can work with security device 110 to decrypt assets that are specifically encrypted for use by computing device 102 coupled to authorized computing device 102 To do. Secure memory 379 includes both read-only memory (ROM) and writable memory that can be locked and unlocked for reading and writing using security logic 380 implemented in hardware.

  A user key 387 associated with the security device 110 serial number 386 is used by the security logic 380 to authenticate the security device 110 to the server 104. Memory key 389 is also used by security logic 380 to initially unlock secure memory 379. The serial number 386, the user key 387, and the memory key 389 are sealed in the secure memory 379 during manufacturing, and once the secure memory 379 is sealed, it cannot be written again. The serial number 386, user key 387, and memory key 389 can also be stored in the user information database 109 of the server. Thus, the server 104 first generates a request and response to uniquely authenticate the security device 110 and opens secure memory 379 and non-volatile memory 384, as discussed in more detail below. Can be locked.

  Non-volatile memory 384 is used as an extension to secure memory 379. Firmware 383 blocks access to non-volatile memory 384 unless secure memory 379 is already unlocked. Non-volatile memory 384 has hardware write protection controlled by firmware 383. Non-volatile memory 384 includes a key 388, such as an asset encryption key (eg, audio file key) associated with a particular purchased asset (eg, audio file), purchase of an asset 390 with the current date. The application date and asset information (for example, information about the asset) 392 are stored. Serial number 386, user key 387, memory key 389, key 388, date 390, asset information 392, and in some cases firmware 383 is also in any of the security device's memory, ie program storage 382, secured It is to be understood that this specific configuration is merely an example, although it can be located in or co-located with either the memory 379 or the non-volatile memory 384.

  Further, as will be discussed later, the security software of the server 104, the computing device 102, and the firmware of the security device 110 may include assets, keys, dates, and other data transmitted between these devices. Includes standard encryption and decryption routines to encrypt and decrypt. Any suitable block mode cipher that uses a pseudo-random number generator to XOR pseudo-random numbers with data can be used. Some examples include data encryption standards (DES), international date encryption algorithms (IDEA), and the like.

  Various security functions performed by the combination of server 104, computing device 102, and security device 110 will now be discussed with reference to the flowcharts of FIGS.

  One security function to be performed is that the computing device 102 coupled to the security device 110 allows access to the server 104 and many of its functions (eg, the GUITARPORT website in one embodiment). In order to ensure that it is done, the server 104 uniquely identifies the security device 110. In addition, the server 104 determines the reliability of the security device 110 to prevent unauthorized access to the server 104 and its assets (eg, audio files). This is done when the user first attempts to log on to the server 104 and can be performed periodically thereafter. This authentication process includes the server 104 issuing a request encoded in the security device in a scripting language that is executed by the security software module 422 of the server 104. The firmware 383 of the security device 110 executes a program to generate a response. The authorized security device 110 returns its own response, and the server 104 using the security software module 422 validates the response. If the response is valid for a particular security device 110, the session continues. If the response is not valid, the session ends.

  Refer to FIG. FIG. 8a is a flow diagram illustrating a process 800 for the server 104 to authenticate the security device 110 according to one embodiment of the invention. These process steps 800 are generally performed by the security software module 422 of the server 104 along with other software modules at the server. Initially, the server 104 requests the serial number 386 stored in the secure memory 379 of the security device 110 from the security device 110 (block 802). In response to the received serial number, at block 803, the server determines whether the serial number is in the user information database 109. If not, the session is terminated (block 805). However, if the serial number is in the user information database 109, the server 104 obtains the user key for that serial number from the user information database 109 (block 806). As described above, the user information database 109 stores a unique user key for each serial number associated with each security device 110. Server 104 also obtains the time and date from the clock / calendar of server 104, which are later used to determine if the purchase has expired (block 808).

  The server 104 then calculates the request (block 810) and the expected response from the security device 110 (block 812). The request is basically a request for the security device 110 to correctly identify itself by sending an appropriate response. The request is made at server 104 by performing a mathematical transformation on user key 387 associated with security device 110. Server 104 so that the response generated at security device 110 is the same as the response generated at server 104 (assuming that it is actually the security device associated with the serial number for the user). And the security device 110 both use the same mathematical transformation and have the same user key 387. In one embodiment, the mathematical transformation common to server 104 and security device 110 may be any suitable one-way hashing function.

  A request is then sent from the server 104 to the security device 110 (block 814). Server 104 then waits for a response from security device 110 (block 816). When the predetermined period has elapsed, the process 800 times out and the session ends (block 817). However, if the response is received within a predetermined period of time, the server 104 determines whether the response from the security device 110 matches the expected response (block 818). If not, the session ends (block 819). If there is a match, the user is allowed to log on to the server 104 and the process 800 is complete (block 821). For example, the user can access the GUITARPORT website as described above.

  Reference is now made to FIG. FIG. 8b is a flow diagram illustrating a process 822 in which the security device 110 responds to an authentication request from the server 104 according to one embodiment of the invention. These process steps 822 are generally performed under the control of firmware 383 of security device 110. First, user key 389 is obtained from secure memory 379 (block 824). Next, at block 826, a response to the request is calculated. As noted above, the response is typically a mathematical transformation of user key 389 (also common to server 104 and security device 110), common to both server 104 and security device 110 (eg, One-way hashing function). A response to the request is then sent to the server 104 (block 828). Process 822 is then complete (block 830).

  Other security functions implemented by the combination of server 104, computing device 102, and security device 110 relate to updating the current date and purchase due date stored in security device 110. The current date and purchase due date 390 are stored in the non-volatile memory 384 of the security device 110. Server 104 updates both the purchase due date and current date 390 of security device 110. However, the application software module 402 of the computing device 102 updates the current date 390 even when not connected to the server 104. Since the application software module 402 does not appear to be secure, the server 104 updates the purchase due date and current date 390 for security preservation when connected.

  Refer to FIG. FIG. 8c is a flow diagram illustrating a process 832 where the server 104 updates the security device 110 with the current date and purchase due date according to one embodiment of the invention. These process steps 832 are generally performed by the security software module 422 of the server 104 along with other software modules at the server 104. First, a purchase due date from the user information database 109 is obtained for the user (block 834). Next, the current date from the clock / calendar of server 104 is obtained (block 836). The purchase due date and the current date are then encrypted (block 838). In addition, the server 104 sends a command to the security device 110 to unlock the security device memory 721 including the non-volatile memory 384 (block 840). FIG. 8d illustrates the process of unlocking the security device memory 721 as will be discussed later. Based on the response from the security device 110 regarding whether the security device memory 721 has already been successfully unlocked, the server 104 determines whether the unlock operation was successful (block 842). If the security device memory 721 is not successfully unlocked, the process 832 fails (block 844).

  However, if the security device memory 721 is successfully unlocked, the server 104 sends the encrypted purchase due date and current date to the security device 110, where the security device 110 updates the date. (Block 846). As will be discussed later, FIG. 8e shows the process by which the security device 110 updates the date. The server then sends a command to the security device to lock the security device memory 721 (block 848). FIGS. 8f and 8g illustrate the process of locking the security device memory 721 as will be discussed later. Process 832 is then complete (block 850).

  Refer to FIG. FIG. 8d is a flow diagram illustrating a process 852 in which the server 104 unlocks the security device memory 721 of the security device 110 according to one embodiment of the invention. At block 854, server 104 obtains serial number 386 from security device 110. Next, at block 856, the server obtains the memory key 389 associated with the serial number associated with the user from the user information database 109. Server 104 then obtains the current time and date from the clock / calendar of server 104 (block 858). The server then obtains the current ciphertext from the security device 110 (block 860). The current ciphertext is a random number generated by the security device 110 each time the security device 110 is authenticated by the server 104.

  Server 104 then calculates an unlock message to unlock security device memory 721 and an appropriate expected response value from security device 110 (block 862). Server 104 then sends a memory unlock message to security device 110 (block 864).

  If the unlock message is valid, i.e., decipherable by the security device 110 to properly instruct the security device 110 to unlock its security device memory 371 (and thus the security device and The security device 110 sends the expected response back to the server 104. Both of the servers are authorized participants). The server 104 will verify that the appropriate expected response returned from the security device 110 is that it is an authorized security device 110 and therefore the security device memory 371 is unlocked. Request. Conversely, the security device 110 can verify that the server 104 is authorized to instruct the security device to unlock its security device memory 371 based on the unlock message. In one embodiment, systematic expected responses generated by server 104 using memory key 389 and ciphertext and responses generated by security device 110 are licensed by ELVA, Inc. It can be based on a proprietary communication interception prevention algorithm. However, any suitable zero knowledge proof algorithm that can accurately authenticate the two parties can be used. Further, in one embodiment, the security logic 380 that implements the ELVA eavesdropping prevention algorithm may be an ATMEL cryptographic device.

  Continuing with this example, server 104 waits for a predetermined period of time for an appropriate response from security device 110 (block 866). If the security device 110 has not responded for a predetermined period of time, the process 852 fails (block 868). If server 104 receives a response from security device 110 in time, at block 870, server 104 determines whether an expected response from security device 110 has already been received. If not, process 852 fails (block 872). If the server 104 receives an expected response from the security device 110, the server 104 knows that the security device memory 721 of the security device 110 has already been unlocked. Accordingly, the memory is unlocked so that the security device can update the current and due date dates received from the server 104 for later verification with reference to FIG. 8e. Process 852 is then complete (block 873). Furthermore, it will be appreciated that the security device memory 721 can be unlocked to perform many other functions, such as storing asset information 392, asset key 391, etc., for later verification. I want.

  Refer to FIG. FIG. 8e is a flow diagram illustrating a process 874 for updating the current date and the due date for the security device 110 received from the server 104, according to one embodiment of the invention. Again, the security device operates under firmware 383 control to perform its function. At block 876, the security device 110 decrypts the current date and purchase due date received from the server 104. Next, at block 878, the security device 110 stores the current date and the purchase due date 390 in the non-volatile memory 384. Process 874 is then complete (block 880).

  Refer to FIG. FIG. 8f is a flow diagram illustrating a process 882 where the server 104 locks the non-volatile memory 384 of the security device memory 721 of the security device 110 according to one embodiment of the invention. To accomplish this, the server 104 only sends a memory lock command to the security device 110 (block 884). Process 882 is then complete (block 886).

  After the server 104 sends a memory lock command to lock the non-volatile memory 384, the security device 110 can lock the secure memory 379. Reference is now made to FIG. FIG. 8g is a flow diagram illustrating a process 888 for the security device 110 to lock the secure memory 379, according to one embodiment of the invention. At block 890, security device 110 determines whether secure memory 379 is unlocked. If not unlocked, that is, if it is indicated that secure memory 379 is already locked, process 888 is complete (block 899). If the secure memory 379 is unlocked, the security device 110 checks whether a lock memory command has already been received (block 892). If so, security device 110 locks secure memory 379 and security logic 380 (block 894) and disables access to non-volatile memory 384 (block 898). Program 888 is then complete (block 899).

  However, if a lock memory command has not yet been received at block 892, the security device 110 checks whether the memory unlock time has already elapsed. If not, the process 888 is complete and the security device 110 may later lock the security device memory 721 (block 899). On the other hand, if the memory unlock time has already passed, the security device 110 locks the secure memory 379 and the security logic 380 (block 894) and disables access to the non-volatile memory 384 ( Block 898). Accordingly, process 888 is then complete (block 899). Thus, once the secure memory 379 is locked, similar to the non-volatile memory 384, the entire security device memory 721 is locked. Thus, after the security device memory 721 has already been unlocked to update the current date and purchase due date to store asset information 392, asset key 391, etc., it may be locked again. it can.

  As described above, the application device module 402 and security software module 408 of the computing device 102 can be used to update the current date and time on the security device 110. However, this is not secure and, as described above, these dates and times are always examined in detail against the date and time received from the server 104.

  Reference is now made to FIG. The diagram is a flow diagram illustrating a process 801 in which the application software module 402 of the computing device 102 updates the current date with the security device 110 along with other software modules, according to one embodiment of the invention. At block 805, the computing device 102 determines whether the security device 110 is requesting a date and time. If not, process 801 is complete (block 807). However, if the security device 110 is requesting a date and time, the computing device 102 obtains the date and time from the clock / calendar of the computing device 102 (block 809). The computing device 102 then sends the date and time to the security device 110 (block 811). Process 801 is then complete (block 813).

  Reference is now made to FIG. FIG. 8i is a flow diagram illustrating a process 815 for updating the current date and time received by security device 110 from computing device 102, according to one embodiment of the invention. At block 823, the security device 110 determines whether the received current date has passed the purchase due date. If so, the security device 110 records the purchase expiration (eg, in non-volatile memory 384) (block 825). Process 815 is then complete (block 827). The security device 110 then instructs the computing device 102 to display to the user that the user has expired, and the server 104 instructs the user to renew the purchase on the next connection.

  On the other hand, if the current date has not passed the purchase due date, the security device 110 is trusted that the date received from the application software module 402 of the computing device 102 received from the server 104 since the last update. It is determined whether or not the date and time are valid (block 829). If not, the security device 110 assumes that there has been a security violation and records the purchase expiration (block 825). Process 815 is then complete (block 827). Again, the security device 110 can instruct the computing device 102 to display to the user that the user's purchase has expired, and the server 104 can update the purchase on the next connection. To instruct. However, if the date from the application software module 402 of the computing device 102 is determined to be valid by the security device 110, the security device stores the date and time 390 in the non-volatile memory 384 (block). 831). Process 815 is then complete (block 833).

  Another security device 706 executed by the security device 110 in conjunction with the server 104 is digital only for the computing device 102 coupled to the appropriately authorized security device 110 to receive and use the asset. Ensure that assets (eg, audio files) are properly encrypted and decrypted. As described above, the asset database 107 may include assets (eg, multimedia presentations associated with a song, audio files (eg, Jamtracks as described above, including songs from which a full song or various instrument tracks have been removed). )) As well as other digital data assets. In addition, the asset database 107 includes a unique asset encryption key for each asset (eg, for each audio file). In addition, the asset database 107 may be purchased or borrowed and downloaded to the computing device 102 that is coupled to the authorized security device 110 via the computer network 105. It should be understood that data assets (eg, multimedia data, video data, voice data, software, other common formats of data, etc.) can also be included. Thus, as used below, the term “asset” specifically includes audio files (eg, Jamtracks, etc., described above with respect to the GUITARPORT website), but any other type of digital asset. In addition.

  Embodiments of the present invention further provide a secure asset delivery system. Assets are encrypted by the security system 700 to protect against unauthorized copying of authorized material (again, see also FIG. 7a). Each asset is stored in the asset database 107 of the server 104 and is specially encrypted with a different unique asset key for that asset. Each asset is uniquely encrypted using the security software module 422 of the server 104 along with other software modules. As each encrypted asset is streamed to the requesting computing device 102, the encrypted asset is stored in the asset storage 712 of the computing device 102. In addition, the asset key for that asset is encrypted using the user key of the associated security device 100 of the requesting computing device 102, and the encrypted asset key is the requesting computing device. It is also streamed to device 102 where it is stored in asset storage 712 of computing device 102. As described above, each user key 389 is unique to each user's security device 110 and each user key 389 is stored in both the security device 110 and the user information database 109 of the server 104.

  When accessing an asset on the computing device 102, for example, the user plays a downloaded audio file asset (eg, as part of a multimedia presentation to Jamtrack to facilitate guitar learning) Security software module 408, along with application software module 402 and other software modules of computing device 102, sends to security device 110 to decrypt the encrypted asset key. To do. The decrypted asset key is then sent back from the security device 110 to the computing device 110 where it is used by the computing device 102 to decrypt the asset (eg, an audio file) into memory. The security software module 408 operates again with the application software module 402 and other software modules. The decrypted asset is then used. For example, the decrypted audio file can be decompressed for playback.

Reference is now made to FIG. FIG. 9 shows an example of a secure asset delivery system 900 as described above, according to one embodiment of the present invention. At block 902, asset (A) 904 is encrypted with asset key (AK) 906. Encrypted asset 905 (eg, (E _AK (A))) is then transmitted to computing device 102 where it is stored in memory (eg, asset storage 712) (block 910). Also, at block 920, the asset key (AK) 906 is encrypted with the user key (UK) 389 of the user. The encrypted asset key 909 (eg, (E _UK (AK))) is then transmitted to the computing device 102 where it is stored in memory (block 924). At block 930, the security device 110 converts the encrypted asset key 909 to the user's unique user key (UK) 389 (eg, D _UK [E _UK ) to obtain the asset key 906 (AK). (AK)]) and the asset key 906 (AK) is then transferred to the computing device 102. Next, at block 932, the computing device 102 decrypts the encrypted asset 905 with an asset key (AK) 906 (eg, D _AK [E _AK (A)]) to obtain asset (A). can do. This asset is then used by the application software module 402 of the computing device 102. For example, if the asset is an audio file, the audio file can be decompressed for playback as part of a Jamtrack multimedia presentation to facilitate guitar learning. It should be understood that encryption and decryption algorithms are well known in the art, and various types of encryption and decryption algorithms can be used by server 104, computing device 102, and security device 110.

  The server 104 security software, computing device 102, and security device 110 firmware are standard for encrypting and decrypting assets, keys, dates, and other data transmitted between these devices. Includes encryption and decryption routines. Any suitable block mode cipher that uses a pseudo-random number generator to XOR pseudo-random numbers with data can be used. Some examples include data encryption standard (DES), international date encryption algorithm (IDEA), and the like.

  Next, consider a more detailed embodiment of a secure asset delivery system 900 according to an embodiment of the present invention. As described above, the server 104 encrypts each asset sent to the user with a unique asset key. In addition, the server 104 also transmits an indication as to whether the asset is lent or owned by the user. The lent asset expires when the user's purchase period expires and cannot be used after purchase. Assets owned by the user do not expire even after the user's purchase expiration date. Server 104 further sends the unique asset key required to decrypt the asset to the user in encrypted form. In this case, the asset key has been encrypted for the user with the user key 389 of the security device 110, so that the security device 110 can decrypt the encrypted asset key and then compute Device 102 can decrypt the asset with the decrypted asset key to provide user access to the asset. Thus, assets can be delivered securely to specific users with specific security devices.

  The computing device 102 operates in conjunction with the application software module 402, security software module 408, and other software modules to perform many functions related to decrypting and accessing assets as described above. . The computing device 102 receives and stores the encrypted asset and the encrypted asset key in local memory (eg, asset storage 712). The computing device 102 sends the encrypted asset key (and an indication of whether the asset is borrowed or owned) to the security device 110. The security device 110 under the control of the firmware 383 decrypts the asset key and determines whether the asset has expired because the purchase has expired. If the asset has not expired, the security device 110 sends the decrypted asset key to the computing device 102 so that the asset can be decrypted and then used by the computing device. As described above, the computing device 102 decrypts the asset with the asset key to obtain the asset.

  On the other hand, if the purchase time limit has expired, the security device 110 notifies the computing device 102, and the computing device 102 notifies the user that the purchase time limit has expired. Next, the specific process steps to realize this function are examined.

  Refer to FIG. FIG. 10a is a flow diagram illustrating a process 1000 for the server 104 to encrypt assets according to one embodiment of the invention. Server 104 operates under the control of application software module 416, security software module 422, and other software modules to implement the functionality of these processes, as will be discussed later. At block 1002, the server 104 obtains the time and date from the server 104 clock / calendar. Next, the server 104 generates an encryption key (block 1004). Server 104 then encrypts the asset with the unique asset key (block 1006). Server 104 then stores the encrypted asset and asset key in asset database 107 (block 1008). The process 1000 is then complete (block 1010).

  Reference is now made to FIG. FIG. 10b is a flow diagram illustrating a process 1012 in which the server 104 delivers assets according to one embodiment of the invention. At block 1014, the server 104 obtains the asset, asset key, and status indication from the asset database 107 whether the asset is owned or borrowed. The status indication can be implemented as a rental flag. For example, a set rental flag corresponds to an asset borrowed by the user, and a rental flag that is not set corresponds to an asset owned or purchased by the user. In addition, the server 104 obtains a user key 389 for the user from the user information database 109 (corresponding to the user's security device 110) (block 1016). Server 104 then encrypts the asset key and rental flag using the user's user key 389 (block 1018). Server 104 then sends the encrypted asset key and rental flag to computing device 102 (block 1020). In addition, the server 104 sends the encrypted asset to the computing device 102 (block 1022). The process 1012 is then complete (block 1024).

  Reference is now made to FIG. FIG. 10c is a flow diagram illustrating a process 1026 where the computing device 102 performs the function of extracting an asset key from the security device 110 according to one embodiment of the invention. The computing device 102 operates under the control of the application software module 402, the security software module 408, and other software modules to implement the functions of these processes, as will be discussed later. At block 1028, the computing device 102 sends the encrypted asset key and rental flag received from the server 104 to the security device 110. Next, the computing device 102 obtains a response from the secure device 110 (block 1030). The response includes a notification as to whether the asset has expired, and also includes a decrypted asset key if the asset has not expired. Response generation at security device 110 will be discussed later with reference to FIG. 10e.

  At block 1032, the computing device 102 determines whether access to the asset has expired based on the response from the security device 110 (block 1032). For example, if an asset has been borrowed and the purchase has expired (ie, the current date has passed the asset's purchase expiration date), access to the asset has already expired. Thus, if access to an asset has expired, at block 1034, the computing device 102 notifies the user that access to the asset has already expired. If access to the asset has not yet expired (ie, the asset is owned or the purchase due date has not passed), the computing device extracts the asset key from the security device response ( Block 1036). Process 1026 is then complete (block 1038).

  Reference is now made to FIG. FIG. 10d is a flow diagram illustrating a process 1040 for the computing device 102 to perform the function of decrypting an asset according to one embodiment of the invention. At block 1042, the computing device 102 initializes a decryption algorithm with the asset key received from the security device 110. The computing device 102 then loads the encrypted asset into memory (block 1044). The computing device 102 then uses the asset key received from the security device 110 to decrypt the encrypted asset (ie, the encrypted asset that has been encrypted with the asset key). And decrypting the memory copy of the encrypted asset (block 1046). Accordingly, an asset is obtained at the computing device 102 for use by the computing device 102. The asset can then be used by an application on the computing device 102. For example, if the asset is an audio file, the audio file may be decompressed for playback as part of a Jamtrack multimedia presentation to facilitate guitar learning, as described above. it can.

  Reference is now made to FIG. FIG. 10e is a flow diagram illustrating a process 1050 for the security device 110 to extract an asset key, according to one embodiment of the invention. As described above, the security device 110 operates under the control of the firmware 383. At block 1052, the security device 110 receives the encrypted asset key and rental flag from the computing device 102. The encrypted asset key and rental flag are encrypted with the user key. Security device 110 then obtains user key 389 from non-volatile memory 384 (block 1054). Next, the security device 110 decrypts the asset key and rental flag with the user key 389 (block 1056).

  The security device then determines whether the asset is borrowed (block 1058). If not borrowed (ie, owned), the security device 110 returns the decrypted asset key to the computing device 102 (block 1060) and the process 1050 is complete (block 1068). However, if the asset is borrowed, the security device 110 determines whether the purchase has already expired (ie, whether the current date has passed the purchase expiration date for the asset) (block). 1062). If not, the security device 110 returns the decrypted asset key to the computing device 102 (block 1060) and the process 1050 is complete (block 1068). However, if the purchase has expired, the security device 110 returns a response to the computing device 102 with an indication that the purchase has expired (block 1064). Process 1050 is then complete (block 1068).

  The server 104 security software, computing device 102, and security device 110 firmware encrypt and decrypt assets, keys, dates, and other data transmitted between these devices, as described above. It should be understood that standard encryption and decryption routines are used for this purpose. Any suitable block mode cipher that uses a pseudo-random number generator to XOR pseudo-random numbers with data can be used. Some examples include data encryption standards (DES), international date encryption algorithms (IDEA), and the like.

  Thus, as noted above, a secure asset delivery system allows only a computing device coupled to a properly authorized security device associated with a particular user / buyer to receive and use the asset. Ensuring that digital assets are encrypted and decrypted so that they can. An embodiment of the present invention is a secure asset delivery system in which digital assets are properly encrypted by a secure server 104 and coupled to a properly authorized security device 110. A system that can only be decrypted by a computing device 102 is provided. As a result, only this properly authorized computing device 102 can receive and use the asset and is therefore protected from unauthorized copying of authorized material. As described above, in one embodiment, the asset database 107 is an asset file (eg, a multimedia presentation associated with a song, an audio file such as Jamtracks that contains songs that have been stripped of full songs and various instrument tracks) ), As well as other digital assets. For example, in one embodiment, if the asset is an audio file, as described above, the audio file is decompressed for playback as part of a Jamtrack multimedia presentation to facilitate guitar learning. can do. In addition, the asset database 107 may be any other digital asset (eg, multimedia, video, movie, voice, etc.) that can be purchased or borrowed and downloaded to the computing device 102 via the computer network 105. It should be understood that sound recordings, software, other common formats of data, etc.) can be included.

  The various aspects of the invention described above can be implemented as one or more instructions (eg, software modules, programs, code segments, etc.) to perform the functions described above. When read and executed by a processor, this instruction causes the processor to perform the operations necessary to implement and / or use the embodiments of the invention. Generally, the instructions are tangibly implemented in and / or readable from a machine-readable medium, device or carrier, such as a memory, data storage device and / or remote device. The instructions can be loaded into memory of the computing device 102, server 104, and interface device 106 from memory, data storage devices, and / or remote devices for use during operation. The instructions can be used to cause a general purpose processor or dedicated processor programmed with the instructions to perform the steps of the present invention. Alternatively, the features or steps of the present invention may be performed by a specific hardware component that includes hardwired logic for performing the steps, or by any combination of programmed computer components and application specific hardware components. can do. While the embodiments of the present invention have been described with reference to the World Wide Web, the methods, systems, and devices described herein are equally applicable to other network infrastructures or other data communication systems. .

  As mentioned above, although the present invention and its various functional components have been described in specific embodiments, the embodiments of the present invention can be realized by hardware, software, firmware, middleware, or a combination thereof. It should be understood that the system, subsystem, component, or can be used with these subcomponents. When implemented in software (eg, as a software module), an element of the invention is an instruction / code segment for performing a required task. A program or code segment may be stored on a machine-readable medium, such as a processor-readable medium or a computer program product, but also transmitted by a computer data signal or a carrier-modulated signal implemented in a carrier wave form. You may transmit via. A machine-readable medium or processor-readable medium may include any medium that can store or transfer information in a form readable and executable by a machine (eg, a processor, a computer, etc.). Examples of machine / processor readable media include electrical circuits, semiconductor memory devices, ROM, flash memory, erasable programmable ROM (EPROM), floppy diskette, compact disk CD-ROM, optical disk, hard disk, optical Fiber media, radio frequency (RF) links, etc. are included. A computer data signal may include any signal that can propagate through a transmission medium such as an electronic network channel, optical fiber, air, electromagnetic, RF link, and the like. The code segment can be downloaded via a computer network such as the Internet, an intranet, or the like.

  While the invention has been described with reference to illustrative embodiments, this description is not intended to be construed in a limiting sense. Various modifications of the exemplary embodiments, as well as other embodiments of the invention, which will be apparent to those skilled in the art to which the invention pertains, are considered to be within the spirit and scope of the invention.

1 is a block diagram illustrating an example system for delivering a multimedia presentation of an audio file to a computing device, according to one embodiment of the invention. FIG. FIG. 2 illustrates a conventional data processing or computer system that can be used with embodiments of the present invention. FIG. 2b shows an exemplary architecture of the conventional data processing or computer system shown in FIG. 2a. 1 is a plan view of an interface device according to an embodiment of the present invention. FIG. 1 is a front view of an interface device according to an embodiment of the present invention. FIG. 1 is a rear view of an interface device according to an embodiment of the present invention. FIG. 2 is a schematic diagram of the internal components of an interface device according to an embodiment of the present invention. 2 is a schematic diagram of the internal components of an interface device according to an embodiment of the present invention. FIG. 2 shows a more detailed view of an example system for delivering a multimedia presentation of audio files to the computing device of FIG. 1, showing exemplary software modules used, according to one embodiment of the invention. It is a block diagram. 4 is a flow diagram illustrating a method for delivering a multimedia presentation to a user according to one embodiment of the invention. 4 is a flow diagram illustrating a method for providing a tone to a user according to one embodiment of the invention. 4 is a flow diagram illustrating a method for providing music to a user according to one embodiment of the invention. FIG. 4 shows the contents of a session file according to an embodiment of the present invention. 6 is a screenshot specifically illustrating a guitar control panel graphical interface (eg, when the instrument is a guitar embodiment), according to one embodiment of the present invention. 4 is a screenshot of a display shown to a user when the user has successfully logged on to a server, according to one embodiment of the present invention. 4 is a screenshot of a display shown to a user when the user has successfully logged on to a server, according to one embodiment of the present invention. 4 is a screenshot showing a display shown to the user when the user selects a song (e.g., Jamtrack) according to an embodiment of the present invention so that the user can play his / her own guitar for a multimedia presentation. FIG. 7 is a screen shot specifically showing a multimedia presentation (for example, with a score) for a selected music piece. 4 is a screenshot showing a display shown to the user when the user selects a song (e.g., Jamtrack) according to an embodiment of the present invention so that the user can play his / her own guitar for a multimedia presentation. FIG. 7 is a screen shot specifically showing a multimedia presentation (for example, with a score) for a selected music piece. 1 illustrates a security system according to one embodiment of the present invention. FIG. FIG. 3 illustrates attached security components of a security device used in a security system, according to one embodiment of the present invention. 3 is a flow diagram illustrating a process for a server to authenticate a security device, according to one embodiment of the invention. 4 is a flow diagram illustrating a process in which a security device responds to an authentication request from a server according to an embodiment of the invention. 3 is a flow diagram illustrating a process by which a server updates a security device with a current date and purchase expiration date according to one embodiment of the invention. 4 is a flow diagram illustrating a process by which a server unlocks a security device's security device memory, according to one embodiment of the invention. 4 is a flow diagram illustrating a process for updating current and purchase expiration dates received by a security device from a server, according to one embodiment of the invention. 3 is a flow diagram illustrating a process by which a server locks non-volatile memory of a security device memory of a security device, according to one embodiment of the invention. 3 is a flow diagram illustrating a process by which a security device locks security device memory, according to one embodiment of the invention. 4 is a flow diagram illustrating a process by which a computing device updates the current date with a security device, according to one embodiment of the invention. 4 is a flow diagram illustrating a process for updating a current date and time received by a security device from a computing device, according to one embodiment of the invention. 1 is a diagram illustrating an example of a secure asset delivery system according to an embodiment of the present invention. FIG. 4 is a flow diagram illustrating a process by which a server encrypts assets according to one embodiment of the invention. 4 is a flow diagram illustrating a process by which a server delivers assets according to one embodiment of the invention. 4 is a flow diagram illustrating a process for a computing device to perform the function of extracting an asset key from a security device, according to one embodiment of the invention. 4 is a flow diagram illustrating a process for a computing device to perform the function of decrypting an asset, according to one embodiment of the invention. 4 is a flow diagram illustrating a process by which a security device extracts an asset key according to one embodiment of the invention.

Claims (69)

In a system for delivering a multimedia presentation of an audio file to a computing device for display to a user so that the user can play an instrument in time with the multimedia presentation,
A server for sending a session file over a computer network to a computing device in response to a user's selection of a song for the computing device to present a multimedia presentation of an audio file to the user A server that is associated with the selected song to process the session file, the session file including the audio file and multimedia data;
An interface device connected to the computing device and the user's instrument, the interface coupling the instrument to the computing device so that the user can play the instrument in time with the multimedia presentation of the audio file A system that includes devices.   The system of claim 1, wherein the instrument control panel graphical interface having settings that define sound characteristics for the instrument is displayed by the computing device.   The system of claim 2, wherein the control panel graphical interface allows a user to set sound characteristics for the song.   Request to set multimedia data in the session file to pre-determined values in the control panel graphical interface to model the sound characteristics of the instrument associated with the audio file for a user-selected song Item 3. The system according to Item 2.   Remove tracks associated with the user's instrument from the audio file of the user's selected song so that the user can play the user's instrument in time with the multimedia presentation of the audio file that does not include the user's instrument The system of claim 1, wherein:   The system of claim 1, wherein the multimedia data of the session file displays a score associated with the audio file of the song selected by the user.   The system of claim 1, wherein the server identifies the user based on a unique identifier stored on the interface device.   The system of claim 7, wherein the unique identifier stored in the user's interface device is a serial number associated with the interface device.   The system of claim 7, wherein the server matches the presentation of the music to the user based on the unique identifier.   The system of claim 7, wherein the interface device stores a user key associated with the interface device.   The audio file sent from the server to the user's computing device is encrypted with the audio file key associated with the audio file, and the audio file key is encrypted with the user key for the user. 12. The system of claim 10, wherein the system is also transmitted to the computing device.   The interface device is encrypted with the user key using the stored user key so that the computing device uses the decrypted audio file key to decrypt the audio file. 12. The system of claim 11, wherein the system decodes the audio file key and transmits the decrypted audio file key to the computing device.   The system of claim 1, wherein the musical instrument is a microphone.   The system of claim 1, wherein the musical instrument is a guitar.   15. The system of claim 14, wherein a control panel graphical interface including a guitar amplifier and having settings that define a guitar sound characteristic is displayed by the computing device.   Requests that multimedia data in the session file set the control panel graphical interface to a predetermined value to model the sound characteristics of the guitar associated with the audio file for the user-selected song Item 16. The system according to Item 15.   The guitar track is removed from the audio file of the song selected by the user so that the user can play the user's guitar in time with the multimedia presentation of the audio file that does not include the guitar track. The system described in.   The system of claim 16, wherein the multimedia data of the session file displays a guitar score associated with the audio file of the song selected by the user. In a method for delivering to a user a multimedia presentation of an audio file that allows the user to play an instrument in time with the multimedia presentation,
Transmitting a session file associated with the song and including the audio file and multimedia data in response to the user's selection of the song;
Processing the session file using a computing device to present a multimedia presentation of the audio file to a user;
Coupling the instrument to the computing device by performing an analog to digital conversion of the analog signal of the instrument so that the user can play the instrument in time with the multimedia presentation of the audio file.   20. The method of claim 19, further comprising displaying an instrument control panel graphical interface having settings that define sound characteristics for the song.   21. The method of claim 20, wherein the control panel graphical interface allows a user to set sound characteristics for the song.   Request to set multimedia data in the session file to pre-determined values in the control panel graphical interface to model the sound characteristics of the instrument associated with the audio file for a user-selected song Item 21. The method according to Item 20.   Remove tracks associated with the user's instrument from the audio file of the user's selected song so that the user can play the user's instrument in time with the multimedia presentation of the audio file that does not include the user's instrument The method of claim 19, further comprising:   20. The method of claim 19, further comprising displaying to the user a score associated with an audio file of a song selected by the user in the multimedia presentation.   The method of claim 19, further comprising identifying the user based on the unique identifier.   26. The method of claim 25, wherein the unique identifier is a serial number.   26. The method of claim 25, further comprising the step of tailoring the music presentation to the user based on the unique identifier.   26. The method of claim 25, further comprising storing a user key. Encrypting an audio file sent to the user's computing device with an audio file key associated with the audio file;
29. The method of claim 28, further comprising encrypting the audio file key with a user key for the user. Decrypting the audio file key encrypted with the user key using the stored user key;
30. The method of claim 29, further comprising: decrypting the audio file with the decrypted audio file key.   The method of claim 19, wherein the musical instrument is a microphone.   The method of claim 19, wherein the musical instrument is a guitar.   33. The method of claim 32, further comprising displaying a control panel graphical interface that includes a guitar amplifier and has settings that define the sound characteristics of the guitar.   Requests that multimedia data in the session file set the control panel graphical interface to a predetermined value to model the sound characteristics of the guitar associated with the audio file for the user-selected song Item 34. The method according to Item 33.   Further comprising removing the guitar track from the audio file of the user-selected song so that the user can play the user's guitar in time with the multimedia presentation of the audio file that does not include the guitar track 35. The method of claim 34.   35. The method of claim 34, further comprising displaying to the user a score for a guitar associated with an audio file of a song selected by the user in the multimedia presentation. When executed by a computer
An operation for sending a session file associated with the song, including an audio file and multimedia data, in response to the user's selection of the song;
Processing the session file to present a multimedia presentation of the audio file to the user;
Computer readable storing instructions that cause a computer to perform operations including operations that perform analog-to-digital conversion of an analog signal of an instrument so that a user can play the instrument in time with a multimedia presentation of an audio file Medium.   38. The computer readable medium of claim 37, further comprising an operation of creating and displaying an instrument control panel graphical interface having settings that define sound characteristics for the song.   40. The computer readable medium of claim 38, wherein the control panel graphical interface allows a user to set sound characteristics for the song.   Request to set multimedia data in the session file to pre-determined values in the control panel graphical interface to model the sound characteristics of the instrument associated with the audio file for a user-selected song Item 40. The computer-readable medium according to Item 38.   Remove tracks associated with the user's instrument from the audio file of the user's selected song so that the user can play the user's instrument in time with the multimedia presentation of the audio file that does not include the user's instrument 38. The computer readable medium of claim 37, further comprising operations for:   38. The computer readable medium of claim 37, further comprising an operation for displaying to a user a score associated with an audio file of a song selected by the user in the multimedia presentation.   38. The computer readable medium of claim 37, further comprising an operation of identifying a user based on a unique identifier.   44. The computer readable medium of claim 43, wherein the unique identifier is a serial number.   44. The computer-readable medium of claim 43, further comprising an operation of matching the presentation of the music to the user based on the unique identifier.   44. The computer readable medium of claim 43, further comprising an operation for storing a user key. An operation of encrypting an audio file sent to the user's computing device with an audio file key associated with the audio file;
The computer-readable medium of claim 46, further comprising: an operation of encrypting the audio file key with a user key for the user. An operation to decrypt the audio file key encrypted with the user key using the stored user key;
49. The computer readable medium of claim 48, further comprising an operation of decrypting the audio file with the decrypted audio file key.   38. The computer readable medium of claim 37, wherein the musical instrument is a microphone.   38. The computer readable medium of claim 37, wherein the musical instrument is a guitar.   51. The computer readable medium of claim 50, further comprising an operation of creating and displaying a control panel graphical interface including a guitar amplifier having settings that define sound characteristics for the guitar.   Requests that the multimedia data in the session file set the control panel graphical interface to a predetermined value to model the sound characteristics of the guitar associated with the audio file for the user-selected song Item 52. The computer-readable medium according to Item 51.   Further includes an operation to remove the guitar track from the audio file of the user-selected song so that the user can play the user's guitar in time with the multimedia presentation of the audio file that does not include the guitar track 53. The computer readable medium of claim 52.   53. The computer readable medium of claim 52, further comprising an operation for displaying to a user a guitar score associated with an audio file of a song selected by the user in the multimedia presentation. In an interface device that couples a musical instrument to a computing device, the computing device responds to the digitized audio signal of the musical instrument received from the interface device to create a processed digital audio signal of the musical instrument. Perform digital signal processing (DSP), present multimedia presentations of digital audio files to the user, and create a mixed digital signal of both the processed digital audio signal of the instrument and the digital audio file The interface device then converts the mixed digital signal into an analog form that presents the sound to the user for transmission to the user via the analog sound device, thereby allowing the user to It possible to play a musical instrument according to the media presentation,
A processor;
A digital-to-analog (D / A) converter that converts the mixed digital signal of both the processed digital audio signal of the instrument and the digital audio file received from the computing device into a mixed analog audio signal; ,
A digital audio interface that controls the timing and format of the digitized audio signal of the instrument and the mixed digital signal;
The processor allows the mixed digital signal to be sent to the user via a D / A converter and via an analog sound device so that the user can play the instrument in time with the multimedia presentation of the audio file. An interface device that controls a digital audio interface to be transmitted.   56. The interface device of claim 55, further comprising a serial I / O controller that couples the interface device to the computing device via a serial input / output (I / O) link.   57. The interface device of claim 56, wherein the serial input / output (I / O) controller is a universal serial bus (USB) controller and the interface device is coupled to the computing device via a USB link.   56. The interface device of claim 55, further comprising a mixer that includes other audio signals for output to an analog sound device.   56. The interface device of claim 55, further comprising a volume controller that controls the volume of the processed analog audio signal and the analog audio file for output to the analog sound device.   56. The interface device of claim 55, wherein the analog sound device includes at least one speaker.   Digital audio with tracks associated with the user's instrument associated with the multimedia presentation so that the user can play the user's instrument in time with the multimedia presentation of the audio file that does not contain the user's instrument 56. The interface device of claim 55, removed from the file.   62. The interface device of claim 61, wherein the multimedia presentation includes a score associated with an audio file displayed to the user.   56. The interface device of claim 55, wherein the musical instrument is a guitar.   56. The interface device of claim 55, wherein the computing device receives a multimedia presentation of the digital audio file from the server over a computer network.   The interface device of claim 64, further comprising a security device that identifies the interface device as an authorized interfaced device based on a unique identifier stored in the security device.   66. The interface device of claim 65, wherein the unique identifier stored on the user's security device is a serial number associated with the interface device.   66. The interface device of claim 65, wherein the security device stores a user key associated with the interface device.   The digital audio file sent from the server to the user's computing device is encrypted with the audio file key associated with the digital audio file, and the audio file key is encrypted with the user key for the user 68. The interface device of claim 67, wherein the interface device is also transmitted to the computing device.   Audio encrypted with the user key using the user key stored by the security device so that the computing device uses the decrypted audio file key to decrypt the audio file 69. The interface device of claim 68, decrypting the file key and sending the decrypted audio file key to the computing device.

Images