WO2007068119A1 - Segmentation and transmission of audio streams - Google Patents
Segmentation and transmission of audio streams Download PDFInfo
- Publication number
- WO2007068119A1 WO2007068119A1 PCT/CA2006/002046 CA2006002046W WO2007068119A1 WO 2007068119 A1 WO2007068119 A1 WO 2007068119A1 CA 2006002046 W CA2006002046 W CA 2006002046W WO 2007068119 A1 WO2007068119 A1 WO 2007068119A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- audio stream
- digital audio
- small digital
- files
- audio
- Prior art date
Links
- 230000005540 biological transmission Effects 0.000 title claims description 16
- 230000011218 segmentation Effects 0.000 title description 3
- 238000000034 method Methods 0.000 claims abstract description 86
- 230000008569 process Effects 0.000 claims description 33
- 238000010926 purge Methods 0.000 claims description 21
- 238000012546 transfer Methods 0.000 claims description 11
- 230000000717 retained effect Effects 0.000 claims description 5
- 230000007704 transition Effects 0.000 claims description 5
- 238000012795 verification Methods 0.000 claims description 2
- 239000003550 marker Substances 0.000 claims 1
- 238000012544 monitoring process Methods 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 19
- 238000013459 approach Methods 0.000 description 10
- 230000006870 function Effects 0.000 description 8
- 238000007726 management method Methods 0.000 description 8
- 230000003068 static effect Effects 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 6
- 230000001934 delay Effects 0.000 description 5
- 230000009471 action Effects 0.000 description 3
- 230000015556 catabolic process Effects 0.000 description 3
- 238000006731 degradation reaction Methods 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 230000008570 general process Effects 0.000 description 2
- 230000032683 aging Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013479 data entry Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/78—Detection of presence or absence of voice signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1101—Session protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
- H04L65/613—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for the control of the source by the destination
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/70—Media network packetisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/762—Media network packet handling at the source
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
Definitions
- the present application relates generally to the transmission of digital audio data, and in particular, to a system, method, and computer-readable code for the delivery of digital audio data on demand.
- the digital audio data is mass downloaded. More specifically, and as shown schematically in Fig. 1, one or more files corresponding to an entire audio stream 10 is transmitted one frame 12 at a time from the server to the client. Once the entire audio stream 10 has been received and reassembled to form a continuous, contiguous audio stream, it is stored in storage 14 prior to being transmitted to a media player 16.
- streaming technology is used to deliver the digital audio data 'just-in-time'. More specifically, and as shown schematically in Fig. 2, an entire audio stream 20 is transmitted one frame 22 at a time from the server to the client, where it is received and reassembled, in part, to provide a continuous, contiguous audio stream (i.e., a small portion of audio stream continuity is preserved). Once each frame is played by the media player 26, it is then discarded from the buffer.
- Tracking problems also develop if the users audio player automatically changes files, if the user is listening to multiple audio streams and/or if the user listens to audio streams on more than one client device (e.g. if a user is listening to the audio stream at work and wants to resume play at home). It can be particularly difficult and time consuming for the user to resume listening to an audio stream at a specific position.
- the instant invention obviates some of the above-described disadvantages by segmenting an audio stream into a plurality of small digital audio files using gaps in the natural language of the audio stream. These small digital audio files are transmitted, loaded, and played, in a specific order, such that from the user's perspective, the audio stream is reproduced in an apparently seamless manner.
- this is done without reassembling the audio stream, either in whole or in part.
- the small digital audio files are created using natural language gaps, they can be sufficiently small to ensure that a first small digital audio file is downloaded and played without significant delay, while successive small digital audio files are downloaded to be played in the future. Accordingly, the user receives the audio-on-demand in a timely manner.
- the instant invention further obviates some of the above-described disadvantages by providing a virtual audio stream descriptor, which includes a record of the position of each small digital audio file in the audio stream, to increase tracking options. More specifically, the virtual audio stream descriptor and one or more predetermined time offsets into the audio stream are used to position or reposition the audio stream at will.
- the predetermined time offsets are typically provided via internal media marks, external media marks, and/or rewind/fast-forward functions.
- a method of providing files for storage in a network accessible library for use in the transmission of digital audio data comprising the steps of: a) segmenting an audio stream into a plurality of small digital audio files using natural language gaps in the audio stream; b) determining at least one of a start time, an end time, and a play time of each small digital audio file within the audio stream; and c) creating a descriptor for identifying the audio stream and for ordering the plurality of small digital audio files, the descriptor including the at least one of a start time, an end time, and a play time of each small digital audio file within the audio stream.
- a method for the transmission of digital audio data comprising the steps of: a) selecting the audio stream from the network accessible library; b) determining a first small digital audio file in the plurality of small digital audio files to be transmitted; c) transmitting the first small digital audio file from the network accessible library to a client; and d) using a media player, playing the first small digital audio file.
- a method for the transmission of digital audio data comprising the steps of: a) selecting an audio stream, the audio stream stored as a plurality of small digital audio files, each small digital audio file corresponding to a segment of the audio stream bounded by natural language gaps in the audio stream; b) determining a first small digital audio file in the plurality of small digital audio files to be transmitted; c) transmitting the first small digital audio file from a server to a client; d) using a media player, playing the transmitted first small digital audio file; e) determining subsequent small digital audio files in the plurality of small digital audio files to be transmitted; f) transmitting the subsequent small digital audio files from a server to a client; and, g) using the media player, playing the transmitted subsequent small digital audio files such that, to a user, the transition therebetween is apparently seamless.
- a method for creating a bookmark for use in the transmission of digital audio data comprising the steps of: a) listening to an audio stream; b) determining a current position within the audio stream; c) determining a time offset from a start of the audio stream to the current position; and, d) creating a bookmark for the current position including the time offset.
- a system for the transmission of digital audio data comprising: a server for storing audio streams, each audio stream stored as a plurality of small digital audio files, each small digital audio file corresponding to a segment of the corresponding audio stream bounded by natural language gaps in the audio stream; a client for playing selected audio streams stored on the server; and a network for connecting the server and the client and facilitating transmission of the small digital audio files from the server to the client, wherein at least one of the server and the client provides a descriptor for each audio stream stored on the server, each descriptor including at least one of a start time, an end time, and a play time of the plurality of small digital audio files of the corresponding audio stream, each descriptor providing means for the client to begin play of the selected audio stream from any position therein without significant delay.
- a system a computer readable storage medium including computer readable code, which when executed by a computer, causes said computer to: download at least part of a selected audio stream stored on a network accessible server, the selected audio stream stored as a plurality of small digital audio files, each small digital audio file corresponding to a segment of the selected audio stream bounded by natural language gaps in the selected audio stream; and begin playing the downloaded audio stream using a media player without significant delay and such the transition between successive small digital audio files appears seamless to a user of the media player.
- FIG. 1 is a schematic diagram showing the prior art mass download of an audio stream
- FIG. 2 is a schematic diagram showing prior art streaming of an audio stream
- FIG. 3 is a schematic diagram illustrating the transmission of an audio stream in accordance with one embodiment of the instant invention.
- FIG. 4 is a schematic diagram of one embodiment of a network based library
- FIG. 5a shows an embodiment of an actual audio stream structure
- FIG. 5b shows an embodiment of a small digital audio file structure
- FIG. 5c shows an embodiment of a virtual audio stream descriptor structure
- FIG. 5d shows an embodiment of an illustration structure
- FIG. 5e shows an embodiment of an advertising structure
- FIG. 5f shows an embodiment of a catalog index structure
- FIG. 5g shows an embodiment of a server list structure
- FIG. 6 is a schematic diagram showing card catalog index structure relationships
- FIG. 7 is a schematic diagram illustrating one embodiment of a library creation process
- FIG. 8 is a schematic diagram illustrating one embodiment of an audio stream splitter process
- FIG. 9 shows an embodiment of a bookmark structure
- FIG. 10 is a schematic diagram showing virtual audio stream structure relationships
- FIG. 11 is a schematic diagram illustrating one embodiment of a performance management process
- FIG. 12 is a schematic diagram illustrating information transfer and client memory status
- FIG. 13 is a schematic diagram illustrating one embodiment of a bookmarked audio stream purge process
- FIG. 14 is a schematic diagram illustrating one embodiment of an active audio stream purging process
- FIG. 15 is a schematic diagram illustrating one embodiment of a memory manager process
- FIG. 16 is a schematic diagram illustrating one embodiment of a download manager process
- FIG. 17 is a flow diagram illustrating one embodiment of a process for using the software product.
- FIG. 18 is a flow diagram illustrating one embodiment of the player control process.
- FIG. 19 is a flow diagram illustrating one embodiment of the general functional process.
- an audio stream analyser 115 is provided for analysing large digital audio files 110 frame by frame 112, and for segmenting the large digital audio files 110 into a plurality of small audio files 122. More specifically, the audio stream analyser 115 locates areas of silence or low decibel levels, hereafter referred to as gaps, within the audio stream. When these natural language gaps are found, and after more than a specific amount of content has been processed, that content is written to a small audio file. This parsing process is repeated until the entire audio stream has been split, or segmented, into the plurality of small audio files 122.
- the size of each small audio file is selected such that it can be transferred from the server 100 to the client 150 in a period of time that that does not cause appreciable consternation on behalf of the user.
- this time frame is similar to that used in the telephone industry when a subscriber lifts a receiver and waits for a dial tone. Accordingly, a two second wait is considered to be close to the maximum tolerable delay, with the optimal target being in the sub-second range.
- the actual size range of the small audio files will be dependent on the network throughput rates. As a result, as network speed increases, the upper limit on the size of the segments will also increase.
- the audio stream analyser 115 also analyses each small digital audio file to determine the start time, end time, and/or play time of the small digital audio file within the audio stream 110.
- This information is recorded in an index file 124 (e.g., an XML document).
- the index file 124 which is a virtual description of the actual audio stream, provides the information needed by a media player to reproduce the experience of a contiguous audio stream for the user without reconstructing the audio stream.
- the term 'actual audio stream' as used herein, refers to the plurality of small digital audio files that comprise the entire audio stream, and that when played sequentially, provide an apparently seamless audio experience.
- each of the small digital audio files is named using a number (e.g., eight-digit decimal number) that indicates its logical order in the actual audio stream.
- the virtual audio stream descriptor 124 In addition to providing actual stream details (i.e., the information for locating and managing the plurality of small digital audio files), the virtual audio stream descriptor 124 also typically includes descriptive details used to describe the content of the audio stream, such as the title and/or ISBN.
- the virtual audio stream descriptor 124 also includes internal media marks, illustrations related to the audio stream, and/or internal advertising. Internal media marks are used to identify a specific point in time in the audio stream that is offset from the beginning of the audio stream. More specifically, they generally point to a time offset associated with some user readable tag such as a table of contents, an index, a list of tables, a list of figures, footnotes, quotations, a list of illustrations, etc. Illustrations related to the audio stream and/or internal advertising may include graphics, static images, moving images, and/or other audiovisual content that is displayed for a fixed duration.
- the virtual audio stream descriptor 124 and the actual audio stream 122 will be stored together in a same location 120 on the server 100.
- the plurality of small audio files 122 and the virtual audio stream descriptor 124 are stored in a same directory of a library residing on one or more servers on the Internet.
- the plurality of small audio files 122 and the virtual audio stream descriptor 124 are stored in the same library, but in different areas. More specifically, the virtual audio stream descriptors 124 are stored in an area for administrative files 144, whereas the plurality of small audio files 122 is stored in an area for actual audio streams 140.
- the area for actual audio streams 140 includes n directories for storing n audio streams, each with a corresponding cover art image.
- the cover art image which is a graphic file, is intended to provide a user with a familiar look and feel of a book cover and/or to provide easy recognition.
- one or more of the n directories is located at a remote URL.
- the administrative files which include the virtual audio stream descriptors 124, typically use the electronic equivalent of a card catalog to provide a simple, easy to use method of navigation and access of the actual audio streams.
- these card catalog index files e.g., XML documents
- the card catalogue will include indices based on keywords such as historical, detective, suspense, action, etc.
- the references contained in each index point to other index structures or to a specific virtual stream descriptor.
- Each index structure contains a reference to its parent index structure, thus allowing navigation in both directions (i.e., up and down the branch of hierarchy).
- Each media entry may appear within the structure of the entire index multiple times, to allow reference and/or navigation from many points.
- the structure of the index is such that endless navigation loops caused by circular definitions are not possible.
- the administrative files also optionally include announcements, updates, and a server list (not shown).
- Announcements which for example may be in an XML file, are typically informative or instructive in nature.
- the updates which may include programs, data files, instruction files, setup files, and/or other text, typically contain information for providing a maintenance update.
- the server list (not shown), which may also be an XML document, typically contains a list of servers that are available on the network and that can provide general library and content information. In general, each server listed will be a mirror of the primary server (also included in the list).
- Figs. 5a-g show examples of data structures of: a) an actual audio stream, b) a small digital audio file, c) a virtual stream descriptor, d) illustrations, e) advertising, f) a card catalog, and g) a server list, respectively.
- Fig. 6, which shows the structure relationships demonstrates that the actual audio stream, illustration, advertisement, and cover art image structure (not shown) are each referenced as a target structure from the virtual audio stream descriptor.
- Each of the actual audio stream, illustration, and cover art image structures also contain a reference identifier back to its parent structure.
- the announcment structure (not shown) is functionally independent of other information bearing structures.
- FIG. 7 An embodiment of a process used to create an audio book library is shown in Fig. 7.
- the audio stream in raw form, is acquired from either a publisher or is imported from an audio media or conversion routine.
- the raw files are analysed using natural language gaps and are segmented into the plurality of small digital audio files (i.e., segment files) that form the actual audio stream.
- Book cover art is imported and formatted, if required.
- the plurality of small digital audio files and cover art image are placed in a unique directory, which is local or at some remote URL.
- Audio stream information that describes the audio stream is manually entered using the library administrator utility to create a virtual audio stream descriptor for each audio stream. Information that describes the location and structure of the actual audio stream is provided using the audio stream profiler.
- the administrator utility is also used to build a series of integrated index files that make up the card catalog for the library, and to provide tools to maintain updates, server lists and announcements.
- this master library is replicated on a number of mirror sites that are also made available on the network.
- an automated verification utility ensures that network accessible copies of the library (i.e., the one or more mirror sites) are also updated to ensure the integrity of the system.
- a first step 200 the list of original raw audio files is built in logical order. These files are processed one at a time. More specifically, after confirming the existence of a raw file 202, the raw file is opened 204, a segment file is opened 206, and a frame is obtained from the raw file 208. Assuming the frame does not correspond to the end of the raw file 210, and that the segment file has not reached an arbitrary minimum size 214 (e.g., 100 kilobytes), the frame is written to the segment file 216. After this limit is reached, audio frames are analysed looking for a period of silence or low decibel levels 218.
- an arbitrary minimum size 214 e.g. 100 kilobytes
- this period of silence is found, or if the upper size limit (e.g., 250 kilobytes) of the segment file is exceeded, the current segment file is closed 220 and a new output small audio file is opened 222.
- the unprocessed raw file content is less than a slack limit 212 (e.g., 25 kilobytes)
- the testing for silence and the upper limit testing is not performed and the remaining audio frames are written to the then current segment file.
- this method is used to find periods of silence between chapters, paragraphs, sentences, phrases, words, and/or at punctuation marks.
- the audio stream splitter/analyser 115 searches for long periods of silence, which are subsequently truncated.
- periods of silence that exceed 2 seconds in length have been found to make users assume that a problem exists in the delivery or replay of the audio stream.
- periods of silence that exceed 2 seconds in length can be truncated, and the audio content that has been truncated, discarded.
- the client side includes a memory manager 152, a download manager (not shown), a media coordinator 154, and a media player 156.
- the memory manager 152 is a complex memory manager used to maintain the integrity of the actual audio stream, which is transferred from the server 100 to the client 150 using a standard transfer utility (e.g., FTP).
- the function of the memory manager 152 is to ensure that there is sufficient memory available to receive large numbers of small digital audio files, to ensure that sufficient audio content is available when needed, and to ensure that a quantity of already heard audio content is maintained (e.g., so a user can rewind the audio stream to review recently heard content without repeated downloads).
- the download manager is responsible for obtaining the small audio files that make up the audio stream.
- the software product is a user-friendly interface that allows the user to select an audio stream, to download a small digital audio file representing a selected part of the selected audio stream, to play the small digital audio file relatively quickly (e.g., within 2 to 5 seconds), and to download and play the logically next small digital audio file such that the transition between successive small audio files is apparently seamless.
- the software product includes computer-readable code that allows the user to use a plurality of navigation buttons to access a network-based library card catalog, bookmarks, cover art images, and/or announcements/updates.
- a network-based library card catalog which may index audio streams in a hierarchical fashion such that there are many possible paths to reach a single audio stream, is typically stored on a network-based library for the navigation thereof.
- the navigation button for the card catalogue is selected the user is able browse through a series of keywords describing a plurality of audio streams, to select an audio stream from the network based card catalogue, to load a profile of the selected audio stream, and/or to download the selected audio stream.
- the profile includes information obtained from the descriptive details entered into the virtual audio stream descriptor.
- the software product is able to select the appropriate small audio file to be played. Moreover, the exact position within the small audio file can also be calculated as a local offset to ensure correct positioning within that small audio file.
- the bookmark since the bookmark only contains references to the audio stream, and does not contain any part of the audio stream itself, the bookmark can be transferred from client to client or from server to client without violating the copyright of the work product contained within the audio stream. For example, a user can bookmark an audio stream at an interesting point and e-mail that bookmark to friends without violating copyright.
- the ability to position an audio stream at some arbitrary point without the need for that media to be resident provides great flexibility.
- the nature of the bookmark makes it independent of the physical structure of the audio stream. This allows changes in media and format without corrupting the integrity of the mark or the audio stream.
- the bookmark is an XML document.
- the bookmark navigation button allows the user to view a list of bookmarks corresponding to open audio streams (e.g., a book that has been accessed and partially read), to select a bookmark, and to play the audio stream at the bookmarked position.
- open audio streams e.g., a book that has been accessed and partially read
- the software product may list the bookmarked audio streams in the descending order of the date and time that the audio steam was last read.
- the software product includes computer-readable code that allows the user to use a plurality of standard player control buttons to begin playing the audio stream, stop playing the audio stream, and/or fast forward within the audio stream.
- the rewind and fast-forward control buttons do not actually act on the audio stream. Rather, these two functions are used to advance or retard the time offset that indicates the then current position in the audio stream. For example, rewind will cause this offset to decrease to a minimum of zero (e.g., seconds), whereas fast forward will increase the time offset to a maximum of the upper limit of the audio stream duration. Accordingly, the user is able to fast forward and rewind through the audio stream, even if the audio content is not resident.
- the time offset has been adjusted to where the user desires, if the relevant small audio file is not resident, it is obtained from the library, again in the 2 to 5 second range. The small audio file is then loaded, positioned and played.
- the software product includes computer-readable code that provides a number of different displays, including for example, a basic display, an introduction display, a bookmark display, a library card catalog display, a book details display, a book player display, and a book cover display.
- these displays provide appeal and/or familiarity to the user.
- the basic display may provide a decorative skin or frame to standardize the appearance of the software product when played on different platforms (e.g., desktop, laptop, personal data assistant, cell phone, dedicated device, etc), whereas the introduction display may appear during the start up of the program.
- Other displays, such as the bookmark display, library card catalog display, and/or book details displays may provide the navigation buttons.
- the book player display may show the book that is currently loaded into the player, the book title, author, copyright, and/or book length.
- the book player display may also provide the standard player control buttons discussed above.
- the book player provides a content level indicator, which is a measure of the amount of continuous content that is resident beyond the current position in the book, and/or a positive feedback feature, which is used to inform the user that the player is active.
- the navigation and/or control buttons are selected using standard data entry techniques, which for example, may use a mouse, keyboard, touch pad, and/or touch sensitive screen. If the latter is provided, a virtual keyboard is typically provided.
- the quotation display allows the user to enter or select various quotations, which may also be edited and/or e-mailed to other clients.
- the quotation file may include a unique numerical identification of the audio stream, the start and end point of the quotation in the audio stream, a user defined title, and user defined comments.
- the contact list display allows the user to maintain a list of names and e-mail address used by the software product.
- the software product includes computer-readable code that provides client-based performance management.
- the performance level of the digital audio data delivery is an important factor in ensuring the integrity of the audio stream available to the user.
- the purpose of client-based performance management is to ensure that the client software receives service at or above minimum levels.
- this service is automated and is provided transparently to the user utilizing any then current available network resource to do so. In other words, the user is not aware of the source of the service or the mechanics of accessing that service.
- the performance management logic is built into lower level functions that perform various network and library based functions. These include 1) Logging in to a server; 2) Obtaining a file from the server; 3) Obtaining file size and creation dates. Referring to Fig. 11, the initial steps taken by the client software are to load the list of servers 360 available for use and the historical transfer statistics 362. The fastest server from the list is then selected 364 as the primary server. If the server is not available or fails to respond, the next fastest server is selected. The process continues until a server is reached. If no servers are available, the default server entered is used. Servers that are found to be slow or are continually in error will have their transfer rate increased based on one of two values 366.
- the software product uses a universal ISBN server, which is designed to provide a simplified means to locate network-based library services from one or more suppliers on a network.
- the ISBN server may be located on the Internet for global access or on various intranets for use by various public or private organizations.
- the purpose of the ISBN server is to receive a request from a client device and return a list of one or more servers.
- the request from the client device will include a unique ISBN number or other unique identifier.
- the ISBN server will look up the unique identifier in a preloaded database and assemble or extract a list of servers capable of supporting library services for that identifier. This list is then returned to the client device.
- a selection is made from that list as the preferred provider of library service (e.g., as discussed with regards to client based performance management).
- the selected server is then accessed to acquire the virtual audio stream descriptor that goes with the unique identifier originally provided by the client.
- the software product including the computer-readable code
- the computer readable code is then used to access information structures and files that reside on one or more servers on the server side of the system 100 (e.g., within a server farm). Information transfer from client to server is accomplished using industry standard server software, tools and utilities. A summary of various types of information, structures or files is provided in Table 1.
- the memory manager will balance the need for space with the need to retain content surrounding active bookmarks. As the demands for space increase, the content surrounding bookmarks becomes less and less.
- the structures that are considered dynamic are semi-permanent structures that typically exist for the duration that an audio stream remains open and bookmarked. The memory manager will make every effort to ensure that these structures are preserved, but may remove them as a final option to obtain space. Typically, the last structures to be purged are the oldest bookmark structures.
- the static files are contained in a root directory, while the volatile files are contained in a spooler directory.
- a list of possible static and/or volatile files that may be used by the software product is provided in Table 2.
- Audio Pod Directory The directory that contains all files that are static in their existence
- Spooler Directory The directory that contains all files that are volatile in their existence
- Announcement File File containing a notice or announcement; in XML format
- Update File File containing components needed to perform an update to the Audio Pod and/or any of its' components
- a memory purge process is used to remove volatile files to ensure that a requested level of free memory is made available. This process works directly on the contents of the spooler directory.
- the purging process takes different approaches when dealing with the active audio stream, bookmarked audio streams, and ancillary or support files.
- a demand for a significant quantity of memory is made at the opening of a new audio stream, or reopening a bookmarked audio stream.
- the size of the demand is subject to the ultimate size of memory available, the size of the audio stream being accessed and the volume of content from the subject audio stream that may already be resident. In the event that sufficient memory is not available, memory is purged in the following order.
- Bookmarked audio streams are purged with increasing levels of severity until the memory demands are met. 4.
- the content of dynamic memory including virtual audio stream descriptors, and supporting files are deleted, starting with the oldest.
- the purging process attempts to retain as much resident content as is possible.
- the purge process focuses on the bookmark position within the audio stream. Some resident content is retained within the audio stream preceding the bookmarked position. This is to allow the user the ability to rewind the audio stream in an attempt to pick up where they left off. However, this quantity of content is not large and generally will not exceed 5 minutes.
- the main effort is to preserve as much resident content of the audio stream that follows the position.
- most, if not all, bookmarked audio streams will have some future content purged. In the event that sufficient memory cannot be obtained with an initial purge of content, the level of severity of the purge will be increased and the purge process repeated.
- the volume of resident content in the bookmarked audio streams is reduced. This reduction is most severe in content preceding bookmarked positions. As the levels of severity increase further, the quantity of content preceding the bookmarked positions prevents further gains through purging, and content that follows the bookmarked positions is aggressively purged. The purging process continues, reducing the quantity of content surrounding bookmarked positions until, at the ultimate extreme, no content remains. Under normal circumstances, the demand for memory will be met and this situation is expected never to arise. This process is shown in Fig. 13.
- the selected audio stream becomes the focus of the purging process.
- the effort becomes one of ensuring that sufficient content is maintained around the current player position to ensure a continuous replay of the audio stream.
- the current audio stream is purged to make room for additional content. Every attempt is made to preserve some content preceding the current player position to allow the user to rewind a few minutes to pick up the story in the event of interruption.
- A shows the normally expected state of memory with already heard content purged and future content loaded as the player position approaches the end of resident content
- B-D shows the state of memory that may result when internal media marks, external bookmarks, rewind, or fast forward functions are used.
- the media player position may be outside of resident content or may result in a discontinuity of resident content.
- the content that precedes the current player position typically is purged prior to purging any content that follows the current player position.
- a method of using the software product to transmit digital audio data is described as follows.
- a user selects an audio stream.
- audio streams include audio books, magazines, newscasts, radio shows, lectures, museum tours, etc, or parts thereof.
- the audio stream typically is selected from a card catalog, a bookmark, or other means.
- the actual audio format of the sound information is not important.
- the target small audio file is not resident, then it is downloaded.
- the small audio file is loaded into the media player and the media player is positioned to the calculated local time offset.
- the download manager is signalled to commence operations.
- the download manager purges the current audio stream and then examines the virtual audio stream and the content of volatile memory. Small audio files are downloaded sequentially. When the end of the audio stream is reached, downloading stops. If memory is exhausted and the download manager indicates that enough continuous audio content is resident, downloading stops. Otherwise, a demand for additional memory is raised with the memory manager, and the process is repeated.
- the small audio files are successively loaded and played until the end of the audio stream is reached.
- the current position in the actual audio stream is tracked. If the current position in the actual audio stream approaches the end of resident audio content and the entire audio stream is not downloaded, then the current audio stream is purged to make memory available for new content, and the download manager is started. New content is downloaded until the end of the audio stream is reached or memory is exhausted. This process is repeated as often as is necessary. In this manner, the software product can process complete audio streams that exceed the size of memory available.
- the small audio files are contained within a common spooling area. As the spooling area fills with small audio files, the quantity of unheard audio increases. This quantity is displayed to the user. As a result, the invention can continue to play through resident unheard small audio files even during periods when out of network contact with the library. The memory manager will detect when network service is restored and continue processing as normal.
- a bookmark is created and stored.
- the bookmark identifies the audio stream and the time offset of the bookmarked position.
- the offset value stored is the current position in the audio stream less an arbitrary time. This allows the listener to 'pick up the story' when the listener resumes the current audio stream. If the listener changes the time offset into the audio stream using the rewind and fast forward buttons, or any of the media marks that may be available, the new offset position is used to position the audio stream as described above.
- any bookmarks are removed from dynamic memory. Without a bookmark, the memory manager will purge the audio stream and all references at the next signal to commence operations.
- Fig. 15 provides an overview of the memory manager process in greater detail.
- the memory manager When activated, the memory manager first checks to see if there is sufficient audio content already resident (e.g., enough for about 5 minutes play time). If there is enough content, the remainder of the audio stream is resident or the download manager is running, then no action is taken. Otherwise, the memory manager purges the content of the audio spooler directory with the goal of freeing a specific amount of memory. With memory available, the memory manager signals the download manager to commence operations.
- Fig. 16 provides an overview of an embodiment of a download manager process.
- the contents of the spooler directory are compared with the virtual audio stream descriptor and the user's current position in the audio stream.
- the spooler content is examined for the first small audio file that is needed to make the audio stream continuous beyond the then current position in the audio stream. If this file is missing, its size and the amount of available memory is obtained. This small audio file is then downloaded and the integrity of the file verified for size.
- the download manager continues to run until either memory is exhausted, or the end of the audio stream is reached. If the player is stopped while the download manager is running, the process stopping the player will stop the download manager.
- FIG. 17 shows an embodiment of a general process for using the software product, from start-up through various navigation steps and associated logic.
- a series of navigation buttons shown at the bottom of the diagram provide the user with the ability to navigate to various displays.
- Fig. 18 shows an embodiment of a process for using the standard control buttons.
- Fig. 19 shows an embodiment of a general process for loading the actual audio stream.
- the software product provides the means to deliver large volume audio streams from a central library to the end user, to maintain bookmarks for each audio stream opened and being read regardless of the number of audio streams opened, to switch audio streams anywhere and anytime, to receive library based announcements and updates, to play spooled audio segments even when network service is unavailable, and to provide active management of network resources that balances load between the main library and all mirror sites on the network, and thus ensures fast, reliable service.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Health & Medical Sciences (AREA)
- Computational Linguistics (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Information Transfer Between Computers (AREA)
Abstract
A system, method and computer-readable code for segmenting an audio stream into a plurality of small digital audio files using gaps in the natural language of the audio stream is provided. The small digital audio files are transmitted, loaded, and played in a specific order, such that from the user's perspective, the audio stream is reproduced in an apparently seamless manner. This is done without reassembling the audio stream, either in whole or in part. The small digital audio files are created using natural language gaps, and are generally small enough to ensure that a first small digital audio file can be downloaded and played without significant delay, while successive small digital audio files are downloaded to be played in the future. Accordingly, the user receives audio-on-demand in a timely manner.
Description
SEGMENTATION AND TRANSMISSION OF AUDIO STREAMS
TECHNICAL FIELD
[1] The present application relates generally to the transmission of digital audio data, and in particular, to a system, method, and computer-readable code for the delivery of digital audio data on demand.
BACKGROUND OF THE INVENTION
[2] Traditionally, there have been two different approaches for delivering digital audio data. In the first approach, the digital audio data is mass downloaded. More specifically, and as shown schematically in Fig. 1, one or more files corresponding to an entire audio stream 10 is transmitted one frame 12 at a time from the server to the client. Once the entire audio stream 10 has been received and reassembled to form a continuous, contiguous audio stream, it is stored in storage 14 prior to being transmitted to a media player 16.
[3] In the second approach, streaming technology is used to deliver the digital audio data 'just-in-time'. More specifically, and as shown schematically in Fig. 2, an entire audio stream 20 is transmitted one frame 22 at a time from the server to the client, where it is received and reassembled, in part, to provide a continuous, contiguous audio stream (i.e., a small portion of audio stream continuity is preserved). Once each frame is played by the media player 26, it is then discarded from the buffer.
[4] Small audio streams, or audio-video streams, which for example correspond to individual songs, very short movies, and music videos, are typically transmitted using the first approach. In terms of the delivery of these smaller streams of media, the delays experienced by the users are generally tolerated because they are relatively short in nature. Typically, time delays are measured as one or two minutes, and although possible, tend not to exceed this.
[5] The delivery of larger audio streams, which for example include books and radio shows, presents a problem for the user community. Whereas a single song that plays for 4 minutes may
take 1 minute to download, an audio book that plays for 12 hours may take 3 to 4 hours to download. Although the general performance is relatively the same in terms of throughput rate, users of this media complain about the hours of waiting to receive and use the media selected.
[6] While streaming technology obviates the waiting associated with mass download, any degradation experienced in the delivery of the content in real time introduces interruptions in the audio stream, causing breaks and interruptions in the users experience of that audio stream. Moreover, since the digital audio data is not stored, repositioning within the audio stream (e.g., using rewind or fast forward functions) interrupts the just-in-time nature of content delivery, and thus, may introduce significant delays and/or be inefficient. For example, in the case of rewinding a streamed audio stream, the content associated with the new position selected in the audio stream will need to be downloaded a second time and the future content temporarily stored in the buffer will be discarded.
[7] In both of the existing technologies, great effort is made to reassemble the audio stream into a continuous, contiguous audio stream prior to being presented to the media player. In the case of the mass download approach, the entire audio stream is downloaded and reassembled prior to use. In streaming technologies, a very small portion of the audio stream is downloaded and reassembled prior to use with additional content delivered and already played content discarded continuously, to maintain a very small portion of continuity in the audio stream. Notably, this reconstruction of the audio stream complicates the digital audio data delivery and increases delivery time.
[8] In addition, in both of the existing technologies, the user has limited tracking options. For example, 'The Godfather' is an audio book that, as commercially released, contains 24 MP3 files that require 80 megabytes of storage and plays at normal speed for a total of almost 9 hours. In order to use these files with existing mass download technology, the user must manually keep track of which file is currently being listened to and where one is in that particular file.
[9] Tracking problems also develop if the users audio player automatically changes files, if the user is listening to multiple audio streams and/or if the user listens to audio streams on more than one client device (e.g. if a user is listening to the audio stream at work and wants to resume
play at home). It can be particularly difficult and time consuming for the user to resume listening to an audio stream at a specific position.
SUMMARY OF THE INVENTION
[10] The instant invention obviates some of the above-described disadvantages by segmenting an audio stream into a plurality of small digital audio files using gaps in the natural language of the audio stream. These small digital audio files are transmitted, loaded, and played, in a specific order, such that from the user's perspective, the audio stream is reproduced in an apparently seamless manner. Advantageously, this is done without reassembling the audio stream, either in whole or in part. Further advantageously, since the small digital audio files are created using natural language gaps, they can be sufficiently small to ensure that a first small digital audio file is downloaded and played without significant delay, while successive small digital audio files are downloaded to be played in the future. Accordingly, the user receives the audio-on-demand in a timely manner.
[11] The instant invention further obviates some of the above-described disadvantages by providing a virtual audio stream descriptor, which includes a record of the position of each small digital audio file in the audio stream, to increase tracking options. More specifically, the virtual audio stream descriptor and one or more predetermined time offsets into the audio stream are used to position or reposition the audio stream at will. The predetermined time offsets are typically provided via internal media marks, external media marks, and/or rewind/fast-forward functions.
[12] In accordance with one aspect of the instant invention there is provided a method of providing files for storage in a network accessible library for use in the transmission of digital audio data, comprising the steps of: a) segmenting an audio stream into a plurality of small digital audio files using natural language gaps in the audio stream; b) determining at least one of a start time, an end time, and a play time of each small digital audio file within the audio stream; and c) creating a descriptor for identifying the audio stream and for ordering the plurality of small digital audio files, the descriptor including the at least one of a start time, an end time, and a play time of each small digital audio file within the audio stream.
[13] In accordance with another aspect of the instant invention there is provided a method for the transmission of digital audio data, comprising the steps of: a) selecting the audio stream from the network accessible library; b) determining a first small digital audio file in the plurality of small digital audio files to be transmitted; c) transmitting the first small digital audio file from the network accessible library to a client; and d) using a media player, playing the first small digital audio file.
[14] In accordance with another aspect of the instant invention there is provided a method for the transmission of digital audio data, comprising the steps of: a) selecting an audio stream, the audio stream stored as a plurality of small digital audio files, each small digital audio file corresponding to a segment of the audio stream bounded by natural language gaps in the audio stream; b) determining a first small digital audio file in the plurality of small digital audio files to be transmitted; c) transmitting the first small digital audio file from a server to a client; d) using a media player, playing the transmitted first small digital audio file; e) determining subsequent small digital audio files in the plurality of small digital audio files to be transmitted; f) transmitting the subsequent small digital audio files from a server to a client; and, g) using the media player, playing the transmitted subsequent small digital audio files such that, to a user, the transition therebetween is apparently seamless.
[15] In accordance with another aspect of the instant invention there is provided a method for creating a bookmark for use in the transmission of digital audio data, comprising the steps of: a) listening to an audio stream; b) determining a current position within the audio stream; c) determining a time offset from a start of the audio stream to the current position; and, d) creating a bookmark for the current position including the time offset.
[16] In accordance with another aspect of the instant invention there is provided a system for the transmission of digital audio data comprising: a server for storing audio streams, each audio stream stored as a plurality of small digital audio files, each small digital audio file corresponding to a segment of the corresponding audio stream bounded by natural language gaps in the audio stream; a client for playing selected audio streams stored on the server; and a network for connecting the server and the client and facilitating transmission of the small digital audio files from the server to the client, wherein at least one of the server and the client provides
a descriptor for each audio stream stored on the server, each descriptor including at least one of a start time, an end time, and a play time of the plurality of small digital audio files of the corresponding audio stream, each descriptor providing means for the client to begin play of the selected audio stream from any position therein without significant delay.
[17] In accordance with another aspect of the instant invention there is provided a system a computer readable storage medium including computer readable code, which when executed by a computer, causes said computer to: download at least part of a selected audio stream stored on a network accessible server, the selected audio stream stored as a plurality of small digital audio files, each small digital audio file corresponding to a segment of the selected audio stream bounded by natural language gaps in the selected audio stream; and begin playing the downloaded audio stream using a media player without significant delay and such the transition between successive small digital audio files appears seamless to a user of the media player.
BRIEF DESCRIPTION OF THE DRAWINGS
[18] Further features and advantages of the present invention will become apparent from the following detailed description, taken in combination with the appended drawings, in which:
[19] FIG. 1 is a schematic diagram showing the prior art mass download of an audio stream;
[20] FIG. 2 is a schematic diagram showing prior art streaming of an audio stream;
[21] FIG. 3 is a schematic diagram illustrating the transmission of an audio stream in accordance with one embodiment of the instant invention;
[22] FIG. 4 is a schematic diagram of one embodiment of a network based library;
[23] FIG. 5a shows an embodiment of an actual audio stream structure;
[24] FIG. 5b shows an embodiment of a small digital audio file structure;
[25] FIG. 5c shows an embodiment of a virtual audio stream descriptor structure;
[26] FIG. 5d shows an embodiment of an illustration structure;
[27] FIG. 5e shows an embodiment of an advertising structure;
[28] FIG. 5f shows an embodiment of a catalog index structure;
[29] FIG. 5g shows an embodiment of a server list structure;
[30] FIG. 6 is a schematic diagram showing card catalog index structure relationships;
[31] FIG. 7 is a schematic diagram illustrating one embodiment of a library creation process;
[32] FIG. 8 is a schematic diagram illustrating one embodiment of an audio stream splitter process;
[33] FIG. 9 shows an embodiment of a bookmark structure;
[34] FIG. 10 is a schematic diagram showing virtual audio stream structure relationships;
[35] FIG. 11 is a schematic diagram illustrating one embodiment of a performance management process;
[36] FIG. 12 is a schematic diagram illustrating information transfer and client memory status;
[37] FIG. 13 is a schematic diagram illustrating one embodiment of a bookmarked audio stream purge process;
[38] FIG. 14 is a schematic diagram illustrating one embodiment of an active audio stream purging process;
[39] FIG. 15 is a schematic diagram illustrating one embodiment of a memory manager process;
[40] FIG. 16 is a schematic diagram illustrating one embodiment of a download manager process;
[41] FIG. 17 is a flow diagram illustrating one embodiment of a process for using the software product;
[42] FIG. 18 is a flow diagram illustrating one embodiment of the player control process; and
[43] FIG. 19 is a flow diagram illustrating one embodiment of the general functional process.,
[44] It will be noted that throughout the appended drawings, like features are identified by like reference numerals.
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
[45] Referring to Fig. 3, there is shown a system for transmitting digital audio data in accordance with one embodiment of the instant invention. The system includes a server 100, a client 150, and a network (not shown) for connecting the server 100 and the client 150.
[46] On the server side 100, an audio stream analyser 115 is provided for analysing large digital audio files 110 frame by frame 112, and for segmenting the large digital audio files 110 into a plurality of small audio files 122. More specifically, the audio stream analyser 115 locates areas of silence or low decibel levels, hereafter referred to as gaps, within the audio stream. When these natural language gaps are found, and after more than a specific amount of content has been processed, that content is written to a small audio file. This parsing process is repeated until the entire audio stream has been split, or segmented, into the plurality of small audio files 122. In general, the size of each small audio file is selected such that it can be transferred from the server 100 to the client 150 in a period of time that that does not cause appreciable consternation on behalf of the user. For example, as a benchmark for success, this time frame is similar to that used in the telephone industry when a subscriber lifts a receiver and waits for a dial tone. Accordingly, a two second wait is considered to be close to the maximum tolerable delay, with the optimal target being in the sub-second range. The actual size range of the small audio files will be dependent on the network throughput rates. As a result, as network speed increases, the upper limit on the size of the segments will also increase.
[47] The audio stream analyser 115 also analyses each small digital audio file to determine the start time, end time, and/or play time of the small digital audio file within the audio stream 110. This information is recorded in an index file 124 (e.g., an XML document). The index file 124, which is a virtual description of the actual audio stream, provides the information needed by a media player to reproduce the experience of a contiguous audio stream for the user without
reconstructing the audio stream. The term 'actual audio stream' as used herein, refers to the plurality of small digital audio files that comprise the entire audio stream, and that when played sequentially, provide an apparently seamless audio experience. According to one embodiment, each of the small digital audio files is named using a number (e.g., eight-digit decimal number) that indicates its logical order in the actual audio stream.
[48] In addition to providing actual stream details (i.e., the information for locating and managing the plurality of small digital audio files), the virtual audio stream descriptor 124 also typically includes descriptive details used to describe the content of the audio stream, such as the title and/or ISBN. Optionally, the virtual audio stream descriptor 124 also includes internal media marks, illustrations related to the audio stream, and/or internal advertising. Internal media marks are used to identify a specific point in time in the audio stream that is offset from the beginning of the audio stream. More specifically, they generally point to a time offset associated with some user readable tag such as a table of contents, an index, a list of tables, a list of figures, footnotes, quotations, a list of illustrations, etc. Illustrations related to the audio stream and/or internal advertising may include graphics, static images, moving images, and/or other audiovisual content that is displayed for a fixed duration.
[49] In general, the virtual audio stream descriptor 124 and the actual audio stream 122 will be stored together in a same location 120 on the server 100. For example, according to one embodiment the plurality of small audio files 122 and the virtual audio stream descriptor 124 are stored in a same directory of a library residing on one or more servers on the Internet. According to the embodiment illustrated in Fig. 4, the plurality of small audio files 122 and the virtual audio stream descriptor 124 are stored in the same library, but in different areas. More specifically, the virtual audio stream descriptors 124 are stored in an area for administrative files 144, whereas the plurality of small audio files 122 is stored in an area for actual audio streams 140. The area for actual audio streams 140 includes n directories for storing n audio streams, each with a corresponding cover art image. The cover art image, which is a graphic file, is intended to provide a user with a familiar look and feel of a book cover and/or to provide easy recognition. Optionally, one or more of the n directories is located at a remote URL.
[50] The administrative files, which include the virtual audio stream descriptors 124, typically use the electronic equivalent of a card catalog to provide a simple, easy to use method of navigation and access of the actual audio streams. In general, these card catalog index files (e.g., XML documents) will include a hierarchical structure of cascading indexes that relate in various ways. For example, according to one embodiment the card catalogue will include indices based on keywords such as historical, detective, suspense, action, etc. The references contained in each index point to other index structures or to a specific virtual stream descriptor. Each index structure contains a reference to its parent index structure, thus allowing navigation in both directions (i.e., up and down the branch of hierarchy). Each media entry may appear within the structure of the entire index multiple times, to allow reference and/or navigation from many points. The structure of the index is such that endless navigation loops caused by circular definitions are not possible.
[51] The administrative files also optionally include announcements, updates, and a server list (not shown). Announcements, which for example may be in an XML file, are typically informative or instructive in nature. The updates, which may include programs, data files, instruction files, setup files, and/or other text, typically contain information for providing a maintenance update. The server list (not shown), which may also be an XML document, typically contains a list of servers that are available on the network and that can provide general library and content information. In general, each server listed will be a mirror of the primary server (also included in the list).
[52] Figs. 5a-g show examples of data structures of: a) an actual audio stream, b) a small digital audio file, c) a virtual stream descriptor, d) illustrations, e) advertising, f) a card catalog, and g) a server list, respectively. Fig. 6, which shows the structure relationships, demonstrates that the actual audio stream, illustration, advertisement, and cover art image structure (not shown) are each referenced as a target structure from the virtual audio stream descriptor. Each of the actual audio stream, illustration, and cover art image structures also contain a reference identifier back to its parent structure. In contrast, the announcment structure (not shown) is functionally independent of other information bearing structures.
[53] An embodiment of a process used to create an audio book library is shown in Fig. 7. The audio stream, in raw form, is acquired from either a publisher or is imported from an audio media or conversion routine. The raw files are analysed using natural language gaps and are segmented into the plurality of small digital audio files (i.e., segment files) that form the actual audio stream. Book cover art is imported and formatted, if required. The plurality of small digital audio files and cover art image are placed in a unique directory, which is local or at some remote URL. Audio stream information that describes the audio stream is manually entered using the library administrator utility to create a virtual audio stream descriptor for each audio stream. Information that describes the location and structure of the actual audio stream is provided using the audio stream profiler. The administrator utility is also used to build a series of integrated index files that make up the card catalog for the library, and to provide tools to maintain updates, server lists and announcements. Preferably, this master library is replicated on a number of mirror sites that are also made available on the network. Following updates to the master library, an automated verification utility ensures that network accessible copies of the library (i.e., the one or more mirror sites) are also updated to ensure the integrity of the system.
[54] Referring to Fig. 8, the segmentation of the raw files is discussed in further detail. In a first step, 200, the list of original raw audio files is built in logical order. These files are processed one at a time. More specifically, after confirming the existence of a raw file 202, the raw file is opened 204, a segment file is opened 206, and a frame is obtained from the raw file 208. Assuming the frame does not correspond to the end of the raw file 210, and that the segment file has not reached an arbitrary minimum size 214 (e.g., 100 kilobytes), the frame is written to the segment file 216. After this limit is reached, audio frames are analysed looking for a period of silence or low decibel levels 218. If this period of silence is found, or if the upper size limit (e.g., 250 kilobytes) of the segment file is exceeded, the current segment file is closed 220 and a new output small audio file is opened 222. In the event that the unprocessed raw file content is less than a slack limit 212 (e.g., 25 kilobytes), the testing for silence and the upper limit testing is not performed and the remaining audio frames are written to the then current segment file. According to one embodiment, this method is used to find periods of silence between chapters, paragraphs, sentences, phrases, words, and/or at punctuation marks. Optionally, the audio stream splitter/analyser 115 searches for long periods of silence, which are
subsequently truncated. For example, periods of silence that exceed 2 seconds in length have been found to make users assume that a problem exists in the delivery or replay of the audio stream. In order to eliminate these user concerns, periods of silence that exceed 2 seconds in length can be truncated, and the audio content that has been truncated, discarded.
[55] Referring again to Fig. 3, the client side includes a memory manager 152, a download manager (not shown), a media coordinator 154, and a media player 156. The memory manager 152 is a complex memory manager used to maintain the integrity of the actual audio stream, which is transferred from the server 100 to the client 150 using a standard transfer utility (e.g., FTP). The function of the memory manager 152 is to ensure that there is sufficient memory available to receive large numbers of small digital audio files, to ensure that sufficient audio content is available when needed, and to ensure that a quantity of already heard audio content is maintained (e.g., so a user can rewind the audio stream to review recently heard content without repeated downloads). The download manager is responsible for obtaining the small audio files that make up the audio stream. The media coordinator 154 delivers the plurality of small digital audio files in the appropriate order to the media player 156. The memory manager 152, download manager (not shown), and media coordinator 154, are all part of an integrated, network-based software product used to control the media player 156.
[56] According to one embodiment, the software product is a user-friendly interface that allows the user to select an audio stream, to download a small digital audio file representing a selected part of the selected audio stream, to play the small digital audio file relatively quickly (e.g., within 2 to 5 seconds), and to download and play the logically next small digital audio file such that the transition between successive small audio files is apparently seamless.
[57] According to one embodiment, the software product includes computer-readable code that allows the user to use a plurality of navigation buttons to access a network-based library card catalog, bookmarks, cover art images, and/or announcements/updates. As discussed above, a network-based library card catalog, which may index audio streams in a hierarchical fashion such that there are many possible paths to reach a single audio stream, is typically stored on a network-based library for the navigation thereof. According to one embodiment, once the navigation button for the card catalogue is selected the user is able browse through a series of
keywords describing a plurality of audio streams, to select an audio stream from the network based card catalogue, to load a profile of the selected audio stream, and/or to download the selected audio stream. According to one embodiment, the profile includes information obtained from the descriptive details entered into the virtual audio stream descriptor.
[58] Bookmarks are external media marks (i.e., external to the virtual audio stream descriptor) that allow the user to identify and/or access an audio stream at any point within that audio stream. Similar to internal media marks, each bookmark provides a time offset from the beginning of the audio stream. In other words, if an audio stream starts at time zero and continues for some elapsed time to a maximum duration, the bookmark identifies a specific point in time in the audio stream that is offset from the beginning of that audio stream. The bookmark also identifies and/or points to the virtual audio stream descriptor of the target audio stream (e.g., in a local directory or at some network address). Using the time offset and the information in the virtual audio stream descriptor, the software product is able to select the appropriate small audio file to be played. Moreover, the exact position within the small audio file can also be calculated as a local offset to ensure correct positioning within that small audio file.
[59] Bookmarks are typically, but not always, created by the client software. For example, if the media player is stopped in the middle of an audio stream, a bookmark is created and stored. Alternatively, the user creates a bookmark using a 'make bookmark' command. More than one bookmark may be created for each audio stream. The bookmark identifies the bookmarked audio stream and the time offset of the bookmarked position. Optionally, to assist the user of the audio stream in 'picking up where you left off, a predetermined time (e.g., 30 seconds) is subtracted from the time offset of the bookmarked position and stored as the new time offset. Optionally, the predetermined time is listener selectable. Fig. 9 shows an example of a data structure for an external bookmark, whereas Fig. 10 illustrates the structure relationships. Notably, the virtual audio stream descriptor may be addressed from either the integrated card catalog or the bookmark. Optionally, the virtual audio stream descriptor is addressed in another manner.
[60] Since the bookmark only contains references to the audio stream, and does not contain any part of the audio stream itself, the bookmark can be transferred from client to client or from
server to client without violating the copyright of the work product contained within the audio stream. For example, a user can bookmark an audio stream at an interesting point and e-mail that bookmark to friends without violating copyright. Clearly, the ability to position an audio stream at some arbitrary point without the need for that media to be resident provides great flexibility. Moreover, the nature of the bookmark makes it independent of the physical structure of the audio stream. This allows changes in media and format without corrupting the integrity of the mark or the audio stream. Examples of such changes include changing bit and scan rates in MP3 files, changing from MP3 to .wav format, changes to the actual audio stream, small audio file structure, and/or reformatting of the audio stream itself. According to one embodiment, the bookmark is an XML document.
[61] The bookmark navigation button allows the user to view a list of bookmarks corresponding to open audio streams (e.g., a book that has been accessed and partially read), to select a bookmark, and to play the audio stream at the bookmarked position. For example, the software product may list the bookmarked audio streams in the descending order of the date and time that the audio steam was last read.
[62] According to one embodiment, the software product includes computer-readable code that allows the user to use a plurality of standard player control buttons to begin playing the audio stream, stop playing the audio stream, and/or fast forward within the audio stream. Notably, the rewind and fast-forward control buttons do not actually act on the audio stream. Rather, these two functions are used to advance or retard the time offset that indicates the then current position in the audio stream. For example, rewind will cause this offset to decrease to a minimum of zero (e.g., seconds), whereas fast forward will increase the time offset to a maximum of the upper limit of the audio stream duration. Accordingly, the user is able to fast forward and rewind through the audio stream, even if the audio content is not resident. In particular, after the time offset has been adjusted to where the user desires, if the relevant small audio file is not resident, it is obtained from the library, again in the 2 to 5 second range. The small audio file is then loaded, positioned and played.
[63] According to one embodiment, the software product includes computer-readable code that provides a number of different displays, including for example, a basic display, an
introduction display, a bookmark display, a library card catalog display, a book details display, a book player display, and a book cover display. These displays provide appeal and/or familiarity to the user. For example, the basic display may provide a decorative skin or frame to standardize the appearance of the software product when played on different platforms (e.g., desktop, laptop, personal data assistant, cell phone, dedicated device, etc), whereas the introduction display may appear during the start up of the program. Other displays, such as the bookmark display, library card catalog display, and/or book details displays may provide the navigation buttons. The book player display may show the book that is currently loaded into the player, the book title, author, copyright, and/or book length. The book player display may also provide the standard player control buttons discussed above. Optionally, the book player provides a content level indicator, which is a measure of the amount of continuous content that is resident beyond the current position in the book, and/or a positive feedback feature, which is used to inform the user that the player is active. According to one embodiment, the navigation and/or control buttons are selected using standard data entry techniques, which for example, may use a mouse, keyboard, touch pad, and/or touch sensitive screen. If the latter is provided, a virtual keyboard is typically provided.
[64] According to one embodiment, the software product also provides a number of other displays including a set-up display, a notes display, a quotations display, and/or a contact list display. The set-up display allows the user to enter/change user account name, password, default server information, DNS name of server, communication ports of the server, and/or secure sockets. The notes display allows the user to enter or select personal notes, which may be edited and/or e-mailed to other clients. In general, the note file may include a unique numerical identification of the audio stream, a tag to the audio stream, a user defined title, comments, the author of the comments, and/or the date and time the note was created. The quotation display allows the user to enter or select various quotations, which may also be edited and/or e-mailed to other clients. In general, the quotation file may include a unique numerical identification of the audio stream, the start and end point of the quotation in the audio stream, a user defined title, and user defined comments. The contact list display allows the user to maintain a list of names and e-mail address used by the software product.
[65] According to one embodiment, the software product includes computer-readable code that provides client-based performance management. The performance level of the digital audio data delivery is an important factor in ensuring the integrity of the audio stream available to the user. The purpose of client-based performance management is to ensure that the client software receives service at or above minimum levels. According to one embodiment, this service is automated and is provided transparently to the user utilizing any then current available network resource to do so. In other words, the user is not aware of the source of the service or the mechanics of accessing that service.
[66] For performance management purposes, the client software views the network and library server as a single entity. To ensure performance levels, the client software maintains statistics for service level for each library server. These server statistics are used when attempting to find the historically fastest server. This file is created and maintained in the client only. If service levels fall below a minimum acceptable level, the client software goes through the list of servers described above to determine which server has the best historical record of service. The client software selects this new server as the primary provider. Notably, using performance management may result in the user receiving small digital audio files from more than one server for the same audio stream.
[67] The performance management logic is built into lower level functions that perform various network and library based functions. These include 1) Logging in to a server; 2) Obtaining a file from the server; 3) Obtaining file size and creation dates. Referring to Fig. 11, the initial steps taken by the client software are to load the list of servers 360 available for use and the historical transfer statistics 362. The fastest server from the list is then selected 364 as the primary server. If the server is not available or fails to respond, the next fastest server is selected. The process continues until a server is reached. If no servers are available, the default server entered is used. Servers that are found to be slow or are continually in error will have their transfer rate increased based on one of two values 366. The value is either the total elapsed time of the transaction with the server or an error value equal to a predetermined transaction delay (e.g., one minute). As time goes on, these operational statistics are aged 368 to reduce the effect of errors or network delays. Servers are slowly aged until such time as their statistics are not less than the average for all servers. The result of the aging process means that, assuming no
additional delays or errors, the operational average will decrease to some baseline average that will be greater than the fastest servers but still make the aged servers available in the future. With the then current fastest server established, that server is used as the target of all library operations. A connection must be established to the network in order to communicate. Each operation including, but not limited to login, get file and get file size are timed to see how long each transaction takes. This testing is built right into the lower level logic of the client software. In the event that a server is failed out as a result of error or degradation, a new server is selected to take its place. This server replacement occurs in the same manner that is customarily used for a non- fatal error. That is, the transaction is retried following the server replacement process without the upper levels of client software logic or the user becoming aware that it has occurred. In this way, the client software is able to balance network and server loads on the basis of performance without intervention from any other level.
[68] According to one embodiment, the software product uses a universal ISBN server, which is designed to provide a simplified means to locate network-based library services from one or more suppliers on a network. The ISBN server may be located on the Internet for global access or on various intranets for use by various public or private organizations. The purpose of the ISBN server is to receive a request from a client device and return a list of one or more servers. The request from the client device will include a unique ISBN number or other unique identifier. The ISBN server will look up the unique identifier in a preloaded database and assemble or extract a list of servers capable of supporting library services for that identifier. This list is then returned to the client device. Upon receipt of the list of library servers, a selection is made from that list as the preferred provider of library service (e.g., as discussed with regards to client based performance management). The selected server is then accessed to acquire the virtual audio stream descriptor that goes with the unique identifier originally provided by the client.
[69] Preferably, the software product, including the computer-readable code, is stored on a computer readable storage medium on the client side of the system 150. The computer readable code is then used to access information structures and files that reside on one or more servers on the server side of the system 100 (e.g., within a server farm). Information transfer from client to server is accomplished using industry standard server software, tools and utilities. A summary of various types of information, structures or files is provided in Table 1.
Table 1. Various types of information, structures, and files
[70] Fig. 12 shows the information, structures and files contained on the server side generally grouped by function. The same information, structures and files are grouped differently on the client side and, in particular, are grouped by their requirement for retention. More specifically, this schematic diagram illustrates that as information is transferred from the server to the client, it is typically organized based on the priorities defined for the memory manager. The structures used are considered more or less expendable subject to their content. Static structures contain information needed to establish and maintain connections with the servers on the network. The term static indicates that the structures, once defined, remain in place although the content thereof may change. The memory manager will preserve these structures at all costs. The volatile structures include those whose existence is short lived. The memory manager will balance the need for space with the need to retain content surrounding active bookmarks. As the demands for space increase, the content surrounding bookmarks becomes less and less. The structures that are considered dynamic are semi-permanent structures that typically exist for the duration that an audio stream remains open and bookmarked. The memory manager will make every effort to ensure that these structures are preserved, but may remove them as a final option to obtain space. Typically, the last structures to be purged are the oldest bookmark structures.
[71] According to one embodiment, the static files are contained in a root directory, while the volatile files are contained in a spooler directory. A list of possible static and/or volatile files that may be used by the software product is provided in Table 2.
Filename(s) Contents Static Files
Audio Pod Directory The directory that contains all files that are static in their existence
Spooler Directory The directory that contains all files that are volatile in their existence
AudioPod.exe The Audio Pod executable image AudioPod.xml The Audio Pod startup initialization file; in XML format UpdateManager . exe The Audio Pod Update Manager executable image ServerList.xml The list of libraries, mirrors and servers that are available on the network as targets for the Audio Pod Performance/Load manager; in XML format
ServerStats.xml The historical rate of response statistics for all library servers; in XML format
BookMarks.xml The list of active bookmarks; in XML format
TheEnd.mp3 The audio stream to be played on completion of an audio stream (book)
ErrorAlert.mp3 The audio stream to play when the Audio Pod must attract the attention of the user while listening to another audio stream (book)
Volatile Files
Small Audio Files Audio files that make up the various open audio streams
(book); in MP3 format
Cover Art Graphic Graphic files that contain images of book covers; in jpg Files graphic format
Card Catalog Index Files containing Card Catalog indexes; in XML format Files
Book Profiles Files containing Book Profiles; in XML format
Announcement File File containing a notice or announcement; in XML format
Update File File containing components needed to perform an update to the Audio Pod and/or any of its' components
Table 2. List of Possible Static and Volatile Files
[72] As discussed above, a memory purge process is used to remove volatile files to ensure that a requested level of free memory is made available. This process works directly on the contents of the spooler directory. The purging process takes different approaches when dealing with the active audio stream, bookmarked audio streams, and ancillary or support files. A demand for a significant quantity of memory is made at the opening of a new audio stream, or reopening a bookmarked audio stream. The size of the demand is subject to the ultimate size of memory available, the size of the audio stream being accessed and the volume of content from the subject audio stream that may already be resident. In the event that sufficient memory is not available, memory is purged in the following order.
1. Ancillary or support files that are considered volatile are removed from memory.
2. Virtual audio streams, supporting files and related audio content for any audio stream for which there is no bookmark are deleted.
3. Bookmarked audio streams are purged with increasing levels of severity until the memory demands are met.
4. The content of dynamic memory including virtual audio stream descriptors, and supporting files are deleted, starting with the oldest.
[73] When purging bookmarked audio streams, the purging process attempts to retain as much resident content as is possible. The purge process focuses on the bookmark position within the audio stream. Some resident content is retained within the audio stream preceding the bookmarked position. This is to allow the user the ability to rewind the audio stream in an attempt to pick up where they left off. However, this quantity of content is not large and generally will not exceed 5 minutes. The main effort is to preserve as much resident content of the audio stream that follows the position. In order to satisfy the demand for memory, most, if not all, bookmarked audio streams will have some future content purged. In the event that sufficient memory cannot be obtained with an initial purge of content, the level of severity of the purge will be increased and the purge process repeated. The volume of resident content in the bookmarked audio streams is reduced. This reduction is most severe in content preceding bookmarked positions. As the levels of severity increase further, the quantity of content preceding the bookmarked positions prevents further gains through purging, and content that follows the bookmarked positions is aggressively purged. The purging process continues, reducing the quantity of content surrounding bookmarked positions until, at the ultimate extreme, no content remains. Under normal circumstances, the demand for memory will be met and this situation is expected never to arise. This process is shown in Fig. 13.
[74] When the demand for memory is met, the selected audio stream becomes the focus of the purging process. The effort becomes one of ensuring that sufficient content is maintained around the current player position to ensure a continuous replay of the audio stream. As the player position approaches the end of available resident content, the current audio stream is purged to make room for additional content. Every attempt is made to preserve some content preceding the current player position to allow the user to rewind a few minutes to pick up the story in the event of interruption. Referring to Fig. 14, A shows the normally expected state of memory with already heard content purged and future content loaded as the player position approaches the end of resident content, whereas B-D shows the state of memory that may result when internal media marks, external bookmarks, rewind, or fast forward functions are used. In these situations, the media player position may be outside of resident content or may result in a discontinuity of
resident content. In each situation, the content that precedes the current player position typically is purged prior to purging any content that follows the current player position.
[75] According to one embodiment of the instant invention, a method of using the software product to transmit digital audio data is described as follows. A user selects an audio stream. Examples of audio streams include audio books, magazines, newscasts, radio shows, lectures, museum tours, etc, or parts thereof. The audio stream typically is selected from a card catalog, a bookmark, or other means. In general, the actual audio format of the sound information is not important.
[76] Once an audio stream has been selected, a demand is raised to the memory manager for enough space to work with the virtual audio stream descriptor (e.g., about 250K bytes). In normal operation, this quantity of memory is routinely expected to be available resulting in no action taken by the memory manager.
[77[ The software product ensures that the virtual audio stream descriptor has been downloaded. More specifically, the volatile memory is checked for the existence of this structure and, if it is not resident, it is downloaded. A demand is then raised to the memory manager for the lesser of two quantities of memory. The first value is 75 percent of available memory. The second is the ultimate size of the actual audio stream minus the amount of any memory currently consumed by any small audio files that may already be resident.
[78] The desired position within the actual audio stream is then ascertained. The default position is assumed to correspond a time offset of zero. If the method of selection was a bookmark, or an internal media mark, then the offset position is obtained from that structure. The offset is validated to be in the range from zero to the maximum duration of the audio stream, a value obtained from the virtual audio stream descriptor. The time offset is compared against the list of small audio file metrics stored in the virtual audio stream descriptor. When the time offset falls between the start and end times of a specific small audio file, that small audio file is identified as the target small audio file. A local time offset is calculated by subtracting the start time of that small audio file from the time offset that was the subject of the search. This local offset is retained for use when positioning the target small audio file.
[79] If the target small audio file is not resident, then it is downloaded. The small audio file is loaded into the media player and the media player is positioned to the calculated local time offset. When the media player is started, the download manager is signalled to commence operations. The download manager purges the current audio stream and then examines the virtual audio stream and the content of volatile memory. Small audio files are downloaded sequentially. When the end of the audio stream is reached, downloading stops. If memory is exhausted and the download manager indicates that enough continuous audio content is resident, downloading stops. Otherwise, a demand for additional memory is raised with the memory manager, and the process is repeated.
[80] As the media player advances through the audio stream, the small audio files are successively loaded and played until the end of the audio stream is reached. The current position in the actual audio stream is tracked. If the current position in the actual audio stream approaches the end of resident audio content and the entire audio stream is not downloaded, then the current audio stream is purged to make memory available for new content, and the download manager is started. New content is downloaded until the end of the audio stream is reached or memory is exhausted. This process is repeated as often as is necessary. In this manner, the software product can process complete audio streams that exceed the size of memory available.
[81] The small audio files are contained within a common spooling area. As the spooling area fills with small audio files, the quantity of unheard audio increases. This quantity is displayed to the user. As a result, the invention can continue to play through resident unheard small audio files even during periods when out of network contact with the library. The memory manager will detect when network service is restored and continue processing as normal.
[82] If the media player is stopped, a bookmark is created and stored. The bookmark identifies the audio stream and the time offset of the bookmarked position. The offset value stored is the current position in the audio stream less an arbitrary time. This allows the listener to 'pick up the story' when the listener resumes the current audio stream. If the listener changes the time offset into the audio stream using the rewind and fast forward buttons, or any of the media marks that may be available, the new offset position is used to position the audio stream as described above.
[83] When the end of the audio stream is reached, any bookmarks are removed from dynamic memory. Without a bookmark, the memory manager will purge the audio stream and all references at the next signal to commence operations.
[84] This approach allows many audio streams to be opened and bookmarked at one time. Given the actual size of these large audio streams, it will be necessary to have a memory manager capable of ensuring sufficient space is available for the most active audio streams while preserving as much physical content surrounding active bookmarks as is possible. The need to preserve actual audio content around bookmarks becomes clear when considering levels of degradation associated with the acquisition of content across the network. The ultimate goal is to have as near zero delay as is possible when resuming an audio stream. Retaining sufficient media allows audio streams to start virtually instantly, and then acquire media content as needed.
[85] Fig. 15 provides an overview of the memory manager process in greater detail. When activated, the memory manager first checks to see if there is sufficient audio content already resident (e.g., enough for about 5 minutes play time). If there is enough content, the remainder of the audio stream is resident or the download manager is running, then no action is taken. Otherwise, the memory manager purges the content of the audio spooler directory with the goal of freeing a specific amount of memory. With memory available, the memory manager signals the download manager to commence operations.
[86] Fig. 16 provides an overview of an embodiment of a download manager process. The contents of the spooler directory are compared with the virtual audio stream descriptor and the user's current position in the audio stream. In particular, the spooler content is examined for the first small audio file that is needed to make the audio stream continuous beyond the then current position in the audio stream. If this file is missing, its size and the amount of available memory is obtained. This small audio file is then downloaded and the integrity of the file verified for size. The download manager continues to run until either memory is exhausted, or the end of the audio stream is reached. If the player is stopped while the download manager is running, the process stopping the player will stop the download manager.
[87] Referring to Figs. 17, 18, and 19, process flow overviews for using the software product are provided. More specifically, Fig. 17 shows an embodiment of a general process for using the
software product, from start-up through various navigation steps and associated logic. A series of navigation buttons shown at the bottom of the diagram provide the user with the ability to navigate to various displays. Fig. 18 shows an embodiment of a process for using the standard control buttons. Fig. 19 shows an embodiment of a general process for loading the actual audio stream.
[88] In summary, the software product provides the means to deliver large volume audio streams from a central library to the end user, to maintain bookmarks for each audio stream opened and being read regardless of the number of audio streams opened, to switch audio streams anywhere and anytime, to receive library based announcements and updates, to play spooled audio segments even when network service is unavailable, and to provide active management of network resources that balances load between the main library and all mirror sites on the network, and thus ensures fast, reliable service.
[89] Of course, the above embodiments have been provided as examples only. It will be appreciated by those of ordinary skill in the art that various modifications, alternate configurations, and/or equivalents will be employed without departing from the spirit and scope of the invention. Accordingly, the scope of the invention is therefore intended to be limited solely by the scope of the appended claims.
Claims
1. A method of providing files for storage in a network accessible library for use in the transmission of digital audio data, comprising the steps of: a) segmenting an audio stream into a plurality of small digital audio files using natural language gaps in the audio stream; b) determining at least one of a start time, an end time, and a play time of each small digital audio file within the audio stream; and c) creating a descriptor for identifying the audio stream and for ordering the plurality of small digital audio files, the descriptor including the at least one of a start time, an end time, and a play time of each small digital audio file within the audio stream.
2. A method according to claim 1, comprising the steps of: d) repeating steps a) to c) for a plurality of other audio streams; and e) storing the plurality of small digital audio files for each audio stream in the plurality of other audio streams in a different directory in the network accessible library.
3. A method according to claim 2, comprising the step of creating a catalog index to facilitate navigation of the network accessible library.
4. A method according to claim 3, comprising the step of storing a cover art image in each of the different directories, the cover art image selected to represent the corresponding audio stream.
5. A method according to any of claims 1 to 4, wherein step (a) includes searching for a frame, which when played, has a decibel level below a predetermined limit.
6. A method according to any of claims 1 to 4, wherein step (a) comprises segmenting the audio stream into a plurality of randomly sized digital audio files.
7. A method according to any of claims 1 to 4, wherein step (a) includes selecting a maximum size for each of the small digital audio files in dependence upon an expected time to transmit, load, and begin playing a digital audio file of said maximum size.
8. A method according to claim 7, wherein the maximum size for each of the small digital audio files is selected such that the expected time to transmit, load, and begin playing is less than about 5 seconds.
9. A method according to any of claims 1 to 4, wherein step (c) includes manually entering at least one of a title, subtitle, author, theme, plot, performer, publisher, copyright holder, ISBN number, and 'Vchip' rating of the audio stream into the descriptor.
10. A method according to claim 9, wherein step (c) includes manually entering internal media marks, the internal media marks including a label and a time offset in the audio stream corresponding to at least one of a table of contents, chapter markers, a content index, a list of figures, a list of illustrations, a list of tables, footnotes, quotations, and cross-references.
11. A method according to claim 9, wherein step (c) includes manually entering a network location of the plurality of small digital audio files into the descriptor.
12. A method for the transmission of digital audio data, comprising the steps of: a) selecting the audio stream from the network accessible library defined in any of claims 1 to 11 ; b) determining a first small digital audio file in the plurality of small digital audio files to be transmitted; c) transmitting the first small digital audio file from the network accessible library to a client; and d) using a media player, playing the first small digital audio file.
13. A method according to claim 12, comprising the step of: e) simultaneously transmitting one or more subsequent small digital audio files from the plurality of small digital audio files from the network accessible library to the client, while playing the first small digital audio file.
14. A method according to claim 13, comprising the step of: f) transmitting and playing successive small digital audio files on demand until available memory space is exhausted or until all small digital audio files in the plurality have been transmitted.
15. A method according to claim 14, comprising the step of: g) purging a plurality of already played small digital audio files to increase available memory space.
16. A method according to claim 12, wherein step (b) comprises transmitting the descriptor from the network accessible library to the client.
17. A method according to claim 12, wherein step (a) comprises selecting the audio stream using a bookmark.
18. A method according to any of claims 12 to 16, wherein step (b) comprises the step of using a time offset from one of the descriptor and a bookmark to select the first small digital audio file to be transmitted.
19. A method according to claim 18, wherein step (d) comprises the step of using the time offset to determine a local time offset within the first small digital audio file from which to begin playback.
20. A method according to claim 18, comprising the step of using another time offset to rewind or fast forward through the audio stream.
21. A method according to claim 18, wherein step (b) comprises using a time offset from the descriptor, and wherein the time offset is selected via a label cross-referenced to the time offset, the label including at least one of a table of contents, an index, a list of figures, a list of illustrations, a list of tables, footnotes, quotations, and cross-references.
22. A method according to claim 12, comprising the steps of: e) determining a numeric value representing a current time offset into the audio stream, while playing the small digital audio file; and f) creating a bookmark using the current time offset and information in the descriptor for identifying the audio stream.
23. A method according to claim 22, wherein the bookmark is created upon one of stopping playback and receiving a request from a user.
24. A method according to claim 22, wherein the information in the descriptor for identifying the audio stream includes the current time offset, a descriptor identifier, and a title of the audio stream.
25. A method according to claim 22, wherein a predetermined value is subtracted from the current time offset.
26. A method according to claim 22, wherein, as successive small digital audio files are played, the current time offset is updated.
27. A method according to claim 26, wherein the current time offset is verified against information in the descriptor pertaining to the successive small digital files, and wherein the current time offset is reset in dependence on the verification.
28. A method according to claim 12, comprising the steps of: determining an amount of memory available for receiving transmitted small digital audio files; determining the severity of a purge process required; obtaining a list of small digital audio files corresponding to the audio stream currently resident with the client; determining small digital audio files in the list for being retained during the purge process in dependence upon rules predetermined for memory management and the determined severity; and purging all small digital audio files not determined to be retained.
29. A method according to claim 28, wherein step (b) comprises using a bookmark to point to the descriptor of the audio stream, the bookmark including a time offset in the audio stream, and wherein the list of small digital audio files to be retained includes small digital audio files with time offsets close to the time offset of the bookmark.
30. A method according to claim 12, wherein step (b) comprises using a unique identifier that is stored on a network based server to provide a list of network-based resources capable providing the descriptor corresponding to the audio stream.
31. A method according to claim 30, wherein the unique identifier is an ISBN number.
32. A method according to claim 30, wherein the unique identifier is obtained from one of a bookmark structure, a card catalog structure, and an advertising structure.
33. A method according to claim 30, comprising the steps of: transmitting the unique identifier from the client to the network based server; and, receiving the list of network-based resources from the network based server, the network based server obtaining the list by searching a database to find a reference structure identified by the unique identifier.
34. A method according to claim 12, comprising the steps of: maintaining a list of servers having copies of files from the network-based library and historical transfer rates thereof; comparing the historical transfer rate for each server; selecting the fastest server in the list; setting a floating average value representing transaction rate to zero; monitoring transaction times for the selected server and updating the floating average transaction rate; increasing the floating average transfer rate by predetermined large value in dependence upon an unavailability of the selected server; and updating the historical transfer rate for the selected server in dependence upon the floating average transaction rate exceeding a predetermined value.
35. A method according to claim 34, comprising the steps of: at arbitrary time intervals, calculating an average value of the historical transfer rates for all servers on the list of servers and subtracting a predetermined small value from the historical transfer rate for each server that has an historical value exceeding the calculated average.
36. A method for the transmission of digital audio data, comprising the steps of:
a) selecting an audio stream, the audio stream stored as a plurality of small digital audio files, each small digital audio file corresponding to a segment of the audio stream bounded by natural language gaps in the audio stream; b) determining a first small digital audio file in the plurality of small digital audio files to be transmitted; c) transmitting the first small digital audio file from a server to a client; d) using a media player, playing the transmitted first small digital audio file; e) determining subsequent small digital audio files in the plurality of small digital audio files to be transmitted; f) transmitting the subsequent small digital audio files from the server to the client; and, g) using the media player, playing the transmitted subsequent small digital audio files such that, to a user, the transition therebetween is apparently seamless.
37. A method according to claim 36, wherein step (a) comprises selecting the audio stream using one of a bookmark and a card catalog, wherein each of the bookmark and the card catalog is cross-referenced to a descriptor including at least one of a start time, an end time, and a play time of each small digital audio file within the audio stream.
38. A method according to claim 36, wherein steps (b) and (d) comprise using a time offset and the descriptor.
39. A method according to claim 38, wherein the time offset corresponds to at least one of a start of the audio stream, a bookmarked position, and a chapter marker.
40. A method according to any of claims 36 to 39, wherein the natural language gaps include gaps between words read from a same paragraph.
41. A method for creating a bookmark for use in the transmission of digital audio data, comprising the steps of:
a) listening to an audio stream; b) determining a current position within the audio stream; c) determining a time offset from a start of the audio stream to the current position; and, d) creating a bookmark for the current position including the time offset.
42. A method according to claim 41, comprising the steps of using the bookmark and a descriptor defining at least one of a start time, an end time, and a play time of a plurality of stored small digital audio files corresponding to the audio stream, to begin play of the audio stream from the bookmarked position.
43. A system for the transmission of digital audio data comprising: a server for storing audio streams, each audio stream stored as a plurality of small digital audio files, each small digital audio file corresponding to a segment of the corresponding audio stream bounded by natural language gaps in the audio stream; a client for playing selected audio streams stored on the server; and a network for connecting the server and the client and facilitating transmission of the small digital audio files from the server to the client, wherein at least one of the server and the client provides a descriptor for each audio stream stored on the server, each descriptor including at least one of a start time, an end time, and a play time of the plurality of small digital audio files of the corresponding audio stream, each descriptor providing means for the client to begin playing the selected audio stream from any position therein without significant delay.
44. A computer readable storage medium including computer readable code, which when executed by a computer, causes said computer to: download at least part of a selected audio stream stored on a network accessible server, the selected audio stream stored as a plurality of small digital audio files, each small digital audio file corresponding to a segment of the selected audio stream bounded by natural language gaps in the selected audio stream; and begin playing the downloaded audio stream using a media player without significant delay and such the transition between successive small digital audio files appears seamless to a user of the media player.
45. A computer readable storage medium according to claim 44, wherein play is begun from a predetermined position within the selected audio stream, the predetermined position determined using a time offset in the selected audio stream, the time offset obtained from one of a bookmark, a catalog index, and an advertising structure.
Priority Applications (13)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP06840473.0A EP1961154A4 (en) | 2005-12-13 | 2006-12-12 | Segmentation and transmission of audio streams |
US12/096,933 US8285809B2 (en) | 2005-12-13 | 2006-12-12 | Segmentation and transmission of audio streams |
US13/313,393 US9319720B2 (en) | 2005-12-13 | 2011-12-07 | System and method for rendering digital content using time offsets |
US13/588,084 US8738740B2 (en) | 2005-12-13 | 2012-08-17 | Transmission of digital audio data |
US14/250,591 US9203884B2 (en) | 2005-12-13 | 2014-04-11 | Transmission of digital audio data |
US14/924,028 US9930089B2 (en) | 2005-12-13 | 2015-10-27 | Memory management of digital audio data |
US15/054,756 US9954922B2 (en) | 2005-12-13 | 2016-02-26 | Method and system for rendering digital content across multiple client devices |
US15/062,610 US9729907B2 (en) | 2005-12-13 | 2016-03-07 | Synchronizing a plurality of digital media streams by using a descriptor file |
US15/358,354 US10091266B2 (en) | 2005-12-13 | 2016-11-22 | Method and system for rendering digital content across multiple client devices |
US15/652,326 US10237595B2 (en) | 2005-12-13 | 2017-07-18 | Simultaneously rendering a plurality of digital media streams in a synchronized manner by using a descriptor file |
US16/145,265 US10735488B2 (en) | 2005-12-13 | 2018-09-28 | Method of downloading digital content to be rendered |
US16/267,550 US10805111B2 (en) | 2005-12-13 | 2019-02-05 | Simultaneously rendering an image stream of static graphic images and a corresponding audio stream |
US16/984,046 US20200366726A1 (en) | 2005-12-13 | 2020-08-03 | Method of downloading digital content to be rendered |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US74963205P | 2005-12-13 | 2005-12-13 | |
US60/749,632 | 2005-12-13 |
Related Child Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/096,933 A-371-Of-International US8285809B2 (en) | 2005-12-13 | 2006-12-12 | Segmentation and transmission of audio streams |
US13/313,393 Continuation-In-Part US9319720B2 (en) | 2005-12-13 | 2011-12-07 | System and method for rendering digital content using time offsets |
US13/588,084 Continuation US8738740B2 (en) | 2005-12-13 | 2012-08-17 | Transmission of digital audio data |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2007068119A1 true WO2007068119A1 (en) | 2007-06-21 |
Family
ID=38162525
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CA2006/002046 WO2007068119A1 (en) | 2005-12-13 | 2006-12-12 | Segmentation and transmission of audio streams |
Country Status (3)
Country | Link |
---|---|
US (8) | US8285809B2 (en) |
EP (1) | EP1961154A4 (en) |
WO (1) | WO2007068119A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8561081B1 (en) | 2007-11-13 | 2013-10-15 | Accenture Global Services Limited | System and method for dynamic brokering of digital content requests |
CN113315810A (en) * | 2021-04-29 | 2021-08-27 | 上海探寻信息技术有限公司 | Online audio playing method and equipment |
Families Citing this family (28)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2001093226A (en) | 1999-09-21 | 2001-04-06 | Sony Corp | Information communication system and method, and information communication device and method |
US8458754B2 (en) | 2001-01-22 | 2013-06-04 | Sony Computer Entertainment Inc. | Method and system for providing instant start multimedia content |
US7539086B2 (en) * | 2002-10-23 | 2009-05-26 | J2 Global Communications, Inc. | System and method for the secure, real-time, high accuracy conversion of general-quality speech into text |
US9665876B2 (en) * | 2003-10-23 | 2017-05-30 | Monvini Limited | System of publication and distribution of instructional materials and method therefor |
EP1961154A4 (en) * | 2005-12-13 | 2016-03-09 | Audio Pod Inc | Segmentation and transmission of audio streams |
US20100281509A1 (en) * | 2007-01-18 | 2010-11-04 | Thomson Licensing | Prefix caching assisted quality of service aware peer-to-peer video on-demand |
US9483405B2 (en) | 2007-09-20 | 2016-11-01 | Sony Interactive Entertainment Inc. | Simplified run-time program translation for emulating complex processor pipelines |
US8595748B1 (en) | 2007-12-21 | 2013-11-26 | Ibiquity Digital Corporation | Systems and methods for transmitting and receiving large objects via digital radio broadcast |
US20090248799A1 (en) * | 2008-03-31 | 2009-10-01 | Telefonaktiebolaget Lm Ericsson (Publ) | Method and server for user identifier update |
US10061742B2 (en) * | 2009-01-30 | 2018-08-28 | Sonos, Inc. | Advertising in a digital media playback system |
WO2010138777A1 (en) | 2009-05-27 | 2010-12-02 | Arsh Technologies, Llc | Automatic resource retrieval and use |
US8489774B2 (en) * | 2009-05-27 | 2013-07-16 | Spot411 Technologies, Inc. | Synchronized delivery of interactive content |
MX2011013072A (en) * | 2009-06-08 | 2012-02-01 | Sharp Kk | Software updating system, display unit and software updating method. |
US20110118858A1 (en) * | 2009-11-13 | 2011-05-19 | Apple Inc. | Local storage of a portion of streamed media items |
US8126987B2 (en) | 2009-11-16 | 2012-02-28 | Sony Computer Entertainment Inc. | Mediation of content-related services |
US9342661B2 (en) * | 2010-03-02 | 2016-05-17 | Time Warner Cable Enterprises Llc | Apparatus and methods for rights-managed content and data delivery |
US8539331B2 (en) * | 2010-05-13 | 2013-09-17 | Microsoft Corporation | Editable bookmarks shared via a social network |
WO2011146898A2 (en) * | 2010-05-21 | 2011-11-24 | Bologh Mark J | Internet system for ultra high video quality |
JP5625482B2 (en) * | 2010-05-21 | 2014-11-19 | ヤマハ株式会社 | Sound processing apparatus, sound processing system, and sound processing method |
US8433759B2 (en) | 2010-05-24 | 2013-04-30 | Sony Computer Entertainment America Llc | Direction-conscious information sharing |
US9026934B1 (en) * | 2011-09-29 | 2015-05-05 | Amazon Technologies, Inc. | Dynamic character biographies |
CA2862813C (en) * | 2012-01-09 | 2021-01-19 | Harman International Industries, Inc. | Systems and methods for operating an audio books service |
US8860479B2 (en) * | 2013-03-15 | 2014-10-14 | Intel Corporation | Integrated clock differential buffering |
US10958966B2 (en) * | 2017-03-31 | 2021-03-23 | Gracenote, Inc. | Synchronizing streaming media content across devices |
CN109005143B (en) * | 2017-06-07 | 2022-03-04 | 上海中兴软件有限责任公司 | Method and device for adjusting website load |
US10673549B1 (en) * | 2018-11-29 | 2020-06-02 | Dts, Inc. | Advertising measurement and conversion measurement for radio systems |
KR20210032809A (en) | 2019-09-17 | 2021-03-25 | 삼성전자주식회사 | Real-time interpretation method and apparatus |
US11050834B1 (en) * | 2020-11-28 | 2021-06-29 | Near Pte. Ltd. | Method for automatically assigning visits to partially observable location data streams |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5586264A (en) * | 1994-09-08 | 1996-12-17 | Ibm Corporation | Video optimized media streamer with cache management |
WO2001058165A2 (en) | 2000-02-03 | 2001-08-09 | Fair Disclosure Financial Network, Inc. | System and method for integrated delivery of media and associated characters, such as audio and synchronized text transcription |
US20030172346A1 (en) * | 1999-04-23 | 2003-09-11 | Gould Eric Justin | Method and computer program for expanding and contracting continuous play media seamlessly |
US6621980B1 (en) * | 1999-04-23 | 2003-09-16 | Monkeymedia, Inc. | Method and apparatus for seamless expansion of media |
EP1463258A1 (en) | 2003-03-28 | 2004-09-29 | Mobile Integrated Solutions Limited | A system and method for transferring data over a wireless communications network |
US20050091062A1 (en) * | 2003-10-24 | 2005-04-28 | Burges Christopher J.C. | Systems and methods for generating audio thumbnails |
US20050111824A1 (en) * | 2003-06-25 | 2005-05-26 | Microsoft Corporation | Digital video segmentation and dynamic segment labeling |
US20050245243A1 (en) | 2004-04-28 | 2005-11-03 | Zuniga Michael A | System and method for wireless delivery of audio content over wireless high speed data networks |
US20060236219A1 (en) * | 2005-04-19 | 2006-10-19 | Microsoft Corporation | Media timeline processing infrastructure |
US20060242550A1 (en) * | 2005-04-20 | 2006-10-26 | Microsoft Corporation | Media timeline sorting |
Family Cites Families (92)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US281509A (en) * | 1883-07-17 | John hope | ||
US118858A (en) * | 1871-09-12 | Improvement in methods for manufacturing ferrules | ||
US5533182A (en) * | 1992-12-22 | 1996-07-02 | International Business Machines Corporation | Aural position indicating mechanism for viewable objects |
US5793980A (en) * | 1994-11-30 | 1998-08-11 | Realnetworks, Inc. | Audio-on-demand communication system |
US5724475A (en) * | 1995-05-18 | 1998-03-03 | Kirsten; Jeff P. | Compressed digital video reload and playback system |
US6108637A (en) * | 1996-09-03 | 2000-08-22 | Nielsen Media Research, Inc. | Content display monitor |
US6393462B1 (en) * | 1997-11-13 | 2002-05-21 | International Business Machines Corporation | Method and apparatus for automatic downloading of URLs and internet addresses |
US6810409B1 (en) * | 1998-06-02 | 2004-10-26 | British Telecommunications Public Limited Company | Communications network |
US6816909B1 (en) * | 1998-09-16 | 2004-11-09 | International Business Machines Corporation | Streaming media player with synchronous events from multiple sources |
US6452609B1 (en) * | 1998-11-06 | 2002-09-17 | Supertuner.Com | Web application for accessing media streams |
US6728748B1 (en) * | 1998-12-01 | 2004-04-27 | Network Appliance, Inc. | Method and apparatus for policy based class of service and adaptive service level management within the context of an internet and intranet |
EP1968067A1 (en) * | 1999-03-30 | 2008-09-10 | Tivo, Inc. | Multimedia program bookmarking system |
WO2001035243A1 (en) * | 1999-11-08 | 2001-05-17 | Megaxess, Inc. | QUALITY OF SERVICE (QoS) NEGOTIATION PROCEDURE FOR MULTI-TRANSPORT PROTOCOL ACCESS FOR SUPPORTING MULTI-MEDIA APPLICATIONS WITH QoS ASSURANCE |
US6990464B1 (en) * | 2000-01-11 | 2006-01-24 | Ncr Corporation | Apparatus, system and method for electronic book distribution |
US6697564B1 (en) * | 2000-03-03 | 2004-02-24 | Siemens Corporate Research, Inc. | Method and system for video browsing and editing by employing audio |
US6542869B1 (en) * | 2000-05-11 | 2003-04-01 | Fuji Xerox Co., Ltd. | Method for automatic analysis of audio including music and speech |
US6961751B1 (en) * | 2000-05-31 | 2005-11-01 | International Business Machines Corporation | Method, apparatus, and article of manufacture for providing enhanced bookmarking features for a heterogeneous environment |
KR20040041082A (en) * | 2000-07-24 | 2004-05-13 | 비브콤 인코포레이티드 | System and method for indexing, searching, identifying, and editing portions of electronic multimedia files |
US8191103B2 (en) * | 2000-08-30 | 2012-05-29 | Sony Corporation | Real-time bookmarking of streaming media assets |
US20030079222A1 (en) * | 2000-10-06 | 2003-04-24 | Boykin Patrick Oscar | System and method for distributing perceptually encrypted encoded files of music and movies |
US20020129162A1 (en) * | 2000-11-22 | 2002-09-12 | Mcgregor Gregory M. | Method, architecture, and apparatus for dynamic content translation and switching |
US20020065922A1 (en) * | 2000-11-30 | 2002-05-30 | Vijnan Shastri | Method and apparatus for selection and redirection of an existing client-server connection to an alternate data server hosted on a data packet network (DPN) based on performance comparisons |
US6850982B1 (en) * | 2000-12-19 | 2005-02-01 | Cisco Technology, Inc. | Methods and apparatus for directing a flow of data between a client and multiple servers |
US7984147B2 (en) * | 2000-12-29 | 2011-07-19 | Hewlett-Packard Development Company, L.P. | Apparatus and method for identifying a requested level of service for a transaction |
US7143353B2 (en) * | 2001-03-30 | 2006-11-28 | Koninklijke Philips Electronics, N.V. | Streaming video bookmarks |
US6988169B2 (en) * | 2001-04-19 | 2006-01-17 | Snowshore Networks, Inc. | Cache for large-object real-time latency elimination |
US7020663B2 (en) * | 2001-05-30 | 2006-03-28 | George M. Hay | System and method for the delivery of electronic books |
US7421411B2 (en) * | 2001-07-06 | 2008-09-02 | Nokia Corporation | Digital rights management in a mobile communications environment |
US8515773B2 (en) * | 2001-08-01 | 2013-08-20 | Sony Corporation | System and method for enabling distribution and brokering of content information |
US20030046348A1 (en) * | 2001-08-29 | 2003-03-06 | Pinto Albert Gregory | System and method of converting video to bitmap animation for use in electronic mail |
US7185084B2 (en) * | 2001-09-05 | 2007-02-27 | Intel Corporation | Server-side measurement of client-perceived quality of service |
US7161887B2 (en) * | 2001-11-13 | 2007-01-09 | Digeo, Inc. | Method and apparatus for extracting digital data from a medium |
JP2003233618A (en) * | 2002-02-07 | 2003-08-22 | Fujitsu Ltd | Transversal search method and transversal search program |
US20100174717A1 (en) * | 2002-02-28 | 2010-07-08 | Olivier Fambon | Interative serialisation procedure for structured software objects |
US7797446B2 (en) * | 2002-07-16 | 2010-09-14 | Apple Inc. | Method and system for updating playlists |
US9412417B2 (en) * | 2002-04-05 | 2016-08-09 | Apple Inc. | Persistent group of media items for a media device |
US7680849B2 (en) * | 2004-10-25 | 2010-03-16 | Apple Inc. | Multiple media type synchronization between host computer and media device |
US7899915B2 (en) * | 2002-05-10 | 2011-03-01 | Richard Reisman | Method and apparatus for browsing using multiple coordinated device sets |
JP3744464B2 (en) * | 2002-05-20 | 2006-02-08 | ソニー株式会社 | Signal recording / reproducing apparatus and method, signal reproducing apparatus and method, program, and recording medium |
US20030221194A1 (en) * | 2002-05-23 | 2003-11-27 | Balaji Thiagarajan | Fast-advance while recording on-demand content |
US6816834B2 (en) * | 2002-10-23 | 2004-11-09 | Jon Jaroker | System and method for secure real-time high accuracy speech to text conversion of general quality speech |
US7539086B2 (en) * | 2002-10-23 | 2009-05-26 | J2 Global Communications, Inc. | System and method for the secure, real-time, high accuracy conversion of general-quality speech into text |
US8225194B2 (en) * | 2003-01-09 | 2012-07-17 | Kaleidescape, Inc. | Bookmarks and watchpoints for selection and presentation of media streams |
US7730407B2 (en) * | 2003-02-28 | 2010-06-01 | Fuji Xerox Co., Ltd. | Systems and methods for bookmarking live and recorded multimedia documents |
US20040172365A1 (en) * | 2003-02-28 | 2004-09-02 | Docomo Communications Laboratories Usa, Inc. | Method for performing electronic redistribution of digital content with fee assessment and proceeds distribution capability |
US7248777B2 (en) * | 2003-04-17 | 2007-07-24 | Nielsen Media Research, Inc. | Methods and apparatus to detect content skipping by a consumer of a recorded program |
TWI236232B (en) * | 2004-07-28 | 2005-07-11 | Via Tech Inc | Method and apparatus for bit stream decoding in MP3 decoder |
AU2003903967A0 (en) * | 2003-07-30 | 2003-08-14 | Canon Kabushiki Kaisha | Distributed data caching in hybrid peer-to-peer systems |
US20060292049A1 (en) * | 2003-09-04 | 2006-12-28 | Tetsuya Nagasaka | Process for producing rutile |
US20050144305A1 (en) * | 2003-10-21 | 2005-06-30 | The Board Of Trustees Operating Michigan State University | Systems and methods for identifying, segmenting, collecting, annotating, and publishing multimedia materials |
GB0328383D0 (en) * | 2003-12-06 | 2004-01-14 | Ibm | Improved quality of service for network connected clients |
CN1627293A (en) * | 2003-12-09 | 2005-06-15 | 皇家飞利浦电子股份有限公司 | Electronic bookmark |
US20050177618A1 (en) * | 2003-12-22 | 2005-08-11 | Randy Zimler | Methods, systems and storage medium for managing bandwidth of segmented content |
US20060265409A1 (en) * | 2005-05-21 | 2006-11-23 | Apple Computer, Inc. | Acquisition, management and synchronization of podcasts |
US20050250439A1 (en) * | 2004-05-06 | 2005-11-10 | Garthen Leslie | Book radio system |
US7631098B2 (en) * | 2004-06-08 | 2009-12-08 | International Business Machines Corporation | Method, system and program product for optimized concurrent data download within a grid computing environment |
US20050276570A1 (en) | 2004-06-15 | 2005-12-15 | Reed Ogden C Jr | Systems, processes and apparatus for creating, processing and interacting with audiobooks and other media |
US8370888B2 (en) * | 2004-06-22 | 2013-02-05 | University Of Southern California | Hydra: high-performance data recording architecture for streaming media |
NZ534100A (en) * | 2004-07-14 | 2008-11-28 | Tandberg Nz Ltd | Method and system for correlating content with linear media |
KR100580195B1 (en) * | 2004-07-16 | 2006-05-16 | 삼성전자주식회사 | Method and apparatus for recording with which time shift function is practicable at plural channel |
US7788671B2 (en) * | 2004-11-01 | 2010-08-31 | International Business Machines Corporation | On-demand application resource allocation through dynamic reconfiguration of application cluster size and placement |
US7882140B1 (en) * | 2004-12-03 | 2011-02-01 | Hotel Digital Network Inc. | System and method for inserting secondary content into programmed primary content |
JP4380524B2 (en) * | 2004-12-17 | 2009-12-09 | ソニー株式会社 | Information processing apparatus and information processing method |
US20060140162A1 (en) * | 2004-12-23 | 2006-06-29 | Yojak Vasa | Alternate-location content delivery apparatus, methods and computer program products |
US8225335B2 (en) * | 2005-01-05 | 2012-07-17 | Microsoft Corporation | Processing files from a mobile device |
US7958441B2 (en) * | 2005-01-07 | 2011-06-07 | Apple Inc. | Media management for groups of media items |
US7852748B2 (en) * | 2005-03-23 | 2010-12-14 | Cisco Technology, Inc. | Method and system for providing voice QoS during network failure |
US7721301B2 (en) * | 2005-03-31 | 2010-05-18 | Microsoft Corporation | Processing files from a mobile device using voice commands |
US20060265637A1 (en) * | 2005-05-21 | 2006-11-23 | Apple Computer, Inc. | Utilization of podcasts on portable media devices |
US7686215B2 (en) * | 2005-05-21 | 2010-03-30 | Apple Inc. | Techniques and systems for supporting podcasting |
US20070016636A1 (en) * | 2005-07-14 | 2007-01-18 | Yahoo! Inc. | Methods and systems for data transfer and notification mechanisms |
GB2430507A (en) | 2005-09-21 | 2007-03-28 | Stephen Robert Ives | System for managing the display of sponsored links together with search results on a mobile/wireless device |
US7966577B2 (en) * | 2005-10-11 | 2011-06-21 | Apple Inc. | Multimedia control center |
US8769408B2 (en) * | 2005-10-07 | 2014-07-01 | Apple Inc. | Intelligent media navigation |
US7813913B2 (en) | 2005-10-12 | 2010-10-12 | Storage Appliance Corporation | Emulation component for data backup applications |
US7546118B2 (en) * | 2005-10-20 | 2009-06-09 | Sony Ericsson Mobile Communications Ab | Coordinated distribution and playback of multimedia programs |
US20070094691A1 (en) * | 2005-10-24 | 2007-04-26 | Gazdzinski Robert F | Method and apparatus for on-demand content transmission and control over networks |
US8009961B2 (en) * | 2005-10-25 | 2011-08-30 | Sony Corporation | Electronic apparatus, playback management method, display control apparatus, and display control method |
US7801910B2 (en) | 2005-11-09 | 2010-09-21 | Ramp Holdings, Inc. | Method and apparatus for timed tagging of media content |
US20070118657A1 (en) * | 2005-11-22 | 2007-05-24 | Motorola, Inc. | Method and system for sharing podcast information |
US8392528B2 (en) * | 2005-11-22 | 2013-03-05 | Motorola Mobility Llc | Architecture for sharing podcast information |
US20070124331A1 (en) * | 2005-11-30 | 2007-05-31 | Sony Ericsson Mobile Communications Ab | Method and apparatus for the seamless delivery of content |
EP1961154A4 (en) * | 2005-12-13 | 2016-03-09 | Audio Pod Inc | Segmentation and transmission of audio streams |
US9319720B2 (en) * | 2005-12-13 | 2016-04-19 | Audio Pod Inc. | System and method for rendering digital content using time offsets |
US7996550B2 (en) * | 2006-11-30 | 2011-08-09 | Red Hat, Inc. | Peer-to-peer download with quality of service fallback |
US20100281509A1 (en) | 2007-01-18 | 2010-11-04 | Thomson Licensing | Prefix caching assisted quality of service aware peer-to-peer video on-demand |
US7769822B2 (en) * | 2007-07-17 | 2010-08-03 | International Business Machines Corporation | Method for distributing file content from a selected target depot server in response to multiple client requests |
US20090171750A1 (en) | 2007-12-27 | 2009-07-02 | Hanning Zhou | Incorporating advertising in on-demand generated content |
US20090177996A1 (en) | 2008-01-09 | 2009-07-09 | Hunt Dorian J | Method and system for rendering and delivering network content |
US20110118858A1 (en) | 2009-11-13 | 2011-05-19 | Apple Inc. | Local storage of a portion of streamed media items |
US8386621B2 (en) * | 2010-03-12 | 2013-02-26 | Netflix, Inc. | Parallel streaming |
US9596170B2 (en) * | 2013-03-14 | 2017-03-14 | Level 3 Communications, Llc | Dynamically optimizing content delivery using manifest chunking |
-
2006
- 2006-12-12 EP EP06840473.0A patent/EP1961154A4/en not_active Withdrawn
- 2006-12-12 US US12/096,933 patent/US8285809B2/en active Active
- 2006-12-12 WO PCT/CA2006/002046 patent/WO2007068119A1/en active Application Filing
-
2012
- 2012-08-17 US US13/588,084 patent/US8738740B2/en active Active
-
2014
- 2014-04-11 US US14/250,591 patent/US9203884B2/en active Active
-
2015
- 2015-10-27 US US14/924,028 patent/US9930089B2/en active Active
-
2016
- 2016-02-26 US US15/054,756 patent/US9954922B2/en active Active
- 2016-11-22 US US15/358,354 patent/US10091266B2/en active Active
-
2018
- 2018-09-28 US US16/145,265 patent/US10735488B2/en active Active
-
2020
- 2020-08-03 US US16/984,046 patent/US20200366726A1/en not_active Abandoned
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5586264A (en) * | 1994-09-08 | 1996-12-17 | Ibm Corporation | Video optimized media streamer with cache management |
US20030172346A1 (en) * | 1999-04-23 | 2003-09-11 | Gould Eric Justin | Method and computer program for expanding and contracting continuous play media seamlessly |
US6621980B1 (en) * | 1999-04-23 | 2003-09-16 | Monkeymedia, Inc. | Method and apparatus for seamless expansion of media |
WO2001058165A2 (en) | 2000-02-03 | 2001-08-09 | Fair Disclosure Financial Network, Inc. | System and method for integrated delivery of media and associated characters, such as audio and synchronized text transcription |
EP1463258A1 (en) | 2003-03-28 | 2004-09-29 | Mobile Integrated Solutions Limited | A system and method for transferring data over a wireless communications network |
US20050111824A1 (en) * | 2003-06-25 | 2005-05-26 | Microsoft Corporation | Digital video segmentation and dynamic segment labeling |
US20050091062A1 (en) * | 2003-10-24 | 2005-04-28 | Burges Christopher J.C. | Systems and methods for generating audio thumbnails |
US20050245243A1 (en) | 2004-04-28 | 2005-11-03 | Zuniga Michael A | System and method for wireless delivery of audio content over wireless high speed data networks |
US20060236219A1 (en) * | 2005-04-19 | 2006-10-19 | Microsoft Corporation | Media timeline processing infrastructure |
US20060242550A1 (en) * | 2005-04-20 | 2006-10-26 | Microsoft Corporation | Media timeline sorting |
Non-Patent Citations (1)
Title |
---|
See also references of EP1961154A4 |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8561081B1 (en) | 2007-11-13 | 2013-10-15 | Accenture Global Services Limited | System and method for dynamic brokering of digital content requests |
CN113315810A (en) * | 2021-04-29 | 2021-08-27 | 上海探寻信息技术有限公司 | Online audio playing method and equipment |
Also Published As
Publication number | Publication date |
---|---|
US20170078357A1 (en) | 2017-03-16 |
EP1961154A4 (en) | 2016-03-09 |
US10091266B2 (en) | 2018-10-02 |
US9954922B2 (en) | 2018-04-24 |
US20190044993A1 (en) | 2019-02-07 |
EP1961154A1 (en) | 2008-08-27 |
US20160182589A1 (en) | 2016-06-23 |
US10735488B2 (en) | 2020-08-04 |
US20080301318A1 (en) | 2008-12-04 |
US8285809B2 (en) | 2012-10-09 |
US9203884B2 (en) | 2015-12-01 |
US20160050250A1 (en) | 2016-02-18 |
US8738740B2 (en) | 2014-05-27 |
US20120317245A1 (en) | 2012-12-13 |
US20200366726A1 (en) | 2020-11-19 |
US9930089B2 (en) | 2018-03-27 |
US20140304374A1 (en) | 2014-10-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10735488B2 (en) | Method of downloading digital content to be rendered | |
US10237595B2 (en) | Simultaneously rendering a plurality of digital media streams in a synchronized manner by using a descriptor file | |
US10805111B2 (en) | Simultaneously rendering an image stream of static graphic images and a corresponding audio stream | |
US7650563B2 (en) | Aggregating metadata for media content from multiple devices | |
US7966551B2 (en) | Associating image files with media content | |
US7707231B2 (en) | Creating standardized playlists and maintaining coherency | |
US6622166B2 (en) | Audio/video from internet direct to compact disc through web browser | |
JP4965565B2 (en) | Playlist structure for large playlists | |
US20060230038A1 (en) | Album art on devices with rules management | |
US20090327222A1 (en) | Dynamic selection of media for playback | |
US8744993B2 (en) | Summarizing a body of media by assembling selected summaries | |
JP2011517816A (en) | Distributed media fingerprint repository | |
US20040177317A1 (en) | Closed caption navigation | |
EP1899823A2 (en) | Retrieving graphics from slow retrieval storage devices | |
JP4647949B2 (en) | Multimedia content reconstruction device, multimedia content reconstruction method, program causing computer to execute the method, and multimedia content distribution system | |
US20070091736A1 (en) | System and method for storing and managing digital content | |
US20090204502A1 (en) | Digital media advertisement system and method | |
KR100490410B1 (en) | Apparatus and method for buffering a multi-media document based on data structure |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 12096933 Country of ref document: US Ref document number: 2006840473 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWP | Wipo information: published in national office |
Ref document number: 2006840473 Country of ref document: EP |