GB2427976A - Providing audio-visual content to a mobile device where the conversion module can determine the bit rate - Google Patents

Providing audio-visual content to a mobile device where the conversion module can determine the bit rate Download PDF

Info

Publication number
GB2427976A
GB2427976A GB0617190A GB0617190A GB2427976A GB 2427976 A GB2427976 A GB 2427976A GB 0617190 A GB0617190 A GB 0617190A GB 0617190 A GB0617190 A GB 0617190A GB 2427976 A GB2427976 A GB 2427976A
Authority
GB
United Kingdom
Prior art keywords
audio
content
data
conversion module
visual content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
GB0617190A
Other versions
GB2427976B (en
GB0617190D0 (en
Inventor
Jeremy Mayo Boswell
Jonathan Mark Kendrick
Timothy John Revell
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Rok Productions Ltd
Original Assignee
Rok Productions Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Rok Productions Ltd filed Critical Rok Productions Ltd
Priority to GB0617190A priority Critical patent/GB2427976B/en
Priority claimed from GB0413231A external-priority patent/GB2410146B/en
Publication of GB0617190D0 publication Critical patent/GB0617190D0/en
Publication of GB2427976A publication Critical patent/GB2427976A/en
Application granted granted Critical
Publication of GB2427976B publication Critical patent/GB2427976B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/16Analogue secrecy systems; Analogue subscription systems
    • H04N7/173Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • H04N7/17309Transmission or handling of upstream communications
    • H04N7/17318Direct or substantially direct transmission and handling of requests
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234363Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2381Adapting the multiplex stream to a specific network, e.g. an Internet Protocol [IP] network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808Management of client data
    • H04N21/25833Management of client data involving client hardware characteristics, e.g. manufacturer, processing or storage capabilities
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/262Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
    • H04N21/26208Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints
    • H04N21/26216Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints involving the channel capacity, e.g. network bandwidth
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/414Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61Network physical structure; Signal processing
    • H04N21/6106Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6131Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via a mobile phone network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61Network physical structure; Signal processing
    • H04N21/6156Network physical structure; Signal processing specially adapted to the upstream path of the transmission network
    • H04N21/6181Network physical structure; Signal processing specially adapted to the upstream path of the transmission network involving transmission via a mobile phone network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/637Control signals issued by the client directed to the server or network components
    • H04N21/6373Control signals issued by the client directed to the server or network components for rate control, e.g. request to the server to modify its transmission rate
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64784Data processing by the network
    • H04N21/64792Controlling the complexity of the content stream, e.g. by dropping packets
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/16Analogue secrecy systems; Analogue subscription systems
    • H04N7/173Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal

Abstract

Content is provided for reproduction on a mobile device by apparatus comprising: an audio-visual content supply arrangement; a source of target device configuration information; a codec; and a conversion module. The conversion module is arranged to use the codec to convert audio-visual content provided by the audio-visual content source according to configuration information provided by the target device configuration information source, the conversion module being arranged to use a) configuration information comprising a maximum volume size for a target storage device, and b) a detected content duration parameter to determine an appropriate bit rate for one or both of audio and video components, and to control the conversion module to provide converted data having the determined bit rate for the audio and/or video components, thereby to supply mobile device consumable.

Description

Providing Audio-Visual Content Description The invention relates to apparatus for providing audio-visual content for reproduction on a mobile device, and to a method of providing audio-visual content for reproduction on a mobile device. There is a trend for mobile telephones, also known as cellular telephones, to be provided with colour displays having many thousands of pixels. As time progresses the quality of these displays and the resolutions afforded thereby increases. Furthermore, semiconductor terminology is such the mobile telephones can be provided with quite substantial amounts of memory. Whereas previously it has been known to incorporate MP3 players and the like into mobile telephones, the provision of improved displays and increased amounts of memory allows mobile telephones to be used for use as limited digital television receivers. It has been proposed as well to provide audio-visual content on a multimedia card (MMC), for viewing on a mobile telephone. The Nokia 7610 is one such capable mobile telephone. This telephone can handle 3GPP and RealMedia audio-visual formats. Providing audio-visual content for consumption on a mobile device currently is a laborious and time-consuming process. It is an aim of the present invention to provide apparatus and method for providing audio-visual content for reproduction on a mobile device which is convenient yet capable of utilising the full capabilities of a target mobile device. According to a first aspect of the present invention there is provided apparatus as claimed in claim 1. This can allow the automated error-free generation of audio-visual content for reproduction on mobile devices, such as mobile telephones, which is optimised for consumption by the particular mobile device. As described in the embodiments, optimisation may be in respect of such characteristics as frame rate, display size (in particular aspect ratio) and audio output capabilities. Optimisation may also take into account the user of the mobile device, by providing audio, and optionally subtitles, in a suitable language. This also can allow the quality of the audio and/or video components to be optimised automatically according to the content source and to the size of the destination. Preferably the apparatus is arranged to determine from the target device configuration information a required aspect ratio for displayed video, and to control the conversion module to modify the source audio-visual content so as to provide content having the required aspect ratio. The apparatus preferably further comprises a digital rights management module arranged to operate with the conversion module to provide the content with data operable to restrict content playback. It is expected that for most uses of the invention in coming years the audio-visual content supply arrangement will include a media drive operable to receive a storage medium having audio-visual content stored thereon. However, this is not essential, and the supply arrangement could instead be a reader of data from another type of data source, for example a solid state memory data source, which could be internal or external to the apparatus. Internal data sources could include hard disk drive data sources and sources involving the reception of data from a communications network, such as the Internet or a private link over a public or private network. According to a second aspect of the invention, there is provided a method for providing audio-visual content for reproduction on a mobile device as claimed in claim 6. The term 'mobile device' will be understood to embrace mobile (cellular) telephones and personal digital assistants having bidirectional voice communication capabilities, as well as other mobile devices, including dedicate media players and the like. Embodiments of the present invention will now be described by way of example only, with reference to the accompanying drawings in which: Figure 1 is a schematic diagram of audio-visual content provision apparatus embodying the invention; Figures 2 and 3 are flowcharts illustrating steps of operation of the Figure 1 apparatus; Figure 4 is a schematic drawing illustrating apparatus for playback of the converted audio-visual content in a mobile telephone; and Figure 5 is a schematic drawing of a system of interconnected computers operable according to the invention. Referring firstly to Figure 1, content extracting and converting apparatus 10 is illustrated schematically. Two alternative sources of audio-visual content 8, 9 are included. A first content source 8 utilises film or movie data stored on a DVD (digital video disk or digital versatile disk) 15. An automated extraction configuration module 16 examines metadata stored on the DVD 15 to determine the configuration of content data stored on the DVD. This involves the application of a tcprobe, and an analysis of the information returned from the DVD 15. This is described in more detail below. The result is data stored in an extraction configuration memory area 17 representing an extraction configuration. The extraction configuration data from the memory area 17 is utilised by a DVD decryption and extraction module 18 to extract movie data (i.e. the content data) from the DVD 15.The result is content data in an intermediate format, which is written to an intermediate format movie data area 14. The data included in the intermediate format movie data area 14 is in predetermined format and is suitable for conversion into a form ready for reproduction on a mobile telephone (not shown). Preferably the intermediate format is AVI. This format has the advantage of high resolution, yet is relatively easy to handle and it is relatively easy to convert from AVI into 3GPP and many other formats suitable for use by mobile devices. The second source of audio-visual content 9 receives from a movie data storage area 12 data representing a movie (or film) in AVI (audio-visual interleave) or other format. The movie so supplied is converted by a format conversion module 13 before being written to the intermediate format movie data area 14. Thus, either of the audio-visual content sources 8, 9 can be used to provide movie data in the intermediate format movie data area 14. A mobile format conversion module 19 converts movie data stored in the extracted movie data area 14 and provides a movie in mobile telephone consumable format in a mobile format movie data area 20. The mobile format conversion module 19 utilises a digital rights management (DRM) processing module 21, which allows certain control over the access and distribution of the resulting movie data. The conversion effected by the mobile format conversion module 19 uses a codec 22, which preferably is custom-designed for the purpose. Importantly, the conversion effected by the mobile format conversion module 19 uses information stored in a production configuration data area 23.By controlling the mobile format conversion module 19 on the basis of information specific to the configuration of, and thus tailored to, a target device, the apparatus 10 can be used to provide movie data for any of potentially a large number of target mobile devices. The extraction effected by the audio-visual content source 12 will now be described in detail with reference to Figure 2. In Figure 2, extraction configuration is effected at step S1. This utilises the automated extraction configuration 16 shown in Figure 1. Extraction configuration commences by analysing the DVD source 15. The result of an example analysis, i.e. what is returned in response to a query, is illustrated below: (dvd_reader.c) mpeg2 pal 16:9 only letterboxed UO 720x576 video (dvd_reader.c) ac3 en drc 48kHz 6Ch (dvd_reader.c) ac3 de drc 48kHz 6Ch (dvd_reader.c) ac3 en drc 48kHz 2Ch (dvd_reader.c) subtitle 00=<en> (dvd_reader.c) subtitle 01=<de> (dvd_reader.c) subtitle 02=<sv> (dvd_reader.c) subtitle 03=<no> (dvd_reader.c) subtitle 04=<da> (dvd_reader.c) subtitle 05=<fi> (dvd_reader.c) subtitle 06=<is> (dvd_reader.c) subtitle 07=<en> (dvd_reader.c) subtitle 08=<de> {tcprobe] summary for /media /dvdrecorder/, (*) = not default, 0 = not detected import frame size: -g 720x576 (720x576] aspect ratio: 16:9 (*) frame rate: -f 25.000 [25.000) frc=3 audio track: -a 0 [0] -e 48000,16,2 [48000,16,2] -n Ox2000 [0x2000] audio track: -a 1 [0] -e 48000,16,2 [48000,16,2J -n Ox2000 [0x2000] audio track: -a 2 [0] -e 48000,16,2 [48000,16,2] -n Ox2000 [Ox2000] [toprobe] V:185950 frames, 7438 sec @ 25.000 fps (tcprobe] A: 116.22 MB @ 128 kbps (tcprobe] CD: 650 MB V: 533.8 MB @ 602.0 kbps [tcprobe] CD: 700 MB V: 583.8 MB @ 658.4 kbps [tcprobe] CD: 1300 MB V: 1183.8 MB @ 1335.1 kbps (tcprobe) CD: 1400 MB V: 1283.8 MB @ 1447.9 kbps This information is returned by tcprobe, which is part of transcode. Part of the extraction configuration process of S1 involves determining the configuration of the target device , which is represented by the information stored in the production configuration data area 23. It is helpful therefore to understand the information that is stored there. Information data stored in the production configuration data area 23 identifies the aspect ratio of the display of the target device. In most cases, the aspect ratio 4:3, although this may vary form device to device. Certain devices will include 16:9 (widescreen) aspect ratios, although in practice the aspect ratio may take a value which is not the same as a conventional television aspect ratio. The production configuration data also identifies the audio language required. It also identifies whether or not subtitles are required. If they are required, the production information configuration identifies the language that the subtitles are required to be in. The bitrates of the video and the audio tracks are included in the production configuration data.The bitrates may depend on the capabilities of the target device, on the particular media player installed in the target device or on any other factors. The production configuration data may also indicate a maximum volume size, for example indicating the amount of usable memory in an MMC. The production configuration information also includes an indication of the format on which the movie data is to be stored. For example, this format can be 3GPP or MPEG-4 format, or any other suitable format. The information included in the production configuration data area 23 also includes the type of the target device. This may be, for example, a model number of the mobile telephone on which the movie is to be reproduced. In some circumstances, it may be possible that two different mobile telephones having the same model number can have different hardware and/or software configurations. Where different configurations are possible, and this may have a bearing on the optimum processing effected by the apparatus 10, the information stored in the production configuration data area 23 preferably also includes details of how the hardware and/or software configuration departs from the standard configuration, or perhaps instead merely specifies the configuration. The automated extraction configuration module 16 determines from the information returned by tcprobe, (in particular the first line thereof reproduced above) that the DVD 15 contains only widescreen (that is 16:9 aspect ratio) video in MPEG 2 PAL format. The module 16 also determines that there are three audio tracks, identified by the second and fourth lines respectively. The first and second tracks have 6 channels each and 48 kHz sampling rates. The first is in the English language and the second is in the German language, as identified by the "en" and "de" designations. The third audio track is in the English language and is a stereo (two channel) signal having a 48 kHz sampling rate. The module determines also that the DVD 15 has eight subtitle tracks, in various languages. The module 16 also determines the frame rate, the number of frames and the length of the movie.The module 16 uses the last four lines of the returned information to determine the content bitrate variations that can be extracted from the DVD 16. The function of the automated extraction configuration module 16 also includes obtaining decryption keys, which are needed to allow the audio-visual content on the DVD to be reproduced. The information determined by the automated extraction configuration module 16 constitutes the configuration of the DVD 15. Based on the information in the production configuration data area 23 and on the DVD configuration information, the automated extraction configuration module 16 makes a decision as to which audio tracks, which video channel (if there is more than one video channel) and which subtitle track are needed. Typically, the subtitle track identified by this process is the first listed subtitle track which is in the same language as the subtitle language identified in the production configuration data area 23. Also, the audio track identified by this process is the audio track which is in the same language as the audio language identified in the production configuration data area 23 and which is most suitable for use by the target device.In most cases, and Dolby Pro Logic audio channels will not be suitable, because most target devices will not be equipped to handle such audio signals. A stereo audio track will in most cases be the most suitable audio track, although any mono track may be most suitable for a target device with only mono audio capabilities. The video channel selected by this process typically is the main channel, i.e. the actual movie, and not any 'additional features', such as trailers and behind-the-scene documentaries and the like that are commonly included on DVDs. Data identifying the tracks and channels identified by this process is stored in the extraction configuration data area 17. In step S2, the data stored on the DVD 15 is read as a stream. This is represented by the arrow between the movie on DVD data area 15 and the DVD decryption and extraction module 18 in Figure 1. It is only the content which is read at this time, since the configuration information, or metadata, is not used by the DVD decryption and extraction module 18 directly. Also, it is only the relevant content which is read. The relevant content is identified to the DVD decryption and extraction module 18 by the information stored in the extraction configuration data area 17, which identifies the relevant video channel, the relevant audio channel and any relevant subtitle channel. At step S3, the relevant portions of the DVD data stream are decrypted by the DVD decryption and extraction module 18.This decryption uses transcode with the keys extracted by the automated extraction configuration module 16. Decryption is performed "on the fly", i.e. as a continuous process as the content is read from the DVD 15. As the data is decrypted, it is converted into the intermediate format, i.e- AVI format. At step S5, the movie data is written into the extracted movie data buffer 14 as a file or series of files in the intermediate format. At step S6, extraction post-processing is performed. This involves splitting or joining the content file or files present in the extracted movie data buffer 14 into components. Whether there is any splitting or any joining and the extent of it depends on the target device configuration information stored in the production configuration data area 23. In most cases, this step will involve splitting the extracted content cleanly to multiple volumes. Providing movie content in the form of multiple volumes is desirable in many circumstances due to the limitations of mobile telephones. It is a fairly straightforward procedure to split DVD movie content into volumes corresponding to the DVD chapters present on the original DVD 15. Following step S6, the extraction of the movie data is complete. The result is movie data stored in the extracted movie data buffer 14 which is encoded into an intermediate format (e.g. AVI format) and which includes only one audio track, which is in the required language identified by the production configuration information stored in production configuration data area 23, and optionally one subtitled track, in the required language. The extracted movie data typically is divided into a number of volumes, although this may not be necessary depending on the configuration of the target device. Instead of using a DVD data source 15, the other movie data storage area 12 may be used. In this case, format conversion to the intermediate format, for example AVI, is carried out by the format conversion module 13. If only DVD sources 15 will be used, then the second content source 9 can be omitted. If included, the format conversion module 13 takes a form which is suitable for the particular type of content provided at the other movie data storage area 12. A separate format conversion module 13 may be needed for each type of data that can be stored in the other movie data storage area 12. The procedure of Figure 3 begins with the extraction process complete. At step S1, the extraction file is read. This is an "on the fly" procedure and is represented by the arrow linking the extracted movie data buffer 14 with the mobile format conversion module 19. At step S2, the mobile format conversion module 19 decodes the content comprising the movie data. The step uses transcode. At step S3, the decoded content is encoded into the required mobile format, as identified by the production configuration information stored in the production configuration data area 23. The encoding is performed by the codec 22. The encoding is performed in such a way as to result in audio and video content having the most appropriate bitrates. What are the most appropriate bitrates is determined by the mobile format conversion module 19.In particular, the mobile format conversion module 19 uses knowledge of the number of video frames in the video data and the length of the audio track along with the maximum volume size information stored in the production configuration data area 23 to determine the most suitable bitrates. In most cases, the most suitable bitrates for the audio and video will be the bitrates which are the maximum possible bitrates which could be used to fit the entire content within the maximum volume size. Usually, the bitrates selected for the audio and the video give rise to comparable quality for those components, although there can be some discrepancy if this results in mobile format movie data which would give an improved playback experience if this is possible having regard to the maximum volume size. For example, if audio and video content at a certain quality level would give rise to data exceeding the maximum volume size but that content at a quality level immediately below that would give rise to a significant shortfall of the volume size, the mobile format conversion module 19 may make a decision to use the higher bitrate for the video content and the lower bitrate for the audio content, so as to make the best use of the available volume size. If examination of the information stored in the production configuration data area 23 reveals that the target device is not optimised for video playback at the same frame rate as that of the DVD source 15, then this is taken into account by the mobile format conversion module 19. In particular, the mobile format conversion module 19 may modify the frame rate of the content data so that it is optimised for the target mobile device. Typically, this will involve a reduction in the frame rate which, because of the limited display size in most mobile telephones, would not be so noticeable as it would if a full size display were used. If the optimal frame rate is not equal to the source frame rate divided by an integer, then the mobile format conversion module 19 may use frame interleaving to effect a smooth result in the generated movie content when played back on a mobile telephone. Step S3 thus utilises information stored in the production configuration data area 23 to control the mobile format conversion module 19 to encode the data using the codec 22 into the appropriate data format and with appropriate bitrates. The production configuration data area 23 may be updatable according to the target device which is of interest in a particular format conversion process. In this case, the production configuration data area 23 will store data for only one target device at a time, and this data is changed as required. Alternatively, the production configuration data area 23 stores a set of data for each of plural target devices, and one of the data sets is selected according to the particular target device of interest at a given time. In either case, the apparatus 10 is easily controlled to carry out a format conversion process which is optimised for each of plural target device configurations. Digital rights management content is added to step S4. This is implemented by the mobile format conversion module 19 using the DRM processing module 21. The procedure implemented by the step S4 depends on the target format identified by the information stored in the production configuration data area 23. What form of DRM content is added may depend in particular on the form of the codec 22. The form of the codec 22 in turn has an effect on the form of the codec in the media player. In particular, when the codec 22 is a custom codec, a custom form of DRM is used. Here, the form of DRM can be selected to provide optimal operation with the custom media player. If an off-the-shelf codec, such as Real Media , is used as the codec 22, a suitable DRM will be used. Assuming it is allowed by the media player and the target device, the DRM content may impose content reproduction and distribution restrictions as follows. One option is to limit viewing of the content to the particular target device or user, as for example identified by an IMEI or an IMSI number or any other unique or quasiunique serial number. In this case, the serial number needs to be included in the production configuration data area 23, so that the mobile format conversion module 19 can operate with the DRM processing module 21 and the production configuration data area 23 to include suitable DRM content in the movie data. Another option is to allow the movie to be viewable up until a particular time and/or date. Thus, the resulting movie will have a "shelf-life" and will not be viewable after the date and/or time specified by the DRM content.A third option is to allow the movie content to be viewable on a predetermined number of occasions (N times). Once the movie has been viewed N times, the media player in the target device will not allow the content to be refused again, thereby rendering it useless. Alternatively, the media player may be arranged to erase the MMC or otherwise delete or corrupt the movie data immediately after the Nth viewing. Alternatively or in addition, the DRM content can prevent the content being copied or forwarded if not authorised. Thus, it can be said that the DRM content prevents or deters the consumption of the content on mobile devices other than the one for which it was intended and/or copying of the content. Preferably, the DRM content is encrypted and included in the header of the resulting movie data, although the DRM content may be included in the movie data in any suitable way. Clearly, if a standard DRM process is required to be used by the target device, the DRM content included in the movie data by the mobile format conversion module 19 in the DRM processing module 21 will conform to the relevant standard. At step S5, the target content is written to the mobile format movie data area 20 as a file. The file may be an area of memory in a computer server, for instance, or the content file may be written directly onto an MMC or other portable transferable media. The file written by this step S5 includes content in the appropriate format, and also DRM content either embedded into the movie content or else in a separate file. After step S5, the conversion is complete, the result is stored in the mobile format movie data area 20 data constituting the movie originally on the DVD data area 15 but encoded in a format suitable for use by the target mobile device and having appropriate audio and video content bitrates.Furthermore, the movie includes suitable DRM content, multiple volumes if appropriate to the format of the target device, a single audio sound track, and optionally a single subtitle track. Where the video content on the DVD 15 has a different aspect ratio to the display of the target device, there preferably is modification of the video signal from the DVD such that it-corresponds to the aspect ratio of the target device. This can be carried out by the.DVD encryption and extraction module. 18. Preferably however, modification of the video signal from the DVD 15 such that it corresponds to the aspect ratio of the target device is carried out by the mobile format conversion module 19. The modification may involve simple cropping from the left and right sides of images if narrower images are required, or cropping from the top and bottom of images if wider images are required. The modification may involve aswell or instead a limited amount of image stretching, either widthwise or heightwise.In this case, it is preferred to have more picture linearity in the central region of the display than at the edges of the display. Thus, compression or stretching is effected to a greater degree at the edges of the images than it is a central portion. The DVD encryption and extraction module 18 or the mobile format conversion module 19, as the case may be, can be pre-programmed to make a decision as to what cropping and/or stretching is required on the basis of a lookup table relating course aspect ratios to target device aspect ratios and the corresponding modification required, or in any other suitable way. In the embodiments described above, the data written to the mobile format movie data area 20 relates only to content data. In an advantageous embodiment, the data written to the mobile format movie data area 20 also includes one or more media players. This is advantageous for a number of reasons. Firstly, it reduces the number of factors which need to be taken into account by the mobile format conversion module 19. The target device configuration information does not need to include information identifying the media player included in the mobile device, since this is not needed when the media player is included with the movie content data. Secondly, it allows movie content data to be consumed even if no suitable media player, or indeed no media player at all, is included in the mobile device. The media player or players may be embedded, or alternatively included alongside, the movie content data. Embedding the media player into the content data allows easier control of the movie content, and makes it very difficult for the movie content data to be separated by unauthorised persons. Each media player typically consumes less than 1MB of memory. In one embodiment, a single custom media player is included with the movie content data. Where the data is written onto an MMC card, the data relating to the media player is extracted by the mobile device from the MMC and the media player run to process the movie content data. In another embodiment, a number of different media players are stored, along with the movie content data and a loader program. The mobile device is controlled to run the loader program initially. The program detects the relevant configuration of the mobile device and determines therefrom which of the media players to use to consume the movie content data. In this way, it is possible to utilise an MMC card for a greater number of target device configurations, which clearly can be advantageous, especially when the MMC cards are intended for retail from a shop display or similar. If the media player is not a custom player, the loader program preferably is arranged to control the mobile device to detect whether or not it already includes a suitable media player. If a suitable media player is detected, this is controlled to be used instead of installing a media player from the MMC card onto the mobile device. This is advantageous since it reduces the possibility of there being an installation or deinstaUation error, thereby improving the reliability of the mobile device. Instead of including multiple separable media players, multiple media players may be provided through a single configurable media player software application. In this case, the loader program may determine what media player is required, and operate appropriate software modules forming part of the media player software. Software module or functions which are not appropriate for the mobile device configuration are not used. Thus, multiple media players are made up from a single software application, which reuses modules or functions for certain media player functionality. Where a single media player software application is used, the loader program may form part of the media player software application itself. The movie content data, as well as any media player(s), stored in the mobile format movie data area 20 can be communicated to the target mobile device in any suitable way.For the next few years at least, it is envisaged that mostly MMC or other transferable media will be used to store and transport the movie content. However, as mobile data transfer becomes faster and cheaper, it is expected that movie content will be transferable over-the-air, for example using WAP or 3G data transfer. Transfer may instead be effected by transfer from an Internet connected PC which has downloaded the movie content from a website, using a short range link such as a cable, or wirelessly using IrDA or Bluetooth, or using a transferable storage medium such as an MMC. A mobile device is shown schematically in Figure 4. Here, the mobile telephone 40 includes all the conventional components needed for voice communication, although these are not shown for the sake of clarity. The telephone 40 includes a movie decode module 41, which is in bidirectional communication with a codec 42. A movie is stored in a mobile movie data area 43, which may take any suitable form. It may for example be an MMC, a memory space connected by way of an external drive, internal RAM or other memory, or it may take any other suitable form. A DRM validation module 44 is connected to receive DRM data from the data in the mobile movie data area 43.The DRM validation module 44 controls the movie decoder module 41 to allow or disallow it to decode the movie data from the mobile movie data area 43 on the basis of a decision made using the DRM data, and time/date or serial number inputs as appropriate. When allowed by the DRM validation module 44 to decode movie data from the mobile movie data area 43 and when controlled to do so by user input, the movie decoder module 41 uses the codec 42 to decode the data and provide decoded data to a buffer 45. From the buffer 45, the movie is displayed on a display 46 by a display module 47. The display module provides control data to the movie decoder module 41 so as to enable decoding at a suitable rate. The mobile telephone 40 may be arranged to install a loader program from the mobile movie data area 43, if one is stored there. The loader program then causes the mobile telephone 40 to determine its configuration, and to select a media player, also stored in the mobile movie data area 43, accordingly. This media player then is used to consume the movie content data. If a suitable media player is already installed in the mobile telephone 40, then this is used instead, and no media player then is installed from the mobile movie data area 43. Although the mobile device is said to be a mobile (cellular) telephone, it may instead be a personal digital assistant (PDA), which may or may not have bidirectional voice communication capabilities. The invention is primarily concerned with providing audio-visual content on a device which is designed primarily for another function. However, the invention is concerned also with dedicated media players. Where a movie on a DVD is to be provided onto transferable media for use with a general class of target mobile devices, or even where the movie is to be provided for more than a small number of target devices on the same model number, a system such as a system shown in Figure 5 can be used to advantage. In Figure 5, first to third servers 30, 31, 32 are shown. The first server 30 is designated as a management node, and includes connections to each of the second and third servers 31, 32, which constitute child nodes. Each of the servers 30 to 32 includes at least first and second DVD drives 33. In this example, DVDs need to be inserted into and extracted from the DVD drives 33 manually, although it is possible to use robots or other automation for this task instead if required. Each of the servers 30 to 32 extracts and converts films from DVDs in the DVD drives 33 in parallel. Movies can be extracted from DVDs in a single drive sequentially, i.e. one after the other. Assuming sufficient speed for the DVD drive 33 and sufficient processing speed for the servers 30 to 32, the DVD extraction and conversion process can be completed in respect of one DVD in tens of minutes. Thus, where a serial number of a target device or similar is to be included in the resulting movie to enable the movie to be reproduced only on that target device, the conversion process needs to be effected once for each specific target device. It will be appreciated that the extraction process needs to be performed only once, since the extracted movie is stored in the extracted movie data buffer. Where a movie is to be used for a number of target devices of the same class, then the extraction and conversion processes need to be performed only once. Once the movie is stored in mobile format in the mobile format movie data area 20, it can be copied to an MMC or other removable media device as many times is required. This can be carried out in a suitable manner, for example using internal or external MMC drives. The setup for the management system installation specific architecture is in flat files, for example, in a /etc/ subdirectory. The setup for movie production is in database tables using a custom Postgres or Oracle database, although any other suitable database can be used instead, depending on the scale and performance requirements. The management system running on the child node servers 31, 32 communicate with the management system on the first server 30. The management node 30 is responsible for task allocation. One instance of the management system is required for each conversion session.

Claims (6)

Claims
1. Apparatus for providing audio-visual content for reproduction on a mobile device, the apparatus comprising: an audio-visual content supply arrangement; a source of target device configuration information; a codec; and a conversion module, wherein the conversion module is arranged to use the codec to convert audio-visual content provided by the audio-visual content source according to configuration information provided by the target device configuration information source, the conversion module being arranged to use a) configuration information comprising a maximum volume size for a target storage device, and b) a detected content duration parameter to determine an appropriate bit rate for one or both of audio and video components, and to control the conversion module to provide converted data having the determined bit rate for the audio and/or video components, thereby to supply mobile device consumable content data.
2. Apparatus according to claim 1, arranged to determine from the target device configuration information a required aspect ratio for displayed video, and to control the conversion module to modify the source audio-visual content so as to provide content having the required aspect ratio.
3. Apparatus according to any preceding claim, further comprising a digital rights management module arranged to operate with the conversion module to provide the content with data operable to restrict content playback.
4. Apparatus according to any preceding claim, wherein the audio-visual content supply arrangement includes a media drive operable to receive a storage medium having audio-visual content stored thereon.
5. Apparatus according to any preceding claim, arranged to provide with the mobile device consumable content data one or more media players suitable for use in consuming the data.
6. A method for providing audio-visual content for reproduction on a mobile device, the method comprising controlling a conversion module to use a codec to convert audio-visual content according to target device configuration information, the method comprising using a) configuration information comprising a maximum volume size for a target storage device, and b) a detected content duration parameter to determine an appropriate bit rate for one or both of audio and video components, and controlling the conversion module to provide converted data having the determined bit rate for the audio and/or video components, and providing the converted audio-visual content as mobile device consumable content data at an output.
GB0617190A 2004-06-14 2004-06-14 Providing audio-visual content Expired - Fee Related GB2427976B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
GB0617190A GB2427976B (en) 2004-06-14 2004-06-14 Providing audio-visual content

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB0413231A GB2410146B (en) 2004-06-14 2004-06-14 Providing audio-visual content
GB0617190A GB2427976B (en) 2004-06-14 2004-06-14 Providing audio-visual content

Publications (3)

Publication Number Publication Date
GB0617190D0 GB0617190D0 (en) 2006-10-11
GB2427976A true GB2427976A (en) 2007-01-10
GB2427976B GB2427976B (en) 2008-02-27

Family

ID=37137132

Family Applications (1)

Application Number Title Priority Date Filing Date
GB0617190A Expired - Fee Related GB2427976B (en) 2004-06-14 2004-06-14 Providing audio-visual content

Country Status (1)

Country Link
GB (1) GB2427976B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008153773A1 (en) * 2007-06-07 2008-12-18 Lucent Technologies Inc. Method and apparatus for providing local multimedia content at a mobile wireless base station using a satellite receiver

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2000048400A1 (en) * 1999-02-11 2000-08-17 Loudeye Technologies, Inc. Distributed production system for digitally encoding information
US20040139233A1 (en) * 2002-12-11 2004-07-15 Marcus Kellerman Media processing system supporting different media formats via server-based transcoding

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2000048400A1 (en) * 1999-02-11 2000-08-17 Loudeye Technologies, Inc. Distributed production system for digitally encoding information
US20040139233A1 (en) * 2002-12-11 2004-07-15 Marcus Kellerman Media processing system supporting different media formats via server-based transcoding

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008153773A1 (en) * 2007-06-07 2008-12-18 Lucent Technologies Inc. Method and apparatus for providing local multimedia content at a mobile wireless base station using a satellite receiver

Also Published As

Publication number Publication date
GB2427976B (en) 2008-02-27
GB0617190D0 (en) 2006-10-11

Similar Documents

Publication Publication Date Title
US9478256B1 (en) Video editing processor for video cloud server
US20090157750A1 (en) Integrated multimedia file format structure, and multimedia service system and method based on the intergrated multimedia format structure
JP5128103B2 (en) How to create alternative audio via subtitle data
US20070185892A1 (en) Method and Apparatus for Coding Information
US20110119313A1 (en) Method and apparatus for managing data
JP2004194338A (en) Method and system for producing slide show
EP2416321B1 (en) Data generating device and data generating method, and data processing device and data processing method
JP2006115457A (en) System and its method for embedding multimedia editing information into multimedia bit stream
KR101952260B1 (en) Video display terminal and method for displaying a plurality of video thumbnail simultaneously
JP2006081146A (en) System and method for embedding scene change information in video bit stream
US20050021805A1 (en) System and method for transmitting multimedia information streams, for instance for remote teaching
TW200419537A (en) Apparatus and method for processing image data in an interactive media player
JP2006014282A (en) System and method for embedding multimedia processing information into multimedia bitstream
RU2497298C2 (en) System and method to store multimedia presentations having several sources
KR20070100755A (en) Method for preparing dvd-video formatted data, method for reconstructing dvd-video data and dvd-video data structure
WO2016103968A1 (en) Information processing device, information recording medium, information processing method, and program
JP2009043400A (en) Method for playing back media data
US20050276572A1 (en) Providing audio-visual content
US10025787B2 (en) Systems and methods for selecting digital data for archival
JP2006074531A (en) Data recording reproducing device and method
US11113329B2 (en) Systems and methods for selecting digital data for archival
KR20140117889A (en) Client apparatus, server apparatus, multimedia redirection system and the method thereof
GB2421394A (en) Providing Audio-Visual Content
GB2427976A (en) Providing audio-visual content to a mobile device where the conversion module can determine the bit rate
GB2427785A (en) Providing audio-visual content on a mobile device with digital rights management

Legal Events

Date Code Title Description
732E Amendments to the register in respect of changes of name or changes affecting rights (sect. 32/1977)

Free format text: REGISTERED BETWEEN 20090226 AND 20090304

732E Amendments to the register in respect of changes of name or changes affecting rights (sect. 32/1977)

Free format text: REGISTERED BETWEEN 20090423 AND 20090429

732E Amendments to the register in respect of changes of name or changes affecting rights (sect. 32/1977)

Free format text: REGISTERED BETWEEN 20110113 AND 20110119

PCNP Patent ceased through non-payment of renewal fee

Effective date: 20120614