CN101073263A - Medium player - Google Patents

Medium player Download PDF

Info

Publication number
CN101073263A
CN101073263A CNA2005800275535A CN200580027553A CN101073263A CN 101073263 A CN101073263 A CN 101073263A CN A2005800275535 A CNA2005800275535 A CN A2005800275535A CN 200580027553 A CN200580027553 A CN 200580027553A CN 101073263 A CN101073263 A CN 101073263A
Authority
CN
China
Prior art keywords
data
content
media player
media
player
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CNA2005800275535A
Other languages
Chinese (zh)
Inventor
杰里米·梅奥·博斯韦尔
乔纳森·马克·肯德里克
蒂莫西·约翰·雷维尔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Rok Productions Ltd
Original Assignee
Rok Productions Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Rok Productions Ltd filed Critical Rok Productions Ltd
Publication of CN101073263A publication Critical patent/CN101073263A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/102Programmed access in sequence to addressed parts of tracks of operating record carriers
    • G11B27/105Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/00086Circuits for prevention of unauthorised reproduction or copying, e.g. piracy
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/00086Circuits for prevention of unauthorised reproduction or copying, e.g. piracy
    • G11B20/0021Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving encryption or decryption of contents recorded on or reproduced from a record carrier
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/034Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440218Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • H04N21/440272Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA for performing aspect ratio conversion
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4408Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving video stream encryption, e.g. re-encrypting a decrypted video stream for redistribution in a home network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/835Generation of protective data, e.g. certificates
    • H04N21/8355Generation of protective data, e.g. certificates involving usage data, e.g. number of copies or viewings allowed
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B2220/00Record carriers by type
    • G11B2220/20Disc-shaped record carriers
    • G11B2220/25Disc-shaped record carriers characterised in that the disc is based on a specific recording technology
    • G11B2220/2537Optical discs
    • G11B2220/2562DVDs [digital versatile discs]; Digital video discs; MMCDs; HDCDs

Abstract

Content is provided on a medium or is transmitted, for example streamed, with in built protection against unauthorised playback or copying. Video content data is provided in content blocks, each of which relates to a video frame and has a corresponding header. Some content clocks have a digital fingerprint interposed somewhere in the data comprising that content block. Thus, the amount of the data in the content block is increased by the addition of the digital fingerprint. Information identifying the length of the content block in the corresponding header is not altered. Some or all content blocks are obfuscated following the additional of the digital fingerprints. In a media player, de-obfuscation is performed, and digital fingerprints then removed before the resulting content blocks are decoded. Whilst listening to music streamed to a mobile terminal, a user can purchase the track currently being played. An automated extraction configuration module examines metadata stored on a DVD to determine the configuration of content data stored on it. Extraction configuration data from a memory area ( 17 ) is utilised by a DVD decryption and extraction module ( 18 ) to extract movie data from the DVD, which is written as AVI data to an intermediate format movie data area. A mobile format conversion module ( 19 ) converts movie data stored in the extracted movie data area ( 14 ) and provides a movie in mobile telephone consumable format in a mobile format movie data area ( 20 ). The data also includes two or more media players and a loader program. The mobile device is controlled to run the loader program initially. The program detects the relevant configuration of the mobile device and determines which of the media players to use to consume the movie content data.

Description

Media player
Cause such problem for content topic provides copyright to play on mobile device on portable storage media etc.: interested people can carry out bootlegging to content, in the agreement that does not obtain the copyright owner or do not have to distribute under the situation of defrayment.
The known Voice ﹠ Video data flow of coding can being delivered on mobile (stream) equipment is to decode and to play on mobile device.Sprint PCS Vision multimedia service (SprintPCS Vision Multimedia Services) provide such service.Yet, so provide content to make it easily be intercepted and captured, even use GPRS and 3G data, services to transmit by interested third parties with copyright.The people that the content that provides so also can be had a suitable technical capability records and duplicates this format of content with can being used for unauthorized.
Routinely, utilize encipherment protection to have the content of copyright.Like this, the recipient who only has correct encryption key can decryption content, subsequently to its decoding with correct broadcast.Use short relatively key can obtain more weak protection.Stronger protection need be used longer encryption key.Yet deciphering has caused the recipient and has handled burden.Using under the situation of mobile device, separate secret meeting and cause consuming a large amount of electric weight, therefore shortened battery discharge to deficiency so that other time of level of mobile device start.In order to decipher the content-data of as much, stronger encryption needs more the processing, has therefore worsened problem.The people that the encryption of content can not prevent to have proper technology ability and decruption key records the content of deciphering and becomes can be used for the form of reproducting content without permission.
Therefore, the inventor sees, need provide protection to content, and it causes less burden to the equipment that is used to decipher with play content.The inventor recognizes that also the content that needs protection is not carried out undelegated duplicating by interested people to it.
According to the present invention, a kind of media player that is used for the decode content data is provided, this media player is configured such that the positional information with excessive data identifies the extra content item in each of a plurality of content pieces of forming a content-data part, remove determined excessive data from described position, and the described content-data of after removing described excessive data, decoding.
This can be so that the broadcast of content only limits to can play through mandate the media player of this content.In addition, mandate can be at specific content item or general to content.Other useful aspect will obtain by the embodiment that describes below understanding.
Preferably, the positional information of excessive data by with the content-data source independently passage obtain.Can control like this, by this control, media player can play content, because the positional information of excessive data and content-data are separately.In addition, the ability of play content can be limited to by paying for content or obtaining the media player that the user of the permission of play content holds.
In addition, preferably, each appearance of excessive data all is a digital finger-print.Like this, excessive data can be very difficult to discern in content-data even can not discern, yet it can be verified as excessive data by the media player of the positional information with excessive data.
Valuably, media player is used for the data whether definite data that form the part of authorization code comprise corresponding described digital finger-print, and only in response to determining the described content-data of decoding certainly.Can provide further protection to content-data like this, because only when the position of fingerprint and fingerprint are known, media player is just understood play content.This also has following other benefit, can use single excessive data position pattern to different digital finger-prints.Particularly, content can be had the positional information of excessive data and the media renderer plays of fingerprint by one or more, and forbids one or morely having the positional information of excessive data but not knowing the media renderer plays of fingerprint.Authorization code can be a media code.Media code can comprise the information that makes broadcast be limited to specific mobile device in addition, as its IMEI.
If each digital finger-print comprises for all identical data sequence of each appearance of digital finger-print, the position of fingerprint can be verified that other modes comprise less data for the corresponding system that has various different fingerprints in the content by media player based on PUK or other modes.
Preferably, media player is set to be used for the data whether definite data that form the part of authorization code or described authorization code comprise the sequence number of corresponding described media player, and only in response to determining the described content-data of decoding certainly.This makes can use the distinctive authorization code of particular media player.Therefore, the authorization code that the user of purchase or acquisition permission of play content on its equipment obtains cannot be used by other media players, thus content play is limited to the single medium player.
Valuably, media player is used for obtaining described excessive data position information from described authorization code.This makes media player obtain required all of its play content or most information from single authorization code, and this provides substantial protection to content, makes simultaneously to authorize the media renderer plays content by simple relatively licensing process.
Media player can be used for using pre-programmed message to determine the content piece at described excessive data place, and uses the positional information of excessive data to determine the position of excessive data in these content pieces.Can carry out effective content protecting like this, simultaneously when being authorized to, with the simple relatively correct play content of function of media player.Realize that this required data volume can be quite little, make to authorize and on limited passage, carry out, as SMS.
Below with reference to accompanying drawing specific embodiments of the invention are described by way of example, wherein:
Fig. 1 is the schematic diagram that is used for understanding audio-video frequency content generator of the present invention;
Fig. 2 and 3 is flow charts of operating procedure of the device of key diagram 1;
Fig. 4 is explanation is used for according to the present invention playing the audio-video frequency content of conversion on mobile phone a schematic representation of apparatus;
Fig. 5 shows the combination of the mobile phone of mmc card and Fig. 4;
Fig. 6 and Fig. 7 illustrate the alternate embodiment that is used to understand MMC hardware of the present invention;
Fig. 8 is the flow chart of the safety verification between the mmc card of the mobile phone of key diagram 4 and Fig. 6 and Fig. 7;
Fig. 9 shows the content that is stored on the mmc card, and it helps understanding the present invention;
Figure 10 A, 10B, 10C and 10D show content piece, its establishment and the application in media player according to the present invention thereof on the mmc card that is stored in Fig. 9;
Figure 11 is the schematic diagram of the broadcasting server assembly operated with media player according to the present invention; And
Figure 12 is the schematic diagram of assembly of the media player of operations according to the instant invention;
Figure 13 is that terminal is passed through this system and can be obtained the schematic diagram of the system component of content according to the present invention, and comprises the assembly according to invention.
In institute's drawings attached, similar elements is reused reference number.
At first with reference to figure 1, it is the diagram of contents extraction conversion equipment 10.Comprising two optional audio-video frequency content sources 8 and 9.The cinematic data that is stored on the DVD (digital video or digital omnipotent CD) 15 is used in first content source 8.Automatically extraction configuration module 16 check DVD15 go up the metadata of storage to determine the upward configuration of the content-data of storage of DVD.This comprises uses tcprobe and analyzes the information of returning from DVD15.Hereinafter this there is more detailed description.
The result is stored in the data of extracting configuration store district 17, and configuration is extracted in its representative.The extraction configuration data that is stored in memory block 17 is used to extract cinematic data (being content-data) from DVD15 by DVD deciphering and extraction module 18.The result is written to the content-data of the intermediate form in intermediate form cinematic data zone 14.Data in the intermediate form cinematic data zone 14 are a kind of predetermined forms, and are suitable for being converted to a kind of form that can duplicate on the mobile phone (not shown).Preferably, intermediate form is AVI.This form has the advantage of high-res, and relatively easily handle and convert to 3GPP and other several be applicable to the form of mobile device.
Data are accepted from cinematic data storage area 12 in the second audio-video frequency content source 9, and it is expressed as the cinematic data of AVI (audio frequency and video alternately) or other form.So provided film by format converting module 13 format transformations after, be then written to intermediate form cinematic data zone 14.
Therefore, audio frequency and video source 8 and 9 any one all can be used for providing cinematic data for intermediate form cinematic data zone 14.
Mobile format converting module 19 conversions are stored in the cinematic data of extracting in the cinematic data zone 14, and for mobile form cinematic data zone 20 provides film, this film is the form that is applicable to that mobile phone uses.Mobile format converting module 19 is used digital copyright management (DRM) processing modules 21, and this DRM module 21 can be carried out certain control to the visit and the distribution of the cinematic data that obtains.Use codecs (CODEC) 22 by the 19 practiced conversions of mobile format converting module, preferably, this codec 22 is purposes and the design that customizes for this reason.It is important, use the information that is stored in the product configuration data zone 23 by mobile format converting module 19 practiced conversions.The specifying information (so this information also is to be exclusively used in target device) of the configuration by based target equipment is controlled mobile format converting module 19, and device 10 can be used to provide cinematic data for potential any a large amount of target mobile devices.
Describe the leaching process that is undertaken by audio frequency and video source 12 in detail below with reference to Fig. 2.
In Fig. 2, extract configuration from step S1.It uses the automatic extraction configuration 16 shown in Fig. 1.Extract and dispose the analysis that starts from DVD source 15.The result of case study, promptly for the response of inquiry, as follows:
(dvd_reader.c)mpeg2?pal?16:9?only?letterboxed?UO?720×576?video
(dvd_reader.c)ac3?en?drc?48kHz?6Ch
(dvd_reader.c)ac3?de?drc?48kHz?6Ch
(dvd_reader.c)ac3?en?drc?48kHz?2Ch
(dvd_reader.c)subtitle?00=<en>
(dvd_reader.c)subtitle?01=<de>
(dvd_reader.c)subtitle?02=<sv>
(dvd_reader.c)subtitle?03=<no>
(dvd_reader.c)subtitle?04=<da>
(dvd_reader.c)subtitle?05=<fi>
(dvd_reader.c)subtitle?06=<is>
(dvd_reader.c)subtitle?07=<en>
(dvd_reader.c)subtitle?08=<de>
[tcprobe]summary?for/media/dvdrecorder/,(*)=not?default,0=not?detectedimport?frame?size:-g720×576[720×576]
aspect?ratio:16∶9(*)
frame?rate:-f?25.000[25.000]frc=3
audio?track:-a0[0]-e?48000,16,2[48000,16,2]-n0x2000[0x2000]
audio?track:-a1[0]-e?48000,16,2[48000,16,2]-n0x2000[0x2000]
audio?track:-a2[0]-e?48000,16,2[48000,16,2]-n0x2000[0x2000]
[tcprobe]V:185950?frames,7438?sec@25.000FFfps
[tcprobe]A:116.22?MB@128?kbps
[tcprobe]CD:650MB|V:533.8?MB@602.0?kbps
[tcprobe]CD:700MB|?V:583.8?MB@658.4?kbps
[tcprobe]CD:1300MB|?V:1183.8?MB@1335.1?kbps
[tcprobe]CD:1400MB|?V:1283.8?MB@1447.9?kbps
These information are to be returned by the tcprobe as the part of code converter.Extracting section layoutprocedure among the S1 comprises the configuration of determining target device, and it is represented by the information that is stored in the product configuration data zone 23.Therefore, it is helpful understanding these information that are stored in wherein.
The canned data data are determined the aspect ratio that target device shows in the product configuration data zone 23.Aspect ratio is 4: 3 under most of situation, but this ratio may change with equipment is different.Some equipment can use the aspect ratio of 16: 9 (wide screen), though the aspect ratio of the value of aspect ratio and traditional tv may be different in actual the use.Product configuration data is also determined required audio language.It has also determined whether need captions.If desired, the information configuration of product will be determined the language of required captions.Product configuration data comprises the bit rate of audio frequency and video track.Bit rate may depend on particular media player or other any factor of installing on the capacity, target device of target device.Product configuration data can also indicate the heap(ed) capacity size, for example indicates the free memory of a mmc card.The product configuration information comprises that also cinematic data is about to the indication of formats stored.For example, storage format may be 3GPP or MPEG-4, or other any suitable form.
Information in the product configuration data zone 23 also comprises the type of target device.For example, it may be the model that is about to duplicate the target mobile phone of film.In some cases, two different mobile phones of identical model, may firmly/different in the configuration of software.In the time may having different configuration, and this situation may be related to by device 10 processing of being carried out, institute's canned data preferably also comprises firmly/particulars of the difference of software arrangements and standard configuration in the product configuration data zone 23 so, or only specifies concrete configuration.
Automatically extract the information that configuration module 16 returns by tcprobe (concrete be before first row of copy data) and determine that DVD15 only comprises the widescreen of MPEG 2 PAL forms (promptly 16: 9 aspect ratios) video.Module 16 also respectively by second and fourth line define three tracks.Article first and second, track respectively has the sample rate of 6 sound channels and 48kHz.First and second tracks are identified by it " en " and " de ", be defined as English and German respectively.Article three, track is an English, and is stereo (dual track) signal of 48kHz sample rate.This module determines that also DVD15 has 8 subtitle track of using different language.Module 16 has also been determined frame per second, totalframes and movie length.Module 16 uses the last four lines of return information to determine to extract from DVD16 the bit rate variation of content.
Automatically the function of extracting configuration module 16 also comprises the acquisition decruption key, and when the audio-video frequency content among the DVD was duplicated in permission, these keys were essential.
Constitute the configuration of DVD15 by automatic extraction configuration module 16 determined information.
Based on information in the product configuration data zone 23 and DVD configuration information, extract configuration module 16 decisions automatically and need use which track, which video channel (if having) and which subtitle track more than a video channel.Usually, by the subtitle track that this process is determined, be in the subtitle list identical first with the subtitle language of in product configuration data zone 23, determining.Same, by the track that this process is determined, be to be track with a kind of language with the track of in product configuration data zone 23, determining, it also is best suited for, and target device uses.Generally, Dolby TMPro Logic TMVoice-grade channel is inappropriate, because most of target device does not have the outfit that can handle this audio signal.The normally only audio track of stereo track, although for having only monaural target device, the monophony track is only only.Usually, the video channel of being selected by this process is the main channel, i.e. film itself, rather than any " extention " are such as trailer and documentary film behind the scenes or be generally comprised within this type of content in the DVD.The data that the track determined by this process and passage are confirmed are kept in the extraction configuration data zone 17.
In step S2, the data that are stored among the DVD15 are read in the mode of stream.In Fig. 1, this is represented by the film of DVD data area 15 and the arrow between DVD deciphering and the extraction module 18.At this constantly, that reads is only meaningful, because DVD deciphering and extraction module 18 directly do not use configuration information or metadata.The just related content of reading equally.Extract configuration data zone 17 and determine associated video passage, related audio passage and any relevant captions passage, and related content is to indicate to DVD deciphering and extraction module 18 by being stored in the information of extracting in the configuration data zone 17.In step S3, the relevant portion of DVD deciphering and 18 pairs of DVD data flow of extraction module is decrypted.The key that this deciphering is used code converter and extracted by automatic extraction configuration module 16.Deciphering is carried out immediately, the time-continuing process when promptly reading content from DVD 15.Data are converted into intermediate form in deciphering, i.e. the AVI form.In step S5, cinematic data writes and extracts cinematic data buffer 14 as the file of independent or a series of intermediate forms.
In step S6, extract reprocessing.This comprises and will appear at content file or a plurality of file division in the extraction cinematic data buffer 14 or be merged into part.Whether have any cutting apart or merging and degree thereof, depend on the target device configuration information of storage in product configuration data zone 23.In most cases, this step can comprise the extraction content fitly is divided into a plurality of volumes.In many cases, because the restriction of mobile phone, providing movie contents with the form of multireel is preferably.The multireel that the DVD movie contents is divided into corresponding to the chapters and sections among the original DVD15 is a process quite intuitively.After the step S6, the extraction of cinematic data just is through with.
The result is stored in the cinematic data of extracting in the cinematic data buffer 14, these data are encoded into intermediate form (as the AVI form), only comprise a track, its language is identical with the determined language of product configuration information in being stored in product configuration data zone 23, and comprises the subtitle track of a required language alternatively.Usually the cinematic data that extracts is divided into several volumes, though depend on the configuration of target device, this point may be unnecessary.
Except using DVD data source 15, also can use other cinematic data storage area 12.Like this, format conversion will be finished by format converting module 13 to the work of intermediate form (as AVI).As long as adopt DVD source 15, second content source 9 just can be omitted so.If comprise other cinematic data storage area 12, the type of the certain content that is fit to other cinematic data storage area 12 and provided is provided the form of format converting module 13 so.Each data type that is stored in other cinematic data storage area 12 may all need an independent format converting module 13.
Process shown in Figure 3 starts from the end of leaching process.At step S1, read extraction document.This is an instant process, connects with the arrow between extraction cinematic data buffer 14 and the mobile format converting module 19 and represents.In step S2, the content that mobile format converting module 19 will comprise cinematic data is decoded.This step is used code converter.In step S3, decoded content is encoded into required mobile form again, and this form is determined by the product configuration information that is stored in the product configuration data zone 23.Coding is finished by codec 22.Coding work will carry out in such a way, promptly make audio-video frequency content have only bit rate.The only bit rate of mobile format converting module 19 decisions.Specifically, mobile format converting module 19 uses following information to decide only bit rate, that is, and and the video frame number in the video data, track length, and be stored in heap(ed) capacity information in the product configuration data zone 23.Usually, can hold the Maximum Bit Rate that can use under the situation of whole contents at heap(ed) capacity, be exactly optimal audio frequency and video bit rate.
Usually, for the selected bit rate of audio frequency and video can provide suitable quality for audio frequency and video, though under the situation of considering heap(ed) capacity, if mobile form cinematic data is given the broadcast impression of people Geng Jia, can there be some differences in the Voice ﹠ Video bit rate.For example, the size of data of the Voice ﹠ Video content of certain credit rating surpasses the size of heap(ed) capacity, but its size of data is far smaller than capacity again when credit rating descends, at this moment mobile format converting module 19 can determine to adopt more high bit rate for video content, and be that audio content adopts than low bit rate, to make full use of the active volume size.
If find for the inspection that is stored in the information in the product configuration data zone 23, target device is unpromising to be adopted the frame per second identical with DVD source 15 when playing and optimizes, and so this situation is by mobile format converting module 19 processing.Specifically, mobile format converting module 19 may be revised the frame per second of content-data, so that it is optimized at the target mobile device.Usually, this can make frame per second reduce, because the mobile phone screen size is limited, its influence that reduces frame per second can be unobvious as full screen display.If the source frame per second is not the integral multiple of optimal frame rate, when mobile phone was play, mobile format converting module 19 may use frame alternately so that the movie contents that generates is realized smooth effect so.
Therefore, use the information be stored in the product configuration data zone 23 to control mobile format converting module 19 among the step S3, with use codec 22 with data with suitable bit rate, be encoded into the suitable data form.
Product configuration data zone 23 can be upgraded according to target device, and this is paid close attention in special format conversion process.In this case, the data of a target device are once only stored in product configuration data zone 23, and these data will be changed with the need.Perhaps, product configuration data zone 23 can also be one group of data of each device storage of a plurality of target devices, and constantly selects one group of data according to certain interested particular target device certain.Under two kinds of situations, control device 10 is to carry out the format conversion process at an easy rate, and each during this process disposes at a plurality of target devices is optimized.
In step S4, add digital rights management content.This uses DRM processing module 21 to realize by mobile format converting module 19.The step that step S4 realized depends on the determined object format of the information that is stored in the product configuration data zone 23.The form of the DRM content that adds may specifically depend on the form of codec 22.The form of codec 22 and then influence the form of codec in the media player.Particularly, when codec 22 is self-defined codec, use self-defining DRM form.Here, can select the form of DRM to come to provide optimum operation for self-defined media player.If an existing codec is as Real Media TM, be used for codec 22, just will use suitable DRM form.
If media player and target device allow, the DRM content just can apply content replication and distribution limits as follows.A selection is, content checked be limited to specific target device or user, as being determined by IMEI or IMSI number or other any unique or accurate unique sequence number.In this case, product configuration data zone 23 need comprise this sequence number so that mobile format converting module 19 can with DRM processing module 21 and product configuration data zone 23 co-operate, in cinematic data, comprise suitable DRM content.Another one is selected, and allows considerable seeing a film before certain time and/or date.Therefore, the film that is produced will have one " storage life ", and can not watch this film after DRM content designated date and/or time.The 3rd selection is to allow to watch movie contents with predetermined times (N time).In case behind viewed N time of the film, the media player in the target device will can not allow content to be used again, thereby make it invalid.Perhaps, can arrange media player after cinematic data is watched by the N time, remove mmc card or deletion or destroy cinematic data.Alternatively or additionally, the DRM content can prevent that unwarranted content is replicated or transmits.Therefore, we can say that the DRM content prevents or stops non-appointment the content on the mobile device is used and duplicating content.
Preferably, the DRM content is encrypted and be comprised in the head (header) of the cinematic data of generation, though the DRM content can any appropriate mode be included in the cinematic data.Significantly,, be included in DRM content in the cinematic data by mobile format converting module 19 in the DRM processing module 21, will follow relevant criterion if target device need use standard DRM process.
Among the step S4, also fuzzy (obfuscate) content of DRM processing module 21.If codec 22 is industrial standard codecs, this is just extremely important, because otherwise may use player to present its dedicated content content in addition.Content is fuzzy is finished its following part that constitutes DRM processing module 21 by an order line blur tool.
Content is fuzzy to be finished in frame.CPU total load when this helps restriction to carry out deblurring (de-obfuscation) operation.The concrete blur method that uses depends on format of content.For example, Real Media TMFormat content will be used different blur methods with the MP3 format content.
Have only content-data by fuzzy, content headers is not by fuzzy.Alternatively, has only the partial content Frame by fuzzy.In by fuzzy content-data frame, a part is blured fully, and a part is fuzzy by part.For example, key frame may be blured fully, and some (for example preceding 10 bytes) are blured in other all frames.Carry out computing fuzzy comprising, as displacement, some byte is done addition or subtraction according to their positions in stream, or the like.This computing is based on carries out the appropriate result who calculates to the timestamp in the content build portion.In computing each time, the position is by obtaining byte number delivery in the content frame.The concrete fuzzy technology of using is unimportant.
Select such Fuzzy Processing technology, require relatively little, minimum cpu load preferably during media renderer plays on mobile device.
First piece in the data content is expanded with fuzzy identifier.This identifier bit and is adjusted content headers so that it can reflect the content block length that comprises fuzzy identifier in the content piece on the suitable position.Fuzzy identifier helps suitable media player to determine that what blur method is DRM processing module 21 use, and allows it to carry out corresponding deblurring method like this.Add after the fuzzy identifier, may need to revise affected directory entry so that search can correct execution.
Employed blur method is difference with the content piece.For example, affected byte number can be different.Additional content also may be different, for example, use an additional content in a content, and use two additional contents in other one.Fuzzy rule can be provided with when content encoding.The blur method that is used for the certain content piece can picked at random.
In step S5, object content writes mobile form cinematic data zone 20 as file.For example, this document can be the region of memory of server, or content file can be written directly into mmc card or any portable transmission medium.The file that writes among the step S5 comprises the content of correct format, and comprises DRM content in the embedding movie contents or individual files.After step S5 finishes, convert, the result is the data of the film in the former DVD of being stored in of the formation data area 15 that is stored in the mobile form cinematic data zone 20, but this digital coding becomes to be suitable for the suitable form that the target mobile device uses, and suitable audio-video frequency content bit rate is arranged.And, multireel, an audio track that this film comprises suitable DRM content, divides for the form that is fit to target device, and optional single subtitle track.
When the video content among the DVD15 has different aspect ratios with the display device of target device, preferably the vision signal on the DVD is made amendment, so that its aspect ratio with target device is corresponding.This can be finished by DVD encryption and extraction module 18.Yet, preferably, the vision signal among the DVD15 is made amendment so that the aspect ratio of its corresponding target device can be finished by mobile format converting module 19.Modification may comprise, when the narrower image of needs, image the right and left is done simple cutting, maybe when the wideer picture of needs to image on bottom do cutting.Revise also can be included in and do limited image stretch on width or the height, or with it as an alternative.In this case, first-selectedly should allow the zone line that shows the more image of manying linearity be arranged than the fringe region that shows.Like this, compression greatly or stretching are done than mid portion in the image border.Like this, can be according to actual conditions, DVD is encrypted and extraction module 18 or mobile format converting module 19 are carried out pre-programmed, or other any suitable manner, it is its question blank according to source aspect ratio and target device aspect ratio, need which kind of cutting and/or stretching with decision, and need which kind of corresponding modification.
Among the embodiment of Miao Shuing, the data that are written to mobile form cinematic data zone 20 are only relevant with content in the above.In advantageous embodiments, the data that are written to mobile form cinematic data zone 20 also comprise one or more media players.The advantage of doing like this has following reason.The first, this has reduced need be moved the factor quantity that format converting module 19 is considered.The target device configuration information does not need to comprise the information of determining the media player in the mobile device, because media player information comprises in the movie contents data.The second, can allow the movie contents data in mobile device, not have suitable media player like this, or not have to be used under the situation of media player at all.
Media player can be embedded into, or is included in alternatively, in the movie contents data.Media player is embedded content-data be easier to movie contents is done control, and make the movie contents data be difficult to be broken by unauthorized people.A common media player need consume the memory space less than 1M.
In an example, comprise a self-defining media player in the movie contents data.After data were written to mmc card, mobile device extracted the related data of media player from mmc card, moved media player then to handle the movie contents data.
In another example, store, also have several different media players with movie contents data and loader.Mobile device is controlled in the loader that brings into operation most.This program detects the relevant configuration of mobile device, and determines to use which kind of media renderer plays movie contents data with this.Like this, a mmc card might be applied in more on the multiple target equipment disposition, especially when mmc card be that this obviously is useful under the situation about buying from the shop shelf retail.
If media player is not self-defined player, preferably arrange the loader controlling mobile equipment, whether comprised suitable media player to detect it.If detect suitable media player, it will be used, rather than from mmc card to mobile device installation medium player.This is useful, because it has reduced the installation and the unloading mistake that may exist, thereby has improved the reliability of mobile device.
Can provide multimedia player by independent configurable media-player software application program, rather than comprise a plurality of different media players.In this case, which kind of media player loader need can determine, and the suitable software module in the operation media-player software.The software module or the function that are not suitable for the mobile device configuration are not used.Like this, multimedia player is made of an independent software application, and it is some media player function reuse module or functions.When using single medium player software application program, loader oneself can become the part of media-player software application program.
Any media player that is written to mobile form cinematic data zone 20 can rendering content, so it comprises suitable deblurring function.
Be stored in movie contents data and any media player in the mobile form cinematic data zone 20, can be with any suitable method and target mobile device communication.It is contemplated that at least below several years, but most of mmc card or other transmission medium all can be used for storage and transmission movie contents.Yet along with the mobile data transmission becomes quicker and more cheap, what can expect is that movie contents can be passed through airborne spread, for example use WAP or 3G transfer of data.Transmission can also realize like this, promptly use short distance to connect as cable, or use wireless technologys such as IrDA and bluetooth, and or use the transmitted storage medium of similar mmc card, come to transmit from a PC who is connected to the internet and has downloaded movie contents from the website.
The mobile device schematic diagram is shown in Figure 4.Mobile phone 40 comprises the legacy device that all voice communications are required, and is for clarity sake not shown here.Phone 40 comprises motion picture decoder module 41, itself and codec 42 two-way communications.Store movies in the mobile film data area 43, mobile film data area 43 may be any suitable form.Memory space, built-in RAM or other internal memory that mobile film data area 43 can be mmc card, connect by external drive, any suitable form that maybe may take.DRM authentication module 44 is connected with the 43 reception data from the mobile film data area.DRM authentication module 44 goes to allow or does not allow the cinematic data in the mobile film data area 43 is decoded with control motion picture decoder module 41 according to the proper sequence of the decision of using the DRM data to be made and time/date or input number.When 44 permissions of DRM authentication module are decoded to the cinematic data in the mobile film data area 43, and import by the user and to control when doing like this, motion picture decoder module 41 uses 42 pairs of data of codec to decode, and decoded data are offered buffer 45.Film is shown module 47 and is presented on the display 46 from buffer 45.This display module provides control data to allow with suitable speed decoding to motion picture decoder module 41.
If have loader in the mobile film data area 43, can arrange mobile phone 40 therefrom to install.Loader can make mobile phone 40 determine its configuration and select media player then, and this media player is a software application, and also is stored in the mobile film data area 43.This media player is used to the movie content-data then.If suitable media player has been installed in the mobile phone 40, so just will use this media player, and installation medium player from mobile film data area 43 not.Yet, use is stored in specialized media player in the mobile film data area 43 (though using portable storage device, as it is not special-purpose under the situation of mmc card) be useful, because this allows the effective control to the safety of content-data, and can allow other nonessential function also existing or that pre-install media player.
The combination of mmc card and mobile device is shown in Figure 5.Here, mobile device 40 comprises CPU51 as shown in the figure, and it provides vision signal by the display driver (not shown) to display 46, and provides signal by the audio device drive (not shown) to audio output apparatus (being earphone jack or loud speaker).CPU51 is connected to ROM53, RAM54, MMC connector and interface 55 by bus.Mmc card 56 is connected to mobile device 40 by MMC connector and interface 55.
The non-volatile memory that mmc card is put within it has movie contents data 57, three different media players 58 and loaders 59.When needs during from the mmc card play content, mobile device is written into loader 59, its by determining mobile device 40 configuration parameter and the parameter of itself and media player compared, determine that in the media player 58 which is the most suitable.Determine to select this media player according to this then and it is loaded in the mobile device 40, and operation (promptly handling media player program) is with reproducting content from content-data 57.According to routine, the operation of media player 58 is included in deposits media player program among the RAM54 in, use CPU51 from mmc card 56, to extract related data to decode and to present the gained content.Media player 58 removes fuzzy identifier, adjusts head, uses deblurring method that content-data is correctly decoded from the first data content piece.Fig. 5 is a schematic diagram, and has omitted the incoherent details with the present invention.
Media player 58 or each media player all are arranged the attribute with the display 46 that detects main frame mobile device 40.Particularly, media player according to the wide number of picture elements of height to detect the size and the direction of display.This player is arranged to come the reproduction of control of video content on display 46 with the direction of the most suitable mobile device 40.If display 46 is wider than height, video content reappears with conventional direction so, does not promptly revise its direction.Yet if determine that display 46 is tall and big in wide, this media player just revolves video content to turn 90 degrees and reappears.Like this, no matter how media player has guaranteed screen size, video content reappears with horizontal form (being wider than height) all the time.This is more effective viewing area that utilizes display 46 just.
When video content was rotated on display 46 by media player, the function when media player 40 will cause the function of numerical key on the keyboard (not shown) or other input equipment and video content not to be rotated by media player was different.Because before can be, need mobile device 40 is rotated to a side, so no matter the direction of mobile device 40 how, provides different key functions to provide the identical experience of controlling to the user when different directions with the direction browsing video of wanting.Like this, the modification to control mode makes that using keyboard or other input equipment that media player is controlled becomes convenient and directly perceived to the user.The control of particular importance is volume up/down, broadcast, suspends, advances or retreat or the like.
When mobile device 40 is not high standard equipment, that is, it has the low relatively contents processing ability and/or the display of low-res, and media player is arranged to visit content from mmc card rather than from other content source.This allows the specialized media player that the content on the mmc card that will play is optimized, and like this, can provide than the free memory of mmc card or the abundant content more that other technical limitations allowed and play.This feature does not influence media player and uses existing standard codec 42 in the mobile device 40.In fact, media player can use standard or other third party's codec, also can use special-purpose codec.
When running on the mobile device 40 of high standard more, use different media players 58.Here, the media player of being selected by loader 59 can carry out convergent-divergent to obtain optimum efficiency to non-optimum content.
The media player 58 of an adjustable function perhaps, is provided on the mmc card 56.Such media player need not loader.When running on mobile device 40, this media player 58 detects the correlation properties of mobile device 40, and the suitable components and the function of enabling media player 58, and prevents to enable other parts and function.
Media player 58 comprises function of search.The user can use function of search redirect in the chapters and sections of content.For realizing this function, except that media file, also write locating file in the mmc card.The expansion of locating file is by name " .pm ".Each chapters and sections all has corresponding delegation in this document.Every provisional capital comprises a part name, as " film begins ", " chasing after the parking lot scape " or the like.Every row also comprises a value, and its pairing timestamp when beginning with each chapters and sections is relevant.Timestamp and part name number are separated with one " # ".When the enterprising line unit of the keyboard of mobile device 40 input indication need scan next chapters and sections, what the timestamp of current play content was used to determine corresponding next chapters and sections in the locating file is which.This comprises determines to stab the row that bigger minimum time stabs the place than the current time.The timestamp of this delegation is sent to media player 58 then.Media player 58 begins play content from this timestamp then.Because the realization of this process is very fast, need to consume less time so carry out second this key input than the user usually.Like this, just can skip chapters and sections continuously.The scanning chapters and sections also can be undertaken by the time backward.
Digital finger-print is all arranged on the diverse location of content-data.Fingerprint can have for example length of 5 bytes.Identical fingerprint is placed in the whole contents data every a spacer segment.If used fuzzy technology, each fingerprint of appearance is also by fuzzy.Fingerprint can't be discerned from content, so the position of fingerprint can not be determined by checking data.Like this, the media player that can not at first remove fingerprint when content is decoded can not obtain correct data, and broadcast will be failed.
Like this, media player 58 need know that what and position thereof fingerprint be.This can only could carry out content play after the mandate that obtains server 80.In licensing process, what and the position in content-data thereof server 80 notice media players 80 fingerprints be.If where do not know fingerprint, media player 58 can't remove fingerprint from content.And media player 58 need guarantee before the play content that current fingerprint in content is identical with expection.Fingerprint is included in first grouping of content-data, so can be verified at once.
Use digital finger-print can realize the feature that some are useful.
For example, mmc card can with one be media item (as the movie or television program) co-market of the broadcast release of media player 58.Other media item also provides in mmc card, but needs release before playing.In the menu of media player 58, other media item is shown as locking.Media player 58 can be this media item display media code when selected when one in these media items, and provides input window with the input PUK.
For the release media item to play, the user of equipment 40 sends SMS to server 80, it comprises the media code that is shown by media player 58.Media code length is 11 bytes (i.e. 11 alphanumeric symbols).The information that this media code is crossed by the Fuzzy Processing that comprises the media identification sign indicating number and the sequence number of media player 58 are formed, and the media identification sign indicating number is used to confirm corresponding media item.After receiving media code by SMS, server 80 these sign indicating numbers of checking.Checking comprises the sequence number of the media player of checking existence and the media item of existence.In case checking is finished, and after known this media item waited to pay, server 80 just obtained suitable PUK, and it is carried out Fuzzy Processing and the PUK after the Fuzzy Processing is issued equipment 40.PUK comprises the sequence number and the digital finger-print that is included in the content-data of media player 58.Payment can promptly be undertaken by SMS by WAP, its with WAP browser of equipment 40 connection to such as payment systems such as Bango or mwallet.After server 80 received payment affirmation from payment system, PUK just mail to equipment 40 from server 80.Perhaps, server 80 can send the reverse payments SMS that comprises PUK, and this PUK is charged by the user's mobile phone service provider.Perhaps, this can select " purchase " option to finish automatically by allowing the user use http to connect.
After receiving SMS, the user imports the PUK that the Fuzzy Processing that receives is crossed in the input window that media player 58 provides.58 pairs of PUKs of media player carry out deblurring and handle then, and the sequence number of checking a part that forms PUK whether with the sequence numbers match of media player 58.If do not match, then show appropriate information, because the user may import wrong PUK.If coupling, media player writes the PUK that comprises digital finger-print to mmc card, with the release media item.Then, for playing this media item, this media item of menu access that the user provides by media player 58.Media player 58 is visited PUK from mmc card then, if the fingerprint in the PUK is identical with fingerprint in the content-data, just can play this media item.
If the fingerprint in fingerprint in the PUK and the current content does not match, media player 58 will be deleted all PUKs of this media item from mmc card, and will turn back to menu.Import wrong PUK under the situation of mmc card even this makes, for example imported the PUK of wrong media item, still allowed media player 58 to operate, and the possibility of importing correct PUK.
Optionally additional features is to use the IMEI of certain equipment with mmc card and its binding.When media player 58 was installed on equipment for the first time and had not yet registered, media player 58 had been known the sequence number and the media identification sign indicating number of content, but and did not know digital finger-print.Before can being played, content needs fingerprint.Media player 58 connects to server 80 initialization http.Media player 58 is by submitting to the sequence number of media player 58 and the IMEI of equipment 40 to register to server 80 then.Server 80 is based on the information searching content designator that receives, and the information that receives of storage.Server 80 sends the information of fingerprint positions in sequence number, fingerprint and the affirmation content of the enciphered message that comprises IMEI, media player 58 then.Media player 58 is storage encryption information in mmc card.Media player 58 just can be play this content then.If mmc card is moved toward another equipment 40, this another one equipment has different IMEI certainly, and this content can not be play by media player 58.Particularly, when having selected this media item to prepare to play, media player 58 will be checked the IMEI in sequence number, media identification sign indicating number and the enciphered message in the mmc card.If the IMEI of IMEI that stores in the enciphered message and equipment 40 does not match, media player 58 is play content not.For can be on different equipment 40 play content, this content at first must be removed registration on original equipment.But the mode of this content as described above is registered on new equipment 40.Media item other on the mmc card can be bought by the way.And different media items can be registered on the distinct device effectively, as long as each media item all only is registered on the independent equipment 40.
If the content that is stored in the mmc card allows freely to be duplicated by the user, this technology can be used for following the tracks of copy.Here do not need to remove registration.Mmc card can registration on different equipment 40 continuously.And, may there be the copy of unknown number.When mmc card is encased in one during for the equipment of content registration, media player 58 contact server 80 are to register this content.After the registration, server 80 sends enciphered message so that its Playable content to equipment 40.By the monitoring registration process, server 80 can be determined to the end and produce what part copies.Server 80 can also by content registration the gateway ip address of process determine copy geographical distribution roughly.
The hardware of mmc card 56 can be standard, for example currently discloses available any mmc card form.Typical mmc card hardware designs comprises flash memory device and the storage/interface controller that is positioned on the extremely thin PCB (printed circuit board (PCB)), and it is outer to be thin plastic casing.The lower floor of PCB is the bottom of shell normally.The mmc card that several different sizes are arranged.
According to some aspect of the present invention, the hardware of mmc card is non-traditional, and it comprises other safety function.In this case, specialized media player 58 is used to the content on the mmc card of safety is carried out release and read.
First example of this new-type mmc card is described with reference to Fig. 6.Here, mmc card 56 comprises shell 60, and connection pin 61 wherein is provided.Connect the part that pin is formed into the host communication interface of external equipment (as mobile device 40).Mmc card 56 also comprises nonvolatile storage 62, and it is connected to storage and interface controller 63, and storage and interface controller 63 control are to the visit of memory 62 with to the interface of pin 61.Described like this mmc card is traditional mmc card.Mmc card 56 also comprises unconventional safety device 64.Safety device 64 be positioned over the storage and interface controller 63 be connected between the pin 61.Like this, storage and interface controller 63 be connected pin 61 in data (DAT), order (CMD) directly not to be connected, because at least some connections will be passed through safety device 64 between these parts with clock (CLK).Connect VCC, VSS1 and parallel simultaneously safety device 64 and internal memory and the interface controller 63 of being connected to of VSS2 quilt in the pin 61.Safety device 64 can be realized with microcontroller, ASIC (application-specific IC) or FPGA (Field Programmable Gate Array).The assembly of mmc card 56 is installed on the PCB (printed circuit board (PCB)), and PCB is the part of shell 60.Like this, mmc card 56 can have identical size and aerial lug with traditional mmc card.
Safety device 64 is used for data and the order that intercepting transmits between main process equipment (being mobile device 40) and storage and interface controller 63.The data of intercepting are processed, and by being to have revised or unmodified behind the safety device 64, or alternatively, it is substituted by the data that safety device 64 self produces.
Concrete data of passing through in any response or order can switch to enable mode with safety device 64, under this pattern, one of them of safety device 64 disguise as storages and interface controller 63 and host interface 61 reads or writes wherein another one.Under enable mode, safety device 64 is (promptly do not have external control ground) inquiry storage and interface controller 63 also independently, is that subsequently host request is prepared data, or is that subsequently request writes data to nonvolatile memory 62.
Provide enable mode to make and realized copy protection by the cooperation between mmc card 56 and the media player 58.
No matter be under the pattern of reading or writing, safety device 64 does not limit the visit for the nonvolatile memory 62 at not protected content place.This makes the mmc card 56 that has comprised safety device 64 to use in a usual manner, i.e. the safety function that device safe in utilization did not provide.The entity that safety device 64 can only have been authorized uses, and for example has been authorized to the content (being film) that copyright is arranged to be put into the entity of mmc card 56.
Mmc card 56 has identical sequence number with media player 58.In configuration, also provide result's (hashed value that hereinafter is called sequence number) to hash equation (hash function) application sequence number for media player 58.Storage and interface controller 63 have safety device 64 control, the sequence number of programming time when being programmed (that is, selling before) storage sequence data, with the safety code that disposes and the hashed value of sequence number.
With reference now to Fig. 8, the checking of 58 pairs of mmc cards 56 of media player and the checking of 56 pairs of media players 58 of mmc card are described.
When the mmc card 56 of content, one or more media player 58 and optional loader 59 of having packed into is connected to mobile device 40, media player will be in menu as seen, and can be activated as any other software application that exists in the mobile device 40.When media player 58 started first, first safety verification was implemented, and wherein carried out following incident.At first, only media player 58 is loaded into mobile device 58.Then, the hashed value that in step S8.1, transmits Sequence Number of media player 58 to safety device 64.Then, safety device 64 compares the hashed value of the sequence number of this hashed value and its storage inside in step S8.2.If the comparative result among step S8.3 coupling, just preliminary supposition media player 58 is complementary with mmc card 56, then safety device 64 in step S8.4 to mmc card 56 releases.Then, safety device 64 sends pre-configured identifying code to media player 58 in step S8.5.Perhaps, if comparative result does not match, safety device 64 does not respond in step S8.6.When media player 58 receives identifying code, just in step S8.7, identifying code is carried out 32 CRC (CRC) computing.Based on this operation result, media player 58 determines in step S8.8 whether mmc card 56 is relevant with media player 58, if just release media player in step S8.9 if not, just interrupts in step S8.10 and the demonstration error message.In this stage, if there is not protected area in nonvolatile storage 62, media player is reading of data therefrom just.
The second stage of safety inspection is carried out when play content.The control of medium on mmc card 56 has been unlocked and data become readable after, data are read out in the media player 58 from nonvolatile memory 62.Simultaneously, data flow is arranged to the frame of 1kB in step S8.11, i.e. beginning to finishing to have 1000 bytes from frame.Media player calculates safety code (as more detailed description hereinafter) and it is mail to safety device 64 in step S8.12, will decode to it in step S8.13.Based on decoded result, safety device 64 will determine in step S8.14 whether safety code is effective.If invalid, safety device 64 is replacement time-out count device in step S8.15 just, to avoid overtime and locked content.If effectively, storage and interface controller 63 just are considered as Frame subsequently to be verified and can visit in step S8.16.If also do not receive effective safety code before frame end, the frame of back will be filled with random data, rather than content-data.
Media player 58 recomputates once correct safety code for each frame, but for each frame produces 20 safety codes, wherein 19 is wrong.In step S8.17, media player 58 sends all safety codes to mmc card 56, in this example, is 20 safety codes of data transmission of each frame.Wherein 19 is to have a mind to make a mistake, and has only 1 to be correct.Safety device 64 in the mmc card 56 will compare the safety code that himself operation result and media player 58 send.As long as receive a correct safety code in each frame, safety device 64 just allows player to send content-data.If in one section preset time (use timer), safety device 64 detects and does not receive the effective and safe sign indicating number, the safety code of perhaps receiving is (no matter being correct or wrong) very little, and safety device 64 can be forbidden the data in the nonvolatile memory 62 are conducted interviews.Then, before content play can continue, safety device 64 needed by media player 58 release once more.If in one predetermined or configurable period, safety device 64 does not have accessed, it also will lock mmc card 56 so.
The computing of safety code is based on following data:
Last 4 bytes of the decoded identifying code of CRC-(verification and part)
The total amount of byte of byte number-from mmc card 56, read so far
Random number-one between 0 and half (every frame update 20 times, and 10 are half of 20 here) of every frame security update number of times between numeral
The computing that media player 58 is carried out is:
((CRC<<Mod32 (byte number)) XOR (byte number)) the * random number
This means identifying code verification and the part (CRC) by reading byte digital-to-analogue 32 to shifting left.The result carries out XOR with the byte number of reading.XOR comprises the bit in two numbers is applied to each XOR gate.The gained result multiply by random number R andom.
The computing that safety device 64 in the mmc card 56 is carried out is:
((CRC<<Mod32 (byte number)) the Xor byte number)) * module frame size (frame number)
In this example, module frame size (frame number) is a frame number mould 1000, because frame sign is variable, that is, 1000, for example, 5032 become 0032.
Such result is that safety device 64 in the mmc card 56 is for the continuous checking of media player 58.This has prevented such situation, promptly may use false media player to extract content-data with available form; On the contrary, can only extract data in the mmc cards 56 by correct media player 58, it is for the use rendering content but do not allow content to be used as unauthorized copy is provided.Media player 58 sends this practical work of many error codes, make need to determine what computing to become difficult or impossible to the code of mmc card 56 transmissions to determine correct code by checking from media player 58, this has just improved fail safe, because the difficulty of using false media player to extract data from mmc card has increased greatly.
Use these features, safety device 64 can be used for determining whether external device, and it comprises the mobile device 40 that moves media player 58, can extract data from nonvolatile memory 62, thereby and allow or refusal to the visit of content-data.
Optionally mmc card 70 is shown in Figure 7.Here, storage and interface controller 63 are omitted.As an alternative, compound storage is connected with safety device 71 with interface controller and has the pin of connection 61 nonvolatile memories 62.This provides storage and interface controller 63 and safety device 64 identical function together, but also has some additional functions, as hereinafter narration.The advantage of this entity is to be included in than in the littler shell of the mmc card among Fig. 6 56.Since it has hardware still less, just can produce more cheaply.And compound storage and interface controller and safety device 71 do not need to support the nonvolatile memory with mmc card controller same type, so the parts flexibility is provided.
The host interface of compound storage and interface controller and safety device 71 mock standard mmc card controllers, thus be main process equipment, as mobile device 40, provide complete connectivity.It also supports security configuration and the safety verification of other host interface order to support some concrete main frame.71 pairs of compound storage and interface controller and safety devices are written to all data of nonvolatile memory 62 and encrypt, and all data of reading nonvolatile memory 62 are decrypted.Like this, the data of mobile device 40 visit are not directly to read from nonvolatile memory 62, and on the contrary, data are decrypted in compound storage and interface controller and safety device 71, handle and buffer memory.
The partial data that main frame is visited is the result who handles, and for example safety device 64 is subsequently the information that host request compiled, or the state input, and as the safe condition data, it is used for again authenticating security or to user notification problem character by media player 58.
Compound storage and interface controller and safety device 71 can be realized with microcontrollers such as ASIC or FPGA.
Use the mmc card among Fig. 5 and Fig. 6, in the DRM file of DRM information stores in the zone of nonvolatile memory 62, this zone has been defined as the safety zone in the mmc card layoutprocedure.Media player 58 can read but can not influence the DRM file, unless the specific DRM problem of time of occurrence.Safety device 64 or 71 is used to calculate the number of times of content play.If content has only been play a part, just count once broadcast to content.The number of times that content is played is recorded in the DRM file by safety device 64 or 71.Media player 58 can read but can not influence this information.The DRM file has indicated the maximum times that content-data can be played.
The DRM data are the expiration date or the validity date of content also.When media player 58 starts for the first time, it is cooperated with safety device 64 or 71, and the current time and date of mobile device 40 onboard clock (not shown) is written in the DRM file.If request play content, safety device 64 and 71 is determined the nearest time and date expired (being the time/date that is later than the record first time on current time and date to add the term of validity) that content can be play, safety device 64 or 71 and media player 58 between safety verification failure, appropriate information will convey to the user by display 46 so.When the maximum times that can be played at content-data reaches restriction, also identical situation can take place.Safety device 64 also writes in the DRM file determines the expired data of content.
If content out of date once after, perhaps time/the date of mobile device 40 is changed to the value of content before expired, safety device 64 or 71 can go out this situation by Data Detection out of date before determining content in the DRM file so.In this case, locked and need before the DRM release in content, can also allow content to be played predetermined times, as 5 times.This realizes by online verification.The clock configuration error when if media player 58 starts first in the mobile device, this function just can be alleviated user's influence.
The online verification process connects the DRM servers from media player 58, go out as shown in Figure 5 80, this DRM server for example belongs to and is authorized to the entity that can present the content on the mmc card.DRM server 80 is known the configuration of the mmc card 56 of all distribution.Connection can be undertaken by WAP or SMS or other any suitable method.If the DRM information on the DRM server can be used, the DRM server sends codes by media player 58 to safety device 64 or 71, this make code be verified and therefore the release content to play.This comprises renewal DRM file.Locked content can be by paying with release once more to more contents visit, and the means of payment can be passed through different approaches (web, wap (as Bango) and SMS).
If the content on mmc card 56 and 71 is locked, media player 58 will can not play this content-data.In this case, the user of mobile device 40 can for the content release to obtain more broadcast, for example by other payment.Payment can be carried out with any suitable method, for example uses WAP, and it is based on the payment services of webpage, or by utilizing phone and operator to consult.When payment is finished, DRM server 80 upgrades these information.When the user starts media player 58 subsequently and attempts to visit locked content, media player 58 is got in touch DRM server 80 in any suitable manner, server 80 sends PUK to mobile device 40, and media player 58 passes to safety device 64 or 71 with this PUK.Safety device 64 or 71 is verified these PUKs then, and upgrades the DRM file with the release content.This may comprise the use digital finger-print, and is as indicated above.
If used mmc card 60 among similar Fig. 6 and Fig. 7 and 70 mmc card 56, can realize some enhanced protection by appropriate MMC hardware designs.Walking around this type of protection will need media player 58 is carried out reverse engineering.
In general, read and write from other particular sector on the mmc card 56 up to specific data, some sector of mmc card 56 just can comprise correct data (not being correct " next sector " data therefore).The system file of some media players 58 and partial content will be positioned at these sectors.The realization of this copy protection comprises the support of using self-defining mmc card hardware, MMC the build tool function (special formatization etc.) and media player 58 (it must read and write correct safe sector).
Media player 58 is when it starts and start the back and do not use the sector to write particular data to some of mmc card 56 at interval with regular time.It is because do not comprise these sectors in the file system format of mmc card 56 (specified by the boot section) that these sectors are not used.Write these sectors of data and handle the present many file sectors of its effective aspect by mmc card 56.The result is the correct data in this sector.
Particularly, the data that the specific area of data on the mmc card 56 comprises are to carry out calculated result to being written on the mmc card 56 other regional data.For example, this can be to carry out 10 times to other littler piece to write the compound hash equation that is carried out.For example, from 15360 to 15871 byte is carried out computing by hash code on the mmc card 56, and this hash code is to generate through the data that write that correctly write continuous more than 10 times from byte 15360 to 15871.This computing is left the content that obtains in byte 12800 to 13311 places.This piece is a sector of media player 58 file that is about to read.Important, this sector will be quoted in the next sector in the file.Media player 58 is arranged like this, if do not comprise correct data when promptly this sector is by media player 58 visit, media player will cut out (even may collapse) so.
Some writes and will generate rubbish contents in readable region, and some writes and then generates the real content that media player 58 is about to use.Because media player 58 writes many times, wherein great majority all are spurious information, expend time in so process decoded, and have prevented from well to duplicate.Therefore, this can obstruct the reverse engineering technology significantly.
An example is as follows.Three sectors on the equipment, wherein each has 512 bytes, is the target sector that is labeled as the part of file on the mmc card.These target sector comprise the result that data in the sector, source are carried out computing.Used sector, 9 sources, each has 512 bytes.
Therefore, to handle sector, three sources for each target sector.An example of computing is as follows: first target sector comprises: first target sector comprises all following bytes: sector, XOR source 3, sector 1, source (no symbolic operation) (first byte is to a last byte)+sector, source 2 (first byte is to a last byte) (last byte is to first byte).
Sector, source 1 is positioned at piece 12034, and sector, source 2 is at piece 12044, and sector, source 3 is at piece 12054, and sector, source 4 is at piece 12035, and sector, source 5 is at piece 12045, and sector, source 6 is at piece 12055, and sector, source 7 is at piece 12036, and sector, source 8 is at piece 12046, and sector, source 9 is at piece 12056.
Target sector 1 is related with sector, source 1,2 and 3, and is positioned at sector 8000.Target sector 2 is related with sector, source 4,5 and 6, and is positioned at sector 8001.Target sector 3 is related with sector, source 7,8 and 9, and is positioned at sector 8002.
For media player 58 used resource files are distributed on target sector 1,2 and 3, distribution of content is in target sector 5,6,7,8 and 9.Only read these files and in the sector, source, do not write correct information and will cause file corruption.
Though we say that mobile device 40 is mobile phones, it also can substitute with PDA(Personal Digital Assistant), and it may possess or not possess the two way voice communication ability.The present invention is chiefly directed to be designed primarily on the equipment that is used for other function provides audio-video frequency content.But, the present invention also relates to special-purpose media player.
Same, though some aspect of the present invention is described at MMC56, this is optional.Except MMC, can also use the medium of other type that comprises nonvolatile memory and internal memory controller, wherein, the visit that is stored in the data on the memory is realized by interface.For example, can use and have USB or bluetooth TMThe perhaps memory devices of other interface.The shell of memory devices can be any suitable shape.
Below with reference to Fig. 9,10A, 10B, 10C and 10D to using digital finger-print and bluring and protect the replacement scheme that is stored in the content on the MMC to be described.
Fig. 9 shows the sequence 1200 that is stored in the packet on the MMC.At first be first to Z head in the sequence 1200, wherein show first head 1201, second head 1202 and Z head 1203.What closely follow Z head 1203 is first content piece 1204, and it is first content piece in Z the content piece in proper order.There is shown first content piece 1204, second content piece 1205, an X content piece 1206, a Y content piece 1207, a Z content piece 1208.Each head and each content piece have man-to-man relation, and order is identical, that is to say that S head is relevant with S content piece.
After Z the content piece 1208 is the index zone, comprising first to J index head and first to J directory entry.Be that first directory entry, 1210, the first directory entries 1210 are the second index heads 1211 afterwards after the first index head 1209, or the like.Therefore, the index head is afterwards followed by associated directory entry.Last data is J directory entries 1212.Usually, J is the number much smaller than Z.
Among the content piece 1204-1208 each is relevant with audio frequency or video content.Each content piece comprises timestamp, and media player can be related with corresponding video content with audio content like this.The head of content piece 1204-1208 comprises the information of determining that the content piece is relevant with which stream.In most cases, have only an audio stream and a video flowing, although situation may be different.
In this example, the content piece is generated by instrument RealProducer, so the data among head 1201-1203 and the content piece 1204-1208 are Real forms.Content can be decoded by the Real codec.Real is the registered trade mark of RealNetworks company.When using the Real form, each the content piece among the content piece 1204-1208 relevant with video flowing all comprises the data relevant with the whole video frame.Like this, each content piece all comprises all information relevant with frame, and only relevant with a frame.Key frame can periodically provide, and each the non-key frame in continuous key frame details is all with different with frame afterwards before.In RealProducer, between the continuous key frame is the parameter that can dispose at interval.The size of content piece is variable.When two continuous frames had many difference, the content piece of second frame comprised a large amount of related datas.When difference was very little, second frame comprised less data usually.When continuous frame did not have difference, second content piece may only comprise the data of several bytes.Each head among the content headers 1201-1203 all comprises determines whether related content piece 1204-1208 comprises the information of the data of key frame.
Machine still is the position that operating personnel can not determine the content block boundary by the data among the scope of examination piece 1204-1208.Yet each content headers among the content headers 1201-1203 all comprises the data of the byte length that indicates related content piece 1204-1208.Like this, can add length and other byte of previous content piece, to determine the start address of content piece 1204-1208 by start address place at previous content piece.The length of adding this piece at previous start address place, the address that can draw the last byte of this piece so just can be by adding the start address that other byte finds next content piece to this address.
Like this, if having any position or byte to be added or to remove among the content piece 1204-1208, below the actual start address of all the elements piece all will not match with the address that head 1201-1203 is calculated.Like this, the data of sending into the Real decoder can not be correctly decoded, and media player may quit work, and need close and reopen and could operate once more.
The present invention utilizes this point valuably.Particularly, each the content piece that can be some the content piece among the content piece 1204-1208 provides one or more extra data items.Extra data items is preferably digital finger-print.Go out as shown, for second, X and Y content piece 1205,1206,1207 provide digital finger-print.
Allow the media player of play content know where extra data items obviously is important.Otherwise the data that are sent to the decoder in the media player may be incorrect forms, and therefore can not be correctly decoded, and may cause the media player collapse.
There are the many kinds of modes can be with the position informing media player of the excessive data project in the content-data.The inventor has been found that special good solution, is to use predefined scheme, data recording was just being determined extra data item destination locations before MMC, and according to the particulars of this scheme media player is being programmed.
In certain embodiments, extra data items is included in second data block 1202, and after at regular intervals (with regard to broadcast or presentative time) occur.For example, extra data items can comprise in first content piece of the timestamp with the interval integral multiple of closelying follow predetermined extra data items that for example 20 seconds excessive data project at interval.According to this technology, extra data items is included in presentative time and is in first content piece after 20 seconds, is included in presentative time and is in first content piece after 40 seconds, is included in presentative time to be in first content piece after 60 seconds, or the like.
The position of extra data in content piece 1205-1207 also is very important.In certain embodiments, extra data items is included in the same position in each content piece among the content piece 1205-1207 of its appearance.For example, extra data may be included among the content piece 1205-1207 position from byte 56 beginnings.In the content piece byte 57 beginning up to digital finger-print finish the position be retained.If the content piece comprises 56 or content piece still less, so extra data items just is included in the ending of this content piece, after all the elements data.Like this, if the content piece comprises 20 bytes, so extra data are since the 21st byte.
There are the many kinds of modes can be with the position informing media player of the excessive data project in the content-data.The inventor has been found that special good solution is to use predetermined scheme, just determines extra data item destination locations before streamed data, and according to the particulars of this scheme media player is programmed.
For example, media player is programmed the 20 kinds of diverse ways that have of processing.Every kind of method is discerned by different digital fingerprinting method identifiers.This can form the part of media code, and is included in position suitable in the content, and is similar with fuzzy identifier, perhaps discerns to media player in any suitable manner.First method relates to that the 56th byte of first content piece comprises digital finger-print behind 20 seconds integral multiple, and this as mentioned above.Second method relates in the 32nd byte followed by first content piece of 30 seconds integral multiple and comprises digital finger-print.The 32nd byte that the third method relates to the content piece behind six content pieces behind 30 seconds the integral multiple comprises digital finger-print.The 32nd byte that cubic method relates to each the content piece behind 60 seconds integral multiple comprises digital finger-print, and the 11st byte of each the content piece behind 30 seconds integral multiple comprises digital finger-print, unless the 32nd byte at this content piece comprised digital finger-print, that is to say, when digital finger-print occurred continuously, its position replaced between the 11st byte and the 32nd byte.In another method, comprise that the content piece of fingerprint changes.For example, digital finger-print can be with respect to the content piece immediately following 40 seconds integral multiple, is positioned at 3 content pieces behind 40 seconds the integral multiple, is positioned at 7 content pieces and 2 content pieces behind 40 seconds the integral multiple with repeating sequences.The change in location of digital finger-print is many more, and the protection that is provided is big more.
The length of excessive data project is unimportant, although for fear of the size of data that increases gained too much, preferably the excessive data project should be not long.
Because before decoding, will remove the excessive data project, so the form of excessive data project (being content) is unimportant.Yet the form that the inventor tends to the excessive data project is a digital finger-print.Preferably, at every turn occurring of digital finger-print is identical,, identical data sequence arranged that is.For example, the length of digital finger-print can be 5 bytes.Even if the third party has determined to constitute the data of digital finger-print, the serial data of identical data can appear at a lot of positions in the content-data, and therefore, only this information itself is not sufficient to make that digital finger-print can be removed.
A content piece has been shown, for example X content piece 1206 among Figure 10 A.Content piece 1206 comprises the data of m byte.In Figure 10 B, show the content piece 1206 that has increased digital finger-print 1301, label is 1304.Digital finger-print 1301 is divided into two parts 1302,1303 with m data byte.First 1302 comprises data byte 0 to n, and second portion 1303 comprises that data byte n+1 is to m.The length that comprises the content piece of digital finger-print equals the m+k byte, and wherein k is the size of digital finger-print.Example above using, n is 56, k is 5.
For to preventing undelegated broadcast and/or duplicating the protection that provides extra, before the content piece is stored on the MMC, all or part of content piece is blured.Comprise at the content piece under the situation of excessive data project that as digital fingerprint 1301, the data of this excessive data project and formation original contents piece are together by fuzzy.Simply, fuzzy comprise the change data, the fuzzy data of gained is different with initial data like this, can not be correctly decoded under the situation of deblurring not having.Usually fuzzyly do not change data volume, thus the size of content piece before fuzzy with the same afterwards.Earlier in respect of figures 3 has been discussed fuzzy.Figure 10 C shows the content piece 1304 that comprises digital finger-print 1301 1305.Fuzzy content piece 1305 comprises k+m byte, and this is the same with content piece 1304 behind the increase digital finger-print.
Shown in Figure 10 D, the fuzzy identifier 1306 of first content piece 1204 usefulness prolongs.Fuzzy identifier 1306 is arranged in the appropriate location of first content piece 1204, and corresponding content headers 1201 is adjusted the length that comprises the content piece of fuzzy identifier 1306 with reaction.Fuzzy identifier 1306 sign DRM processing modules 21 use any blur method to come fuzzy data.This makes suitable media player can carry out corresponding deblurring method.After increasing fuzzy identifier 1306, may need to proofread and correct the directory entry that is influenced, make retrieval correctly to carry out.First content piece 1204 is not by fuzzy, because otherwise fuzzy identifier 1306 will be by fuzzy.
If full content is only used a kind of blur method, media player 58 knows which type of has used blur so, therefore can omit fuzzy identifier 1306 from first content piece 1204.
Because comprising the content piece 1203-1208 of digital finger-print comprises than by its corresponding indicated more data of head 1201-1203, so directory entry the 1210, the 1212nd is incorrect.Particularly, should point to the address of the beginning of key frame by the data of a part that forms directory entry 1210,1212 physical address pointed.Yet,, comprise that the initial actual address of the content piece of key frame data will be than by the indicated address height of the index item 1210,1212 of correspondence if comprise digital finger-print in the one or more content pieces before key frame.Therefore, the data in the index item 1210,1212 are made amendment to reflect the actual initial address of the content piece that data should be corresponding.Therefore, when media player 58 uses the data of index item 1210,1212 to visit content, the decoded and correct broadcast of content.
At fuzzy part or all of content piece 1205-1208, suitable fuzzy identifier 1306 be provided in first content piece 1204, revise the data in the directory entry 1210,1212 after, the storage of gained is on mmc card 56.
When mmc card 56 was inserted in the mobile device 40, mobile device 40 was written into media player 58.When the user plays by the menu chosen content item of media player 58, media player 58 beginning read head and the content piece relevant with content.DRM authentication module 44 in the media player 58 know fuzzy identifier 1306 in first content piece 1204 the position and extract it.Then, the DRM authentication module 44 of media player 58 uses fuzzy identifier 1306 to determine what blur method deblurring content-data 57 needs.DRM authentication module 44 also determines whether to exist the required media code of play content blocks of data 57.In licensing process, server 80 provides media code to media player 58.Media code is discriminating digit fingerprint 1301 also, and make media player 58 determine digital finger-prints in content piece 1205-1208 which and where.This can carry out by rights.For example, media code can comprise the digital finger-print position code, and its identification is used to remove the preordering method of the appearance of digital finger-print.Then, media player 58 is ready to play content.Yet preferably, when only the digital finger-print in being included in the content piece was identical with digital finger-print in being included in media code, media player 58 is play content.This is authorized to use media player 58 play content that further inspection is provided to the user.Digital finger-print is included in second content piece 1205, therefore, after play content begins, can directly verify.
If where do not know fingerprint, just can not it be removed from content by media player 58.Simultaneously, before media player 58 play content, it guarantees the same of the digital finger-print that occurs in content and expection.
When play content, the content piece that 44 pairs of quilts of DRM authentication module are fuzzy carries out deblurring.For example, for the content piece 1305 among Figure 10 C, DRM authentication module 44 is carried out the fuzzy inverse process that carries out in DRM processing module 21, obtains to add the content piece 1304 of fingerprint thus.When play content, DRM authentication module 44 also from the content piece that comprises fingerprint with its removal.
For example, for the content piece 1304 among Figure 10 B, DRM authentication module 44 is removed digital finger-print 1301, obtains the content piece 1206 shown in Figure 10 A thus.Only behind deblurring and removal digital finger-print, the content piece just is transfused to the codec 42 of media player 58.Do not accomplish that any step data that all can lead to errors in this two step are imported into codec 42, this may cause media player 58 collapses.Under the best situation, content can not be play with available form.
If the media player of non-media player 58 is attempted play content, this trial will be failed.In order to construct the medium extractor that can extract available content, the medium extractor need be known definitely will use any blur method, and knows definite position and the size thereof of excessive data project in the content piece.Therefore, this technology provides strict protection for preventing that content from being used by unauthorized.Even if use simple relatively blur method and comprise less relatively digital finger-print, technologically speaking, the protection that is provided makes from the DVD extraction content of encrypting still more directly perceived than obtaining content from mmc card 56.Because which kind of deblurring method what media player 58 was known use is, and knows and to remove at which position digital finger-print, so media player 58 play content correctly from.Yet media player is not the medium extractor, so can not be used for extracting content to do the usefulness of unauthorized with unprotected form.
Use digital finger-print and fuzzy content of being transmitted and the content that is stored on the carrier can usefully protected.Below with reference to Figure 12 and 13 radio and television and radio system are described.Referring to Figure 11, broadcasting server 100 comprises input 101, its receiving channels input and the I/O of arriving internet 102.Portable terminal 103 as portable terminal 40 is connected to internet 102 by mobile network's (not shown), therefore can communicate by letter with broadcasting server 100.In brief, in case the user of portable terminal 103 subscribes to broadcasting area, they just can send data flow to them, and they use the portable terminal 103 can tuned television channel or listen to broadcast receiver by data flow.
Broadcasting server 100 comprises WAP Registering modules 104, and the WAP that the user by this module portable terminal 103 can pass through to internet 102 is connected broadcasting server 100 and registers.Portable terminal 103 can identify by for example its IMEI.Registering modules and registration database 105 carry out two-way communication, and registration database 105 is safeguarded registered user's details, and allow the keeper to monitor the registered user, and when needed they are removed registration.After the registration, the user can use the WAP between accounting module 106 and the internet 102 to connect subscription service.Accounting module 106 and billing database 107 carry out two-way communication, billing database 107 monitoring subscription information, and allow the keeper to check each subscription and provide to subscribe to statistics.Subscription database 107 and registration database 105 carry out two-way communication each other, so log-on message can pass to accounting module 106, subscribe to and charge information can pass to registration database 105 and Registering modules 104.
The channel configuration parameter between broadcasting server 100 and a plurality of portable terminal is safeguarded in band allocation data storehouse 108, only show among the figure one of them 103.Channel configuration is transmitted road channel configurator 109 from configuration database, and channel configurator 109 has to the internet 102 http connect.Band allocation data storehouse 108 comprises the data that are provided with of channel.Band allocation data storehouse 108 uses the management tool based on webpage to upgrade, and to increase, to revise and the deletion channel, to meet the stream of arrival, this is set by manual configuration procedures.
The data that comprise in the band allocation data storehouse 108 comprise the complete URL of each channel.
Channel configurator 109 reads band allocation data storehouse 108, and preparing the specific user can be with the XML tabulation of all channels of (being that they subscribe to), and this XML tabulation is sent to media player 58 on the portable terminal.Menu option on the media player " refreshes channel " and can be used to start this process.Then, the media player channel list new for the user creates.
The data that the channel input receives are handled by a series of assemblies that comprise stream transformer 110, stream damper 111, content encoder 112, DRM encoder 113 and content server 114.In this example, the content sent of stream is Real TMForm, therefore, content encoder 112 is RealProducer TM, and content server 114 is RealServer TMAlthough can use any other suitable form as an alternative.At input 101 places, input has a stream transformer 110 and stream damper 111 to the channel of each arrival.The channel configuration information that stream transformer 110, content encoder 112 and DRM encoder 113 receive from the band allocation data storehouse.DRM encoder 113 also receives the subscription information from billing database 107.
Content server 114 provides stream to send channel to internet 102, and portable terminal 103 can access stream be sent channel by the stream request is provided to content server 114 via internet 102.
Use broadcasting server 100, the user of portable terminal 103 can register and subscription service.When subscribing to, the user of portable terminal 104 can select channel from content server 114 by internet 102 (for example using GPRS), and content server 114 send channel to portable terminal stream then.Use the bit rate of 30kbps can obtain reasonable single audio frequency video.If broadcasting server 100 is set in channel input 101 and receives radio and television, therefore, can on portable terminal 103, provide radio and television, and can change channel by the suitable instrument of user interface for the user.This is by realizing GPRS as carrier, and has eliminated portable terminal and must possess the needs that receive hardware as the radio and television of DVB-T or DVB-H receiver.Similarly, use the bit rate of 30kbps can obtain the very extraordinary stereo video of quality.30kbps is to use the maximum available bandwidth of GPRS.3G can provide the available bandwidth of 50-50kbps.Can use different bit rates for each content source multichannel to be set, bit rate is used for GPRS, another is used for 3G.Also can be arranged to difference is subscribed to the rate difference.
This also allows the user to pass through broadcasting server 100 and receive the broadcast receiver service on portable terminal 103, and does not need portable terminal 103 to have FM or other broadcast receivers reception hardware.The Maximum Bit Rate of considering GRRS is possible of 128kbps and undesirable channel condition, and bit rate is chosen as the compromise that is provided between service reliability and content play quality.It is evident that for the specific bit rate, better coding provides the better content quality, although selected coding techniques should not cause unnecessary coding burden to portable terminal 103, because of this may increase the frequency of battery charge.
DRM encoder 113 increases digital rights management information in the content that is provided by content encoder 112, make that having only effective subscriber can be correctly decoded from content server 114 streams send and next content.Particularly, DRM encoder 113 increases digital finger-print with the interval of approximate regulation to content stream.Have only effective subscriber could remove digital finger-print.Can not remove digital finger-print will cause can not be correct decode content stream.Therefore, comprise that digital finger-print prevents that the user outside effective subscriber from watching broadcast TV channel or broadcast listening radio channels.In addition, can use different digital finger-prints to different content stream, the restriction that is applied to some channel thus may not be applied to other channels.
The details that comprises and be installed in the w media player 120 on the portable terminal 103 is illustrated by Figure 12.Please referring to Figure 12, media player 120 is included in the connection of internet, this connect by and the GPRS of the mobile telephone network (not shown) of Mobile Network Operator be connected, the user of portable terminal 103 uses this GPRS to have subscription or other contracts.Media player 120 also comprises communication interface 121, and the stream that communication interface 121 will receive is input to DRM decoder 122.Self-defining codec 123 and Real TMPerhaps MP4 codec 124 all provides input by DRM decoder 122.Use in the codec 123 and 124 which to depend on the coding that broadcasting server uses this channel at given time.Real TMCan processing audio flow (being used for radio channels) and video flowing (being used for television channel) with the MP4 codec.In the codec 123,124 each all has the output that is connected to display engine and user interface 125.Channel update module 126 is connected to broadcasting server 100 by internet 102, and obtains the information about available channel therefrom.This channel information is stored in the channel storage 127.In response to the channel selecting signal from display engine and user interface 125, channel storage 127 provides the channel standardize information to display engine and user interface 125.This channel standardize information is delivered to communication interface 121 from display engine and user interface 125, and communication interface 121 uses the channel standardize information to guarantee that it receives correct content stream at any given time.
Charging authentication module 128 can be connected to the WAP Registering modules 104 of accounting module 106 and broadcasting server 100 by internet 102.These modules are cooperated and are registered and make the one or more services of portable terminal 103 subscription.The IMEI (being provided by the IMEI storage 129 that forms a portable terminal part) of portable terminal 103 is provided the charging authentication module, with the sign portable terminal.In case set up a subscription, send access code to charging authentication module 128 from accounting module 106.This access code is stored in charging/DRM configuration store 130 then.Access code comprises digital finger-print, and the position of identification fingerprint in content stream.Access code can be relevant with a plurality of channels.DRM decoder 122 is used for accepting DRM information from charging/DRM storage 130.DRM decoder 122 can use this information to remove digital finger-print from content stream, and this makes content stream to be correctly decoded by self-defined codec 123 or Real/MP4 codec.
Communication interface 121 also is used for receiving information from charging/DRM configuration store 130.This makes media player 120 and to subscribe in the registration of broadcasting server 100 places.Media player 120 comprises and is used to register TV and/or broadcast receiver services menu option that by selecting this menu item, media player begins the WAP session and is connected to the Registering modules 104 of broadcasting server.Subscription and charging are also undertaken by WAP.In case finish registration and any subscription and/or charging, the WAP conversation end, media player 120 returns, to allow to select other functions.Charging is that carry out on the basis with each time quantum of each channel, and based on the basis of subscribing to.Subscription has duration or Close Date, and can be relevant with signal channel or channel grouping.
Referring to Figure 13, the broadcasting server, internet 102 and the portable terminal that are used to the user that the system 140 of content is provided to comprise Figure 12 and 13.System also comprises paying server 141, and it is connected to internet 102.In this example, paying server 141 is placed on broadcasting server 100.Paying server 141 can by with the operation broadcasting server 100 the different physical operation of entity.For example, paying server 141 can be operated by mobile-phone carrier.Content server 142 also is connected to internet 102, and it can be by operator or different operator's operation of broadcasting server 100.Content server 142 and paying server 141 can be by the operations of same operator.The GPRS network that portable terminal 103 is connected to internet 102 143 illustrating in the drawings.
Be described in detail in now and use digital finger-print and fuzzy in the system of Figure 12 and 13.When by GPRS or other carrier streaming contents, the data content piece is sent to corresponding head on different channels.Can adopt any suitable channel for this purpose.
As described with reference to figure 9, head has identical content with the content piece, although head and content piece shown in not resembling be order.Each head and content piece have man-to-man relation, and sequence is identical.Index head or head clauses and subclauses do not appear.Because transmission can be continuous process,, there are not first head or content piece so there be not the physical start address relevant with the content piece yet.
Each of content piece 1204-1208 is relevant with audio frequency or video content.Formation of video content piece and audio content piece be homogeneous turbulence not.Each content piece comprises that presentative time stabs, so media player can be relevant with corresponding video content with audio content.The head of content piece 1204-1208 comprises the information that this content piece of identification is relevant with which stream.In most cases, have only an audio stream and a video flowing, although this may be according to circumstances and different.
In this example, the content piece is produced by the RealProducer instrument, so head 1201-1203 and content piece 1204-1208 and Real format compatible.Content can be decoded by the Real codec.Real is the trade mark of RealNetworks company.Use Real, each content piece 1204-1208 relevant with video flowing comprises the data relevant with the whole video frame.Therefore, each content piece comprises all information relevant with frame, and only relevant with a frame.Key frame periodically is provided, and the non-key frame of each between the continuous key frame provides the detailed difference of previous frame and this interframe.Between continuous key frame is the parameter that can set in RealProducer at interval.The size of content piece is variable.When having a lot of the difference between two successive frames, the content piece that is used for second frame comprises relative lot of data.Difference hour, the second content frame generally includes less data.When as broad as long, the second content frame can include only the data of several bits between successive frame.Each head 1201-1203 comprises whether identification corresponding content piece 1204-1208 comprises the information of key frame data.
Be defined into the initial skew of content piece at the medium head, this head is at first sent.Content build portion has constant length, the variable-length of its definition content blocks of data.The content piece is critical.Because media player is known first skew from main head, know the skew of back piece then, so media player can determine to flow in content piece initial.The end of content stops or is identified when the identifier in index zone is read as next content build portion initial at stream.
Machine or human operators can not by the data of scope of examination piece 1204-1208 determine between the content piece the border wherein.Yet each content build 1201-1203 of portion comprises the data with the length of the corresponding content piece 1204-1208 of byte indication.Therefore, the length of initial address that the initial address of content piece 1204-1208 can be by the last content piece that adds up and last content piece adds a byte again and obtains.The initial address of piece adds that last length obtains the final address of this piece, and therefore, the initial address of next content piece is by obtaining in this cyclic address change extra byte.
Therefore, if increase on any one in content piece 1204-1208 or deduct any bit or byte, the actual initial address of all content pieces subsequently will not match with the address that 1201-1203 from the head calculates gained.In this case, the data that are input to the Real decoder can not be correctly decoded, and media player may quit work, and need close and restart then so that it can be worked.
The present invention utilizes this point valuably.Particularly, provide one or more extra data items to some the content piece among the content piece 1204-1208.Preferably, this extra data items is a digital finger-print.In this example, second, X and Y content piece 1205,1206,1207 have digital finger-print.
Allow the media player of play content know where extra data items obviously is important.Otherwise the data that are sent to the decoder in the media player may be incorrect forms, and therefore can not be correctly decoded, and may cause the media player collapse.
In certain embodiments, extra data items is included in (with regard to broadcast or presentative time) appearance in the stream at a certain time interval.For example, extra data items can comprise in first content piece of the timestamp with the interval integral multiple of closelying follow predetermined extra data items that for example 20 seconds excessive data project at interval.According to this technology, extra data items is included in presentative time and is in first content piece after 20 seconds, is included in presentative time and is in first content piece after 40 seconds, is included in presentative time to be in first content piece after 60 seconds, or the like.Although stream can be continuous, presentative time stabs and finally is circulated back to zero.Whether yet determining to stab preset time is that first timestamp behind the extra data items integral multiple at interval is a problem intuitively.
The position of extra data in content piece 1205-1207 also is very important.In certain embodiments, extra data items is included in the same position in each content piece among the content piece 1205-1207 of its appearance.For example, extra data may be included among the content piece 1205-1207 position from byte 56 beginnings.Byte 57 beginnings are retained up to the position that digital finger-print finishes in the content piece.If the content piece comprises 56 or content piece still less, so extra data items just is included in the ending of this content piece, after all the elements data.Like this, if the content piece comprises 20 bytes, so extra data are since the 21st byte.There are the many kinds of modes can be with the position informing media player of the excessive data project in the content-data.The inventor has been found that special good solution is to use predetermined scheme, just determines extra data item destination locations before streamed data, and according to the particulars of this scheme media player is programmed.
For example, media player is programmed the 20 kinds of diverse ways that have of processing.Every kind of method is discerned by different digital fingerprinting method identifiers.This can form the part of media code, perhaps discerns to media player in any suitable manner.First method relates to that the 56th byte of first content piece comprises digital finger-print behind 20 seconds integral multiple, and this as mentioned above.Second method relates in the 32nd byte followed by first content piece of 30 seconds integral multiple and comprises digital finger-print.The 32nd byte that the third method relates to the content piece behind six content pieces behind 30 seconds the integral multiple comprises digital finger-print.The 32nd byte that cubic method relates to each the content piece behind 60 seconds integral multiple comprises digital finger-print, and the 11st byte of each the content piece behind 30 seconds integral multiple comprises digital finger-print, unless the 32nd byte at this content piece comprised digital finger-print, that is to say, when digital finger-print occurred continuously, its position replaced between the 11st byte and the 32nd byte.In another method, comprise that the content piece of fingerprint changes.For example, digital finger-print can be with respect to the content piece immediately following 40 seconds integral multiple, is positioned at 3 content pieces behind 40 seconds the integral multiple, is positioned at 7 content pieces and 2 content pieces behind 40 seconds the integral multiple with repeating sequences.The change in location of digital finger-print is many more, and the protection that is provided is big more.
The length of excessive data project is unimportant, although for fear of the size of data that increases gained too much, preferably the excessive data project should be not long.
Because before decoding, will remove the excessive data project, so the form of excessive data project (being content) is unimportant.Yet the form that the inventor tends to the excessive data project is a digital finger-print.Preferably, at every turn occurring of digital finger-print is identical,, identical data sequence arranged that is.For example, the length of digital finger-print can be 5 bytes.Even if the third party has determined to constitute the data of digital finger-print, the serial data of identical data can appear at a lot of positions in the content-data, and therefore, only this information itself is not sufficient to make that digital finger-print can be removed.
Shown in Figure 10 A, unmodified content piece 1206 comprises the data of m byte.In Figure 10 B, show the content piece 1206 that has increased digital finger-print 1301, label is 1304.Digital finger-print 1301 is divided into two parts 1302,1303 with m data byte.First 1302 comprises data byte 0 to n, and second portion 1303 comprises that data byte n+1 is to m.The length that comprises the content piece of digital finger-print equals the m+k byte, and wherein k is the size of digital finger-print.Example above using, n is 56, k is 5.
For to preventing undelegated broadcast and/or duplicating the protection that provides extra, before the content piece is stored on the MMC, all or part of content piece is blured.Comprise at the content piece under the situation of excessive data project that as digital fingerprint 1301, the data of this excessive data project and formation original contents piece are together by fuzzy.Simply, fuzzy comprise the change data, the fuzzy data of gained is different with initial data like this, can not be correctly decoded under the situation of deblurring not having.Usually fuzzyly do not change data volume, thus the size of content piece before fuzzy with the same afterwards.Earlier in respect of figures 3 has been discussed fuzzy.Figure 10 C shows the content piece 1304 that comprises digital finger-print 1301 1305.Fuzzy content piece 1305 comprises k+m byte, and this is the same with content piece 1304 behind the increase digital finger-print.
If full content is only used a kind of blur method, media player 58 need not notifiedly just know which type of has used blur so.
If the blur method difference of all the elements piece needs to notify 58 pairs of content pieces of media player to use what blur method so.In this case, can obtain fuzzy identifier from broadcasting server 100 in any suitable manner.Fuzzy identifier sign DRM encoder 113 uses any blur method to come fuzzy data.This makes media player can carry out corresponding deblurring method.
The content piece 1203-1208 that comprises digital finger-print comprises the indicated more data than they corresponding header 1201-1203.
To content piece 1205-1208 some or all blur after, the data of gained are streamed to mobile device 103.
When the user operated media player on their mobile device 103 with the TV that receives stream and send or radio channels, mobile device was communicated by letter with broadcasting server 100, and arranges suitable stream to be sent to mobile device.Head and any fuzzy identifier are received separately.Media player begins read head and the content piece relevant with content then.DRM decoder module 112 in the media player uses any fuzzy identifier to determine content blocks of data 57 is carried out deblurring needs for which kind of method.DRM decoder module 112 also determines whether to have the media code that need present streaming content, and it obtains in licensing process.Media code reference numbers fingerprint 1301, and make media player 58 can determine to have occurred in content piece 1205-1208 which position of digital finger-print and appearance thereof.This can carry out in any suitable manner.For example, media code can comprise the position code of digital finger-print, and the position code sign can be used for removing the preordering method that digital finger-print occurs.
Then, media player 58 is ready to play content.Yet when only the digital finger-print in being included in the content piece was identical with digital finger-print in being included in media code, media player 58 is play content.This is authorized to use media player 58 play content that further inspection is provided to the user.
If where do not know fingerprint, just can not it be removed from content by media player 58.Simultaneously, before media player 58 play content, it guarantees the same of the digital finger-print that occurs in content and expection.
When play content, the content piece that 122 pairs of quilts of DRM decoder module are fuzzy carries out deblurring.For example, for the content piece 1305 among Figure 10 C, DRM authentication module 44 is carried out the fuzzy inverse process that carries out in DRM processing module 21, obtains to add the content piece 1304 of fingerprint thus.When play content, DRM processing module 21 also from the content piece that comprises fingerprint with its removal.For example, for the content piece 1304 among Figure 10 B, DRM processing module 21 is removed digital finger-print 1301, obtains the content piece 1206 shown in Figure 10 A thus.Only behind deblurring and removal digital finger-print, the content piece just is transfused to the codec 123 of codec 124 or media player.Do not accomplish that any step data that all can lead to errors in this two step are imported into codec, this may cause the media player collapse.Under the best situation, content can not be play with available form.
If use any other media player to attempt play content, this trial will be failed.In order to construct the medium extractor that can extract available content, the medium extractor need be known definitely will use any blur method, and knows definite position and the size thereof of excessive data project in the content piece.Therefore, this technology provides strict protection for preventing that content from being used by unauthorized.Even if use simple relatively blur method and comprise less relatively digital finger-print, technologically speaking, the protection that is provided also is powerful relatively.Because which kind of deblurring method what media player was known use is, and knows and to remove at which position digital finger-print, so media player play content correctly from.Yet media player is not the medium extractor, so can not be used for extracting content to do the usefulness of unauthorized with unprotected form.
Obtain content
To known a period of time of the technology of the computer that is connected to the internet, computer is used to reproducting content so that the user watches/listens to audio frequency or dynamic image distribution.Be well known that now, can answer program request that audio-frequency fragments or piece of video cutout are delivered to portable terminal, and use the w media player on the terminal to come play content.For example possesses this function by the MM-A700 mobile phone of Samsung manufacturing is known.The video content that stream send is provided by the multimedia service of Sprint PCS version.It also provides MP3 and similar player to mobile phone and other handheld portable devices, and it produces music and other audio contents from the packed data that is loaded into terminal in advance or be connected on the removable memory device of terminal.
With content stream deliver to move make that the user has more multimachine can touch their may this interested new music and other guide.
According to a further aspect in the invention, provide the method that content item is provided to terminal, this method comprises:
Content stream is delivered to terminal,
In end, detect user's input that the indication user wants content item, content item is one of following at least:
A) form the part of the content that stream send, and
B) content with a part that forms the content that stream send is relevant
In response to user's input, send request from terminal to server;
In response to the request of receiving,
The content item that identification is asked,
Determine whether the user has the right to use this content item, and
Provide content to obtain means to terminal; And
Obtain means in response to receiving content, control terminal uses content acquisition means to obtain content item.
According to a further aspect in the invention, provide a kind of system, having comprised: server, terminal and content stream delivered to the device of terminal,
Terminal is used to respond user's input that the indication user wants content item, and content item is one of following at least:
A) form the part of the content that stream send, and
B) content with a part that forms the content that stream send is relevant
Send request to server;
Server is in response to the request of receiving, and the content item that identification is asked determines whether the user has the right to use this content item, and provides content to obtain means to terminal; And
Terminal is used to use content acquisition means to obtain content item.
According to a further aspect in the invention, provide a kind of terminal, having comprised:
Receive the device of streaming content,
The user input of wanting content item in response to the indication user sends the device of request to server, and content item is one of following at least: a) form the part of the content that stream send, with b) relevant with the content of the part of the content sent of formation stream,
Obtain means in response to receiving content, control terminal uses content acquisition means to obtain the device of content item.
According to a further aspect in the invention, provide a kind of method of operating terminal, this method comprises:
Receive the data that stream send,
Want the user input of content item to send request to server in response to the indication user, content item is one of following at least: a) form the part of the content that stream send, with b) relevant with the content of the part of the content sent of formation stream; And
Obtain means in response to receiving content, control terminal uses content acquisition means to obtain the device of content item.
These aspects of the present invention allow the user obtaining content on their terminal that is triggered when receiving streaming content.This can so that obtain the user the process of interested content (for example buying) very directly perceived concerning the user, do not need particularly to determine that institute's stream send is what content and obtains under the situation of contents from other sources independently then.This process technologically speaking also can be very directly perceived, makes usually uncorrelated each other and be not the system component cooperation that is designed for interoperability, thinks that the user provides content.
The embodiment of these and other aspects of the present invention is described with reference to the drawings now by way of example, wherein:
Figure 11 is the schematic diagram of the broadcasting server assembly operated with media player according to the present invention; And
Figure 12 is the assembly schematic diagram of the media player operated according to certain aspects of the invention.
Figure 13 is that terminal is passed through this system and can be obtained the schematic diagram of the system component of content according to the present invention, and comprises the assembly according to invention; And
Figure 14 is that each invention operation according to the present invention of the system of key diagram 3 is to provide the operational flowchart of content to terminal.
With reference now to Figure 11 and 12, radio and television and radio system are described.Referring to Figure 11, broadcasting server 100 comprises input 101, its receiving channels input and the I/O of arriving internet 102.Portable terminal 103 is connected to internet 102 by mobile network's (not shown), therefore can communicate by letter with broadcasting server 100.In brief, in case the user of portable terminal 103 subscribes to broadcasting area, they just can ask to send to their stream, and they use the portable terminal 103 can tuned television channel or listen to broadcast receiver by data flow.
Broadcasting server 100 comprises WAP Registering modules 104, and the WAP that the user by this module portable terminal 103 can pass through to internet 102 is connected broadcasting server 100 and registers.Portable terminal 103 can identify by for example its IMEI.Registering modules and registration database 105 carry out two-way communication, and registration database 105 is safeguarded registered user's details, and allow the keeper to monitor the registered user, and when needed they are removed registration.After the registration, the user can use the WAP between accounting module 106 and the internet 102 to connect subscription service.Accounting module 106 and billing database 107 carry out two-way communication, billing database 107 monitoring subscription information, and allow the keeper to check each subscription and provide to subscribe to statistics.Subscription database 107 and registration database 105 carry out two-way communication each other, so log-on message can pass to accounting module 106, subscribe to and charge information can pass to registration database 105 and Registering modules 104.
The channel configuration parameter between broadcasting server 100 and a plurality of portable terminal is safeguarded in band allocation data storehouse 108, only show among the figure one of them 103.Channel configuration is transmitted road channel configurator 109 from configuration database, and channel configurator 109 has to the internet 102 http connect.Band allocation data storehouse 108 comprises the configuration data of channel.Band allocation data storehouse 108 uses the management tool based on webpage to upgrade, and to increase, to revise and the deletion channel, to meet the stream of arrival, this is set by manual configuration procedures.
The data that comprise in the band allocation data storehouse 108 constitute the complete URL of each channel.
Channel configurator 109 reads band allocation data storehouse 108, and preparing the specific user can be with the XML tabulation of all channels of (being that they subscribe to), and this XML tabulation is sent to media player on the portable terminal.Menu option on the media player " refreshes channel " and can be used to start this process.Then, the media player channel list new for the user creates.
The data that the channel input receives are handled by a series of assemblies that comprise stream transformer 110, stream damper 111, content encoder 112, DRM encoder 113 and content server 114.In this example, the content sent of stream is Real TMForm, therefore, content encoder 112 is RealProducer TM, and content server 114 is RealServer TMAlthough can use any other suitable form as an alternative.At input 101 places, input has a stream transformer 110 and stream damper 111 to the channel of each arrival.The channel configuration information that stream transformer 110, content encoder 112 and DRM encoder 113 receive from the band allocation data storehouse.DRM encoder 113 also receives the subscription information from billing database 107.
Content server 114 provides stream to send channel to internet 102, and portable terminal 103 can access stream be sent channel by the stream request is provided to content server 114 via internet 102.
Use broadcasting server 100, the user of portable terminal 103 can register and subscription service.When subscribing to, the user of portable terminal 104 can select channel from content server 114 by internet 102 (for example using GPRS), and content server 114 send channel to portable terminal stream then.Use the bit rate of 30kbps can obtain reasonable single audio frequency video.If broadcasting server 100 is set in channel input 101 and receives radio and television, therefore, can on portable terminal 103, provide radio and television, and can change channel by the suitable instrument of user interface for the user.This is by realizing GPRS as carrier, and has eliminated portable terminal and must possess the needs that receive hardware as the radio and television of DVB-T or DVB-H receiver.Similarly, use the bit rate of 30kbps can obtain the very extraordinary stereo video of quality.30kbps is to use the maximum available bandwidth of GPRS.3G can provide the available bandwidth of 50-50kbps.Can use different bit rates for each content source multichannel to be set, bit rate is used for GPRS, another is used for 3G.Also can be arranged to difference is subscribed to the rate difference.
This allows the user to receive the broadcast receiver service by broadcasting server 100 on portable terminal 103, and does not need portable terminal 103 to have FM or other broadcast receivers reception hardware.The Maximum Bit Rate of considering GRRS is possible of 128kbps and undesirable channel condition, and bit rate is chosen as the compromise that is provided between service reliability and content play quality.It is evident that for the specific bit rate, better coding provides the better content quality, although selected coding techniques should not cause unnecessary coding burden to portable terminal 103, because this may increase the frequency of battery charge.
DRM encoder 113 increases digital rights management information in the content that is provided by content encoder 112, make that having only effective subscriber can be correctly decoded from content server 114 streams send and next content.Particularly, DRM encoder 113 increases digital finger-print with the interval of approximate regulation to content stream.Have only effective subscriber could remove digital finger-print.Can not remove digital finger-print will cause can not be correct decode content stream.Therefore, comprise that digital finger-print prevents that the user outside effective subscriber from watching broadcast TV channel or broadcast listening radio channels.In addition, can use different digital finger-prints to different content stream, the restriction that is applied to some channel thus may not be applied to other channels.
The details that comprises and be installed in the w media player 120 on the portable terminal 103 is illustrated by Figure 12.Please referring to Figure 12, media player 120 is included in the connection of internet, this connect by and the GPRS of the mobile telephone network (not shown) of Mobile Network Operator be connected, the user of portable terminal 103 uses this GPRS to have subscription or other contracts.Media player 120 also comprises communication interface 121, and the stream that communication interface 121 will receive is input to DRM decoder 122.Self-defining codec 123 and Real TMPerhaps MP4 codec 124 all provides input by DRM decoder 122.Use in the codec 123 and 124 which to depend on the coding that broadcasting server uses this channel at given time.Real TMCan processing audio flow (being used for radio channels) and video flowing (being used for television channel) with the MP4 codec.In the codec 123,124 each all has the output that is connected to display engine and user interface 125.Channel update module 126 is connected to broadcasting server 100 by internet 102, and obtains the information about available channel therefrom.This channel information is stored in the channel storage 127.In response to the channel selecting signal from display engine and user interface 125, channel storage 127 provides the channel standardize information to display engine and user interface 125.This channel standardize information is delivered to communication interface 121 from display engine and user interface 125, and communication interface 121 uses the channel standardize information to guarantee that it receives correct content stream at any given time.
Charging authentication module 128 can be connected to the WAP Registering modules 104 of accounting module 106 and broadcasting server 100 by internet 102.These modules are cooperated and are registered portable terminal 103 and make it subscribe to one or more services.The IMEI (being provided by the IMEI storage 129 that forms a portable terminal part) of portable terminal 103 is provided the charging authentication module, with the sign portable terminal.In case set up a subscription, send access code to charging authentication module 128 from accounting module 106.This access code is stored in charging/DRM configuration store 130 then.Access code comprises digital finger-print, and the position of identification fingerprint in content stream.Access code can be relevant with a channel, also can be relevant with a plurality of channels.DRM decoder 122 is used for accepting DRM information from charging/DRM storage 130.DRM decoder 122 can use this information to remove digital finger-print from content stream, and this makes content stream to be correctly decoded by self-defined codec 123 or Real/MP4 codec.
Communication interface 121 also is used for receiving information from charging/DRM configuration store 130.This makes media player 120 and to subscribe in the registration of broadcasting server 100 places.Media player 120 comprises the menu option that is used to register TV and/or broadcast receiver service, and by selecting this menu item, media player begins the WAP session and is connected to the Registering modules 104 of broadcasting server.Subscription and charging are also undertaken by WAP.In case finish registration and any subscription and/or charging, the WAP conversation end, media player 120 returns, to allow to select other functions.Charging is that carry out on the basis with each time quantum of each channel, and based on the basis of subscribing to.Subscription has duration or Close Date, and can be relevant with signal channel or channel grouping.
Referring to Figure 13, the broadcasting server 100, internet 102 and the portable terminal that are used to the user that the system 140 of content is provided to comprise Figure 11 and 12.System also comprises paying server 141, and it is connected to internet 102.In this example, paying server 141 is placed on broadcasting server 100.Paying server 141 can by with the operation broadcasting server 100 the different physical operation of entity.For example, paying server 141 can be operated by mobile-phone carrier.Content server 142 also is connected to internet 102, and it can be by operator or different operator's operation of broadcasting server 100.Content server 142 and paying server 141 can be by the operations of same operator.The GPRS network that portable terminal 103 is connected to internet 102 143 illustrating in the drawings.
Operation below with reference to the assembly of Figure 13 descriptive system 140.Operation starts from step S1, and portable terminal 103 receives audio stream from broadcasting server 100.Here, the user can listen to radio station, and its content is delivered to portable terminal 103 by GPRS stream on internet 102.Radio channels generally includes some music tracks, and perhaps " song " play continuously is separated with talk, advertising dialogue and/or advertisement between once in a while.At step S2, the user represents that he wishes to buy the track that current radio station is play.This can any mode easily carry out.For the most convenient user, be positioned at media player 120 on the portable terminal 103 when playing radio station, be used to provide soft key or other easily key as " purchase track " option selector.Therefore, whenever listen to radio station by portable terminal 103 the user, the user can be quick and direct mode indicate to want to buy and buy a track.In order to reduce the possibility that the user selects track by accident, before buying, media player 120 is configured to require the user to confirm to buy a track, for example by selecting to be appointed as by media player 120 a different key of acknowledgement key.Acknowledgement key is pressed in requirement, and the sign of acknowledgement key, indicates on the display screen of portable terminal 103.
The request of being carried out at step S2 by the user to track makes media player 120 send http request by GPRS network 143 and internet to broadcasting server at step S3.The http of step S3 request comprises timestamp or other indication users data in the absolute time of the time of step S2 request track alternatively, perhaps other data in the streaming content, these data can be broadcasted server and be used for the time of identifying user at step S2 request track.Yet,, so just need not comprise timestamp or other times data if significantly do not postpone between the broadcasting of the reception http of supposition step S2 and step S3 request.
After receiving http request, broadcasting server 100 particularly is that to identify the track of being play on the present radio channels at step S4 be the track that is streamed to portable terminal for wherein content server 114.If http request comprises timestamp or other times data, step S4 comprises the sign of the track of determining that the user play in the time of step S2 request track so.Self produce under the situation of radio station at broadcasting server 100, so, the sign of track is known to broadcasting server 100.If the radio station that broadcasting server 100 streams send receives from external source, so, this step comprises, for example, visit by the website of radio station operation to determine the sign of current track.
After step S4, broadcasting server 100 identifies the product code of the track of being asked at step S5.This can carry out in any suitable manner, for example, uses question blank.Product code identifies the track of being asked uniquely.Product code can be any suitable form, and can be from any suitable source.Product code can be from content server 114.After the step S5, broadcasting server is created payment URL (unified source location device) at step S6.Payment URL indicating mobile terminal 103 needs accessed resources for the permission that obtains to obtain content.Then, at step S7, payment URL and product code are sent to portable terminal, as the http request responding to being sent in the S3 step.They are received by portable terminal 103 at step S8.
At step S9, portable terminal 103 attempts to visit the resource that is received at step S8.URL is relevant with webpage that is stored in paying server 141 or WAP page or leaf.Attempt access resources and be included in step S10, portable terminal 103 sends http and asks paying server 141 on internet 102.In response, paying server 141 is prepared webpage or WAP page or leaf at step S11, and arrives portable terminal 103 in the data of step S12 transmission response.Webpage and WAP page or leaf comprise data clauses and subclauses territory, at step S13, in this territory, are subjected to the mobile phone 103 of media player 120 controls to insert product code automatically, and at step S14 suitable data are sent to paying server 141.Therefore, at step S15, paying server 141 receives product code.Paying server 141 is from knowing the sign of portable terminal 103 in the data of step S10 and S14 reception.
Then, paying server 141 is handled payment at step S16.This can carry out in any suitable manner.For example, paying server 141 can use the service of credit card or the registration of other Payment Cards relevant with the user of portable terminal 103.In this case, the processing of payment only relates to paying server deduct the suitable amount of money from Payment Card.Perhaps, the user has advance payment, and in this case, paying server 141 can only deduct the suitable amount of money from user's advance payment.Perhaps, paying server 141 can in this case, can add the suitable amount of money by user's Mobile Network Operator operation in the user's mobile phone bill.
Should be appreciated that pay not necessarily necessaryly, for example, the copyright of the track that requires has this and do not need to pay user's permission, perhaps the user has quota, for example, every month three free tracks, perhaps the user also had one or more of free tracks this month.
Whether no matter need the user to pay, handling payment is the payment failure in the result of step S15, perhaps pays successfully, if payment failure, the user does not obtain asking the access right of track, if pay successfully, the user of portable terminal 103 is considered to have the right to use this track.Step S17 has the right to use the situation of track relevant with the user.
The payment of finishing at step S17 causes two actions.At first, send token at step S18 to broadcasting server 100.Then, broadcasting server 100 confirms that the user of token indicating mobile terminal 103 has the right to use this track.Token comprises the identifier and/or the transaction identifiers of portable terminal 103, and therefore, broadcasting server 100 can be distinguished different track requests.In response to this affirmation, broadcasting server 100 sends to paying server 141 at step S20 to be confirmed.In response to receiving the confirmation at paying server 141, broadcasting server 100 finishes its participation to this process.The action that another payment of being finished by step S17 causes is that to portable terminal 103 transmission contents acquisition URL, this is indicated by step S21 in the drawings from paying server 141.
Content obtains URL and is included in by the webpage of broadcasting server 100 maintenances or the link of WAP page or leaf.After portable terminal 103 received this URL, media player 120 made the browser of portable terminal 103 be directed to the resource address of URL.This is represented by S23 in the drawings.Simultaneously, after confirming step S19, broadcasting server 100 is prepared the XML data at step S24, and when the XML data were offered portable terminal 103, it made portable terminal obtain content from content server 142.To obtain the visit of the webpage of URL in content, broadcasting server 100 sends the XML data at step S25 to portable terminal 103 in response to portable terminal.
Receive the XML data from broadcasting server 100, portable terminal 103 is observed the instruction in the XML data automatically by media player 120 controls.This is included in step S26 control portable terminal 103, can be for example send and be included in the product code the XML data that step S24 prepared and the mode and the data contact content server 142 of identification content at step S7 with content server, and checking portable terminal 103 has the right to use the content of being asked from broadcasting server.Therefore, the step S26 of the portable terminal 103 of acquisition content and the step S27 of the content server 142 that content is provided cooperate.By content server 142 after portable terminal 103 provides content, these two parts all finish the participation to process.
The different XML of use of some portable terminals data obtain content from content server 142.In this case, need to use different technology as an alternative.
Except allowing the user step S2 asks current track, media player 120 can allow the user to ask track before, perhaps other tracks that can identify.This relates to, and the other input that is provided by media player 120 is provided on user interface, asks the subordinate option of the selection of current track during this input.In this case, broadcasting server 100 has appropriate functional.
Audio-video frequency content is provided
The other aspect of the present invention relates to the device of the audio-video frequency content that is provided for duplicating on mobile device, the method that relates to the audio-video frequency content that is provided on mobile device, duplicating, relate to and be stored in portable medium data or the existing data that at least temporarily are arranged in memory, and relate to the method for operating mobile device.
For mobile phone (being also referred to as cell phone) provides the colorful display screen with a lot of pixels is trend.As time passes, the quality of these display screens and resolution increase.In addition, semiconductor technology makes that can be mobile phone provides quite a large amount of internal memories.Known before MP3 player etc. is attached in the mobile phone, improved display screen is provided and increases amount of ram to make mobile phone can be used as conditional digital television receiver.Also be proposed on the multimedia card (MMC) audio-video frequency content is provided, on mobile phone, to show.Nokia TMThe 7610th, possess one of mobile phone of this function.This phone can be handled 3GPP and RealMedia audio frequency and video form.
At present, providing audio-video frequency content on mobile device is experimental and time-consuming process.The object of the present invention is to provide the apparatus and method of the audio-video frequency content that is used for playing on mobile device, it is convenient and can utilize whole abilities of target mobile device.
According to a further aspect in the invention, be provided for being provided for the device of the audio-video frequency content play on mobile phone, this device comprises:
Audio-video frequency content provides structure;
Be used for writing to storage area the device of data, these data comprise:
Audio-video frequency content;
Two with a plurality of different media players; And
Loader,
Loader is such, and when it was written into mobile device, it made the configuration parameter of mobile device be determined, and make to determine a media player based on the configuration parameter that is detected, and controlling mobile equipment is used selected media player.
Like this, for example mmc card can be used for the more target device configuration of big figure.This is useful, is under the situation of retails such as shop at for example mmc card particularly.
Loader can be used for controlling mobile equipment and go to detect it and whether comprised suitable media player, if detect suitable media player, be not from memory area to mobile device installation medium player, but this detected media player is controlled.
This is useful, occurs installing and unloading wrong possibility because can reduce, and the reliability of mobile device is provided thus.
Two and a plurality of media players can be provided by independent configurable media-player software application program.In this case, which kind of media player loader need can determine, and the suitable software module in the operation media-player software.Therefore, a plurality of media players are made of an independent software application, and it is some media player function reuse module or functions.
When two and a plurality of media players are provided by independent configurable media-player software application program, loader can become the part of media-player software application program.
According to a further aspect in the invention, provide data that are stored on the portable medium or the data that at least temporarily are arranged in memory, these data comprise:
Audio-video frequency content;
Two with a plurality of different media players; And
Loader,
Loader is such, and when it was written into mobile device, it made the configuration parameter of mobile device be determined, and make to determine a media player based on the configuration parameter that is detected, and controlling mobile equipment is used selected media player.
According to a further aspect in the invention, be provided for being provided for the method for the audio-video frequency content play on mobile phone, this method comprises:
Write data to storage area, these data comprise:
Audio-video frequency content;
Two with a plurality of different media players; And
Loader,
Loader is such, and when it was written into mobile device, it made the configuration parameter of mobile device be determined, and make to determine a media player based on the configuration parameter that is detected, and controlling mobile equipment is used selected media player.
According to a further aspect in the invention, provide the method for operation mobile phone, this method comprises:
Storage audio-video frequency content data and two or more different media players on built-in and/or external memory;
Determine the configuration parameter of mobile device;
Select a media player based on detected configuration parameter, and
Use selected media player to use the audio-video frequency content data.
Personal digital assistant and other mobile devices that " mobile device " speech should be understood to include mobile (honeycomb) phone and have the two way voice communication function comprise specialized media player etc.
With reference now to accompanying drawing, apart from describing the otherwise embodiment of the present invention, wherein:
Fig. 1 is a schematic diagram of realizing audio-video frequency content generator of the present invention;
Fig. 2 and 3 is flow charts of operating procedure of the device of key diagram 1;
Fig. 4 is explanation is used for playing the audio-video frequency content of conversion on mobile phone a schematic representation of apparatus; And
Figure 15 is the schematic diagram of the interconnected computer system of operation according to the present invention.
At first with reference to figure 1, it is the diagram of contents extraction conversion equipment 10.Comprising two optional audio-video frequency content sources 8 and 9.The cinematic data that is stored on the DVD (digital video or digital omnipotent CD) 15 is used in first content source 8.Automatically extraction configuration module 16 check DVD15 go up the metadata of storage to determine the upward configuration of the content-data of storage of DVD.This comprises uses tcprobe and analyzes the information of returning from DVD15.Hereinafter this there is more detailed description.The result is stored in the data of extracting configuration store district 17, and configuration is extracted in its representative.The extraction configuration data that is stored in memory block 17 is used to extract cinematic data (being content-data) from DVD15 by DVD deciphering and extraction module 18.The result is written to the content-data of the intermediate form in intermediate form cinematic data zone 14.Data in the intermediate form cinematic data zone 14 are a kind of predetermined forms, and are suitable for being converted to a kind of form that can duplicate on the mobile phone (not shown).Preferably, intermediate form is AVI.This form has the advantage of high-res, and relatively easily handle and convert to 3GPP and other several be applicable to the form of mobile device.
Data are accepted from cinematic data storage area 12 in the second audio-video frequency content source 9, and it is expressed as the cinematic data of AVI (audio frequency and video alternately) or other form.So provided film by format converting module 13 format transformations after, be then written to intermediate form cinematic data zone 14.
Therefore, audio frequency and video source 8 and 9 any one all can be used for providing cinematic data for intermediate form cinematic data zone 14.
Mobile format converting module 19 conversions are stored in the cinematic data of extracting in the cinematic data zone 14, and for mobile form cinematic data zone 20 provides film, this film is the form that is applicable to that mobile phone uses.Mobile format converting module 19 is used digital copyright management (DRM) processing modules 21, and this DRM module 21 can be carried out certain control to the visit and the distribution of the cinematic data that obtains.Use codecs 22 by the 19 practiced conversions of mobile format converting module, preferably, this codec 22 is purposes and the design that customizes for this reason.It is important, use the information that is stored in the product configuration data zone 23 by mobile format converting module 19 practiced conversions.The specifying information (so this information also is to be exclusively used in target device) of the configuration by based target equipment is controlled mobile format converting module 19, and device 10 can be used to provide cinematic data for potential any a large amount of target mobile devices.
Describe the leaching process that is undertaken by audio frequency and video source 12 in detail below with reference to Fig. 2.
In Fig. 2, extract configuration from step S1.It uses the automatic extraction configuration 16 shown in Fig. 1.Extract and dispose the analysis that starts from DVD source 15.The result of case study, promptly for the response of inquiry, as follows:
(dvd_reader.c)mpeg2?pal16:9?only?letterboxed?UO?720×576?video
(dvd_reader.c)ac3?en?drc?48kHz?6Ch
(dvd_reader.c)ac3?de?drc?48kHz?6Ch
(dvd_reader.c)ac3?en?drc?48kHz?2Ch
(dvd_reader.c)subtitle?00=<en>
(dvd_reader.c)subtitle?01=<de>
(dvd_reader.c)subtitle?02=<sv>
(dvd_reader.c)subtitle?03=<no>
(dvd_reader.c)subtitle?04=<da>
(dvd_reader.c)subtitle?05=<fi>
(dvd_reader.c)subtitle?06=<is>
(dvd_reader.c)subtitle?07=<en>
(dvd_reader.c)subtitle?08=<de>
[tcprobe]summary?for/media/dvdrecorder/,(*)=not?default,0=not?detected
import?frame?size:-g?720×576[720×576]
aspect?ratio:16∶9(*)
frame?rate:-f?25.000[25.000]frc=3
audio?track:-a0[0]-e?48000,16,2[48000,16,2]-n?0x2000[0x2000]
audio?track:-a1[0]-e?48000,16,2[48000,16,2]-n?0x2000[0x2000]
audio?track:-a2[0]-e?48000,16,2[48000,16,2]-n?0x2000[0x2000]
[tcprobe]V:185950?frames,7438?sec@25.000fps
[tcprobe]A:116.22?MB@128?kbps
[tcprobe]CD:650MB|?V:533.8?MB@602.0?kbps
[tcprobe]CD:700MB|?V:583.8?MB@658.4?kbps
[tcprobe]CD:1300MB|V:1183.8?MB@1335.1?kbps
[tcprobe]CD:1400MB|V:1283.8?MB@1447.9?kbps
These information are to be returned by the tcprobe as the part of code converter.Extracting section layoutprocedure among the S1 comprises the configuration of determining target device, and it is represented by the information that is stored in the product configuration data zone 23.Therefore, it is helpful understanding these information that are stored in wherein.
The canned data data are determined the aspect ratio that target device shows in the product configuration data zone 23.Aspect ratio is 4: 3 under most of situation, but this ratio may change with equipment is different.Some equipment can use the aspect ratio of 16: 9 (wide screen), though the aspect ratio of the value of aspect ratio and traditional tv may be different in actual the use.Product configuration data is also determined required audio language.It has also determined whether need captions.If desired, the information configuration of product will be determined the language of required captions.Product configuration data comprises the bit rate of audio frequency and video track.Bit rate may depend on particular media player or other any factor of installing on the capacity, target device of target device.Product configuration data can also indicate the heap(ed) capacity size, for example indicates the free memory of a mmc card.The product configuration information comprises that also cinematic data is about to the indication of formats stored.For example, storage format may be 3GPP or MPEG-4, or other any suitable form.
Information in the product configuration data zone 23 also comprises the type of target device.For example, it may be the model that is about to duplicate the target mobile phone of film.In some cases, two different mobile phones of identical model, may firmly/different in the configuration of software.In the time may having different configuration, and this situation may be related to by device 10 processing of being carried out, institute's canned data preferably also comprises firmly/particulars of the difference of software arrangements and standard configuration in the product configuration data zone 23 so, or only specifies concrete configuration.
The information that automatic extraction configuration module 16 is returned by tcprobe (concrete is first row of front copy data) determines that DVD15 only comprises the widescreen of MPEG 2PAL form (promptly 16: 9 aspect ratios) video.Module 16 also respectively by second and fourth line define three tracks.Article first and second, track respectively has the sample rate of 6 sound channels and 48kHz.First and second tracks are identified by it " en " and " de ", be defined as English and German respectively.Article three, track is an English, and is stereo (dual track) signal of 48kHz sample rate.This module determines that also DVD 15 has 8 subtitle track of using different language.Module 16 has also been determined frame per second, totalframes and movie length.Module 16 uses the last four lines of return information to determine to extract from DVD16 the bit rate variation of content.
Automatically the function of extracting configuration module 16 also comprises the acquisition decruption key, and when the audio-video frequency content among the DVD was duplicated in permission, these keys were essential.
Constitute the configuration of DVD15 by automatic extraction configuration module 16 determined information.
Based on information in the product configuration data zone 23 and DVD configuration information, extract configuration module 16 decisions automatically and need use which track, which video channel (if having) and which subtitle track more than a video channel.Usually, by the subtitle track that this process is determined, be in the subtitle list identical first with the subtitle language of in product configuration data zone 23, determining.Same, by the track that this process is determined, be to be track with a kind of language with the track of in product configuration data zone 23, determining, it also is best suited for, and target device uses.Generally, Dolby TMPro Logic TMVoice-grade channel is inappropriate, because most of target device does not have the outfit that can handle this audio signal.The normally only audio track of stereo track, although for having only monaural target device, the monophony track is only only.Usually, the video channel of being selected by this process is the main channel, i.e. film itself, rather than any " extention " are such as trailer and documentary film behind the scenes or be generally comprised within this type of content in the DVD.The data that the track determined by this process and passage are confirmed are kept in the extraction configuration data zone 17.
In step S2, the data that are stored among the DVD15 are read in the mode of stream.In Fig. 1, this is represented by the film of DVD data area 15 and the arrow between DVD deciphering and the extraction module 18.At this constantly, that reads is only meaningful, because DVD deciphering and extraction module 18 directly do not use configuration information or metadata.The just related content of reading equally.Extract configuration data zone 17 and determine associated video passage, related audio passage and any relevant captions passage, and related content is to indicate to DVD deciphering and extraction module 18 by being stored in the information of extracting in the configuration data zone 17.In step S3, the relevant portion of DVD deciphering and 18 pairs of DVD data flow of extraction module is decrypted.The key that this deciphering is used code converter and extracted by automatic extraction configuration module 16.Deciphering is carried out immediately, the time-continuing process when promptly reading content from DVD15.Data are converted into intermediate form in deciphering, i.e. the AVI form.In step S5, cinematic data writes and extracts cinematic data buffer 14 as the file of independent or a series of intermediate forms.
In step S6, extract reprocessing.This comprises and will appear at content file or a plurality of file division in the extraction cinematic data buffer 14 or be merged into part.Whether have any cutting apart or merging and degree thereof, depend on the target device configuration information of storage in product configuration data zone 23.In most cases, this step can comprise the extraction content fitly is divided into a plurality of volumes.In many cases, because the restriction of mobile phone, providing movie contents with the form of multireel is preferably.The multireel that the DVD movie contents is divided into corresponding to the chapters and sections among the original DVD15 is a process quite intuitively.After the step S6, the extraction of cinematic data just is through with.
The result is stored in the cinematic data of extracting in the cinematic data buffer 14, these data are encoded into intermediate form (as the AVI form), only comprise a track, its language is identical with the determined language of product configuration information in being stored in product configuration data zone 23, and comprises the subtitle track of a required language alternatively.Usually the cinematic data that extracts is divided into several volumes, though depend on the configuration of target device, this point may be unnecessary.
Except DVD data source 15, also can use other cinematic data storage area 12.Like this, format conversion will be finished by format converting module 13 to the work of intermediate form (as AVI).As long as adopt DVD source 15, second content source 9 just can be omitted so.If comprise other cinematic data storage area 12, the type of the certain content that is fit to other cinematic data storage area 12 and provided is provided the form of format converting module 13 so.Each data type that is stored in other cinematic data storage area 12 may all need an independent format converting module 13.
Process shown in Figure 3 starts from the end of leaching process.At step S1, read extraction document.This is an instant process, connects with the arrow between extraction cinematic data buffer 14 and the mobile format converting module 19 and represents.In step S2, the content that mobile format converting module 19 will comprise cinematic data is decoded.This step is used code converter.In step S3, decoded content is encoded into required mobile form again, and this form is determined by the product configuration information that is stored in the product configuration data zone 23.Coding is finished by codec 22.Coding work will carry out in such a way, promptly make audio-video frequency content have only bit rate.The only bit rate of mobile format converting module 19 decisions.Specifically, mobile format converting module 19 uses following information to decide only bit rate, that is, and and the video frame number in the video data, track length, and be stored in heap(ed) capacity information in the product configuration data zone 23.Usually, can hold the Maximum Bit Rate that can use under the situation of whole contents at maximum Volume Space, be exactly optimal audio frequency and video bit rate.
Usually, for the selected bit rate of audio frequency and video can provide suitable quality for audio frequency and video, though under the situation of considering heap(ed) capacity, if mobile form cinematic data is given the broadcast impression of people Geng Jia, can there be some differences in the Voice ﹠ Video bit rate.For example, the size of data of the Voice ﹠ Video content of certain credit rating surpasses the size of heap(ed) capacity, but its size of data is far smaller than capacity again when credit rating descends, at this moment mobile format converting module 19 can determine to adopt more high bit rate for video content, and be that audio content adopts than low bit rate, to make full use of the active volume size.
If find for the inspection that is stored in the information in the product configuration data zone 23, target device is unpromising to be adopted the frame per second identical with DVD source 15 when playing and optimizes, and so this situation is by mobile format converting module 19 processing.Specifically, mobile format converting module 19 may be revised the frame per second of content-data, to be the optimization of target mobile device.Usually, this can make frame per second reduce, because the mobile phone screen size is limited, its influence that reduces frame per second can be unobvious as full screen display.If the source frame per second is not the integral multiple of optimal frame rate, when mobile phone was play, mobile format converting module 19 may use frame alternately so that the movie contents that generates is realized smooth effect so.
Therefore, use the information be stored in the product configuration data zone 23 to control mobile format converting module 19 among the step S3, with use codec 22 with data with suitable bit rate, be encoded into the suitable data form.
Product configuration data zone 23 can be upgraded according to target device, and this is paid close attention in special format conversion process.In this case, the data of a target device are once only stored in product configuration data zone 23, and these data will be changed with the need.Perhaps, product configuration data zone 23 can also be one group of data of each device storage of a plurality of target devices, and constantly selects one group of data according to certain interested particular target device certain.Under two kinds of situations, control device 10 is to carry out the format conversion process at an easy rate, and each during this process disposes at a plurality of target devices is optimized.
In step S4, add digital rights management content.This uses DRM processing module 21 to realize by mobile format converting module 19.The step that step S4 realized depends on the determined object format of the information that is stored in the product configuration data zone 23.The form of the DRM content that adds may specifically depend on the form of codec 22.The form of codec 22 and then influence the form of codec in the media player.Particularly, when codec 22 is self-defined codec, use self-defining DRM form.Here, can select the form of DRM to come to provide optimum operation for self-defined media player.If an existing codec is as Real Media TM, be used for codec 22, just will use suitable DRM form.
If media player and target device allow, the DRM content just can apply content replication and distribution limits as follows.A selection is, content checked be limited to specific target device or user, as being determined by IMEI or IMSI number or other any unique or accurate unique sequence number.In this case, product configuration data zone 23 need comprise this sequence number so that mobile format converting module 19 can with DRM processing module 21 and product configuration data zone 23 co-operate, in cinematic data, comprise suitable DRM content.Another one is selected, and allows considerable seeing a film before certain time and/or date.Therefore, the film that is produced will have one " storage life ", and can not watch this film after DRM content designated date and/or time.The 3rd selection is to allow to watch movie contents with predetermined times (N time).In case behind viewed N time of the film, the media player in the target device will can not allow content to be used again, thereby make it invalid.Perhaps, can arrange media player after cinematic data is watched by the N time, remove mmc card or deletion or destroy cinematic data.Alternatively or additionally, the DRM content can prevent that unwarranted content is replicated or transmits.Therefore, we can say that the DRM content prevents or stops non-appointment the content on the mobile device is used and duplicating content.
Preferably, the DRM content is encrypted and be comprised in the head of the cinematic data of generation, though the DRM content can any appropriate mode be included in the cinematic data.Significantly,, be included in DRM content in the cinematic data by mobile format converting module 19 in the DRM processing module 21, will follow relevant criterion if target device need use standard DRM process.
At step S5, object content writes mobile form cinematic data zone 20 as file.This document can be interior cun zone of for example computer server, and perhaps this content file can directly write to mmc card or other portable removable mediums.The file that writes among the step S5 comprises the content of correct format, and comprises DRM content in the embedding movie contents or individual files.After step S5 finishes, convert, the result is the data of the film in the former DVD of being stored in of the formation data area 15 that is stored in the mobile form cinematic data zone 20, but this digital coding becomes to be suitable for the suitable form that the target mobile device uses, and suitable audio-video frequency content bit rate is arranged.And, multireel, an audio track that this film comprises suitable DRM content, divides for the form that is fit to target device, and optional single subtitle track.
When the video content among the DVD15 has different aspect ratios with the display device of target device, preferably the vision signal on the DVD is made amendment, so that its aspect ratio with target device is corresponding.This can be finished by DVD encryption and extraction module 18.Yet, preferably, the vision signal among the DVD15 is made amendment so that the aspect ratio of its corresponding target device can be finished by mobile format converting module 19.Modification may comprise, when the narrower image of needs, image the right and left is done simple cutting, maybe when the wideer picture of needs to image on bottom do cutting.Revise also can be included in and do limited image stretch on width or the height, or with it as an alternative.In this case, first-selectedly should allow the zone line that shows the more image of manying linearity be arranged than the fringe region that shows.Like this, compression greatly or stretching are done than mid portion in the image border.Like this, can be according to actual conditions, DVD is encrypted and extraction module 18 or mobile format converting module 19 are carried out pre-programmed, or other any suitable manner, it is its question blank according to source aspect ratio and target device aspect ratio, need which kind of cutting and/or stretching with decision, and need which kind of corresponding modification.
According to the present invention, the data that are written to mobile form cinematic data zone 20 are only relevant with content.In advantageous embodiments, the data that are written to mobile form cinematic data zone 20 also comprise one or more media players.The advantage of doing like this has following reason.The first, this has reduced need be moved the factor quantity that format converting module 19 is considered.The target device configuration information does not need to comprise the information of determining the media player in the mobile device, because media player information comprises in the movie contents data.The second, can allow the movie contents data in mobile device, not have suitable media player like this, or not have to be used under the situation of media player at all.
Media player can be embedded into, or is included in alternatively, in the movie contents data.Media player is embedded content-data be easier to movie contents is done control, and make the movie contents data be difficult to be broken by unauthorized people.A common media player need consume the memory space less than 1M.
In one embodiment, store, also have several different media players with movie contents data and loader.Program detects the relevant configuration of mobile device, and determines to use which kind of media renderer plays movie contents data with this.Like this, a mmc card might be applied in more on the multiple target equipment disposition, especially when mmc card be that this obviously is useful under the situation about buying from the shop shelf retail.
Preferably, arrange the loader controlling mobile equipment, whether comprised suitable media player to detect it.If detect suitable media player, it will be used, rather than from mmc card to mobile device installation medium player.This is useful, because it has reduced the installation and the unloading mistake that may exist, thereby has improved the reliability of mobile device.
In second embodiment, can provide multimedia player by independent configurable media-player software application program, rather than comprise a plurality of different media players.In this case, which kind of media player loader need can determine, and the suitable software module in the operation media-player software.The software module or the function that are not suitable for the mobile device configuration are not used.Like this, a plurality of media players are made of an independent software application, and it is some media player function reuse module or functions.When using single medium player software application program, loader oneself can become the part of media-player software application program.
Be stored in movie contents data and any media player in the mobile form cinematic data zone 20, can be with any suitable method and target mobile device communication.It is contemplated that at least below several years, but most of mmc card or other transmission medium all can be used for storage and transmission movie contents.Yet along with the mobile data transmission becomes quicker and more cheap, what can expect is that movie contents can be passed through airborne spread, for example use WAP or 3G transfer of data.Transmission can also realize like this, promptly use short distance to connect as cable, or use wireless technologys such as IrDA and bluetooth, and or use the transmitted storage medium of similar mmc card, come to transmit from a PC who is connected to the internet and has downloaded movie contents from the website.
The mobile device schematic diagram is shown in Figure 4.Mobile phone 40 comprises the legacy device that all voice communications are required, and is for clarity sake not shown here.Phone 40 comprises motion picture decoder module 41, itself and codec 42 two-way communications.Store movies in the mobile film data area 43, mobile film data area 43 may be any suitable form.Memory space, built-in RAM or other internal memory that mobile film data area 43 can be mmc card, connect by external drive, any suitable form that maybe may take.DRM authentication module 44 is connected with the 43 reception data from the mobile film data area.DRM authentication module 44 goes to allow or does not allow the cinematic data in the mobile film data area 43 is decoded with control motion picture decoder module 41 according to the proper sequence of the decision of using the DRM data to be made and time/date or input number.When 44 permissions of DRM authentication module are decoded to the cinematic data in the mobile film data area 43, and import by the user and to control when doing like this, motion picture decoder module 41 uses 42 pairs of data of codec to decode, and decoded data are offered buffer 45.Film is shown module 47 and is presented on the display 46 from buffer 45.This display module provides control data to allow with suitable speed decoding to motion picture decoder module 41.
If have loader in the mobile film data area 43, can arrange mobile phone 40 therefrom to install.Loader can make mobile phone 40 determine its configuration and select media player then, and correspondingly, it also is stored in the mobile film data area 43.This media player is used to the movie content-data then.If suitable media player has been installed in the mobile phone 40, so just will use this media player, and installation medium player from mobile film data area 43 not.
Although we say that mobile device is mobile (honeycomb) phone, it also can be a PDA(Personal Digital Assistant), and this PDA may have or not have the two way voice communication function.The present invention is chiefly directed on the equipment that is designed for other purposes audio-video frequency content is provided.Yet, the present invention also relates to special-purpose media player.
To on transferable medium, provide for the target mobile device of general kind at the film on the DVD and to use, perhaps even when on film will the target device at a plurality of peanuts of same pattern number, providing, utilization that can be useful system as shown in Figure 5.In Fig. 5, show first to the 3rd server 30,31,32.First server 30 is appointed as management node, be included in second with being connected of the 3rd server 31,32, the second and the 3rd server 31,32 constitutes child nodes.Among the server 30-32 each comprises that at least the first and second DVD drive 33.In this example, DVD need manually insert DVD and drive and therefrom remove, although can use robot or other automation tools to carry out this task as an alternative under the situation about needing.
Each server 30-32 extracts and changes film concurrently from the DVD that DVD drives 33.Can from single driving, sequentially extract film, that is, extract one by one.
Suppose that DVD drives 33 and has enough speed, server 30-32 has enough processing speeds, can finish in ten minutes DVD extraction and the processing procedure of a DVD.Therefore, in the film of gained, comprise the sequence number or the similar information of mobile device,, then need realize transfer process one time on this target device each particular target device so that this film can only be play.Should be appreciated that, only need carry out one time leaching process, extract in the cinematic data buffer because the film after extracting is stored in.
Film will be by under the situation of of a sort a plurality of target devices uses, and extraction and transfer process only need be carried out once.In case film is stored in the mobile form cinematic data zone 20 with mobile form, it just can repeatedly copy to mmc card or other detachable media equipment as required.This can carry out in any suitable manner, for example uses internal or external MMC to drive.
The configuration that is used for management system installation particular process is positioned at ordinary file, for example, is arranged in/the etc/ subdirectory.The configuration of product film is arranged in the database table that uses self-defining Postgres or oracle database, although according to scale and performance requirement, can use any other suitable data storehouse as an alternative.Operate in management system on the child node server 31,32 and the communication on first server 30.Management node 30 is responsible for Task Distribution.Each transfer process needs an example of management system.
Memory contents
The invention still further relates to the portable data storage medium that comprises safety device.
For mobile phone (being also referred to as cell phone) provides the colorful display screen with a lot of pixels is trend.As time passes, the quality of these display screens and resolution increase.In addition, semiconductor technology makes that can be mobile phone provides quite a large amount of internal memories.Known before MP3 player etc. is attached in the mobile phone, improved display screen is provided and increases amount of ram to make mobile phone can be used as conditional digital television receiver.Also be proposed on the multimedia card (MMC) audio-video frequency content is provided, on mobile phone, to show.Nokia TMThe 7610th, possess one of mobile phone of this function.This phone can be handled 3GPP and RealMedia audio frequency and video form.
On mmc card, provide copyright work to provide content by the chance of bootlegging and distribution potentially to sell to the public.The present invention is devoted to provide a kind of storage device as mmc card, and on this device, content can not be visited easily so that it is replicated, but makes it can be played use.
According to a further aspect in the invention, provide portable data storage medium, comprising:
Nonvolatile memory, it has the computer-readable instruction that forms media player that comprises that is stored in wherein;
Interface comprises the terminal that is used to be connected to external device;
Controller is used for from the nonvolatile memory reading of data and with data feed-in interface; And
Safety device,
Wherein, when media player moves on external device, user and safety device are mutual, make safety device can determine whether media player has the right from the nonvolatile memory access content-data, and safety device responsively allows or do not allow content-data.
The data terminal of controller can provide safety device to be connected to interface.
Perhaps, safety device can be integrated into controller inside.In this case, controller and safety device can be used to decipher the content-data of reading from nonvolatile memory.
Valuably, controller also is used for writing data from interface to nonvolatile memory.In this case, if controller and safety device can be used to decipher the content-data of reading from nonvolatile memory, it also can be used for encrypting the data that are written to nonvolatile memory from interface.
With reference now to accompanying drawing, apart from describing the otherwise embodiment of the present invention, wherein:
Fig. 1 is a schematic diagram of realizing audio-video frequency content generator of the present invention;
Fig. 2 and 3 is flow charts of operating procedure of the device of key diagram 1;
Fig. 4 is explanation is used for playing the audio-video frequency content of conversion on mobile phone a schematic representation of apparatus;
Fig. 5 shows the combination of the mobile phone of mmc card and Fig. 4;
The alternate embodiment of the MMC hardware that Fig. 6 and Fig. 7 show according to the present invention;
Fig. 8 is the flow chart of the safety verification between the mmc card of the mobile phone of key diagram 4 and Fig. 6 and Fig. 7; And
Figure 15 is the schematic diagram of the interconnected computer system of operation according to the present invention.
In institute's drawings attached, similar elements is reused reference number.
At first with reference to figure 1, it is the diagram of contents extraction conversion equipment 10.Comprising two optional audio-video frequency content sources 8 and 9.The cinematic data that is stored on the DVD (digital video or digital omnipotent CD) 15 is used in first content source 8.Automatically extraction configuration module 16 check DVD15 go up the metadata of storage to determine the upward configuration of the content-data of storage of DVD.This comprises uses tcprobe and analyzes the information of returning from DVD15.Hereinafter this there is more detailed description.The result is stored in the data of extracting configuration store district 17, and configuration is extracted in its representative.The extraction configuration data that is stored in memory block 17 is used to extract cinematic data (being content-data) from DVD15 by DVD deciphering and extraction module 18.The result is written to the content-data of the intermediate form in intermediate form cinematic data zone 14.Data in the intermediate form cinematic data zone 14 are a kind of predetermined forms, and are suitable for being converted to a kind of form that can duplicate on the mobile phone (not shown).Preferably, intermediate form is AVI.This form has the advantage of high-res, and relatively easily handle and convert to 3GPP and other several be applicable to the form of mobile device.
Data are accepted from cinematic data storage area 12 in the second audio-video frequency content source 9, and it is expressed as the cinematic data of AVI (audio frequency and video alternately) or other form.So provided film by format converting module 13 format transformations after, be then written to intermediate form cinematic data zone 14.
Therefore, audio frequency and video source 8 and 9 any one all can be used for providing cinematic data for intermediate form cinematic data zone 14.
Mobile format converting module 19 conversions are stored in the cinematic data of extracting in the cinematic data zone 14, and for mobile form cinematic data zone 20 provides film, this film is the form that is applicable to that mobile phone uses.Mobile format converting module 19 is used digital copyright management (DRM) processing modules 21, and this DRM module 21 can be carried out certain control to the visit and the distribution of the cinematic data that obtains.Use codecs 22 by the 19 practiced conversions of mobile format converting module, preferably, this codec 22 is purposes and the design that customizes for this reason.It is important, use the information that is stored in the product configuration data zone 23 by mobile format converting module 19 practiced conversions.The specifying information (so this information also is to be exclusively used in target device) of the configuration by based target equipment is controlled mobile format converting module 19, and device 10 can be used to provide cinematic data for potential any a large amount of target mobile devices.
Describe the leaching process that is undertaken by audio frequency and video source 12 in detail below with reference to Fig. 2.
In Fig. 2, extract configuration from step S1.It uses the automatic extraction configuration 16 shown in Fig. 1.Extract and dispose the analysis that starts from DVD source 15.The result of case study, promptly for the response of inquiry, as follows:
(dvd_reader.c)mpeg2?pal?16∶9?only?letterboxed?UO?720×576?video
(dvd_reader.c)ac3?en?drc?48kHz?6Ch
(dvd_reader.c)ac3?de?drc?48kHz?6Ch
(dvd_reader.c)ac3?en?drc?48kHz?2Ch
(dvd_reader.c)subtitle?00=<en>
(dvd_reader.c)subtitle?01=<de>
(dvd_reader.c)subtitle?02=<sv>
(dvd_reader.c)subtitle?03=<no>
(dvd_reader.c)subtitle?04=<da>
(dvd_reader.c)subtitle?05=<fi>
(dvd_reader.c)subtitle?06=<is>
(dvd_reader.c)subtitle?07=<en>
(dvd_reader.c)subtitle?08=<de>
[tcprobe]summary?for/media/dvdrecorder/,(*)=not?default,0=not?detected
import?frame?size:-g?720×576[720×576]
aspect?ratio:16∶9(*)
frame?rate:-f?25.000[25.000]?frc=3
audio?track:-a0[0]-e?48000,16,2[48000,16,2]-n?0x2000[0x2000]
audio?track:-a1[0]-e?48000,16,2[48000,16,2]-n?0x2000[0x2000]
audio?track:-a2[0]-e?48000,16,2[48000,16,2]-n?0x2000[0x2000]
[tcprobe]V:185950?frames,7438?sec@25.000fps
[tcprobe]A:116.22?MB@128?kbps
[tcprobe]CD:650MB|?V:533.8?MB@602.0?kbps
[tcprobe]CD:700MB|?V:583.8?MB@658.4?kbps
[tcprobe]CD:1300MB|V:1183.8?MB@1335.1?kbps
[tcprobe]CD:1400MB|?V:1283.8?MB@1447.9?kbps
These information are to be returned by the tcprobe as the part of code converter.Extracting section layoutprocedure among the S1 comprises the configuration of determining target device, and it is represented by the information that is stored in the product configuration data zone 23.Therefore, it is helpful understanding these information that are stored in wherein.
The canned data data are determined the aspect ratio that target device shows in the product configuration data zone 23.Aspect ratio is 4: 3 under most of situation, but this ratio may change with equipment is different.Some equipment can use the aspect ratio of 16: 9 (wide screen), though the aspect ratio of the value of aspect ratio and traditional tv may be different in actual the use.Product configuration data is also determined required audio language.It has also determined whether need captions.If desired, the information configuration of product will be determined the language of required captions.Product configuration data comprises the bit rate of audio frequency and video track.Bit rate may depend on particular media player or other any factor of installing on the capacity, target device of target device.Product configuration data can also indicate the heap(ed) capacity size, for example indicates the free memory of a mmc card.The product configuration information comprises that also cinematic data is about to the indication of formats stored.For example, storage format may be 3GPP or MPEG-4, or other any suitable form.
Information in the product configuration data zone 23 also comprises the type of target device.For example, it may be the model that is about to duplicate the target mobile phone of film.In some cases, two different mobile phones of identical model, may firmly/different in the configuration of software.In the time may having different configuration, and this situation may be related to by device 10 processing of being carried out, institute's canned data preferably also comprises firmly/particulars of the difference of software arrangements and standard configuration in the product configuration data zone 23 so, or only specifies concrete configuration.
The information that automatic extraction configuration module 16 is returned by tcprobe (concrete is first row of front copy data) determines that DVD15 only comprises the widescreen of MPEG 2 PAL forms (promptly 16: 9 aspect ratios) video.Module 16 also respectively by second and fourth line define three tracks.Article first and second, track respectively has the sample rate of 6 sound channels and 48kHz.First and second tracks are identified by it " en " and " de ", be defined as English and German respectively.Article three, track is an English, and is stereo (dual track) signal of 48kHz sample rate.This module determines that also DVD15 has 8 subtitle track of using different language.Module 16 has also been determined frame per second, totalframes and movie length.Module 16 uses the last four lines of return information to determine to extract from DVD16 the bit rate variation of content.
Automatically the function of extracting configuration module 16 also comprises the acquisition decruption key, and when the audio-video frequency content among the DVD was duplicated in permission, these keys were essential.
Constitute the configuration of DVD15 by automatic extraction configuration module 16 determined information.
Based on information in the product configuration data zone 23 and DVD configuration information, extract configuration module 16 decisions automatically and need use which track, which video channel (if having) and which subtitle track more than a video channel.Usually, by the subtitle track that this process is determined, be in the subtitle list identical first with the subtitle language of in product configuration data zone 23, determining.Same, by the track that this process is determined, be to be track with a kind of language with the track of in product configuration data zone 23, determining, it also is best suited for, and target device uses.Generally, Dolby TMPro Logic TMVoice-grade channel is inappropriate, because most of target device does not have the outfit that can handle this audio signal.The normally only audio track of stereo track, although for having only monaural target device, the monophony track is only only.Usually, the video channel of being selected by this process is the main channel, i.e. film itself, rather than any " extention " are such as trailer and documentary film behind the scenes or be generally comprised within this type of content in the DVD.The data that the track determined by this process and passage are confirmed are kept in the extraction configuration data zone 17.
In step S2, the data that are stored among the DVD15 are read in the mode of stream.In Fig. 1, this is represented by the film of DVD data area 15 and the arrow between DVD deciphering and the extraction module 18.At this constantly, that reads is only meaningful, because DVD deciphering and extraction module 18 directly do not use configuration information or metadata.The just related content of reading equally.Extract configuration data zone 17 and determine associated video passage, related audio passage and any relevant captions passage, and related content is to indicate to DVD deciphering and extraction module 18 by being stored in the information of extracting in the configuration data zone 17.In step S3, the relevant portion of DVD deciphering and 18 pairs of DVD data flow of extraction module is decrypted.The key that this deciphering is used code converter and extracted by automatic extraction configuration module 16.Deciphering is carried out immediately, the time-continuing process when promptly reading content from DVD15.Data are converted into intermediate form in deciphering, i.e. the AVI form.In step S5, cinematic data writes and extracts cinematic data buffer 14 as the file of independent or a series of intermediate forms.
In step S6, extract reprocessing.This comprises and will appear at content file or a plurality of file division in the extraction cinematic data buffer 14 or be merged into part.Whether have any cutting apart or merging and degree thereof, depend on the target device configuration information of storage in product configuration data zone 23.In most cases, this step can comprise the extraction content fitly is divided into a plurality of volumes.In many cases, because the restriction of mobile phone, providing movie contents with the form of multireel is preferably.The multireel that the DVD movie contents is divided into corresponding to the chapters and sections among the original DVD15 is a process quite intuitively.After the step S6, the extraction of cinematic data just is through with.
The result is stored in the cinematic data of extracting in the cinematic data buffer 14, these data are encoded into intermediate form (as the AVI form), only comprise a track, its language is identical with the determined language of product configuration information in being stored in product configuration data zone 23, and comprises the subtitle track of a required language alternatively.Usually the cinematic data that extracts is divided into several volumes, though depend on the configuration of target device, this point may be unnecessary.
Except DVD data source 15, also can use other cinematic data storage area 12.Like this, format conversion will be finished by format converting module 13 to the work of intermediate form (as AVI).As long as adopt DVD source 15, second content source 9 just can be omitted so.If comprise other cinematic data storage area 12, the type of the certain content that is fit to other cinematic data storage area 12 and provided is provided the form of format converting module 13 so.Each data type that is stored in other cinematic data storage area 12 may all need an independent format converting module 13.
Process shown in Figure 3 starts from the end of leaching process.At step S1, read extraction document.This is an instant process, connects with the arrow between extraction cinematic data buffer 14 and the mobile format converting module 19 and represents.In step S2, the content that mobile format converting module 19 will comprise cinematic data is decoded.This step is used code converter.In step S3, decoded content is encoded into required mobile form again, and this form is determined by the product configuration information that is stored in the product configuration data zone 23.Coding is finished by codec 22.Coding work will carry out in such a way, promptly make audio-video frequency content have only bit rate.The only bit rate of mobile format converting module 19 decisions.Specifically, mobile format converting module 19 uses following information to decide only bit rate, that is, and and the video frame number in the video data, track length, and be stored in heap(ed) capacity information in the product configuration data zone 23.Usually, can hold the Maximum Bit Rate that can use under the situation of whole contents at maximum Volume Space, be exactly optimal audio frequency and video bit rate.
Usually, for the selected bit rate of audio frequency and video can provide suitable quality for audio frequency and video, though under the situation of considering heap(ed) capacity, if mobile form cinematic data is given the broadcast impression of people Geng Jia, can there be some differences in the Voice ﹠ Video bit rate.For example, the size of data of the Voice ﹠ Video content of certain credit rating surpasses the size of heap(ed) capacity, but its size of data is far smaller than capacity again when credit rating descends, at this moment mobile format converting module 19 can determine to adopt more high bit rate for video content, and be that audio content adopts than low bit rate, to make full use of the active volume size.
If find for the inspection that is stored in the information in the product configuration data zone 23, target device is unpromising to be adopted the frame per second identical with DVD source 15 when playing and optimizes, and so this situation is by mobile format converting module 19 processing.Specifically, mobile format converting module 19 may be revised the frame per second of content-data, to be the optimization of target mobile device.Usually, this can make frame per second reduce, because the mobile phone screen size is limited, its influence that reduces frame per second can be unobvious as full screen display.If the source frame per second is not the integral multiple of optimal frame rate, when mobile phone was play, mobile format converting module 19 may use frame alternately so that the movie contents that generates is realized smooth effect so.
Therefore, use the information be stored in the product configuration data zone 23 to control mobile format converting module 19 among the step S3, with use codec 22 with data with suitable bit rate, be encoded into the suitable data form.
Product configuration data zone 23 can be upgraded according to target device, and this is paid close attention in special format conversion process.In this case, the data of a target device are once only stored in product configuration data zone 23, and these data will be changed with the need.Perhaps, product configuration data zone 23 can also be one group of data of each device storage of a plurality of target devices, and constantly selects one group of data according to certain interested particular target device certain.Under two kinds of situations, control device 10 is to carry out the format conversion process at an easy rate, and each during this process disposes at a plurality of target devices is optimized.
In step S4, add digital rights management content.This uses DRM processing module 21 to realize by mobile format converting module 19.The step that step S4 realized depends on the determined object format of the information that is stored in the product configuration data zone 23.The form of the DRM content that adds may specifically depend on the form of codec 22.The form of codec 22 and then influence the form of codec in the media player.Particularly, when codec 22 is self-defined codec, use self-defining DRM form.Here, can select the form of DRM to come to provide optimum operation for self-defined media player.If an existing codec is as Real Media TM, be used for codec 22, just will use suitable DRM form.
If media player and target device allow, the DRM content just can apply content replication and distribution limits as follows.A selection is, content checked be limited to specific target device or user, as being determined by IMEI or IMSI number or other any unique or accurate unique sequence number.In this case, product configuration data zone 23 need comprise this sequence number so that mobile format converting module 19 can with DRM processing module 21 and product configuration data zone 23 co-operate, in cinematic data, comprise suitable DRM content.Another one is selected, and allows considerable seeing a film before certain time and/or date.Therefore, the film that is produced will have one " storage life ", and can not watch this film after DRM content designated date and/or time.The 3rd selection is to allow to watch movie contents with predetermined times (N time).In case behind viewed N time of the film, the media player in the target device will can not allow content to be used again, thereby make it invalid.Perhaps, can arrange media player after cinematic data is watched by the N time, remove mmc card or deletion or destroy cinematic data.Alternatively or additionally, the DRM content can prevent that unwarranted content is replicated or transmits.Therefore, we can say that the DRM content prevents or stops non-appointment the content on the mobile device is used and duplicating content.
Preferably, the DRM content is encrypted and be comprised in the head of the cinematic data of generation, though the DRM content can any appropriate mode be included in the cinematic data.Significantly,, be included in DRM content in the cinematic data by mobile format converting module 19 in the DRM processing module 21, will follow relevant criterion if target device need use standard DRM process.
At step S5, object content writes mobile form cinematic data zone 20 as file.This document can be interior cun zone of for example computer server, and perhaps this content file can directly write to mmc card or other portable removable mediums.The file that writes among the step S5 comprises the content of correct format, and comprises DRM content in the embedding movie contents or individual files.After step S5 finishes, convert, the result is the data of the film in the former DVD of being stored in of the formation data area 15 that is stored in the mobile form cinematic data zone 20, but this digital coding becomes to be suitable for the suitable form that the target mobile device uses, and suitable audio-video frequency content bit rate is arranged.And, multireel, an audio track that this film comprises suitable DRM content, divides for the form that is fit to target device, and optional single subtitle track.
When the video content among the DVD15 has different aspect ratios with the display device of target device, preferably the vision signal on the DVD is made amendment, so that its aspect ratio with target device is corresponding.This can be finished by DVD encryption and extraction module 18.Yet, preferably, the vision signal among the DVD15 is made amendment so that the aspect ratio of its corresponding target device can be finished by mobile format converting module 19.Modification may comprise, when the narrower image of needs, image the right and left is done simple cutting, maybe when the wideer picture of needs to image on bottom do cutting.Revise also can be included in and do limited image stretch on width or the height, or with it as an alternative.In this case, first-selectedly should allow the zone line that shows the more image of manying linearity be arranged than the fringe region that shows.Like this, compression greatly or stretching are done than mid portion in the image border.Like this, can be according to actual conditions, DVD is encrypted and extraction module 18 or mobile format converting module 19 are carried out pre-programmed, or other any suitable manner, it is its question blank according to source aspect ratio and target device aspect ratio, need which kind of cutting and/or stretching with decision, and need which kind of corresponding modification.
The data that are written to mobile form cinematic data zone 20 are only relevant with content.In advantageous embodiments, the data that are written to mobile form cinematic data zone 20 also comprise one or more media players.The advantage of doing like this has following reason.The first, this has reduced need be moved the factor quantity that format converting module 19 is considered.The target device configuration information does not need to comprise the information of determining the media player in the mobile device, because media player information comprises in the movie contents data.The second, can allow the movie contents data in mobile device, not have suitable media player like this, or not have to be used under the situation of media player at all.
Media player can be embedded into, or is included in alternatively, in the movie contents data.Media player is embedded content-data be easier to movie contents is done control, and make the movie contents data be difficult to be broken by unauthorized people.A common media player need consume the memory space less than 1M.
In an example, comprise a self-defining media player in the movie contents data.After data were written to mmc card, mobile device extracted the related data of media player from mmc card, and the media player operation is to handle the movie contents data then.
In another example, store, also have several different media players with movie contents data and loader.Mobile device is controlled in the loader that brings into operation most.This program detects the relevant configuration of mobile device, and determines to use which kind of media renderer plays movie contents data with this.Like this, a mmc card might be applied in more on the multiple target equipment disposition, especially when mmc card be that this obviously is useful under the situation about buying from the shop shelf retail.
Can provide multimedia player by independent configurable media-player software application program, rather than comprise a plurality of different media players.In this case, which kind of media player loader need can determine, and the suitable software module in the operation media-player software.The software module or the function that are not suitable for the mobile device configuration are not used.Like this, a plurality of media players are made of an independent software application, and it is some media player function reuse module or functions.When using single medium player software application program, loader oneself can become the part of media-player software application program.
Be stored in movie contents data and any media player in the mobile form cinematic data zone 20, can be sent on the mmc card or other are used to store and shift target mobile device on the transferable medium of movie contents.
The mobile device schematic diagram is shown in Figure 4.Mobile phone 40 comprises the legacy device that all voice communications are required, and is for clarity sake not shown here.Phone 40 comprises motion picture decoder module 41, itself and codec 42 two-way communications.Store movies in the mobile film data area 43, mobile film data area 43 may be any suitable form.Memory space, built-in RAM or other internal memory that mobile film data area 43 can be mmc card, connect by external drive, any suitable form that maybe may take.DRM authentication module 44 is connected with the 43 reception data from the mobile film data area.DRM authentication module 44 goes to allow or does not allow the cinematic data in the mobile film data area 43 is decoded with control motion picture decoder module 41 according to the proper sequence of the decision of using the DRM data to be made and time/date or input number.When 44 permissions of DRM authentication module are decoded to the cinematic data in the mobile film data area 43, and import by the user and to control when doing like this, motion picture decoder module 41 uses 42 pairs of data of codec to decode, and decoded data are offered buffer 45.Film is shown module 47 and is presented on the display 46 from buffer 45.This display module provides control data to allow with suitable speed decoding to motion picture decoder module 41.
If have loader in the mobile film data area 43, can arrange mobile phone 40 therefrom to install.Loader can make mobile phone 40 determine its configuration and select media player then, and this media player is a software application, and also is stored in the mobile film data area 43.The specialized media player that use is stored in the mobile film data area 43 is useful, because this allows the effective control to the safety of content-data, and can allow other nonessential function also existing or that pre-install media player.
The combination of mmc card and mobile device is shown in Figure 5.Here, mobile device 40 comprises CPU51 as shown in the figure, and it provides vision signal by the display driver (not shown) to display 46, and provides signal by the audio device drive (not shown) to audio output apparatus (being earphone jack or loud speaker).CPU51 is connected to ROM53, RAM54, MMC connector and interface 55 by bus.Mmc card 56 is connected to mobile device 40 by MMC connector and interface 55.
The non-volatile memory that mmc card is put within it has movie contents data 57, three different media players 58 and loaders 59.When needs during from the mmc card play content, mobile device is written into loader 59, its by determining mobile device 40 configuration parameter and the parameter of itself and media player compared, determine that in the media player 58 which is the most suitable.Determine to select this media player according to this then and it is loaded in the mobile device 40, and operation (promptly handling media player program) is with reproducting content from content-data 57.According to routine, the operation of media player 58 is included in deposits media player program among the RAM54 in, use CPU51 from mmc card 56, to extract related data to decode and to present the gained content.Media player 58 removes fuzzy identifier, adjusts head, uses deblurring method that content-data is correctly decoded from the first data content piece.Fig. 5 is a schematic diagram, and has omitted the incoherent details with the present invention.
Media player 58 or each media player all are arranged the attribute with the display 46 that detects main frame mobile device 40.Particularly, media player according to the wide number of picture elements of height to detect the size and the direction of display.This player is arranged to come the reproduction of control of video content on display 46 with the direction of the most suitable mobile device 40.If display 46 is wider than height, video content reappears with conventional direction so, does not promptly revise its direction.Yet if determine that display 46 is tall and big in wide, this media player just revolves video content to turn 90 degrees and reappears.Like this, no matter how media player has guaranteed screen size, video content reappears with horizontal form (being wider than height) all the time.This is more effective viewing area that utilizes display 46 just.
When video content was rotated on display 46 by media player, the function when media player 40 will cause the function of numerical key on the keyboard (not shown) or other input equipment and video content not to be rotated by media player was different.Because before can be, need mobile device 40 is rotated to a side, so no matter the direction of mobile device 40 how, provides different key functions to provide the identical experience of controlling to the user when different directions with the direction browsing video of wanting.Like this, the modification to control mode makes that using keyboard or other input equipment that media player is controlled becomes convenient and directly perceived to the user.The control of particular importance is volume up/down, broadcast, suspends, advances or retreat or the like.
When mobile device 40 is not high standard equipment, that is, it has the low relatively contents processing ability and/or the display of low-res, and media player is arranged to visit content from mmc card rather than from other content source.This allows the specialized media player that the content on the mmc card that will reappear is optimized, and like this, can provide than the free memory of mmc card or the abundant content more that other technical limitations allowed and reappear.This feature does not influence media player and uses existing standard codec 42 in the mobile device 40.In fact, media player can use standard or other third party's codec, also can use special-purpose codec.
When running on the mobile device 40 of high standard more, use different media players 58.Here, the media player of being selected by loader 59 can carry out convergent-divergent to obtain optimum efficiency to non-optimum content.
The media player 58 of an adjustable function perhaps, is provided on the mmc card 56.Such media player need not loader.When running on mobile device 40, this media player 58 detects the correlation properties of mobile device 40, and the suitable components and the function of enabling media player 58, and prevents to enable other parts and function.
Typical mmc card hardware designs comprises flash memory device and the storage/interface controller that is positioned on the extremely thin PCB (printed circuit board (PCB)), and it is outer to be the plastic casing that approaches.The following bottom that forms shell usually of PCB.The mmc card that several different sizes are arranged.
According to the present invention, the hardware of mmc card is non-traditional, and it comprises other safety function.Specialized media player 58 is used to the content on the mmc card of safety is carried out release and read.
First example of this new-type mmc card is described with reference to Fig. 6.Here, mmc card 56 comprises shell 60, and connection pin 61 wherein is provided.Connect the part that pin is formed into the host communication interface of external equipment (as mobile device 40).Mmc card 56 also comprises nonvolatile storage 62, and it is connected to storage and interface controller 63, and storage and interface controller 63 control are to the visit of memory 62 with to the interface of pin 61.Described like this mmc card is traditional mmc card.Mmc card 56 also comprises unconventional safety device 64.Safety device 64 be positioned over the storage and interface controller 63 be connected between the pin 61.Like this, storage and interface controller 63 be connected pin 61 in data (DAT), order (CMD) directly not to be connected, because at least some connections will be passed through safety device 64 between these parts with clock (CLK).Connect VCC, VSS1 and parallel simultaneously safety device 64 and internal memory and the interface controller 63 of being connected to of VSS2 quilt in the pin 61.Safety device 64 can be realized with microcontroller, ASIC (application-specific IC) or FPGA (Field Programmable Gate Array).The assembly of mmc card 56 is installed on the PCB (printed circuit board (PCB)), and PCB is the part of shell 60.Like this, mmc card 56 can have identical size and aerial lug with traditional mmc card.
Safety device 64 is used for data and the order that intercepting transmits between main process equipment (being mobile device 40) and storage and interface controller 63.The data of intercepting are processed, and by being to have revised or unmodified behind the safety device 64, or alternatively, it is substituted by the data that safety device 64 self produces.
Concrete data of passing through in any response or order can switch to enable mode with safety device 64, under this pattern, one of them of safety device 64 disguise as storages and interface controller 63 and host interface 61 reads or writes wherein another one.Under enable mode, safety device 64 is (promptly do not have external control ground) inquiry storage and interface controller 63 also independently, is that subsequently host request is prepared data, or is that subsequently request writes data to nonvolatile memory 62.
Provide enable mode to make and realized copy protection by the cooperation between mmc card 56 and the media player 58.
No matter be under the pattern of reading or writing, safety device 64 does not limit the visit for the nonvolatile memory 62 at not protected content place.This makes the mmc card 56 that has comprised safety device 64 to use in a usual manner, i.e. the safety function that device safe in utilization did not provide.The entity that safety device 64 can only have been authorized uses, and for example has been authorized to the content (being film) that copyright is arranged to be put into the entity of mmc card 56.
Mmc card 56 has identical sequence number with media player 58.In configuration, also provide result's (hashed value that hereinafter is called sequence number) to hash equation application sequence number for media player 58.Storage and interface controller 63 have safety device 64 control, the sequence number of programming time when being programmed (that is, selling before) storage sequence data, with the safety code that disposes and the hashed value of sequence number.
With reference now to Fig. 8, the checking of 58 pairs of mmc cards 56 of media player and the checking of 56 pairs of media players 58 of mmc card are described.
When the mmc card 56 of content, one or more media player 58 and optional loader 59 of having packed into is connected to mobile device 40, media player will be in menu as seen, and can be activated as any other software application that occurs in the mobile device 40.When media player 58 started first, first safety verification was implemented, and wherein carried out following incident.At first, only media player 58 is loaded into mobile device 58.Then, the hashed value that in step S8.1, transmits Sequence Number of media player 58 to safety device 64.Then, safety device 64 compares the hashed value of the sequence number of this hashed value and its storage inside in step S8.2.If the comparative result among step S8.3 coupling, just initial supposition media player 58 is complementary with mmc card 56, then safety device 64 in step S8.4 to mmc card 56 releases.Then, safety device 64 sends pre-configured identifying code to media player 58 in step S8.5.Perhaps, if comparative result does not match, safety device 64 does not respond in step S8.6.When media player 58 receives identifying code, just in step S8.7, identifying code is carried out 32 CRC (CRC) computing.Based on this operation result, media player 58 determines in step S8.8 whether mmc card 56 is relevant with media player 58, if just release media player in step S8.9 if not, just interrupts in step S8.10 and the demonstration error message.In this stage, if there is not protected area in nonvolatile storage 62, media player is reading of data therefrom just.
The second stage of safety inspection is carried out when play content.The control of medium on mmc card 56 has been unlocked and data become readable after, data are read out in the media player 58 from nonvolatile memory 62.Simultaneously, data flow is arranged to the frame of 1kB in step S8.11, i.e. beginning to finishing to have 1000 bytes from frame.Media player calculates safety code (as more detailed description hereinafter) and it is mail to safety device 64 in step S8.12, will decode to it in step S8.13.Based on decoded result, safety device 64 will determine in step S8.14 whether safety code is effective.If invalid, safety device 64 is replacement time-out count device in step S8.15 just, to avoid overtime and locked content.If effectively, storage and interface controller 63 just are considered as Frame subsequently to be verified and can visit in step S8.16.If also do not receive effective safety code before frame end, the frame of back will be filled with random data, rather than content-data.
Media player 58 recomputates once correct safety code for each frame, but for each frame produces 20 safety codes, wherein 19 is wrong.In step S8.17, media player 58 sends all safety codes to mmc card 56, in this example, is 20 safety codes of data transmission of each frame.Wherein 19 is to have a mind to make a mistake, and has only 1 to be correct.Safety device 64 in the mmc card 56 will compare the safety code that himself operation result and media player 58 send.As long as receive a correct safety code in each frame, safety device 64 just allows player to send content-data.If in one section preset time (use timer), safety device 64 detects and does not receive the effective and safe sign indicating number, the safety code of perhaps receiving is (no matter being correct or wrong) very little, and safety device 64 can be forbidden the data in the nonvolatile memory 62 are conducted interviews.Then, before content play can continue, safety device 64 needed by media player 58 release once more.If in one predetermined or configurable period, safety device 64 does not have accessed, it also will lock mmc card 56 so.
The computing of safety code is based on following data:
Last 4 bytes of the decoded identifying code of CRC-(verification and part)
The total amount of byte of byte number-from mmc card 56, read so far
Random number-one between 0 and half (every frame update 20 times, and 10 are half of 20 here) of every frame security update number of times between numeral
The computing that media player 58 is carried out is:
((CRC<<Mod32 (byte number)) XOR (byte number)) the * random number
This means identifying code verification and the part (CRC) by reading byte digital-to-analogue 32 to shifting left.The result carries out XOR with the byte number of reading.XOR comprises the bit in two numbers is applied to each XOR gate.The gained result multiply by random number.
The computing that safety device 64 in the mmc card 56 is carried out is:
((CRC<<Mod32 (byte number)) the XOR byte number)) * module frame size (frame number)
In this example, module frame size (frame number) is a frame number mould 1000, because frame sign is variable, that is, 1000, for example, 5032 become 0032.
Such result is that safety device 64 in the mmc card 56 is for the continuous checking of media player 58.This has prevented such situation, promptly may use false media player to extract content-data with available form; On the contrary, can only extract data in the mmc cards 56 by correct media player 58, it is for the use rendering content but do not allow content to be used as unauthorized copy is provided.Media player 58 sends this practical work of many error codes, make need to determine what computing to become difficult or impossible to the code of mmc card 56 transmissions to determine correct code by checking from media player 58, this has just improved fail safe, because the difficulty of using false media player to extract data from mmc card has increased greatly.
Use these features, safety device 64 can be used for determining whether external device, and it comprises the mobile device 40 that moves media player 58, can extract data from nonvolatile memory 62, thereby and allow or refusal to the visit of content-data.
Optionally mmc card 70 is shown in Figure 7.Here, storage and interface controller 63 are omitted.As an alternative, storage and interface controller are connected with safe set composite 71 and have the pin of connection 61 nonvolatile memories 62.This provides storage and interface controller 63 and safety device 64 identical function together, but also has some additional functions, as hereinafter narration.The advantage of this entity is to be included in than in the littler shell of the mmc card among Fig. 6 56.Since it has hardware still less, just can produce more cheaply.And storage and interface controller and safe set composite 71 do not need to support the nonvolatile memory with mmc card controller same type, so the parts flexibility is provided.
The host interface of storage and interface controller and safe set composite 71 mock standard mmc card controllers, thus be main process equipment, as mobile device 40, provide complete connectivity.It also supports security set and the safety verification of other host interface order to support some concrete main frame.71 pairs of storage and interface controller and safe set composites are written to all data of nonvolatile memory 62 and encrypt, and all data of reading nonvolatile memory 62 are decrypted.Like this, the data of mobile device 40 visit are not directly to read from nonvolatile memory 62, and on the contrary, data are decrypted in storage and interface controller and safe set composite 71, handle and buffer memory.
The partial data that main frame is visited is the result who handles, and for example safety device 64 is subsequently the information that host request compiled, or the state input, and as the safe condition data, it is used for again authenticating security or to user notification problem character by media player 58.
Storage and interface controller and safe set composite 71 can be realized with microcontrollers such as ASIC or FPGA.
Use the mmc card among Fig. 5 and Fig. 6, in the DRM file of DRM information stores in the zone of nonvolatile memory 62, this zone has been defined as the safety zone in the mmc card setting up procedure.Media player 58 can read but can not influence the DRM file, unless the specific DRM problem of time of occurrence.Safety device 64 or 71 is used to calculate the number of times of content play.If content has only been play a part, just count once broadcast to content.The number of times that content is played is recorded in the DRM file by safety device 64 or 71.Media player 58 can read but can not influence this information.The DRM file has indicated the maximum times that content-data can be played.
The DRM data are the expiration date or the validity date of content also.When media player 58 starts for the first time, it is cooperated with safety device 64 or 71, and the current time and date of mobile device 40 onboard clock (not shown) is written in the DRM file.If request play content, safety device 64 and 71 is determined the nearest time and date expired (being the time/date that is later than the record first time on current time and date to add the term of validity) that content can be play, safety device 64 or 71 and media player 58 between safety verification failure, appropriate information will convey to the user by display 46 so.When the maximum times that can be played at content-data reaches restriction, also identical situation can take place.Safety device 64 also writes in the DRM file determines the expired data of content.
If content out of date once after, perhaps time/the date of mobile device 40 is changed to the value of content before expired, safety device 64 or 71 can go out this situation by Data Detection out of date before determining content in the DRM file so.In this case, locked and need before the DRM release in content, can also allow content to be played predetermined times, as 5 times.This realizes by online verification.The clock setting mistake when if media player 58 starts first in the mobile device, this function just can be alleviated user's influence.
The online verification process connects the DRM servers from media player 58, go out as shown in Figure 5 80, this DRM server for example belongs to and is authorized to the entity that can present the content on the mmc card.DRM server 80 is known the setting of the mmc card 56 of all distribution.Connection can be undertaken by WAP or SMS or other any suitable method.If the DRM information on the DRM server can be used, the DRM server sends codes by media player 58 to safety device 64 or 71, this make code be verified and therefore the release content to play.This comprises renewal DRM file.Locked content can be by paying with release once more to more contents visit, and the means of payment can be passed through different approaches (web, wap (as Bango) and SMS).
If the content on mmc card 56 and 71 is locked, media player 58 will can not play this content-data.In this case, the user of mobile device 40 can for the content release to obtain more broadcast, for example by other payment.Payment can be carried out with any suitable method, for example uses WAP, and it is based on the payment services of webpage, or by utilizing phone and operator to consult.When payment is finished, DRM server 80 upgrades these information.When the user starts media player 58 subsequently and attempts to visit locked content, media player 58 is got in touch DRM server 80 in any suitable manner, server 80 sends PUK to mobile device 40, and media player 58 passes to safety device 64 or 71 with this PUK.Safety device 64 or 71 is verified these PUKs then, and upgrades the DRM file with the release content.
Although we say that mobile device is mobile (honeycomb) phone, it also can be a PDA(Personal Digital Assistant), and this PDA may have or not have the two way voice communication function.The present invention is chiefly directed on the equipment that is designed for other purposes audio-video frequency content is provided.Yet, the present invention also relates to special-purpose media player.
Same, though some aspect of the present invention is described at MMC56, this is optional.Except MMC, can also use the medium of other type that comprises nonvolatile memory and internal memory controller, wherein, the visit that is stored in the data on the memory is realized by interface.For example, can use and have USB or bluetooth TMThe perhaps memory devices of other interface.The shell of memory devices can be any suitable shape.
To on transferable medium, provide for the target mobile device of general kind at the film on the DVD and to use, perhaps even when on film will the target device at a plurality of peanuts of same pattern number, providing, utilization that can be useful system as shown in Figure 9.In Fig. 9, show first to the 3rd server 30,31,32.First server 30 is appointed as management node, be included in second with being connected of the 3rd server 31,32, the second and the 3rd server 31,32 constitutes child nodes.Among the server 30-32 each comprises that at least the first and second DVD drive 33.In this example, DVD need manually insert DVD and drive and therefrom remove, although can use robot or other automation tools to carry out this task as an alternative under the situation about needing.
Each server 30-32 extracts and changes film concurrently from the DVD that DVD drives 33.Can from single driving, sequentially extract film, that is, extract one by one.
Suppose that DVD drives 33 and has enough speed, server 30-32 has enough processing speeds, can finish in ten minutes DVD extraction and the processing procedure of a DVD.Therefore, in the film of gained, comprise the sequence number or the similar information of mobile device,, then need realize transfer process one time on this target device each particular target device so that this film can only be play.Should be appreciated that, only need carry out one time leaching process, extract in the cinematic data buffer because the film after extracting is stored in.
Film will be by under the situation of of a sort a plurality of target devices uses, and extraction and transfer process only need be carried out once.In case film is stored in the mobile form cinematic data zone 20 with mobile form, it just can repeatedly copy to mmc card or other detachable media equipment as required.This can carry out in any suitable manner, for example uses internal or external MMC to drive.
The setting that is used for management system installation particular process is positioned at ordinary file, for example, is arranged in/the etc/ subdirectory.The setting of product film is arranged in the database table that uses self-defining Postgres or oracle database, although according to scale and performance requirement, can use any other suitable data storehouse as an alternative.Operate in management system on the child node server 31,32 and the communication on first server 30.Management node 30 is responsible for Task Distribution.Each transfer process needs an example of management system.

Claims (73)

1, a kind of media player that is used for the decode content data, this media player is configured such that the positional information with excessive data identifies the position of the excessive data item in each of a plurality of content pieces of forming a described content-data part, remove described excessive data from described definite position, and the described content-data of after removing described excessive data, decoding.
2, media player as claimed in claim 1, the positional information of wherein said excessive data obtains by the passage that separates with described content-data source.
3, media player as claimed in claim 1 or 2, each appearance of wherein said excessive data all is a digital finger-print.
4, media player as claimed in claim 3, wherein said media player are used for the data whether definite data that form the part of authorization code comprise corresponding described digital finger-print, and only in response to determining the described content-data of decoding certainly.
5, media player as claimed in claim 4, wherein each described digital finger-print comprises identical data sequence concerning each appearance of described digital finger-print.
6, the described media player of any one claim as described above, wherein said media player is used for the data whether definite data that form the part of authorization code or described authorization code comprise the sequence number of corresponding described media player, and only in response to determining the described content-data of decoding certainly.
7, as any one the described media player among the claim 4-6, wherein said media player is used for deriving from described authorization code the positional information of described excessive data.
8, the described media player of any one claim as described above, wherein said media player is used to use pre-programmed message to identify the content piece at described excessive data place, and uses the positional information of described excessive data to determine the position of described excessive data in these content pieces.
9, a kind ofly provide the method for content item to terminal, this method comprises:
Content stream is delivered to terminal,
In described end, detect user's input that the indication user wants content item, described content item is one of following at least:
A) form the part of the content that described stream send, and
B) content with a part that forms the content that described stream send is relevant
In response to described user's input, send request from described terminal to server;
In response to receiving described request,
The described content item that identification is asked,
Determine whether the user has the right to use this content item, and
Provide content to obtain means to described terminal; And
Obtain means in response to receive described content in described terminal, control described terminal and use described content acquisition means to obtain described content item.
10, method as claimed in claim 9, wherein said request comprise the data of indicating the time of making described user's input.
11, as claim 9 or 10 described methods, wherein said content acquisition means comprise product code.
12, as any one the described method among the claim 9-11, wherein said content acquisition means comprise the payment resource localizer, and described terminal can be paid the permission that resource localizer obtains obtaining described content item by this.
13, method as claimed in claim 12 comprises automatically described terminal browser is pointed to described payment resource localizer.
14, as any one the described method among the claim 9-13, the described step that wherein provides content to obtain means comprises, in response at the described payment resource localizer of described server access, sends for example data of XML data.
15, method as claimed in claim 15 is wherein controlled described terminal and is used the described step of described content acquisition means to comprise, follows the instruction that forms a described data part automatically.
16, a kind of system comprises: server, terminal and content stream delivered to the device of described terminal,
Described terminal is used to respond user's input that the indication user wants content item, and described content item is one of following at least:
A) form the part of the content that described stream send, and
B) content with a part that forms the content that described stream send is relevant
Send request to described server;
Described server is in response to receiving described request, and the described content item that identification is asked determines whether described user has the right to use this content item, and provides content to obtain means to described terminal; And
Described terminal is used to use described content acquisition means to obtain described content item.
17, system as claimed in claim 16, wherein said terminal are used for comprising the data of indicating the time of making described user's input in described request.
18, as claim 16 or 17 described systems, wherein said content acquisition means comprise product code.
19, as any one the described system among the claim 16-18, wherein said content acquisition means comprise the payment resource localizer, and described terminal can be paid the permission that resource localizer obtains obtaining described content item by this.
20, system as claimed in claim 19, wherein said terminal are used for automatically the browser that comprises on the described terminal being pointed to described payment resource localizer.
21, as any one the described system among the claim 16-20, wherein said server is used in response to described payment resource localizer accessed, and for example sending, the data of XML data arrive described terminal.
22, system as claimed in claim 21, wherein said terminal are set to follow automatically the instruction that forms a described data part.
23, a kind of terminal comprises:
Receive the device of streaming content,
Want the user input of content item in response to the indication user, send the device of request to server, described content item is one of following at least: a) form the part of the content that described stream send, with b) relevant with the content of the part of the content sent of the described stream of formation;
Obtain means in response to received content, use described content acquisition means to obtain the device of described stream content item.
24, terminal as claimed in claim 23, wherein said terminal are used for comprising the data of indicating the time of making described user's input in described request.
25, as claim 23 or 24 described terminals, wherein said content acquisition means comprise the payment resource localizer, after described terminal is set to receive described payment resource localizer, automatically the browser that comprises on the described terminal is pointed to described payment resource localizer.
26, as any one the described terminal among the claim 23-25, wherein said terminal response is followed the instruction that forms a described data part automatically in the data that receive as the XML data.
27, a kind of method of operating terminal, this method comprises:
Receive the data that stream send,
Want the user input of content item to send request to server in response to the indication user, content item is one of following at least: a) form the part of the content that described stream send, with b) relevant with the content of the part of the content sent of the described stream of formation; And
Obtain means in response to received content, use described content acquisition means to obtain described content item.
28, method as claimed in claim 27 is included in and comprises in the described request that indication makes the data of the time of described user input.
29, as claim 27 or 28 described methods, wherein said content acquisition means comprise the payment resource localizer, and described terminal is pointed to described payment resource localizer with the browser that comprises on the described terminal after receiving described payment resource localizer automatically.
30, as any one the described method among the claim 27-29, comprise,, follow the instruction that forms a described data part automatically in response to receiving for example data of XML data.
31, a kind of computer program that comprises instruction, when carrying out this computer program with the processing unit on the terminal, it makes described terminal carry out any one the described method according to claim 27-30.
32, a kind of computer program comprises the computer-readable medium of storing computer program according to claim 31.
33, a kind of device that is used to be provided at the audio-video frequency content that reproduces on the mobile device, this device comprises:
Audio-video frequency content provides structure;
This device is set to write data to storage area, and these data comprise:
Audio-video frequency content;
Two or more media players; And
Loader,
Described loader is set at, when it is written into mobile device, it makes the configuration parameter of described mobile device be determined, and makes to make a media player selected based on the configuration parameter that is detected, and controls the media player that described mobile device uses described selection.
34, device as claimed in claim 33, wherein said loader is configured to control described mobile device and goes to detect it and whether comprised suitable media player, if detect suitable media player, be not from described memory area to described mobile device installation medium player, but this detected media player is used in control.
35, as claim 33 or 34 described devices, described two or more media players provide by independent configurable media-player software application program.
36, device as claimed in claim 35, wherein said loader are used to need to determine any media player, and operation forms the suitable software module of the part of described media-player software.
37, as claim 35 or 36 described devices, wherein said loader forms the part of described media-player software application program.
38, be stored in data on the portable medium or at least temporarily be arranged in the data of memory, these data comprise:
Audio-video frequency content;
Two or more media players; And
Loader,
Described loader is set at, when it is written into mobile device, it makes the configuration parameter of described mobile device be determined, and makes to make a media player selected based on the configuration parameter that is detected, and controls the media player that described mobile device uses described selection.
39, data as claimed in claim 38, wherein said loader is configured to control described mobile device and goes to detect it and whether comprised suitable media player, if detect suitable media player, be not from described data to described mobile device installation medium player, but this detected media player is used in control.
40, as claim 38 or 39 described data, wherein said two or more media players provide by independent configurable media-player software application program.
41, data as claimed in claim 40, wherein said loader are used to need to determine any media player, and operation forms the suitable software module of the part of described media-player software.
42, as claim 40 or 41 described data, wherein said loader forms the part of described media-player software application program.
43, a kind of method that is used to be provided at the audio-video frequency content that reproduces on the mobile device, this method comprises:
Write data to storage area, these data comprise:
Audio-video frequency content;
Two and a plurality of media players; And
Loader,
Described loader is set at, and makes mobile device determine the configuration parameter of described mobile device, selects a media player based on the configuration parameter that is detected, and controls the media player that described mobile device uses described selection.
44, method as claimed in claim 43, wherein said loader is used for controlling mobile equipment and whether has comprised suitable media player to detect it, if detect suitable media player, be not from described storage area to described mobile device installation medium player, but this detected media player is used in control.
45, as claim 43 or 44 described methods, wherein said two or more media players provide by independent configurable media-player software application program.
46, method as claimed in claim 45, wherein said loader are used to need to determine any media player, and operation forms the suitable software module of the part of described media-player software.
47, as claim 45 or 46 described methods, wherein said loader forms the part of described media-player software application program.
48, a kind of method of operating mobile device, this method comprises:
Storage audio-video frequency content data and two or more media player on built-in and/or external memory;
Determine the configuration parameter of described mobile device;
Select a media player based on detected configuration parameter, and
Use the media player of described selection to play described audio-video frequency content data.
49, method as claimed in claim 48, loader is controlled described mobile device and whether has been comprised suitable media player to detect it, if detect suitable media player, be not from described storage area to described mobile device installation medium player, but this detected media player is used in control.
50, as claim 48 or 49 described methods, wherein said two or more media players provide by independent configurable media-player software application program.
51, method as claimed in claim 50, wherein said loader need to determine any media player, and operation forms the suitable software module of the part of described media-player software.
52, as claim 50 or 51 described methods, wherein said loader forms the part of described media-player software application program.
53, a kind of portable data storage medium comprises:
Nonvolatile memory wherein stores the data that comprise the computer-readable instruction that forms media player;
Interface comprises the terminal that is used to be connected to external device;
Controller is used for from described nonvolatile memory reading of data and with the described interface of data feed-in; And
Safety device,
Wherein, when described media player moves on external device, it is used for described safety device mutual, make described safety device can determine whether described media player has the right to visit the content-data in the described nonvolatile memory, and described safety device correspondingly allows or the described content-data of disable access.
54, portable data storage medium as claimed in claim 53, the data terminal of wherein said controller is connected to described interface by described safety device.
55, portable data storage medium as claimed in claim 53, wherein said safety device and described controller are integrated.
56, portable data storage medium as claimed in claim 55, wherein said controller and safety device are used to decipher the content-data of reading from described nonvolatile memory.
57, as any one the described portable data storage medium among the claim 53-56, wherein said controller also is used for described data are written to described nonvolatile memory from described interface.
58, as any one the described portable data storage medium among the claim 53-57, when wherein said media player moves on external device, it is used to detect the configuration parameter of described external device, and controls the function of described media player according to described detected configuration parameter.
59, as any one the described portable data storage medium among the claim 53-58, when wherein said media player moves on external device, it is used for determining the display characteristic of described equipment, and selects the direction of video content reproduction according to described detected display characteristic.
60, portable data storage medium as claimed in claim 61 also comprises the controlled function of one or more keys of the described external device that depends on selected direction.
61, as any one the described portable data storage medium among the claim 53-60, wherein said media player is used for verifying described data storage medium by the identifying code that receives from described data storage medium is carried out computing.
62, as any one the described portable data storage medium among the claim 53-61, wherein said safety device is used for by receiving code and determining that at least once receiving effective code in each predetermined time interval or data cell determines the described external device accessed content data of whether having the right.
63, as any one the described portable data storage medium among the claim 53-62, wherein said safety device is used for preserving managing entitlement data, the broadcast enable state of the data represented described content-data of this managing entitlement at described nonvolatile storage.
64, portable data storage medium as claimed in claim 62, wherein said safety device are used to use the data of the chance number of times that the described content-data of sign is played to upgrade described managing entitlement data.
65, as claim 62 or 63 described portable data storage mediums, wherein said safety device is used to store the time that the described content-data of representative is played for the first time and/or the managing entitlement data on date.
66, as any one the described portable data storage medium among the claim 53-65, wherein said safety device is in response to scheduled time sequence or predetermined command and enter enable mode.
67, as any one the described portable data storage medium among the claim 53-66; wherein said safety device is used for according to determining whether described external equipment has authority; allow or refuse visit to content-data; described content-data is stored in the appointment protection zone of described nonvolatile memory, and does not refuse the visit to the content-data in the not protection zone of described nonvolatile memory.
68, as any one the described portable data storage medium among the claim 53-67, wherein said safety device is used for expiring in the term of validity of determining described content-data, lock described content-data when perhaps having reached the predetermined restriction of chance number of times that content-data plays, prevent to visit described content-data thus.
69, as any one the described portable data storage medium among the claim 65-68, wherein said safety device is used for using the described managing entitlement data of the overdue Data Update of the instruction content data term of validity when the described term of validity of determining described content-data has expired.
70, as claim 68 or 69 described portable data storage mediums, wherein said safety device is in response to receiving the described content-data of PUK release to play subsequently.
71, as claim 17 and 18 described portable data storage mediums, wherein said safety device suitably upgrades described managing entitlement data in response to receiving described PUK.
72, as any one the described portable data storage medium among the claim 53-71, wherein said safety device is in response to the request of the blocked content-data of visit, communication channel visit remote server by described external device, and after receiving PUK the described content-data of release to play subsequently.
73, as any one the described portable data storage medium among the claim 53-74, wherein said nonvolatile memory stores the data that comprise the computer-readable instruction that forms two or more media players and loader therein, when described loader moves on external device, it is used for determining the configuration parameter of described equipment, select in the described media player one based on the configuration parameter of described detection, and control the media player that described mobile device moves described selection.
CNA2005800275535A 2004-06-14 2005-06-14 Medium player Pending CN101073263A (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
GB0413231.2 2004-06-14
GB0413231A GB2410146B (en) 2004-06-14 2004-06-14 Providing audio-visual content
GB0423761.6 2004-10-26
GB0504013.4 2005-02-25

Publications (1)

Publication Number Publication Date
CN101073263A true CN101073263A (en) 2007-11-14

Family

ID=32732454

Family Applications (1)

Application Number Title Priority Date Filing Date
CNA2005800275535A Pending CN101073263A (en) 2004-06-14 2005-06-14 Medium player

Country Status (3)

Country Link
CN (1) CN101073263A (en)
GB (3) GB2410146B (en)
RU (1) RU2007101296A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103748531A (en) * 2011-04-21 2014-04-23 塔奇斯特尔姆技术有限公司 Play control of content on a display device
WO2018176734A1 (en) * 2017-03-27 2018-10-04 华为技术有限公司 Data processing method and terminal
CN113141380A (en) * 2016-12-14 2021-07-20 微软技术许可有限责任公司 Encoding optimization for obfuscated media

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU1265195A (en) * 1993-12-06 1995-06-27 Telequip Corporation Secure computer memory card
US6618789B1 (en) * 1999-04-07 2003-09-09 Sony Corporation Security memory card compatible with secure and non-secure data processing systems
JP3389186B2 (en) * 1999-04-27 2003-03-24 松下電器産業株式会社 Semiconductor memory card and reading device
GB0008501D0 (en) * 2000-04-07 2000-05-24 Hunt Simon J Mixed video streaming and push technology distribution system for mobile users
US7190976B2 (en) * 2000-10-02 2007-03-13 Microsoft Corporation Customizing the display of a mobile computing device
US20020151327A1 (en) * 2000-12-22 2002-10-17 David Levitt Program selector and guide system and method
JP2003087704A (en) * 2001-09-12 2003-03-20 Kenwood Corp On-vehicle optical disk reproduction system, on-vehicle optical disk reproducing device, converter, and information communication terminal
JP2003230117A (en) * 2002-01-31 2003-08-15 Nec Commun Syst Ltd Transmission system, transmission device, transmission scheme and transmission method for dynamic image data
JP2003298744A (en) * 2002-03-29 2003-10-17 Canon Inc Communication controller, gateway, information holder, information delivery system, communication control method, program and storing medium

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103748531A (en) * 2011-04-21 2014-04-23 塔奇斯特尔姆技术有限公司 Play control of content on a display device
CN113141380A (en) * 2016-12-14 2021-07-20 微软技术许可有限责任公司 Encoding optimization for obfuscated media
WO2018176734A1 (en) * 2017-03-27 2018-10-04 华为技术有限公司 Data processing method and terminal

Also Published As

Publication number Publication date
GB2410817A (en) 2005-08-10
RU2007101296A (en) 2008-07-27
GB0413231D0 (en) 2004-07-14
GB2410817B (en) 2006-01-11
GB2410146A (en) 2005-07-20
GB0423761D0 (en) 2004-12-01
GB2421394B (en) 2007-03-21
GB2421394A (en) 2006-06-21
GB2410146B (en) 2007-03-14
GB0602328D0 (en) 2006-03-15

Similar Documents

Publication Publication Date Title
CN1272930C (en) Recording of encrypted digital data
US20070288715A1 (en) Media Player
US20060195909A1 (en) Media player operable to decode content data
CN100476683C (en) Equipment for processing data, receiver and decoder thereof
CN100479046C (en) Information management method, information reproduction apparatus, and information management apparatus
CN101253566B (en) Multimedia service system and method based on the integrated multimedia format structure
US20080008319A1 (en) Method and system for security of data transmissions
CN100561493C (en) Method for supervising and supervising device that digital multimedia content is play
CN1825456B (en) Digital information recording apparatus and recording/reproducing apparatus
CN101945249B (en) Process stream in can recorded content
CN101945248A (en) But handle the recorded content in the stream
JP5357263B2 (en) Content receiving apparatus and content output method
US20040088183A1 (en) Computer-readable information storage medium having content-data stored therein and content charging system
KR20060048949A (en) Method of providing access to encrypted content to one of a plurality of consumer systems, device for providing access to encrypted content and method of generating a secure content package
KR20060048948A (en) Method of providing rights data objects
CN103514351A (en) Method, device and system for editing multi-media file
JPWO2011132333A1 (en) Content receiving apparatus and content distribution system
CN101843109A (en) The method of deal with data and IPTV receiving equipment
CN102025490A (en) File segmental protection method, device and system
CN101124825B (en) Method and apparatus for secure transfer and playback of multimedia content
CN103597842A (en) Content receiver and content information output method
CN102291598B (en) Controllable license management method of digital television hardware function
US7657743B2 (en) Information viewing/listening system
CN101073263A (en) Medium player
CN101719198A (en) Method and system for processing forward- locked drm contents, and portable device adapted thereto

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Open date: 20071114