Embodiment
Below in conjunction with accompanying drawing the present invention is described in further detail.
Fig. 1 illustrates the equipment schematic diagram of network multimedia file that is used to play multiple encapsulation format according to one aspect of the invention, and wherein, built-in terminal 1 comprises deriving means 11, checkout gear 12, first conversion equipment 13 and first playing device 14.At this; built-in terminal can be anyly can implant embedded system and can pass through keyboard with the user; mouse; remote controller; mode such as touch-screen or hand-written equipment is carried out the electronic product of man-machine interaction; include but not limited to mobile phone; electronic dictionary; video telephone; digital camera (DC); digital camera (DV); set-top box (Set Top Box); HDTV (High-Definition Television) (HDTV); game machine; intelligent toy; appliance control system etc.; those skilled in the art will be understood that above-mentioned built-in terminal is only for giving an example; other built-in terminals existing or that may occur from now on are as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
Deriving means 11 is used for obtaining the multimedia file with first encapsulation format by network.Particularly, deriving means 11 is by network, and server or third-party server from content supplier obtain the multimedia file with first encapsulation format.At this, network includes but not limited to the Internet, wide area network, metropolitan area network, local area network (LAN), VPN network, wireless self-organization network (Ad Hoc network) etc.; The server of content supplier or third-party server include but not limited to web server, streaming media server etc.Those skilled in the art will be understood that above-mentioned network or server only for giving an example, and other networks existing or that may occur from now on or server also should be included in the protection range of the present invention as applicable to the present invention, and are contained in this at this with way of reference.In addition, described obtain manner with multimedia file of first encapsulation format includes but not limited to, HTTP mode, FTP mode, RTSP mode, MMS mode or P2P mode.For example, built-in terminal 1 not only can be browsed generic web page by browser, also can login video website or other websites, by http protocol access browsing video webpage, obtains hyperlink multimedia file pointed in this video webpage.And for example, deriving means 11 in the built-in terminal 1 obtains multichannel P2P video file from network, these multi-channel video files comprise the video file of separate sources, a plurality of fragments of a video file of separate sources (separate sources film for example, perhaps a plurality of fragments of this film of composition of separate sources), deriving means 11 carries out ensuing operation for other devices of built-in terminal 1 fragment delivery of the video file of specific video file or special time more then.At this; those skilled in the art will be understood that above-mentioned several obtain manner with multimedia file of first encapsulation format only is for example; the obtain manner of other existing or multimedia files with first encapsulation format that may occur from now on is as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.At this, multimedia file includes but not limited to that audio file, video file, picture file etc. can be by the digital documents of player plays.Those skilled in the art will be understood that above-mentioned several multimedia file only for giving an example, and other multimedia files existing or that may occur from now on also should be included in the protection range of the present invention as applicable to the present invention, and are contained in this at this with way of reference.
Whether checkout gear 12 is used to detect described first encapsulation format and is complementary with the support format list of built-in terminal.Particularly, the multimedia file that checkout gear 12 obtains according to deriving means 11 with first encapsulation format, detect first encapsulation format of this multimedia file, for example according to the extension name of this multimedia file, characteristic information such as characteristic signature or metadata, determine first encapsulation format of this multimedia file, after this, support format list with described first encapsulation format and built-in terminal compares again, whether detect described first encapsulation format and be complementary with the support format list of built-in terminal, whether for example described first encapsulation format is contained in this support format list.To expand example by name, the encapsulation format of the multimedia file correspondence of expansion " flv " by name is " FLV "; But the corresponding identical encapsulation format of different extension name possibility, for example the encapsulation format that " asf " and " wmv " is corresponding is " ASF ".At this; the extension name of multimedia file includes but not limited to " mp3 ", " mp4 ", " avi ", " flv ", " mov ", " rmvb ", " rm ", " asf ", " wmv " or " mkv " etc.; those skilled in the art will be understood that the extension name of above-mentioned several multimedia files is only for giving an example; the extension name of other multimedia files existing or that may occur from now on is as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.At this; the encapsulation format of multimedia file includes but not limited to " MP3 ", " MP4 ", " AVI ", " FLV ", " QuickTime ", " RMVB ", " RM ", " ASF " or " MKV "; those skilled in the art will be understood that the encapsulation format of above-mentioned several multimedia files is only for giving an example; the encapsulation format of other multimedia files existing or that may occur from now on is as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.Whether checkout gear 12 is according to first encapsulation format of described multimedia file, compares with the support format list of built-in terminal, detect described first encapsulation format and be complementary with the support format list of built-in terminal.At this, support to store the encapsulation format that described built-in terminal is supported in the format list encapsulation format of the multimedia file of the broadcast that can directly on this built-in terminal, be well on; Cause the multimedia file that can't play on this built-in terminal for not matching because of encapsulation format, its encapsulation format does not then match with this support format list.Those skilled in the art will be understood that mode that whether described first encapsulation format of above-mentioned detection be complementary with the support format list of built-in terminal is only for for example; the mode whether described first encapsulation format of other detections existing or that may occur from now on is complementary with the support format list of built-in terminal is as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.Preferably, because browser execution is in application layer, its support be JS, HTML, scripts such as XML, and the CPU of built-in terminal 1, decoding chips etc. are positioned at bottom, it supports code speechs such as C language, can't directly call above-mentioned script, therefore, deriving means 11 can also call modes such as described application programming interfaces (API) or socket (Socket) interface by one or many, the multimedia file with first encapsulation format that is obtained is passed to checkout gear 12, whether is complementary with the support format list of built-in terminal to detect described first encapsulation format.
First conversion equipment 13 is used for when described first encapsulation format and described support format list are not complementary, according to the format conversion storehouse, described multimedia file is carried out format conversion processing, to obtain to have the multimedia file of second encapsulation format, wherein, described second encapsulation format and described support format list are complementary.Particularly, when detecting described first encapsulation format and described support format list by checkout gear 12 when not being complementary, first conversion equipment 13 is according to the format conversion storehouse, obtain the format conversion information of described first encapsulation format, the packaging information of this first encapsulation format for example, decapsulation information etc., and according to described format conversion information, by modes such as decapsulation-encapsulation process, described multimedia file is carried out format conversion processing, to obtain to have the multimedia file of second encapsulation format, wherein, described second encapsulation format and described support format list are complementary, that is, described built-in terminal can be play-overed the multimedia file with described second encapsulation format.For example, first conversion equipment 13 is according to the format conversion storehouse, use by calling (calling or far call) or loading and call corresponding decapsulation as this locality, the decapsulation multimedia file, thus obtain one or more coding unit sequence flows after this multimedia file decapsulation.At this, the coding unit sequence flows includes but not limited to audio coding unit sequence flows, video encoding unit sequence flows or both combinations.For example, suppose that checkout gear 12 is after first encapsulation format that detects multimedia file is for " MKV ", call with the corresponding decapsulation of " MKV " form and use, behind this multimedia file of decapsulation, obtain an audio coding unit sequence flows and a video encoding unit sequence flows in this multimedia file.Those skilled in the art will be understood that above-mentioned several coding unit sequence flows is only for giving an example; other coding unit sequence flows existing or that may occur from now on are as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.After this, one or more coding unit sequence flows that first conversion equipment 13 obtains according to decapsulation again, according to second encapsulation format in the described support format list, described one or more coding unit sequence flows are packaged into the multimedia file with second encapsulation format, to finish the format conversion operation of described multimedia file.For example, suppose that multimedia file first encapsulation format is " FLV ", after its decapsulation, obtain an audio coding unit sequence flows and a video encoding unit sequence flows, at this moment, second encapsulation format that built-in terminal 1 is supported is " AVI ", so, first conversion equipment 13 encapsulates this audio coding unit sequence flows and the video encoding unit sequence flows form according to " AVI ", thereby finishes the conversion of encapsulation format from " FLV " to " AVI " of this multimedia file.Those skilled in the art will be understood that the above-mentioned mode that multimedia file is carried out format conversion processing is only for for example; other existing or modes of multimedia file being carried out format conversion processing that may occur from now on are as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
First playing device 14 is used to decode and plays described multimedia file with second encapsulation format.Particularly, first playing device 14 carries out the multimedia file with second encapsulation format that obtained after the conversion process according to first conversion equipment 13, by wherein coding unit sequence flows is decompressed, then according to audio coding unit and video encoding unit in this coding unit sequence flows of the temporal information synchronous playing in this coding unit sequence flows.For example, first playing device 14 its receive with first conversion equipment 13 conversion back obtain have the multimedia file of second encapsulation format time, for example by the decoding chip in the built-in terminal 1, to coding unit sequence flows decompression wherein, from the temporal information of coding unit sequence flows, obtain the timestamp of audio coding unit and video encoding unit, realize the synchronous playing of audio coding unit and video encoding unit then according to this timestamp.Those skilled in the art will be understood that the method for synchronization of above-mentioned audio coding unit and video encoding unit is only for giving an example; the method of synchronization of other audio coding units existing or that may occur from now on and video encoding unit is as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.Those skilled in the art will be understood that it only is for example that described mode with multimedia file of second encapsulation format is play in above-mentioned decoding; the mode that described multimedia file with second encapsulation format is play in other decodings existing or that may occur from now on is as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
Preferably, be constant work between each device of built-in terminal 1.Particularly, deriving means 11 obtains the multimedia file with first encapsulation format by network; Whether checkout gear 12 detects described first encapsulation format and is complementary with the support format list of built-in terminal; When described first encapsulation format and described support format list are not complementary, first conversion equipment 13 is according to the format conversion storehouse, described multimedia file is carried out format conversion processing, to obtain to have the multimedia file of second encapsulation format, wherein, described second encapsulation format and described support format list are complementary; Described multimedia file with second encapsulation format is play in 14 decodings of first playing device.At this, it will be understood by those skilled in the art that each device that " continuing " be meant built-in terminal 1 respectively according to the mode of operation of setting or adjust in real time require to have the obtaining of multimedia file, first encapsulation format of first encapsulation format detection and conversion, have the decoding broadcast of the multimedia file of second encapsulation format, stop in a long time obtaining multimedia file until deriving means 11 with first encapsulation format by network.
Preferably, built-in terminal 1 can also comprise the second playing device (not shown).Described second playing device is used for when described first encapsulation format and described support format list are complementary, to the broadcast of decoding of described multimedia file.Particularly, when checkout gear 12 detects described first encapsulation format and described support format list when being complementary, second playing device is by decompressing to described coding unit sequence flows with multimedia file of first encapsulation format, then according to audio coding unit and video encoding unit in this coding unit sequence flows of the temporal information synchronous playing in this coding unit sequence flows, to the broadcast of decoding of described multimedia file.For example, second playing device decompresses described coding unit sequence flows with multimedia file of first encapsulation format, from the temporal information of coding unit sequence flows, obtain the timestamp of audio coding unit and video encoding unit, realize the synchronous playing of audio coding unit and video encoding unit then according to this timestamp.Those skilled in the art will be understood that the method for synchronization of above-mentioned audio coding unit and video encoding unit is only for giving an example; the method of synchronization of other audio coding units existing or that may occur from now on and video encoding unit is as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.Those skilled in the art will be understood that also it only is for example that described mode with multimedia file of first encapsulation format is play in above-mentioned decoding; the mode that described multimedia file with first encapsulation format is play in other decodings existing or that may occur from now on is as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
Those skilled in the art will be understood that above-mentioned first playing device and second playing device only are example, and in practice, they can be two independently modules, also can all be integrated in the module.
Preferably, first conversion equipment 13 also is used for when described first encapsulation format and described support format list are not complementary, and according to described format conversion storehouse, described multimedia file is carried out decapsulation handle, to obtain not have the multimedia file of encapsulation; According to described support format list, select second encapsulation format of described multimedia file, wherein, described second encapsulation format and described support format list are complementary; According to described second encapsulation format, the multimedia file that described nothing is encapsulated carries out the form encapsulation process, to obtain to have the multimedia file of second encapsulation format.Particularly, when detecting described first encapsulation format and described support format list by checkout gear 12 when not being complementary, first conversion equipment 13 is according to described format conversion storehouse, obtain the format conversion information of described first encapsulation format, the packaging information of this first encapsulation format for example, decapsulation information etc., and according to described format conversion information, use by calling (calling or far call) or loading and call corresponding decapsulation as this locality, described multimedia file is carried out decapsulation to be handled, to obtain not have the multimedia file of encapsulation, for example one or more coding unit sequence flows; After this, second encapsulation format that first conversion equipment 13 is supported according to the decoding chip of described built-in terminal again, mode such as for example from support format list, select, select second encapsulation format of described multimedia file, wherein, described second encapsulation format and described support format list are complementary; Then, described first conversion equipment 13 is again according to described second encapsulation format, the multimedia file of described nothing encapsulation is carried out the form encapsulation process, to obtain to have the multimedia file of second encapsulation format, for example described one or more coding unit sequence flows are packaged into the multimedia file with second encapsulation format.At this, the coding unit sequence flows includes but not limited to audio coding unit sequence flows, video encoding unit sequence flows or both combinations.For example, suppose that checkout gear 12 is after first encapsulation format that detects multimedia file is for " MKV ", first conversion equipment 13 calls with the corresponding decapsulation of " MKV " form and uses, behind this multimedia file of decapsulation, obtain an audio coding unit sequence flows and a video encoding unit sequence flows in this multimedia file.Those skilled in the art will be understood that above-mentioned several coding unit sequence flows is only for giving an example; other coding unit sequence flows existing or that may occur from now on are as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.For example, suppose that multimedia file first encapsulation format is " FLV ", after its decapsulation, obtain an audio coding unit sequence flows and a video encoding unit sequence flows, at this moment, second encapsulation format that built-in terminal 1 is supported is " AVI ", so, first conversion equipment 13 encapsulates this audio coding unit sequence flows and the video encoding unit sequence flows form according to " AVI ", thereby finishes the conversion of encapsulation format from " FLV " to " AVI " of this multimedia file.Those skilled in the art will be understood that the above-mentioned mode that multimedia file is carried out format conversion processing is only for for example; other existing or modes of multimedia file being carried out format conversion processing that may occur from now on are as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
(with reference to Fig. 1) in a preferred embodiment, described format conversion storehouse comprises the native format transformation warehouse; Wherein, described first conversion equipment 13 also is used for when described first encapsulation format and described support format list are not complementary, according to described native format transformation warehouse, described multimedia file is carried out format conversion processing, to obtain to have the multimedia file of second encapsulation format, wherein, described second encapsulation format and described support format list are complementary.Particularly, when described format conversion storehouse comprised the native format transformation warehouse, described format conversion storehouse was kept at local side, and promptly built-in terminal wherein stores format conversion information, for example the packaging information of encapsulation format, decapsulation information etc.When checkout gear 12 detects described first encapsulation format and described support format list when not being complementary, first conversion equipment 13 is according to the native format transformation warehouse, obtain the format conversion information of described first encapsulation format, for example this first encapsulation format is stored in local packaging information, decapsulation information etc., and according to described format conversion information, by modes such as decapsulation-encapsulation process, described multimedia file is carried out format conversion processing, to obtain to have the multimedia file of second encapsulation format, wherein, described second encapsulation format and described support format list are complementary.Those skilled in the art will be understood that the above-mentioned mode that multimedia file is carried out format conversion processing is only for for example; other existing or modes of multimedia file being carried out format conversion processing that may occur from now on are as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
Fig. 2 illustrates the system topological figure of network multimedia file that is used to play multiple encapsulation format according to one aspect of the invention; Comprising the network equipment 2 and a plurality of built-in terminal 1 that is connected via network with it.Wherein, the network equipment 2 can be connected via network with a plurality of built-in terminal 1, and be received from the format conversion request that built-in terminal 1 sends about described multimedia file, wherein, described format conversion request comprises the support format list of described built-in terminal; According to the network format transformation warehouse, described multimedia file is carried out format conversion processing, to obtain to have the multimedia file of second encapsulation format, wherein, described second encapsulation format and described support format list are complementary; Send the multimedia file that is obtained based on described format conversion request to described built-in terminal 1 with second encapsulation format.At this, network includes but not limited to the Internet, wide area network, metropolitan area network, local area network (LAN), VPN network, wireless self-organization network (Ad Hoc network) etc.
In addition, the network equipment 2 includes but not limited to the cloud that network host, single network server, a plurality of webserver collection or a plurality of server constitute.At this, cloud is by constituting based on a large amount of computers of cloud computing (Cloud Computing) or the webserver, and wherein, cloud computing is a kind of of Distributed Calculation, a super virtual machine of being made up of the loosely-coupled computer collection of a group.And built-in terminal 1 includes but not limited to any electronic product that can implant embedded system and can carry out man-machine interaction by modes such as keyboard, mouse, remote controller, touch-screen or hand-written equipment with the user, for example mobile phone, electronic dictionary, video telephone, digital camera (DC), digital camera (DV), set-top box (Set Top Box), HDTV (High-Definition Television) (HDTV), game machine, intelligent toy, appliance control system etc.Communicating by letter between the network equipment 2 and the built-in terminal 1 is separate, includes but not limited to based on the packet data transmission such as ICP/IP protocol, udp protocol etc.
Those skilled in the art will be understood that the above-mentioned network equipment 2, built-in terminal 1 and connection network or communication mode therebetween only is for example; other network equipments existing or that may occur from now on, built-in terminal or network, communication mode are as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
Those skilled in the art also will be understood that, the quantity of the disparate networks element that only illustrates for simplicity's sake among Fig. 2 may be less than the quantity in the real network, but this omission far and away with can not influence to the present invention carry out clear, be disclosed as prerequisite fully.
For simplicity's sake, be that example is described with a built-in terminal 1 below.Those skilled in the art will be understood that, the network equipment 2 is can be simultaneously mutual with a plurality of built-in terminal 1, and be received from the format conversion request that different built-in terminals 1 send about described multimedia file, wherein, described format conversion request comprises the support format list of described built-in terminal; According to the network format transformation warehouse, described multimedia file is carried out format conversion processing, to obtain to have the multimedia file of second encapsulation format, wherein, described second encapsulation format and described support format list are complementary; Send the multimedia file that is obtained based on described format conversion request to corresponding built-in terminal 1 with second encapsulation format.
Fig. 3 illustrates the equipment schematic diagram of network multimedia file that is used to play multiple encapsulation format in accordance with a preferred embodiment of the present invention.Built-in terminal 1 comprises deriving means 11 ', checkout gear 12 ', first conversion equipment 13 ' and first playing device 14 '; The network equipment 2 comprises receiving system 21 ', second conversion equipment 22 ' and first dispensing device 23 '.Wherein, the deriving means 11 ' in the built-in terminal 1, checkout gear 12 ' and first playing device 14 ' are identical with corresponding intrument shown in Figure 1 respectively, so locate to repeat no more, and mode by reference is contained in this.
Work in coordination between each device in the built-in terminal 1 and the network equipment 2, to finish the network multimedia file of playing multiple encapsulation format.Particularly, when described format conversion storehouse comprises network format transformation warehouse in the network equipment, and when described first encapsulation format and described support format list are not complementary, first conversion equipment 13 ' in the built-in terminal 1 is to the format conversion request of described network equipment transmission about described multimedia file, and wherein said format conversion request comprises described support format list.Receiving system 21 ' in the network equipment 2 is received from the format conversion request about described multimedia file that built-in terminal sends, and wherein, described format conversion request comprises the support format list of described built-in terminal; Second conversion equipment 22 ' carries out format conversion processing according to the network format transformation warehouse with described multimedia file, and to obtain to have the multimedia file of second encapsulation format, wherein, described second encapsulation format and described support format list are complementary; First dispensing device 23 ' sends the multimedia file with second encapsulation format that is obtained based on described format conversion request to described built-in terminal.What first conversion equipment 13 ' in the built-in terminal 1 was received from that the described network equipment sends obtains to have the multimedia file of second encapsulation format based on described format conversion request according to described network format transformation warehouse, wherein, described second encapsulation format and described support format list are complementary.Preferably, be constant work between above-mentioned each device.At this, it will be understood by those skilled in the art that " continuing " is meant that above-mentioned each device requires to operate accordingly according to the mode of operation of setting or adjust in real time respectively.
More specifically, when described format conversion storehouse comprises network format transformation warehouse in the network equipment, and when described first encapsulation format and described support format list are not complementary; First conversion equipment 13 ' in the described built-in terminal 1 in real time or answer Event triggered ground, call the application programming interfaces (API) that the network equipment 2 provided or the communication mode of other agreements by one or many, to the format conversion request that the described network equipment 2 sends about described multimedia file, wherein said format conversion request comprises described support format list; After this, what be received from that the described network equipment 2 sends obtains to have the multimedia file of second encapsulation format based on described format conversion request according to described network format transformation warehouse, for example receive multimedia file with second encapsulation format by the communication mode transmission of the API described in the precedent or other agreements, wherein, described second encapsulation format and described support format list are complementary.Those skilled in the art will be understood that above-mentioned transmission format conversion request mode is only for giving an example; other transmission format conversion request mode existing or that may occur from now on are as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.Those skilled in the art will be understood that also above-mentioned reception has the mode of multimedia file of second encapsulation format only for for example; other receptions existing or that may occur from now on have the mode of multimedia file of second encapsulation format as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
Receiving system 21 ' in the network equipment 2 is received from the format conversion request about described multimedia file that built-in terminal sends, for example receive the format conversion request of the described multimedia file of the communication mode transmission of passing through the API described in the precedent or other agreements, wherein, described format conversion request comprises the support format list of described built-in terminal.
Second conversion equipment 22 ' is according to the network format transformation warehouse, obtain the format conversion information of described first encapsulation format, for example be stored in the packaging information of this first encapsulation format of network terminal, decapsulation information etc., and according to described format conversion information, support format list in conjunction with built-in terminal 1 included in the format conversion request that receiving system 21 ' received, by modes such as decapsulation-encapsulation process, described multimedia file is carried out format conversion processing, to obtain to have the multimedia file of second encapsulation format, wherein, described second encapsulation format and described support format list are complementary.
First dispensing device 23 ' in real time or answer Event triggered ground, call the application programming interfaces (API) that built-in terminal 1 provided or the communication mode of other agreements by one or many, send the multimedia file that is obtained based on described format conversion request to described built-in terminal with second encapsulation format.
In a preferred embodiment, described second conversion equipment 22 ' also is used for according to described network format transformation warehouse, described multimedia file is carried out decapsulation handle, to obtain not have the multimedia file of encapsulation; According to described support format list, select second encapsulation format of described multimedia file, wherein, described second encapsulation format and described support format list are complementary; According to described second encapsulation format, the multimedia file that described nothing is encapsulated carries out the form encapsulation process, to obtain to have the multimedia file of second encapsulation format.Particularly, second conversion equipment 22 ' is according to described network format transformation warehouse, obtain the format conversion information of described first encapsulation format, for example be stored in packaging information, decapsulation information of this first encapsulation format of network terminal etc., and according to described format conversion information, use by calling or load and call corresponding decapsulation, described multimedia file is carried out decapsulation handle, to obtain not have the multimedia file of encapsulation, for example one or more coding unit sequence flows; After this, second conversion equipment 22 ' is again according to the support format list of built-in terminal 1 included in the format conversion request that receiving system 21 ' received, mode such as for example from support format list, select, select second encapsulation format of described multimedia file, wherein, described second encapsulation format and described support format list are complementary; Then, described second conversion equipment 22 ' is again according to described second encapsulation format, the multimedia file of described nothing encapsulation is carried out the form encapsulation process, to obtain to have the multimedia file of second encapsulation format, for example described one or more coding unit sequence flows are packaged into the multimedia file with second encapsulation format.At this, the coding unit sequence flows includes but not limited to audio coding unit sequence flows, video encoding unit sequence flows or both combinations.Those skilled in the art will be understood that the above-mentioned mode that multimedia file is carried out format conversion processing is only for for example; other existing or modes of multimedia file being carried out format conversion processing that may occur from now on are as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
Preferably, the network equipment 2 can also comprise the second dispensing device (not shown), and built-in terminal 1 can also comprise the updating device (not shown).Described second dispensing device is used for to the format conversion information of described built-in terminal transmission based on described network format transformation warehouse.Described updating device is used for when described format conversion storehouse also comprises the native format transformation warehouse, is received from the format conversion information based on described network format transformation warehouse that the described network equipment sends; According to described format conversion information, set up or upgrade described native format transformation warehouse.Particularly, second dispensing device in the network equipment 2 in real time or answer Event triggered ground, call the application programming interfaces (API) that built-in terminal 1 provides or the communication mode of other agreements by one or many, send format conversion information based on described network format transformation warehouse to described built-in terminal.When described format conversion storehouse also comprises the native format transformation warehouse, updating device in the built-in terminal 1 is received from the format conversion information based on described network format transformation warehouse that the described network equipment sends, for example receive the format conversion information of the described network format transformation warehouse that the communication mode by the API described in the precedent or other agreements transmits, for example encapsulation format is stored in the packaging information, decapsulation information of network terminal etc.; After this, updating device is again according to described format conversion information, by modes such as database updates, sets up or upgrades described native format transformation warehouse.Those skilled in the art will be understood that the mode of above-mentioned renewal native format transformation warehouse is only for giving an example; the mode of other renewal native format transformation warehouses existing or that may occur from now on is as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
Those skilled in the art will be understood that above-mentioned first dispensing device and second dispensing device only are example, and in practice, they can be two independently modules, also can all be integrated in the module.
Fig. 4 illustrates the method flow diagram of network multimedia file that is used to play multiple encapsulation format according to a further aspect of the present invention.
Wherein, in step S1, built-in terminal 1 obtains the multimedia file with first encapsulation format by network.Particularly, in step S1, built-in terminal 1 is by network, and server or third-party server from content supplier obtain the multimedia file with first encapsulation format.At this, network includes but not limited to the Internet, wide area network, metropolitan area network, local area network (LAN), VPN network, wireless self-organization network (Ad Hoc network) etc.; The server of content supplier or third-party server include but not limited to web server, streaming media server etc.Those skilled in the art will be understood that above-mentioned network or server only for giving an example, and other networks existing or that may occur from now on or server also should be included in the protection range of the present invention as applicable to the present invention, and are contained in this at this with way of reference.In addition, described obtain manner with multimedia file of first encapsulation format includes but not limited to, HTTP mode, FTP mode, RTSP mode, MMS mode or P2P mode.For example, built-in terminal 1 not only can be browsed generic web page by browser, also can login video website or other websites, by http protocol access browsing video webpage, obtains hyperlink multimedia file pointed in this video webpage.And for example, built-in terminal 1 obtains multichannel P2P video file from network in step S1, these multi-channel video files comprise the video file of separate sources, a plurality of fragments of a video file of separate sources (separate sources film for example, perhaps a plurality of fragments of this film of composition of separate sources), built-in terminal 1 carries out following step to the fragment of the video file of specific video file or special time more then.At this; those skilled in the art will be understood that above-mentioned several obtain manner with multimedia file of first encapsulation format only is for example; the obtain manner of other existing or multimedia files with first encapsulation format that may occur from now on is as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.At this, multimedia file includes but not limited to that audio file, video file, picture file etc. can be by the digital documents of player plays.Those skilled in the art will be understood that above-mentioned several multimedia file only for giving an example, and other multimedia files existing or that may occur from now on also should be included in the protection range of the present invention as applicable to the present invention, and are contained in this at this with way of reference.
In step S2, whether built-in terminal 1 detects described first encapsulation format and is complementary with the support format list of built-in terminal.Particularly, in step S2, built-in terminal 1 is according to the multimedia file with first encapsulation format that obtains in step S1, detect first encapsulation format of this multimedia file, for example according to the extension name of this multimedia file, characteristic information such as characteristic signature or metadata, determine first encapsulation format of this multimedia file, after this, support format list with described first encapsulation format and built-in terminal compares again, whether detect described first encapsulation format and be complementary with the support format list of built-in terminal, whether for example described first encapsulation format is contained in this support format list.To expand example by name, the encapsulation format of the multimedia file correspondence of expansion " flv " by name is " FLV "; But the corresponding identical encapsulation format of different extension name possibility, for example the encapsulation format that " asf " and " wmv " is corresponding is " ASF ".At this; the extension name of multimedia file includes but not limited to " mp3 ", " mp4 ", " avi ", " flv ", " mov ", " rmvb ", " rm ", " asf ", " wmv " or " mkv " etc.; those skilled in the art will be understood that the extension name of above-mentioned several multimedia files is only for giving an example; the extension name of other multimedia files existing or that may occur from now on is as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.At this; the encapsulation format of multimedia file includes but not limited to " MP3 ", " MP4 ", " AVI ", " FLV ", " QuickTime ", " RMVB ", " RM ", " ASF " or " MKV "; those skilled in the art will be understood that the encapsulation format of above-mentioned several multimedia files is only for giving an example; the encapsulation format of other multimedia files existing or that may occur from now on is as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.Whether in step S2, built-in terminal 1 is according to first encapsulation format of described multimedia file, compares with the support format list of built-in terminal, detect described first encapsulation format and be complementary with the support format list of built-in terminal.At this, support to store the encapsulation format that described built-in terminal is supported in the format list encapsulation format of the multimedia file of the broadcast that can directly on this built-in terminal, be well on; Cause the multimedia file that can't play on this built-in terminal for not matching because of encapsulation format, its encapsulation format does not then match with this support format list.Those skilled in the art will be understood that mode that whether described first encapsulation format of above-mentioned detection be complementary with the support format list of built-in terminal is only for for example; the mode whether described first encapsulation format of other detections existing or that may occur from now on is complementary with the support format list of built-in terminal is as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.Preferably, because browser execution is in application layer, its support be JS, HTML, scripts such as XML, and the CPU of built-in terminal 1, decoding chips etc. are positioned at bottom, it supports code speechs such as C language, can't directly call above-mentioned script, therefore, in step S1, built-in terminal 1 can also call modes such as described application programming interfaces (API) or socket (Socket) interface by one or many, the multimedia file with first encapsulation format that is obtained is passed to bottom, whether is complementary with the support format list of built-in terminal to detect described first encapsulation format.
In step S3, when described first encapsulation format and described support format list are not complementary, built-in terminal 1 is according to the format conversion storehouse, described multimedia file is carried out format conversion processing, to obtain to have the multimedia file of second encapsulation format, wherein, described second encapsulation format and described support format list are complementary.Particularly, when in step S2, built-in terminal 1 detects described first encapsulation format and described support format list when not being complementary, in step S3, built-in terminal 1 is according to the format conversion storehouse, obtain the format conversion information of described first encapsulation format, the packaging information of this first encapsulation format for example, decapsulation information etc., and according to described format conversion information, by modes such as decapsulation-encapsulation process, described multimedia file is carried out format conversion processing, to obtain to have the multimedia file of second encapsulation format, wherein, described second encapsulation format and described support format list are complementary, that is, described built-in terminal can be play-overed the multimedia file with described second encapsulation format.For example, in step S3, built-in terminal 1 is used by calling (calling or far call as this locality) or loading and call corresponding decapsulation according to the format conversion storehouse, the decapsulation multimedia file, thus one or more coding unit sequence flows after this multimedia file decapsulation obtained.At this, the coding unit sequence flows includes but not limited to audio coding unit sequence flows, video encoding unit sequence flows or both combinations.For example, suppose in step S2, first encapsulation format that built-in terminal 1 detects multimedia file for " MKV " after, call with the corresponding decapsulation of " MKV " form and use, behind this multimedia file of decapsulation, obtain an audio coding unit sequence flows and a video encoding unit sequence flows in this multimedia file.Those skilled in the art will be understood that above-mentioned several coding unit sequence flows is only for giving an example; other coding unit sequence flows existing or that may occur from now on are as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.After this, in step S3, one or more coding unit sequence flows that built-in terminal 1 obtains according to decapsulation again, according to second encapsulation format in the described support format list, described one or more coding unit sequence flows are packaged into the multimedia file with second encapsulation format, to finish the format conversion operation of described multimedia file.For example, suppose that multimedia file first encapsulation format is " FLV ", after its decapsulation, obtain an audio coding unit sequence flows and a video encoding unit sequence flows, at this moment, second encapsulation format that built-in terminal 1 is supported is " AVI ", so, in step S3, built-in terminal 1 encapsulates this audio coding unit sequence flows and the video encoding unit sequence flows form according to " AVI ", thereby finishes the conversion of encapsulation format from " FLV " to " AVI " of this multimedia file.Those skilled in the art will be understood that the above-mentioned mode that multimedia file is carried out format conversion processing is only for for example; other existing or modes of multimedia file being carried out format conversion processing that may occur from now on are as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
In step S4, described multimedia file with second encapsulation format is play in built-in terminal 1 decoding.Particularly, in step S4, built-in terminal 1 is according to the multimedia file with second encapsulation format that carries out being obtained after the conversion process in step S3, by wherein coding unit sequence flows is decompressed, then according to audio coding unit and video encoding unit in this coding unit sequence flows of the temporal information synchronous playing in this coding unit sequence flows.For example, in step S4, built-in terminal 1 its receive in step S3 that the conversion back obtains have the multimedia file of second encapsulation format time, for example by the decoding chip in the built-in terminal 1, to coding unit sequence flows decompression wherein, from the temporal information of coding unit sequence flows, obtain the timestamp of audio coding unit and video encoding unit, realize the synchronous playing of audio coding unit and video encoding unit then according to this timestamp.Those skilled in the art will be understood that the method for synchronization of above-mentioned audio coding unit and video encoding unit is only for giving an example; the method of synchronization of other audio coding units existing or that may occur from now on and video encoding unit is as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.Those skilled in the art will be understood that it only is for example that described mode with multimedia file of second encapsulation format is play in above-mentioned decoding; the mode that described multimedia file with second encapsulation format is play in other decodings existing or that may occur from now on is as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
Preferably, between above-mentioned each step be constant work.Particularly, in step S1, built-in terminal 1 obtains the multimedia file with first encapsulation format by network; In step S2, whether built-in terminal 1 detects described first encapsulation format and is complementary with the support format list of built-in terminal; When described first encapsulation format and described support format list are not complementary, in step S3, built-in terminal 1 is according to the format conversion storehouse, described multimedia file is carried out format conversion processing, to obtain to have the multimedia file of second encapsulation format, wherein, described second encapsulation format and described support format list are complementary; In step S4, described multimedia file with second encapsulation format is play in built-in terminal 1 decoding.At this, it will be understood by those skilled in the art that " continuing " be meant above steps respectively according to the mode of operation of setting or adjust in real time require to have the obtaining of multimedia file, first encapsulation format of first encapsulation format detection and conversion, have the decoding broadcast of the multimedia file of second encapsulation format, stop in a long time obtaining multimedia file until built-in terminal 1 with first encapsulation format by network.
Preferably, in step S6 (not shown), when described first encapsulation format and described support format list were complementary, built-in terminal 1 can also be to the broadcast of decoding of described multimedia file.Particularly, when in step S2, built-in terminal 1 detects described first encapsulation format and described support format list when being complementary, in step S6, built-in terminal 1 is by decompressing to described coding unit sequence flows with multimedia file of first encapsulation format, then according to audio coding unit and video encoding unit in this coding unit sequence flows of the temporal information synchronous playing in this coding unit sequence flows, to the broadcast of decoding of described multimedia file.For example, in step S6, built-in terminal 1 decompresses described coding unit sequence flows with multimedia file of first encapsulation format, from the temporal information of coding unit sequence flows, obtain the timestamp of audio coding unit and video encoding unit, realize the synchronous playing of audio coding unit and video encoding unit then according to this timestamp.Those skilled in the art will be understood that the method for synchronization of above-mentioned audio coding unit and video encoding unit is only for giving an example; the method of synchronization of other audio coding units existing or that may occur from now on and video encoding unit is as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.Those skilled in the art will be understood that also it only is for example that described mode with multimedia file of first encapsulation format is play in above-mentioned decoding; the mode that described multimedia file with first encapsulation format is play in other decodings existing or that may occur from now on is as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
Preferably, in step S3, when described first encapsulation format and described support format list were not complementary, built-in terminal 1 can also carry out decapsulation to described multimedia file and handle according to described format conversion storehouse, to obtain not have the multimedia file of encapsulation; According to described support format list, select second encapsulation format of described multimedia file, wherein, described second encapsulation format and described support format list are complementary; According to described second encapsulation format, the multimedia file that described nothing is encapsulated carries out the form encapsulation process, to obtain to have the multimedia file of second encapsulation format.Particularly, when in step S2, built-in terminal 1 detects described first encapsulation format and described support format list when not being complementary, in step S3, built-in terminal 1 is according to described format conversion storehouse, obtain the format conversion information of described first encapsulation format, the packaging information of this first encapsulation format for example, decapsulation information etc., and according to described format conversion information, use by calling (calling or far call) or loading and call corresponding decapsulation as this locality, described multimedia file is carried out decapsulation handle, to obtain not have the multimedia file of encapsulation, for example one or more coding unit sequence flows; After this, second encapsulation format that built-in terminal 1 is supported according to the decoding chip of described built-in terminal again such as for example selects at mode from support format list, select second encapsulation format of described multimedia file, wherein, described second encapsulation format and described support format list are complementary; Then, built-in terminal 1 is again according to described second encapsulation format, the multimedia file of described nothing encapsulation is carried out the form encapsulation process, to obtain to have the multimedia file of second encapsulation format, for example described one or more coding unit sequence flows are packaged into the multimedia file with second encapsulation format.At this, the coding unit sequence flows includes but not limited to audio coding unit sequence flows, video encoding unit sequence flows or both combinations.For example, suppose in step S2, first encapsulation format that built-in terminal 1 detects multimedia file for " MKV " after, in step S3, built-in terminal 1 calls with the corresponding decapsulation of " MKV " form and uses, behind this multimedia file of decapsulation, obtain an audio coding unit sequence flows and a video encoding unit sequence flows in this multimedia file.Those skilled in the art will be understood that above-mentioned several coding unit sequence flows is only for giving an example; other coding unit sequence flows existing or that may occur from now on are as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.For example, suppose that multimedia file first encapsulation format is " FLV ", after its decapsulation, obtain an audio coding unit sequence flows and a video encoding unit sequence flows, at this moment, second encapsulation format that built-in terminal 1 is supported is " AVI ", so, in step S3, built-in terminal 1 encapsulates this audio coding unit sequence flows and the video encoding unit sequence flows form according to " AVI ", thereby finishes the conversion of encapsulation format from " FLV " to " AVI " of this multimedia file.Those skilled in the art will be understood that the above-mentioned mode that multimedia file is carried out format conversion processing is only for for example; other existing or modes of multimedia file being carried out format conversion processing that may occur from now on are as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
(with reference to Fig. 4) in a preferred embodiment, described format conversion storehouse comprises the native format transformation warehouse; Wherein, in step S3, when described first encapsulation format and described support format list are not complementary, built-in terminal 1 can also be according to described native format transformation warehouse, described multimedia file is carried out format conversion processing, to obtain to have the multimedia file of second encapsulation format, wherein, described second encapsulation format and described support format list are complementary.Particularly, when described format conversion storehouse comprised the native format transformation warehouse, described format conversion storehouse was kept at local side, and promptly built-in terminal wherein stores format conversion information, for example the packaging information of encapsulation format, decapsulation information etc.When in step S2, built-in terminal 1 detects described first encapsulation format and described support format list when not being complementary, in step S3, built-in terminal 1 is according to the native format transformation warehouse, obtain the format conversion information of described first encapsulation format, for example this first encapsulation format is stored in local packaging information, decapsulation information etc., and according to described format conversion information, by modes such as decapsulation-encapsulation process, described multimedia file is carried out format conversion processing, to obtain to have the multimedia file of second encapsulation format, wherein, described second encapsulation format and described support format list are complementary.Those skilled in the art will be understood that the above-mentioned mode that multimedia file is carried out format conversion processing is only for for example; other existing or modes of multimedia file being carried out format conversion processing that may occur from now on are as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
Fig. 5 illustrates the method flow diagram of network multimedia file that is used to play multiple encapsulation format in accordance with a preferred embodiment of the present invention.
Work in coordination between each step in the built-in terminal 1 and the network equipment 2, to finish the network multimedia file of playing multiple encapsulation format.Particularly, when described format conversion storehouse comprises network format transformation warehouse in the network equipment, and when described first encapsulation format and described support format list are not complementary, in step S31 ', built-in terminal 1 is to the format conversion request of described network equipment transmission about described multimedia file, and wherein said format conversion request comprises described support format list.The network equipment 2 is received from the format conversion request about described multimedia file that built-in terminal sends, and wherein, described format conversion request comprises the support format list of described built-in terminal; In step S5 ', the network equipment 2 carries out format conversion processing according to the network format transformation warehouse with described multimedia file, and to obtain to have the multimedia file of second encapsulation format, wherein, described second encapsulation format and described support format list are complementary; In step S32 ', the network equipment 2 sends the multimedia file with second encapsulation format that is obtained based on described format conversion request to described built-in terminal.What built-in terminal 1 was received from that the described network equipment sends obtains to have the multimedia file of second encapsulation format based on described format conversion request according to described network format transformation warehouse, wherein, described second encapsulation format and described support format list are complementary.Preferably, between above-mentioned each step be constant work.At this, it will be understood by those skilled in the art that " continuing " is meant that above steps requires to operate accordingly according to the mode of operation of setting or adjust in real time respectively.
More specifically, when described format conversion storehouse comprises network format transformation warehouse in the network equipment, and when described first encapsulation format and described support format list are not complementary; In step S31 ', described built-in terminal 1 in real time or answer Event triggered ground, call the application programming interfaces (API) that the network equipment 2 provided or the communication mode of other agreements by one or many, to the format conversion request that the described network equipment 2 sends about described multimedia file, wherein said format conversion request comprises described support format list; After this, what be received from that the described network equipment 2 sends obtains to have the multimedia file of second encapsulation format based on described format conversion request according to described network format transformation warehouse, for example receive multimedia file with second encapsulation format by the communication mode transmission of the API described in the precedent or other agreements, wherein, described second encapsulation format and described support format list are complementary.Those skilled in the art will be understood that above-mentioned transmission format conversion request mode is only for giving an example; other transmission format conversion request mode existing or that may occur from now on are as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.Those skilled in the art will be understood that also above-mentioned reception has the mode of multimedia file of second encapsulation format only for for example; other receptions existing or that may occur from now on have the mode of multimedia file of second encapsulation format as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
The network equipment 2 is received from the format conversion request about described multimedia file that built-in terminal sends, for example receive the format conversion request of the described multimedia file of the communication mode transmission of passing through the API described in the precedent or other agreements, wherein, described format conversion request comprises the support format list of described built-in terminal.
In step S5 ', the network equipment 2 is according to the network format transformation warehouse, obtain the format conversion information of described first encapsulation format, for example be stored in the packaging information of this first encapsulation format of network terminal, decapsulation information etc., and according to described format conversion information, be combined in the support format list of built-in terminal 1 included in the format conversion request that is received among the step S31 ', by modes such as decapsulation-encapsulation process, described multimedia file is carried out format conversion processing, to obtain to have the multimedia file of second encapsulation format, wherein, described second encapsulation format and described support format list are complementary.
In step S32 ', the network equipment 2 in real time or answer Event triggered ground, call the application programming interfaces (API) that built-in terminal 1 provided or the communication mode of other agreements by one or many, send the multimedia file that is obtained based on described format conversion request to described built-in terminal with second encapsulation format.
In a preferred embodiment, in step S5 ', the network equipment 2 can also carry out decapsulation to described multimedia file and handle according to described network format transformation warehouse, to obtain not have the multimedia file of encapsulation; According to described support format list, select second encapsulation format of described multimedia file, wherein, described second encapsulation format and described support format list are complementary; According to described second encapsulation format, the multimedia file that described nothing is encapsulated carries out the form encapsulation process, to obtain to have the multimedia file of second encapsulation format.Particularly, in step S5 ', the network equipment 2 is according to described network format transformation warehouse, obtain the format conversion information of described first encapsulation format, for example be stored in packaging information, decapsulation information of this first encapsulation format of network terminal etc., and according to described format conversion information, use by calling or load and call corresponding decapsulation, described multimedia file is carried out decapsulation handle, to obtain not have the multimedia file of encapsulation, for example one or more coding unit sequence flows; After this, the network equipment 2 is again according to the support format list of built-in terminal 1 included in the format conversion request that is received in step S31 ', mode such as for example from support format list, select, select second encapsulation format of described multimedia file, wherein, described second encapsulation format and described support format list are complementary; Then, the network equipment 2 is again according to described second encapsulation format, the multimedia file of described nothing encapsulation is carried out the form encapsulation process, to obtain to have the multimedia file of second encapsulation format, for example described one or more coding unit sequence flows are packaged into the multimedia file with second encapsulation format.At this, the coding unit sequence flows includes but not limited to audio coding unit sequence flows, video encoding unit sequence flows or both combinations.Those skilled in the art will be understood that the above-mentioned mode that multimedia file is carried out format conversion processing is only for for example; other existing or modes of multimedia file being carried out format conversion processing that may occur from now on are as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
Preferably, in step S7 ' (not shown), the network equipment 2 can also be to the format conversion information of described built-in terminal transmission based on described network format transformation warehouse.In step S8 ' (not shown), when described format conversion storehouse also comprised the native format transformation warehouse, built-in terminal 1 can also be received from the format conversion information based on described network format transformation warehouse that the described network equipment sends; According to described format conversion information, set up or upgrade described native format transformation warehouse.Particularly, in step S7 ', the network equipment 2 in real time or answer Event triggered ground, call the application programming interfaces (API) that built-in terminal 1 provides or the communication mode of other agreements by one or many, send format conversion information based on described network format transformation warehouse to described built-in terminal.When described format conversion storehouse also comprises the native format transformation warehouse, in step S8 ', built-in terminal 1 is received from the format conversion information based on described network format transformation warehouse that the described network equipment sends, for example receive the format conversion information of the described network format transformation warehouse that the communication mode by the API described in the precedent or other agreements transmits, for example encapsulation format is stored in the packaging information, decapsulation information of network terminal etc.; After this, built-in terminal 1 is again according to described format conversion information, by modes such as database updates, sets up or upgrades described native format transformation warehouse.Those skilled in the art will be understood that the mode of above-mentioned renewal native format transformation warehouse is only for giving an example; the mode of other renewal native format transformation warehouses existing or that may occur from now on is as applicable to the present invention; also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
To those skilled in the art, obviously the invention is not restricted to the details of above-mentioned one exemplary embodiment, and under the situation that does not deviate from spirit of the present invention or essential characteristic, can realize the present invention with other concrete form.Therefore, no matter from which point, all should regard embodiment as exemplary, and be nonrestrictive, scope of the present invention is limited by claims rather than above-mentioned explanation, therefore is intended to be included in the present invention dropping on the implication that is equal to important document of claim and all changes in the scope.Any Reference numeral in the claim should be considered as limit related claim.In addition, obviously other unit or step do not got rid of in " comprising " speech, and odd number is not got rid of plural number.A plurality of unit of stating in the device claim or device also can be realized by software or hardware by a unit or device.The first, the second word such as grade is used for representing title, and does not represent any specific order.