CN101499915A - Method and apparatus for providing multimedia content description information for customer in Internet - Google Patents
Method and apparatus for providing multimedia content description information for customer in Internet Download PDFInfo
- Publication number
- CN101499915A CN101499915A CNA2008100334933A CN200810033493A CN101499915A CN 101499915 A CN101499915 A CN 101499915A CN A2008100334933 A CNA2008100334933 A CN A2008100334933A CN 200810033493 A CN200810033493 A CN 200810033493A CN 101499915 A CN101499915 A CN 101499915A
- Authority
- CN
- China
- Prior art keywords
- content
- multimedia
- information
- description information
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention discloses a method and a device used for providing multimedia content describing information to a user terminal in network equipment. The network equipment used for providing the multimedia content describing information (electronic program sheet) to the user terminal generates and provides the multimedia content describing information to the user terminal; the multimedia content describing information not only contains title information, playing time and summary information of each multimedia content, but also contains detailed content information of each multimedia content. Specifically, the detailed content information can contain screenshot information of the multimedia content on one or more moments, or audio and video segment information or text describing information in one or more time sections, and the like. User can select favorite multimedia content for watching according to the detailed content information of each multimedia content which is displayed in the electronic program sheet, thus greatly improving user experience.
Description
Technical field
The present invention relates to the computer internet technology, relate in particular to and be used to user terminal that the network equipment of multimedia content description information is provided in the computer internet.
Background technology
Along with the fast development of Internet technology, the Internet video field has become a big focus.For general cable TV, Internet video has rich and colourful items content more, it not only contains the most of channel in the cable TV, and comprise abundant film, TV play program, and can take turns in 24 hours and broadcast, the user can click own programs of interest and view and admire at any time according to the content that electronic program list presented.
In existing Internet video technology, when the user passes through terminal equipment browsing multimedia content, can at first understand the relevant information of each content of multimedia according to electronic program list (EPG) content that is presented, then, select own interested content of multimedia to view and admire according to present on the electronic program list corresponding to the relevant information of each content of multimedia.Usually, the relevant information corresponding to each content of multimedia that is presented on the electronic program list in the existing network video technique comprises heading message, reproduction time and the summary info of each content of multimedia, hereinafter, with among the three each or appoint the multinomial essential information that is called content of multimedia, wherein summary info has typically been described the profile of corresponding content of multimedia from overall angle.The user can recognize content of multimedia that each time period plays by these relevant informations and corresponding to the summary info of this content of multimedia, like this, the user just can choose own programs of interest according to these information and view and admire.
Electronic program list in the existing network video technique only offers the summary info of heading message, reproduction time and each content of multimedia of each content of multimedia of user, and these essential informations are relatively simple, lacks characteristic.
Especially, for the network direct broadcasting program, when the user misses the first half of whole programme televised live for some reason, the user just can only watch the latter half content of this programme televised live, and can't from electronic program list, get access to relevant information about the first half content of this programme televised live of having missed, this greatly reduces user's experience.
Summary of the invention
For solving above-mentioned shortcoming of the prior art, the present invention proposes a kind of method and apparatus that in the network equipment, is used to user terminal that multimedia content description information is provided.In the present invention, be used to user terminal to provide multimedia content description information (for example, electronic program list, be EPG) the network equipment multimedia content description information that generates and offer user terminal not only comprise the heading message of each content of multimedia, the summary info of reproduction time and each content of multimedia, the content detail information that also comprises each content of multimedia, the sectional drawing information or audio/video frag info on one or more time period or the text description information etc. that engrave when particularly, content detail information can comprise each content of multimedia one or more.
According to a first aspect of the invention, a kind of method that is used to user terminal that multimedia content description information is provided in the network equipment is provided, wherein, may further comprise the steps: b. is that one or more content of multimedia generate multimedia content description information, wherein, described multimedia content description information comprises the content detail information of described one or more content of multimedia; C. described multimedia content description information is sent to described user terminal.
According to a second aspect of the invention, provide a kind of being used in the network multimedia server to assist the method that multimedia content description information is provided for user terminal, wherein, may further comprise the steps: i. generates the content detail information of one or more content of multimedia; Ii. the content detail information of described one or more content of multimedia being sent to is used to user terminal that the network equipment of multimedia content description information is provided.
According to a third aspect of the present invention, a kind of generator that is used to user terminal that multimedia content description information is provided in the network equipment is provided, wherein, comprise: first generating apparatus, be used to one or more content of multimedia to generate multimedia content description information, wherein, described multimedia content description information comprises the content detail information of described one or more content of multimedia; First dispensing device is used for described multimedia content description information is sent to described user terminal.
According to a fourth aspect of the present invention, a kind of auxiliary auxiliary generator that multimedia content description information is provided for user terminal that is used in the network multimedia server is provided, wherein, comprising: the 3rd generating apparatus is used to generate the content detail information of one or more content of multimedia; Second dispensing device is used for content detail information with described one or more content of multimedia and is sent to and is used to user terminal that the network equipment of multimedia content description information is provided.
In the present invention, the multimedia content description information that is used to user terminal to provide the network equipment of multimedia content description information (electronic program list) to generate and offer user terminal not only comprises the heading message of each content of multimedia, the summary info of reproduction time and each content of multimedia, the content detail information that also comprises each content of multimedia, the sectional drawing information or audio/video frag info on one or more time period or the text description information etc. that engrave when particularly, described content detail information can comprise each content of multimedia one or more.The user can choose own interested content of multimedia according to the content detail information about each content of multimedia that is presented on the electronic program list and view and admire.Advantageously, especially at the content of multimedia of real-time broadcast, if the user misses the front part content of this content of multimedia, then can also recognize some content detail of that part of content that it misses at least according to the content detail information about this content of multimedia that is presented on the electronic program list, this has improved user's experience greatly.
Description of drawings
By reading the detailed description of non-limiting example being done with reference to the following drawings, other features, objects and advantages of the present invention will become more apparent:
Fig. 1 shows the schematic network structure that generates and provide multimedia content description information according to of the present invention in the Internet;
Fig. 2 shows according to a specific embodiment of the present invention, generates in the server at multimedia content description information to be used to user terminal that the method flow diagram of multimedia content description information is provided;
Fig. 3 shows according to another embodiment of the present invention, generates in the server at multimedia content description information to be used to user terminal that the method flow diagram of multimedia content description information is provided;
Fig. 4 shows according to a specific embodiment of the present invention, is used for auxiliaryly providing for user terminal the method flow diagram of multimedia content description information in the network multimedia server;
Fig. 5 shows according to a specific embodiment of the present invention, generates in the server at multimedia content description information to be used to user terminal that the structured flowchart of the generator of multimedia content description information is provided;
Fig. 6 shows according to another embodiment of the present invention, generates in the server at multimedia content description information to be used to user terminal that the structured flowchart of the generator of multimedia content description information is provided; And
Fig. 7 shows according to a specific embodiment of the present invention, is used for auxiliaryly providing for user terminal the structured flowchart of the auxiliary generator of multimedia content description information in the network multimedia server.
In the accompanying drawing, identical or the similar identical or similar parts of accompanying drawing sign representative.
Embodiment
Followingly describe the present invention with reference to accompanying drawing:
Need to prove, in the technical scheme involved in the present invention, it can be two servers that separate with being used to user terminal that the network multimedia server (hereinafter to be referred as multimedia server) of content of multimedia is provided that the multimedia content description information that is used to generate multimedia content description information and provide it to user terminal generates server (hereinafter to be referred as the content description information server), also can be integrated in the server.
For convenience of description, we only are described technical scheme of the present invention at the separate situation of content description information server and network multimedia server below.Those skilled in the art can apply to the two with technical scheme of the present invention without creative work ground and be integrated in the situation in the server according to the description of this paper to the separate situation of content description information server and network multimedia server.
Fig. 1 shows the schematic network structure that generates and provide multimedia content description information according to of the present invention in the Internet.Network shown in Figure 1 comprises content description information server 1, and multimedia server 2 and a plurality of user terminal wherein only illustrate user terminal 3 for simplicity's sake.Those skilled in the art will be understood that user terminal 3 includes but not limited to following equipment: computer, mobile phone, PDA(Personal Digital Assistant).
At first, 1 reception of content description information server is from the content of multimedia of multimedia server 2.
Secondly, content description information server 1 is according to received content of multimedia, for one or more content of multimedia generate content detail information.Concrete, these one or more content of multimedia can be programme televised live, request program, also can be that the wheel that broadcasts that circulates is in a period of time broadcast program.
Further, the content detail information of each content of multimedia is relevant with the one or more moment or the content on one or more time period of this content of multimedia.
Further, the content detail information of a content of multimedia can comprise: when this content of multimedia was video content, the picture (video data frame) that engraves during to this video content one or more intercepted and the pictorial information that generates; Perhaps, when this content of multimedia is the audio or video content, the voice data on one or more time periods of this content of multimedia is intercepted and the audio fragment information that generates; Or, when this content of multimedia is video content, the video data on one or more time periods of this video content is intercepted and the video segment information that generates; Perhaps, corresponding to the one or more moment of this content of multimedia or the text description information of the content on one or more period.Certainly, the content detail information of content of multimedia can also comprise above-mentioned not most other types content detail information, and this is that those skilled in the art will be understood that, does not give unnecessary details at this.
Subsequently, content description information server 1 is based on the essential information of one or more content of multimedia and be the content detail information that described one or more content of multimedia generates, and is that these one or more content of multimedia generate multimedia content description informations.
Below, for explaining conveniently, features such as its essential information, content detail information are only described at a content of multimedia, it will be appreciated by those skilled in the art that this can not influence the clear of flesh and blood of the present invention and comprehensively description.
Concrete, the essential information of a content of multimedia comprises the heading message of this content of multimedia, reproduction time, preferably, the essential information of a content of multimedia also comprises the summary info of this content of multimedia.
Preferably, content description information server 1 can be based on the essential information of a content of multimedia, be the content detail information that this content of multimedia generated and the content detail information of the local described content of multimedia that prestores, and coming is that this content of multimedia generates multimedia content description information.The form of the multimedia content description information that is generated schematically is shown in Table 1:
Table 1: the multimedia content description information form that is generated according to the present invention
| Heading message | Reproduction time | Summary info | Content detail information | |
| Content of multimedia M1 | 00:00-06:00 | ＊＊＊＊＊ | Time point t1 and corresponding sectional drawing | Time point t2 and corresponding sectional drawing |
| Content of multimedia M2 | 06:00-12:00 | ＊＊＊＊＊ | Time point t3 and corresponding sectional drawing | Time point t4 and corresponding sectional drawing |
| Content of multimedia M3 | 12:00-18:00 | ＊＊＊＊＊ | Time point t5 and corresponding sectional drawing | Time point t6 and corresponding sectional drawing |
| Content of multimedia M4 | 18:00-00:00 | ＊＊＊＊＊ | Time point t7 and corresponding sectional drawing | Time point t8 and corresponding sectional drawing |
Wherein, content of multimedia M1, M2, M3 and M4 can be counted as a content of multimedia respectively.Certainly, it will be appreciated by those skilled in the art that the multimedia content description information shown in the his-and-hers watches 1 is simplified or refinement neatly by on this basis each content of multimedia being merged or splitting.
Wherein, the acquisition mode of the content detail information of this content of multimedia of prestoring of content description information server 1 includes but not limited to:
Acquisition mode 1. is especially at being used for program request, taking turns the content of multimedia of broadcasting, content description information server 1 is obtained all or part of data of this content of multimedia in advance by network multimedia server 2 places, and therefrom intercept picture/audio frequency and video fragment to generate content detail information and storage, prepare against when needing to generate multimedia content description information and use;
Acquisition mode 2. is especially at being used for live content of multimedia, because this kind content of multimedia is instant that generate and can not obtain in advance, content description information server 1 obtains content of multimedia with the status identical with user terminal 3 in live process, and generating its content description information based on this, the content detail information of generation is stored in order to generating the usefulness of multimedia descriptions information.
At last, content description information server 1 is sent to user terminal 3 with the multimedia content description information that is generated.
Concrete, content description information server 1 can pass through HTTP (HTML (Hypertext Markup Language)), UDP (User Datagram Protoco (UDP)), TCP (transmission control protocol), perhaps P2P (point-to-point protocol) is sent to user terminal 3 with the multimedia content description information that is generated.Certainly, content description information server 1 can also be sent to user terminal 3 with the multimedia content description information that is generated by the agreement of other types, and this is that those skilled in the art will be understood that, does not give unnecessary details at this.
User terminal 3 shows the user with it after receiving multimedia content description information from content description information server 1.Particularly, the sectional drawing of video content can present with JPEG forms such as (JPEG (joint photographic experts group) standards); Audio fragment then can present with forms such as mpeg 3, WAV; Video segment then can present with forms such as MPEG4, AVI, RMVB.The concrete form of all kinds of content detail information will depend on the digital coding compress mode of content description information server 1 when this content detail information of generation in the multimedia content description information.It will be appreciated by those skilled in the art that any form of the concrete employing of all kinds of content detail information is not an emphasis of the present invention, therefore hereinafter repeat no more.
In the above-described embodiments, the content detail information of content of multimedia is generated based on the content of multimedia from network multimedia server 2 by content description information server 1.And in a variation example of above-mentioned specific embodiment, the generation of this content detail information is finished by network multimedia server 2.Particularly, when content of multimedia was sent to user terminal 3, multimedia server 2 generated its content detail information for this content of multimedia, and the content detail information of this content of multimedia of being generated is sent to content description information server 1.The mode that it will be appreciated by those skilled in the art that this kind generation corresponding contents detailed information when sending content of multimedia is applicable to program request, takes turns and broadcast and the direct broadcast service mode.
Certainly, broadcast or the program of program request for wheel, network multimedia server 2 can be according to all or part of content information of the described content of multimedia of being stored in its internal storage, generate the content detail information of this content of multimedia in advance, and periodically on one's own initiative or the request of content-based descriptor server 1 come to provide the content detail that is generated information for it.
After content description information server 1 receives content detail information from the described content of multimedia of network multimedia server 2, essential information based on described content detail information and this content of multimedia, for it generates multimedia content description information, example is as shown in table 1.
Preferably, content description information server 1 can based on the essential information of this content of multimedia, received from the content detail information of this content of multimedia of multimedia server 2 and the content detail information of local this content of multimedia that prestores, be that described content of multimedia generates multimedia content description information.
Further, the content detail information of the described content of multimedia that prestores of content description information server 1 this locality can comprise that content description information server 1 receives and storage from this content of multimedia of multimedia server 2 before any/content detail information on a plurality of moment or period.
At last, content description information server 1 is sent to user terminal 3 with the multimedia content description information that is generated.Concrete, content description information server 1 can be sent to user terminal 3 with the multimedia content description information that is generated by in http protocol, udp protocol, Transmission Control Protocol, the P2P agreement any.Certainly, content description information server 1 can also be sent to user terminal 3 with the multimedia content description information that is generated by the agreement of other types, and this is that those skilled in the art will be understood that, does not give unnecessary details at this.
User terminal 3 shows the user with it after receiving multimedia content description information from content description information server 1.
Followingly a first aspect of the present invention is described, the description of Fig. 1 is incorporated herein by reference with reference to Fig. 2.
The user terminal that is used in the content description information server that Fig. 2 shows according to a specific embodiment of the present invention provides the method flow diagram of multimedia content description information.
At first, in step S11, the content of multimedia that content description information server 1 receives from multimedia server 2.Concrete, multimedia server 2 can send it to content description information server 1 when content of multimedia is sent to user terminal 3.
Certainly, broadcast program or request program for the circulation wheel, network multimedia server 2 can be sent to content description information server 1 with the part or all of content information of being stored in its internal storage of this content of multimedia earlier, content description information server 1 generates content detail information according to the content information of this received content of multimedia, to be used for the generation of multimedia content description information.
More specifically, 1 acquisition of content description information server includes but not limited to following two kinds from the mode of the content of multimedia of multimedia server 2:
A) passive receiving multimedia content
When multimedia server 2 sends content of multimedia to user terminal 3, also this content of multimedia is pushed to content description information server 1.
Content description information server 1 is handled to generate the content detail information of this content of multimedia it after receiving content of multimedia from network multimedia server 2.
If multimedia server 2 ceaselessly sends the data of this content of multimedia to content description information server 1, then will cause a certain amount of bandwidth to be taken by content description information server 1 all the time, and can not be used by users' terminal, this mode can reduce bandwidth availability ratio when multimedia server 2 adopts client-server (server-client) technology to carry out transfer of data.Therefore, and considering that each content detail information of a content of multimedia typically intersperses among a plurality of play time/Duan Shanghou of this content of multimedia, multimedia server 2 promptly sends the partial data of this content of multimedia to described content description information server 1 every one-period, therefrom obtain the content detail information of this content of multimedia for the latter.
B) active request and receiving multimedia content
Content description information server 1 sends the content of multimedia request message to multimedia server 2, multimedia server 2 is according to the content of multimedia request message from content description information server 1, when content of multimedia is sent to user terminal 3, send it to content description information server 1.
Preferably, content description information server 1 can periodically send the content of multimedia request message to multimedia server 2, after receiving the content of multimedia request message from content description information server 1, multimedia server 2 is sent to content description information server 1 with a part of data of this content of multimedia at every turn.
When coming the data of transmitting multimedia contents based on the P2P agreement between multimedia server 2 and the especially described content description information server of each user terminal, because the download of data fragmentation is many based on the request principle, also be, only when receive that download request person sends to the download request of certain data fragmentation the time, loading source is just issued this download request person with corresponding data fragmentation.The form of foregoing descriptor server 1 active request and receiving multimedia content that it will be appreciated by those skilled in the art that is particularly useful for carrying out based on the P2P agreement scene of content of multimedia transmission.
Among the step S12 after obtaining content of multimedia, content description information server 1 is according to received content of multimedia, for this content of multimedia generates content detail information.Wherein, the content detail information of this content of multimedia is relevant with the one or more moment or the content on one or more time period of this content of multimedia.
Below, the TV play " deer ancient cooking vessel note " of acting the leading role with Chen Xiaochun is an example, S12 describes to step.
At first, suppose the same day from morning 08:00 to evening the 36th collection that 20:00 circulation wheel is broadcast the TV play " deer ancient cooking vessel note " that Chen Xiaochun acts the leading role collect to the 40th.Can obtain shape multimedia content description information as shown in table 2 thus:
Table 2: according to the multimedia content description information of an example of the present invention
| Heading message | Reproduction time | Summary info | Content detail information | |
| Deer ancient cooking vessel note (36-40) | 08:00-20:00 | The Wei Xiaobao identity is exposed, and Kangxu is furious, and how are Wei Xiaobao and seven wife's destiny ... | Time point t1 ' and corresponding sectional drawing | Time point t2 ' and corresponding sectional drawing |
| ... | ... | ＊＊＊＊＊ | ... | ... |
Concrete, in the morning 08:20:15 this constantly, multimedia server 2 just is sent to user terminal 3 with the part content of multimedia that " deer ancient cooking vessel note " the 36th concentrated, and meanwhile, network multimedia server 2 also is sent to content description information server 1 with this content of multimedia.Wherein, suppose the employing RMVB form of this content of multimedia (video),, it will be appreciated by those skilled in the art that video format and corresponding encoding and decoding technique are very ripe now, need not to give unnecessary details naturally its encoding and decoding technique is also corresponding with this kind form.
Suppose that content description information server 1 needs to obtain the content detail information of content of multimedia " deer ancient cooking vessel note (36-40) " on time point 08:20:15, so, receive from network multimedia server 2 corresponding to this time content of multimedia that engraves after, the content of multimedia that engraves during to this carries out decoding processing and encoding process, to generate corresponding to this pictorial information constantly.Particularly, player/the coding/decoding module at content description information server 1 place is located the video data frame that is positioned on this time point of 08:20:15 according to the control information (for example file header information, index information etc.) of this content of multimedia, after this frame decoded, again (for example based on the predetermined format of picture file, jpeg format) decoded data message is carried out respective coding, with obtain this content of multimedia 08:20:15 this time content detail information that engraves.Existing perfect video interception technology in the prior art, the extracting of the pictorial information of video content can adopt that wherein any is realized among the present invention, repeats no more, and the intercepting of audio frequency, video segment is in like manner.
Preferably, when content description information server 1 obtained this content of multimedia 08:20:15 this time pictorial information that engraves after, can also discern this picture by the image recognition technology, thereby identify personage in this picture (for example, acting the leading role Chen Xiaochun).
After content description information server 1 identifies personage in this picture (for example, acting the leading role Chen Xiaochun), can be with some information relevant as content detail information with Chen Xiaochun.For example, the heading message of the TV play that Chen Xiaochun can be acted the leading role of content description information server 1 and film is as content detail information.Particularly, content description information server 1 can be searched the information relevant with Chen Xiaochun from another is specifically designed to each performer's of storage the memory device of relevant information, and with it as content detail information.Certainly, if just store each performer's relevant information in the local storage of content description information server 1, then 1 need of content description information server are searched the information relevant with Chen Xiaochun from local storage, and with it as content detail information.
Preferably, content description information server 1 can also receive from network multimedia server 2 corresponding to the content of multimedia on a certain period, and it is carried out decoding processing and encoding process, to generate corresponding to audio-frequency fragments information on this period or video segment information.
Concrete, this period of 09:10:25-09:12:10 in the morning, network multimedia server 2 just is sent to user terminal 3 with the part content of multimedia of " deer ancient cooking vessel note " the 37th collection, meanwhile, network multimedia server 2 also will be sent to content description information server 1 corresponding to the content of multimedia on this period.
After content description information server 1 receives corresponding to the content of multimedia on this period, this content of multimedia is carried out decoding processing and encoding process, to generate corresponding to audio fragment information on this period or video segment information.This audio fragment information or video segment information can be used as " deer ancient cooking vessel note (36-40) " in the content detail information of 09:10:25-09:12:10 on this period.
Further, when content description information server 1 has obtained TV play " deer ancient cooking vessel note " the 37th collection in the audio fragment information of 09:10:25-09:12:10 on this period, content description information server 1 can also be according to the audio fragment information on this period, utilize speech recognition technology to identify dialogue between the personage, thereby generate text description information, promptly corresponding to the brief introduction of this period corresponding to this period.Alternately, the brief introduction of this period can also obtain by reading caption information (if having).
Subsequently, in step S13, content description information server 1 is that this content of multimedia generates multimedia content description information based on the content detail information of the essential information of this content of multimedia and this content of multimedia of being generated.
At last, in step S14, content description information server 1 is sent to user terminal 3 with the multimedia content description information that is generated.
User terminal 3 shows the user with it after receiving multimedia content description information from content description information server 1.
Change in the example at one, come for content of multimedia generates content detail information by multimedia server 2, and the content detail information that is generated is sent to content description information server 1.
Hereinafter with reference to Fig. 3 and Fig. 4 above-mentioned variation example is described, the description of Fig. 1 is incorporated herein by reference.
The user terminal that is used in the content description information server that Fig. 3 shows according to another embodiment of the present invention provides the method flow diagram of multimedia content description information.
Fig. 4 shows according to a specific embodiment of the present invention, is used for the auxiliary method flow diagram that multimedia content description information is provided for user terminal in the network multimedia server.
Referring to Fig. 4, at first, in step S31, multimedia server 2 generates the content detail information of described content of multimedia.
Preferably, multimedia server 2 can generate the content detail information of this content of multimedia sending content of multimedia in user terminal 3 according to this content of multimedia.Wherein, preferably, multimedia server 2 can generate the content corresponding detailed information periodically according to the current content of multimedia that mails to user terminal 3.
Certainly, broadcast or the program (normally prestoring) of program request for wheel, multimedia server 2 can generate the content detail information of this content of multimedia in advance according to all or part of content information of this content of multimedia of being stored in its internal storage.
Generate the concrete grammar step of the content detail information of content of multimedia according to content of multimedia for multimedia server 2, see also the description that generates the content detail information of content of multimedia among Fig. 2 about content description information server 1 according to the content of multimedia that is received, for simplicity's sake, do not give unnecessary details at this.
Secondly, in step S32, multimedia server 2 is sent to content description information server 1 with the content detail information of the described content of multimedia that generated.
Referring again to Fig. 3, for content description information server 1, at first, and in step S21, the content detail information that content description information server 1 receives from a content of multimedia of multimedia server 2.
After content description information server 1 receives content detail information from this content of multimedia of network multimedia server 2, in step S22, content description information server 1 is that described content of multimedia generates multimedia content description information based on the essential information of this content of multimedia and the content detail information from the described content of multimedia of multimedia server 2 that received.
At last, in step S23, content description information server 1 is sent to user terminal 3 with the multimedia content description information that is generated.
User terminal 3 shows the user with it after receiving multimedia content description information from content description information server 1.
Followingly a third aspect of the present invention is described, the description of Fig. 1 is incorporated herein by reference with reference to Fig. 5.
The user terminal that is used in the content description information server that Fig. 5 shows according to a specific embodiment of the present invention provides the structured flowchart of the generator of multimedia content description information.Diagram generator 10 comprises first generating apparatus 103, first dispensing device 104, second deriving means 101 and second generating apparatus 102.
At first, the content of multimedia that receives from network multimedia server 2 of second deriving means 101 in the generator 10 that comprised of content description information server 1.
Concrete, multimedia server 2 can send it to content description information server 1 when content of multimedia is sent to user terminal 3.
Certainly, broadcast program or request program for the circulation wheel, multimedia server 2 can be earlier be sent to content description information server 1 with the part or all of content information of this content of multimedia of being stored in its internal storage, second generating apparatus 102 in the generator 10 that content description information server 1 is comprised generates content detail information for this content of multimedia in advance according to the part or all of content information of this received content of multimedia.
More specifically, 101 acquisitions of second deriving means include but not limited to following two kinds from the mode of the content of multimedia of multimedia server 2:
A) passive receiving multimedia content
When network multimedia server 2 sends content of multimedia to user terminal 3, also this content of multimedia is pushed to content description information server 1.
Second deriving means 101 in the generator 10 is handled to generate the content detail information of one or more content of multimedia it after receiving content of multimedia from network multimedia server 2.
If multimedia server 2 ceaselessly sends the data of this content of multimedia to content description information server 1, then will cause a certain amount of bandwidth to be taken by content description information server 1 all the time, and can not be used by users' terminal, this mode can reduce bandwidth availability ratio when multimedia server 2 adopts client-server (server-client) technology to carry out transfer of data.Therefore, and considering that each content detail information of a content of multimedia typically intersperses among a plurality of play time/Duan Shanghou of this content of multimedia, multimedia server 2 promptly sends the partial data of this content of multimedia to described content description information server 1 every one-period, therefrom obtain the content detail information of this content of multimedia for the latter.
B) active request receiving multimedia content
The 3rd dispensing device in the generator 10 that content description information server 1 is comprised (for simplicity's sake, not shown among Fig. 5) send the content of multimedia request message to multimedia server 2, multimedia server 2 is according to the content of multimedia request message from content description information server 1, when content of multimedia is sent to user terminal 3, send it to content description information server 1.
Preferably, the 3rd dispensing device in the generator 10 can periodically send the content of multimedia request message to network multimedia server 2, multimedia server 2 is behind the content of multimedia request message that at every turn receives from content description information server 1, and a part of content that sends this content of multimedia is to described content description information server 1.
Secondly, second generating apparatus 102 in the generator 10 that content description information server 1 is comprised is according to received content of multimedia, for described content of multimedia generates content detail information.
Further, the content detail information of each content of multimedia is relevant with the one or more moment or the content on one or more time period of this content of multimedia.
Below the TV play " deer ancient cooking vessel note " of acting the leading role with Chen Xiaochun be example, the function that second generating apparatus 102 in the generator 10 is realized describes.
At first, suppose the same day from morning 08:00 to evening the 36th collection that 20:00 circulation wheel is broadcast the TV play " deer ancient cooking vessel note " that Chen Xiaochun acts the leading role collect to the 40th.Corresponding multimedia content description information form can see Table 2.
Concrete, in the morning 08:20:15 this constantly, network multimedia server 2 just is sent to user terminal 3 with the part content of multimedia that " deer ancient cooking vessel note " the 36th concentrated, and meanwhile, network multimedia server 2 also is sent to content description information server 1 with this content of multimedia.Wherein, suppose the employing RMVB form of this content of multimedia (video),, it will be appreciated by those skilled in the art that video format and corresponding encoding and decoding technique are very ripe now, need not to give unnecessary details naturally its encoding and decoding technique is also corresponding with this kind form.
Suppose that content description information server 1 needs to obtain the content detail information of content of multimedia " deer ancient cooking vessel note (36-40) " on time point 08:20:15, so, when second deriving means 101 in the generator 10 receive from network multimedia server 2 corresponding to this time content of multimedia that engraves after, second generating apparatus 102 in the generator 10, the content of multimedia that engraves during to this carries out decoding processing and encoding process, the pictorial information that engraves when generating corresponding to this.Particularly, second generating apparatus 102 is located the video data frame that is positioned on this time point of 08:20:15 according to the control information (for example file header information, index information etc.) of this content of multimedia, after this frame decoded, again (for example based on the predetermined format of picture file, jpeg format) decoded data message is carried out respective coding, with obtain this content of multimedia 08:20:15 this time content detail information that engraves.Existing perfect video interception technology in the prior art, the extracting of the pictorial information of video content can adopt that wherein any is realized among the present invention, repeats no more, and the intercepting of audio frequency, video segment is in like manner.
Preferably, when second generating apparatus 102 in the generator 10 generated content of multimedia " deer ancient cooking vessel note (36-40) " 08:20:15 this time pictorial information that engraves after, video identification device in the content description information server 1 (for simplicity's sake, not shown among Fig. 5) can also discern this picture by the image recognition technology, thereby identify the personage's (for example, acting the leading role Chen Xiaochun) in this picture.
After the video identification device in the content description information server 1 identifies personage in this picture (for example, acting the leading role Chen Xiaochun), can be with some information relevant as content detail information with Chen Xiaochun.For example, the heading message of the TV play that Chen Xiaochun can be acted the leading role of content description information server 1 and film is as content detail information.Further, search device (for simplicity's sake in the content description information server 1, not shown among Fig. 5) can from another is specifically designed to each performer's of storage the memory device of relevant information, search the information relevant with Chen Xiaochun, and with it as content detail information.
Certainly, if just store each performer's relevant information in the local storage of content description information server 1, then the device of searching in the content description information server 1 only needs to search the information relevant with Chen Xiaochun from local storage, and with it as content detail information.
Preferably, second deriving means 101 in the generator 10 can also receive from network multimedia server 2 corresponding to the content of multimedia on a certain period, then, second generating apparatus 102 in the generator 10 carries out decoding processing and encoding process to it, to generate corresponding to audio-frequency fragments information on this period or video segment information.
Concrete, this period of 09:10:25-09:12:10 in the morning, network multimedia server 2 just is sent to user terminal 3 with the part content of multimedia of " deer ancient cooking vessel note " the 37th collection, meanwhile, network multimedia server 2 also will be sent to content description information server 1 corresponding to the content of multimedia on this period.
After second deriving means 101 in the generator 10 receives corresponding to the content of multimedia on this period, 102 pairs of these content of multimedia of second generating apparatus in the generator 10 carry out decoding processing and encoding process, to generate corresponding to audio fragment information on this period or video segment information.This audio fragment information or video segment information can be used as " deer ancient cooking vessel note (36-40) " in the content detail information of 09:10:25-09:12:10 on this period.
Further, when second generating apparatus 102 in the generator 10 has generated TV play " deer ancient cooking vessel note " the 37th collection in the audio fragment information of 09:10:25-09:12:10 on this period, speech recognition equipment in the content description information server 1 (for simplicity's sake, not shown among Fig. 5) can also be according to the audio fragment information on this period, utilize speech recognition technology to identify dialogue between the personage, thereby generate text description information, promptly corresponding to the brief introduction of this period corresponding to this period.Alternately, the brief introduction of this period can also obtain by reading caption information (if having).
Subsequently, first generating apparatus 103 in the generator 10 that content description information server 1 is comprised is that this content of multimedia generates multimedia content description information based on the content detail information corresponding to the essential information of this content of multimedia and this content of multimedia of being generated.
At last, first dispensing device 104 in the generator 10 that comprised of content description information server 1 is sent to user terminal 3 with the multimedia content description information that is generated.
User terminal 3 shows the user with it after receiving multimedia content description information from content description information server 1.
Change in the example at one, when content of multimedia is sent to user terminal 3, and the content detail information that is generated is sent to content description information server 1 by multimedia server 2.
Hereinafter with reference to Fig. 6 and Fig. 7 above-mentioned variation example is described, the description of Fig. 1 is incorporated herein by reference.
Fig. 6 shows according to another embodiment of the present invention, is used to user terminal that the structured flowchart of the generator of multimedia content description information is provided in the content description information server.
Fig. 7 shows according to a specific embodiment of the present invention, is used for the auxiliary structured flowchart that the auxiliary generator of multimedia content description information is provided for user terminal in the network multimedia server.
With reference to Fig. 7, at first, the 3rd generating apparatus 201 in the auxiliary generator 20 that multimedia server 2 is comprised generates the content detail information of this content of multimedia according to content of multimedia.
Preferably, the 3rd generating apparatus 201 in the auxiliary generator 20 can generate the content detail information of this content of multimedia sending content of multimedia in user terminal 3 according to this content of multimedia.Wherein, preferably, the 3rd generating apparatus 201 in the auxiliary generator 20 can generate the content corresponding detailed information periodically according to the current content of multimedia that mails to user terminal 3.
Certainly, broadcast or the program (normally prestoring) of program request for wheel, the 3rd generating apparatus 201 in the auxiliary generator 20 can generate the content detail information of this content of multimedia in advance according to all or part of content information of this content of multimedia that prestores.
For the 3rd generating apparatus 201 in the auxiliary generator 20 according to content of multimedia, generate the detailed process of the content detail information of content of multimedia, see also second generating apparatus 102 in the generator 10 that is comprised about content description information server 1 among Fig. 5 generates the content detail information of content of multimedia according to the content of multimedia that is received associated description, for simplicity's sake, do not give unnecessary details at this.
Secondly, second dispensing device 202 in the auxiliary generator 20 that network multimedia server 2 is comprised is sent to content description information server 1 with the content detail information of this content of multimedia of generate.
Referring to Fig. 6, for content description information server 1, at first, the content detail information that receives from network multimedia server 2 of first deriving means 105 ' in the generator 10 ' that comprised of content description information server 1 corresponding to one or more content of multimedia.
After first deriving means 105 ' in the generator 10 ' receives content detail information from this content of multimedia of network multimedia server 2, first generating apparatus 103 ' in the generator 10 ' that content description information server 1 is comprised is that this content of multimedia generates multimedia content description information based on the essential information of this content of multimedia and the content detail information from this content of multimedia of multimedia server 2 that received.
At last, first dispensing device 104 ' in the generator 10 ' that comprised of content description information server 1 is sent to user terminal 3 with the multimedia content description information that is generated.
User terminal 3 shows the user with it after receiving multimedia content description information from content description information server 1.
More than specific embodiments of the invention are described, it will be appreciated that the present invention is not limited to above-mentioned specific execution mode, those skilled in the art can make various typings and modification within the scope of the appended claims.
Claims (19)
1. method that is used to user terminal that multimedia content description information is provided in the network equipment wherein, may further comprise the steps:
B. be that one or more content of multimedia generate multimedia content description information, wherein, described multimedia content description information comprises the content detail information of described one or more content of multimedia;
C. described multimedia content description information is sent to described user terminal.
2. method according to claim 1 is characterized in that, the content detail information of described each content of multimedia is relevant with content on one or more moment of this content of multimedia or one or more period.
3. method according to claim 1 and 2 is characterized in that, may further comprise the steps before the described step b:
A. obtain the content detail information of described one or more content of multimedia;
Wherein, described step b also comprises: based on the content detail information of being obtained, for described one or more content of multimedia generate multimedia content description information.
4. method according to claim 3 is characterized in that, described step b also comprises: based on content detail information of being obtained and the content detail information that prestores, be that described one or more content of multimedia generate multimedia content description informations.
5. according to claim 3 or 4 described methods, it is characterized in that, the described network equipment is independent of the network multimedia server that is used to provide content of multimedia, and wherein, described step a comprises: the content detail information of being obtained described one or more content of multimedia by the network multimedia server.
6. according to claim 3 or 4 described methods, it is characterized in that described step a may further comprise the steps:
A1. obtain content of multimedia;
A2. according to the content of multimedia that is obtained, generate the content detail information of described one or more content of multimedia.
7. according to each described method in the claim 1 to 6, it is characterized in that, described content detail information comprise in the following each or appoint multinomial:
-the content that engraves during to each content of multimedia one or more intercepts and the pictorial information that generates;
-content on one or more periods of each content of multimedia is intercepted and the audio fragment information that generates;
-content on one or more periods of each content of multimedia is intercepted and the video segment information that generates;
-corresponding to the one or more moment of each content of multimedia or the text description information of the content on one or more period.
8. one kind is used for assisting the method that multimedia content description information is provided for user terminal in the network multimedia server, wherein, may further comprise the steps:
I. generate the content detail information of one or more content of multimedia;
Ii. the content detail information of described one or more content of multimedia being sent to is used to user terminal that the network equipment of multimedia content description information is provided.
9. generator that is used to user terminal that multimedia content description information is provided in the network equipment wherein, comprising:
First generating apparatus is used to one or more content of multimedia to generate multimedia content description information, and wherein, described multimedia content description information comprises the content detail information of described one or more content of multimedia;
First dispensing device is used for described multimedia content description information is sent to described user terminal.
10. generator according to claim 9 is characterized in that, the content detail information of described each content of multimedia is relevant with content on one or more moment of this content of multimedia or one or more period.
11. according to claim 9 or 10 described generators, it is characterized in that, also comprise:
First deriving means is used to obtain the content detail information of described one or more content of multimedia;
Wherein, described first generating apparatus also is used for based on the content detail information of being obtained, for described one or more content of multimedia generate multimedia content description information.
12. generator according to claim 11, it is characterized in that, described first generating apparatus also is used for based on content detail information of being obtained and the content detail information that prestores, is that described one or more content of multimedia generate multimedia content description informations.
13. according to claim 11 or 12 described generators, it is characterized in that, the described network equipment is independent of the network multimedia server that is used to provide content of multimedia, wherein, described first deriving means also is used for being obtained by the network multimedia server content detail information of described one or more content of multimedia.
14., it is characterized in that described first deriving means also comprises according to claim 11 or 12 described generators:
Second deriving means is used to obtain content of multimedia;
Second generating apparatus is used for according to the content of multimedia that is obtained, and generates the content detail information of described one or more content of multimedia.
15. according to each described generator in the claim 9 to 14, it is characterized in that, described content detail information comprise in the following each or appoint multinomial:
-the content that engraves during to each content of multimedia one or more intercepts and the pictorial information that generates;
-content on one or more periods of each content of multimedia is intercepted and the audio fragment information that generates;
-content on one or more periods of each content of multimedia is intercepted and the video segment information that generates;
-corresponding to the one or more moment of each content of multimedia or the text description information of the content on one or more period.
16. an auxiliary generator that is used for auxiliaryly providing for user terminal multimedia content description information in the network multimedia server wherein, comprising:
The 3rd generating apparatus is used to generate the content detail information of one or more content of multimedia;
Second dispensing device is used for content detail information with described one or more content of multimedia and is sent to and is used to user terminal that the network equipment of multimedia content description information is provided.
17. a network equipment is characterized in that, comprises according to each described generator that is used to user terminal that multimedia content description information is provided in the claim 9 to 15.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2008100334933A CN101499915A (en) | 2008-02-03 | 2008-02-03 | Method and apparatus for providing multimedia content description information for customer in Internet |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2008100334933A CN101499915A (en) | 2008-02-03 | 2008-02-03 | Method and apparatus for providing multimedia content description information for customer in Internet |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101499915A true CN101499915A (en) | 2009-08-05 |
Family
ID=40946806
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2008100334933A Pending CN101499915A (en) | 2008-02-03 | 2008-02-03 | Method and apparatus for providing multimedia content description information for customer in Internet |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101499915A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101969546A (en) * | 2009-09-30 | 2011-02-09 | 突触计算机系统（上海）有限公司 | Method and device for providing electric program, publishing and presenting advertisement |
| WO2011144117A3 (en) * | 2011-05-27 | 2012-04-26 | 华为技术有限公司 | Media transmission method, media reception method, client and system thereof |
| CN104185085A (en) * | 2014-03-28 | 2014-12-03 | 无锡天脉聚源传媒科技有限公司 | Video on-demand method and device |
| CN106210862A (en) * | 2016-07-21 | 2016-12-07 | 青岛海信传媒网络技术有限公司 | Method for processing program information and device |
| CN106462637A (en) * | 2014-06-20 | 2017-02-22 | 谷歌公司 | Displaying information related to content playing on a device |
| CN106462636A (en) * | 2014-06-20 | 2017-02-22 | 谷歌公司 | Clarifying audible verbal information in video content |
| CN108882024A (en) * | 2018-08-01 | 2018-11-23 | 北京奇艺世纪科技有限公司 | A kind of video broadcasting method, device and electronic equipment |
| CN110225367A (en) * | 2019-06-27 | 2019-09-10 | 北京奇艺世纪科技有限公司 | It has been shown that, recognition methods and the device of object information in a kind of video |
| US11350173B2 (en) | 2015-11-19 | 2022-05-31 | Google Llc | Reminders of media content referenced in other media content |
| US11354368B2 (en) | 2014-06-20 | 2022-06-07 | Google Llc | Displaying information related to spoken dialogue in content playing on a device |
-
2008
- 2008-02-03 CN CNA2008100334933A patent/CN101499915A/en active Pending
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101969546A (en) * | 2009-09-30 | 2011-02-09 | 突触计算机系统（上海）有限公司 | Method and device for providing electric program, publishing and presenting advertisement |
| WO2011144117A3 (en) * | 2011-05-27 | 2012-04-26 | 华为技术有限公司 | Media transmission method, media reception method, client and system thereof |
| CN104185085A (en) * | 2014-03-28 | 2014-12-03 | 无锡天脉聚源传媒科技有限公司 | Video on-demand method and device |
| CN104185085B (en) * | 2014-03-28 | 2017-08-08 | 无锡天脉聚源传媒科技有限公司 | A kind of VOD method and device |
| US11064266B2 (en) | 2014-06-20 | 2021-07-13 | Google Llc | Methods and devices for clarifying audible video content |
| US11797625B2 (en) | 2014-06-20 | 2023-10-24 | Google Llc | Displaying information related to spoken dialogue in content playing on a device |
| CN106462637A (en) * | 2014-06-20 | 2017-02-22 | 谷歌公司 | Displaying information related to content playing on a device |
| CN106462636A (en) * | 2014-06-20 | 2017-02-22 | 谷歌公司 | Clarifying audible verbal information in video content |
| US11425469B2 (en) | 2014-06-20 | 2022-08-23 | Google Llc | Methods and devices for clarifying audible video content |
| US11354368B2 (en) | 2014-06-20 | 2022-06-07 | Google Llc | Displaying information related to spoken dialogue in content playing on a device |
| CN106462637B (en) * | 2014-06-20 | 2020-12-08 | 谷歌有限责任公司 | Displaying information related to content played on a device |
| US11350173B2 (en) | 2015-11-19 | 2022-05-31 | Google Llc | Reminders of media content referenced in other media content |
| CN106210862B (en) * | 2016-07-21 | 2020-06-30 | 青岛海信传媒网络技术有限公司 | Program information processing method and device |
| CN106210862A (en) * | 2016-07-21 | 2016-12-07 | 青岛海信传媒网络技术有限公司 | Method for processing program information and device |
| CN108882024A (en) * | 2018-08-01 | 2018-11-23 | 北京奇艺世纪科技有限公司 | A kind of video broadcasting method, device and electronic equipment |
| CN110225367A (en) * | 2019-06-27 | 2019-09-10 | 北京奇艺世纪科技有限公司 | It has been shown that, recognition methods and the device of object information in a kind of video |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101499915A (en) | Method and apparatus for providing multimedia content description information for customer in Internet | |
| CN108391179B (en) | Live broadcast data processing method and device, server, terminal and storage medium | |
| KR102075174B1 (en) | Trigger compaction | |
| RU2601446C2 (en) | Terminal apparatus, server apparatus, information processing method, program and interlocked application feed system | |
| US20160073141A1 (en) | Synchronizing secondary content to a multimedia presentation | |
| CN102422284B (en) | Bookmarking system | |
| CN105681912A (en) | Video playing method and device | |
| US20110078728A1 (en) | Method and means for providing electronic program guide and a method and means for posting and presenting advertisement | |
| US9615119B2 (en) | Method and apparatus for providing timeshift service in digital broadcasting system and system thereof | |
| US20100145938A1 (en) | System and Method of Keyword Detection | |
| WO2017116231A1 (en) | Live-stream video advertisement system | |
| CN101098329B (en) | Method and system for interactive request program | |
| CN101267543A (en) | Method of providing metadata , method of managing the provided metadata and apparatus using the methods | |
| US20130070152A1 (en) | Sampled digital content based syncronization of supplementary digital content | |
| CN101576930A (en) | Publishing key frames of a video content item being viewed by a first user to one or more second users | |
| CN103051931A (en) | Method, server, client and system for recording and playing replay program | |
| US11463741B2 (en) | Methods and systems for dynamic routing of content using a static playlist manifest | |
| US9002717B2 (en) | Method and apparatus for audio communication of information | |
| KR101293301B1 (en) | System and method for serching images using caption of moving picture in keyword | |
| CN105210376A (en) | Using an audio stream to identify metadata associated with a currently playing television program | |
| CN109218765B (en) | Live video room recommendation method and device | |
| CN103688553A (en) | Using a closed caption stream for device metadata | |
| US20120167140A1 (en) | System and method of providing personalized service | |
| CN109842804A (en) | Processing method and server, the computer storage medium of audio, video data | |
| JP2016532969A (en) | Related content processing method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Open date: 20090805 |