CN101075233A - Member, system and method for collecting multi-medium content - Google Patents
Member, system and method for collecting multi-medium content Download PDFInfo
- Publication number
- CN101075233A CN101075233A CN 200610080570 CN200610080570A CN101075233A CN 101075233 A CN101075233 A CN 101075233A CN 200610080570 CN200610080570 CN 200610080570 CN 200610080570 A CN200610080570 A CN 200610080570A CN 101075233 A CN101075233 A CN 101075233A
- Authority
- CN
- China
- Prior art keywords
- content
- multimedia
- retrieval
- information
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
A content collection system of multimedia comprises playing server for providing content of multimedia, multimedia content collection component for indexing out relevant multimedia content from media stream played by said server media character in service request provided by user and for providing indexed multimedia content to user terminal, user terminal for providing service request to said component and for receiving multimedia content provided from said component. The method applying said system to collect multimedia content is also disclosed.
Description
Technical field
The present invention relates to technical field of digital media, particularly collecting multi-medium content parts, system and method thereof.
Background technology
The development of digital media technology such as internet, Digital Television, Web TV has brought diversified digital multimedia services, itself and traditional media business are that as the difference of maximums such as TV, broadcasting business has interactivity and can provide individual business to the user.On the other hand, the development of internet causes quantity of information to increase severely, and how obtaining valuable content from the information of magnanimity becomes the problem that the user pays close attention to most, for addressing this problem, has successively developed multiple search technique.
Provide personalized multimedia service need be based upon on the basis of retrieval technique to the user.The patent of invention of application number 00107315 " is used the multi-media content extraction system and the method for user described data recording medium " and is disclosed a kind of method that the personalized multi-media business is provided to the user based on retrieval technique.This method is used and is write down the user characteristic data recording medium that shows user preference in advance, automatically select and extract the content of multimedia of customer requirements between a plurality of content of multimedia from be stored in content stores supply part in advance, by user terminal apparatus that the user characteristic data recording medium is packed into, import and read the user characteristic data that is recorded in advance on the user characteristic data recording medium; The user characteristic data of using input is as search key, this key word recognition the feature of user's interest content of multimedia, automatically retrieved content of multimedia: and automatically select and extract the content of customer requirements and display it according to result for retrieval.
The user record medium refers to the medium of recording user characteristic, may be the medium of similar IC-card, magnetic card etc.The data of storing in the recording medium will be as search key.The search key reading section reads user characteristic data from the user record medium, as the search key of retrieval similarity evaluation part.Illustrated in the patent document that in addition search key reading section, retrieval similarity evaluation part, controller, content choice are extracted part and can be placed in content of multimedia supply part.This show the retrieval and contents extraction can carry out on the server or on terminal.This method can realize extracting automatically the user's interest content, and can allow the user browse these contents at any time.
The significant disadvantages of above-mentioned patented method adopts the retrieval technique based on literal exactly, rather than the real retrieval technique based on content of multimedia feature or semantic information of multimedia feature, and described search key can not accurately be represented the user's interest content; Therefore retrieving the content that obtains may be a lot, and is not that the user is really interested probably.The consequence that causes like this is: the user still need select in the content that retrieves in a large number, uses this individual business very inconvenient; The content of multimedia that network side need provide enough storage space memory scans to arrive will take a large amount of storage spaces like this.
In addition, this retrieval mode relies on terminal to realize fully, and terminal capability has been proposed higher requirement, and searching algorithm is difficult to change; If certain Search Requirement can satisfy a lot of user's requests simultaneously, also can only repeat separately by a plurality of terminals, the content that retrieves also must repeat to be placed on a plurality of terminals.
Summary of the invention
In view of this, the objective of the invention is to, propose a kind of collecting multi-medium content parts, can accurately find the content of multimedia that meets specific multimedia feature.These parts comprise as the lower part:
The retrieval control module is used to receive the retrieval tasks that comprises the multimedia feature, the content of multimedia feature or the semantic feature that become the search function unit to discern the multimedia Feature Conversion that is received, and retrieval tasks distributed to the search function unit;
At least one search function unit is used for retrieving the content of multimedia with the multimedia feature that is comprised in the retrieval tasks that is assigned with at the Media Stream that needs are retrieved.
Described parts can further include:
The programme information maintenance module is used to create and safeguards the content identification that is used to preserve the content of multimedia that the search function unit retrieves and the personal program information table of content description information;
The function of then described search function unit further comprises: the multimedia content description information that retrieves is fed back to the retrieval control module;
The function of described retrieval control module further comprises: the content description information allocation contents according to search function unit feedback identifies, and content identification and the multimedia content description information that is distributed is sent to the programme information maintenance module.
Preferably, described parts can further include:
Content managing module is used for content of multimedia and content identification that the memory scan functional unit is retrieved, and carries out related with the content corresponding sign content of multimedia of being stored; Send to such an extent that content identification sends content of multimedia associated therewith to user terminal according to user terminal;
The function of then described retrieval control module further comprises: the content identification that is distributed is sent to corresponding search function unit;
The function of search function unit further comprises: the content identification of being received and the content of multimedia corresponding with described content identification are sent to content managing module.
Preferably, described parts can further include:
User's request processing module, be used to receive the service request that comprises user ID and multimedia feature at least from user terminal, multimedia feature in the service request is analyzed, created or the renewal retrieval tasks, with retrieval tasks input retrieval control module according to the result who analyzes; Notify program maintenance of information module creation or upgrade corresponding personal program information table in the time of establishment or renewal retrieval tasks.
Preferably, described user's request processing module further comprises:
The request receiving element is used to receive the service request that user terminal is sent, and the service request that is received is transmitted to the requirement analysis unit;
The requirement analysis unit, be used for analyzing from the service request of request receiving element, generate retrieval tasks and deterministic retrieval scope according to multimedia feature of carrying in the service request and user ID, and for retrieval tasks allocating task sign, with the retrieval tasks incoming task formation that is generated; Notice program maintenance of information module creation personal program information table;
Task queue is deposited the retrieval tasks of requirement analysis unit input, and is extracted stored retrieval tasks and be sent to the retrieval control module.
Describedly retrieval tasks is distributed to the search function unit be: described retrieval tasks is distributed to search function unit with function of retrieving according to described multimedia feature.
Another object of the present invention is to, propose a kind of system that is used to carry out collecting multi-medium content, can accurately find the content of multimedia that meets customer requirements.This system comprises:
Be used to provide the Play Server of content of multimedia;
The collecting multi-medium content parts, be used for multimedia characteristic information according to the service request of user's submission, from the Media Stream that the content of multimedia Play Server is play, retrieve corresponding content of multimedia, and the content of multimedia that retrieves is offered user terminal;
User terminal is used for submitting the service request that comprises the multimedia characteristic information at least to the collecting multi-medium content parts, also is used to receive the content of multimedia from the collecting multi-medium content parts.
Preferably, described collecting multi-medium content parts further comprise:
User's request processing module is used to receive the service request from user terminal, and service request is analyzed, and generates the driving incident of retrieval tasks as retrieval module; Notice program maintenance of information module creation personal program information table when creating retrieval tasks;
Retrieval module is used to carry out the retrieval tasks that user's request processing module is generated, and the content of multimedia that the content of multimedia Play Server is play is retrieved; And the content of multimedia that is retrieved is sent to content managing module; Notice program maintenance of information mould certainly upgrades the personal program information of its maintenance;
The programme information maintenance module is used to create and safeguards the personal program information table of the relevant information that is used to preserve the content of multimedia that retrieval module retrieves issue the personal program information table to user terminal;
Content managing module is used for the content of multimedia that the memory scan module is retrieved, and sends the content of multimedia of being stored to user terminal.
Preferably, described user's request processing module further comprises:
The request receiving element is used to receive the service request that user terminal is sent, and the service request that is received is transmitted to the requirement analysis unit;
The requirement analysis unit, be used for analyzing from the service request of request receiving element, generate retrieval tasks and deterministic retrieval scope according to multimedia feature of carrying in the service request and user ID, and for retrieval tasks allocating task sign, with the retrieval tasks incoming task formation that is generated; Notice program maintenance of information module creation personal program information table;
Task queue is deposited the retrieval tasks of requirement analysis unit input, and is extracted stored retrieval tasks and be sent to retrieval module.
Described range of search comprises the start and end time of retrieval at least;
Range of search may further include: the program channel that need be retrieved.
At least comprise task identification, multimedia feature and range of search in the retrieval tasks of depositing in the described task queue.
Described retrieval module further comprises:
The retrieval control module, be used to receive retrieval tasks from user's request processing module, analyze the multimedia characteristic attribute of retrieval tasks, content of multimedia feature or semantic feature that the multimedia Feature Conversion that user perspective in the retrieval tasks is understood becomes the search function unit to discern are distributed to suitable search function unit according to the result who analyzes with retrieval tasks; The relevant information of the content of multimedia that the search function unit is retrieved is sent to the programme information maintenance module;
The search function unit of at least one, be used for according to the retrieval retrieval tasks that control module distributed, the content of multimedia that retrieval has the multimedia feature in the retrieval tasks in from the Media Stream of content of multimedia Play Server, to comprise that the content of multimedia that retrieves and the Search Results of content description information feed back to the retrieval control module, and the content of multimedia that retrieves will be sent to content managing module.
The relevant information of the content of multimedia that described retrieval control module retrieves the search function unit is sent to the programme information maintenance module and comprises:
The retrieval control module be to identify from the content of multimedia allocation contents of search function unit, and content description information and the content identification that distributed are sent to the programme information maintenance module;
The function of search function unit further comprises: will retrieve the content identification that control module distributes and be sent to content managing module.
Described search function unit comprises one of following feature at least:
A certain class retrieval tasks can be finished in each search function unit;
The content of multimedia of intercepting and capturing can be kept in the search function unit in retrieving;
Each search function unit can the more than one retrieval tasks of executed in parallel.
Described programme information maintenance module is created and is safeguarded that the personal program information table comprises: create or renewal personal program information table according to the notification message of sending after establishment of user's request processing module or the renewal retrieval tasks; Retrieve the content identification and the content description information that send after the related content according to retrieval module and safeguard the personal program information table.
Described personal program information table comprises following content at least: user ID; The task identification of the retrieval tasks that the service request of being submitted to by described user ID causes; Also has corresponding range of search information for each task identification; For each content of multimedia, comprise content identification and content description information.
Described content description information comprises: retrieve the range describe information of described content of multimedia, the task identification of retrieval tasks that retrieves described content of multimedia and the attribute information of described content of multimedia.
The range describe information of described content of multimedia comprises the time that retrieves described content of multimedia at least; Can further include the program channel that described content of multimedia belongs to;
The attribute information of described content of multimedia comprises following a kind of at least: the time span of content of multimedia, media formats.
The part or all of module of described collecting multi-medium content parts is: the functional module of the functional module of content of multimedia Play Server, other equipment of server side or server apparatus independently.
The present invention also aims to, propose a kind of method of collecting multi-medium content, can accurately find the content of multimedia that meets customer requirements.This method comprises the steps:
A, user terminal generate and comprise to the collecting multi-medium content parts transmission of server side the service request of multimedia feature and user ID;
B, collecting multi-medium content parts are according to the multimedia characteristic information in the service request of user's submission, the corresponding content of multimedia of retrieval from the Media Stream that the content of multimedia Play Server is play, the content of multimedia that preservation is retrieved and the relevant information of content of multimedia.
The described user terminal of steps A generates service request: default business request information template is edited, generate business request information; Described editor comprises the intelligible multimedia characteristic information of interpolation user at least, can also comprise the prescribed information of hunting zone.
The prescribed information of described range of search comprises following a kind of information at least: retrieval starting and ending time, the program channel that is retrieved.
Preferably, step B comprises:
B1, collecting multi-medium content parts are set up according to the service request of being received or are upgraded retrieval tasks, and create or upgrade the personal program information table of relative users;
B2, execution retrieval tasks are stored the content of multimedia that is retrieved, and the relevant information of described content of multimedia are deposited in the personal program information table of relative users.
Preferably, the described collecting multi-medium content parts of step B1 are set up according to the service request of being received or are upgraded retrieval tasks and comprise:
B11, received service request is analyzed, extract necessary informations such as the user ID that comprises in the request message, multimedia characteristic information, range of search prescribed information, according to the range of search deterministic retrieval scope of range of search prescribed information and server side acquiescence;
The retrieval tasks that B12, inquiry have existed judges whether the multimedia characteristic information in the described service request is included in the retrieval tasks that has existed, if then upgrade the task attribute of the described retrieval tasks that has existed; Otherwise set up new retrieval tasks and the task attribute of the retrieval tasks of being set up is set, described task attribute comprises the multimedia feature at least, task identification and range of search.
The described deterministic retrieval scope of step B11 comprises:
Check whether the range of search information in the service request is complete, if, then according to the range of search information deterministic retrieval scope of service request; Otherwise if the range of search information in the service request is imperfect, then the range of search according to acquiescence is additional complete with the range of search information of service request, and according to the range of search information deterministic retrieval scope after replenishing; If do not have range of search information in the service request, then the range of search with acquiescence is defined as range of search.
The personal program information table of described establishment of step B1 or renewal relative users comprises:
User ID, range of search and task identification that B13, basis extract from described service request, inquire about existing personal program information table, if find to have created personal program information table, then in described original personal program information table with same subscriber sign, upgrade the relevant information that changes or increase new task identification and relevant information with same subscriber sign; If find not create as yet personal program information table with described user ID, then create the personal program information table of this user ID, and incoming task sign and range of search.
Describedly in described original personal program information table with same subscriber sign, upgrade the relevant information that changes, perhaps increasing new task identification and relevant information is: judge the task identification that whether extracts to some extent in the customized information table of described user ID, if have, then upgrade the corresponding range of search of described task identification; Otherwise in described personal program information table, increase task identification and the corresponding range of search extracted.
The described execution retrieval tasks of step B2 is:
B21, be the discernible multimedia feature in search function unit, and described retrieval tasks is distributed to the search function unit with function of retrieving according to described multimedia feature the multimedia Feature Conversion in the retrieval tasks;
B22, begin to carry out this retrieval tasks, stop this retrieval tasks in the retrieval concluding time in the retrieval start time of described retrieval tasks;
B23, content identification of each bar content of multimedia distribution for retrieving.
Can further include after the step B23:
Whether B24, query contents administration module be available, if then continue to carry out subsequent step, otherwise returns the service fail prompting message and withdraw from this flow process to user terminal.
The content of multimedia that the described storage of step B2 is retrieved is:
Content managing module receives from the content of multimedia of search function unit and content identification, stores described content of multimedia and the memory location of content identification and content of multimedia is shone upon, and returns the response message that shows that storage is successful to the retrieval control module.
The relevant information of the described content of multimedia of step B2 comprises: the descriptor of content of multimedia and content identification.
Described content description information comprises: retrieve the range describe information of described content of multimedia, the task identification of retrieval tasks that retrieves described content of multimedia and the attribute information of described content of multimedia.
The range describe information of described content of multimedia comprises the time that retrieves described content of multimedia at least; Can further include the program channel that described content of multimedia belongs to;
The attribute information of described content of multimedia comprises following a kind of at least: the time span of content of multimedia, media formats.
Preferably, further comprise after the described B2: the collecting multi-medium content parts return to user terminal and show the response message that is ready to the personalized multi-media content.
Can further include after the described step B:
C, user terminal be to the relevant information of collecting multi-medium content component request content of multimedia, and according to the corresponding content of multimedia of being received of relevant information selective reception.
Described step C comprises:
C1, user terminal send the request that requires to obtain personal program information to the collecting multi-medium content parts;
After C2, collecting multi-medium content parts are received step C1 described request, in the personal program information table of described user terminal, find relevant programme information and the programme information that is found is back to described user terminal;
C3, user terminal are selected the wherein listed content of multimedia more than or according to the programme information of being received, send the request that requires to obtain selected content of multimedia to the collecting multi-medium content parts;
C4, collecting multi-medium content parts send corresponding content of multimedia to user terminal after receiving step C3 described request.
As can be seen from the above technical solutions, the retrieval technique that the present invention program adopts is based on the retrieval technique of content of multimedia feature or semantic feature, therefore the content of multimedia that retrieves can accurately meet the service request that the user submits to, more meet user's requirement than text based search method, can provide accurate personalized service for the user; And in the content that retrieval obtains useless in perhaps uncorrelated content will significantly reduce, do not need to use the storage space of magnanimity that the content of multimedia that retrieves is stored.
User terminal only need be submitted the multimedia feature that the user can understand among the present invention program, finish the conversion of the multimedia feature that multimedia feature that the user understands can discern to searching algorithm by server side, set up the retrieval tasks line search of going forward side by side, and the relevant information arrangement of the content of multimedia that searches is generated the personal program information table offer user terminal, make things convenient for the content of multimedia of user terminal reception oneself customization, the beneficial effect of this scheme is: to user terminal require low, the result for retrieval with identical multimedia feature that different user terminals is submitted to can be shared each other, and the user can easily learn individualized content and selective reception content wherein that oneself customizes, makes individual business very convenient to use.
Description of drawings
Fig. 1 is the structure and the annexation synoptic diagram of system of the present invention;
Fig. 2 is the synoptic diagram of the task queue of user's request processing module in the system of the present invention;
Fig. 3 is used to carry out the apparatus structure synoptic diagram of content of multimedia retrieval for the present invention;
Fig. 4 realizes that for the inventive method user terminal sends service request obtains the personalized multi-media content to this service terminal processing and Signalling exchange process flow diagram.
Embodiment
Along with the Multimedia Content Description Interface standard---(the Moving PictureExperts Group 7 of Motion Picture Experts Group-7, MPEG-7) issue, development and maturation based on the multimedia retrieval technology of content of multimedia feature, and based on the retrieval technique of high-rise semantic information of multimedia feature also in continuous development, more be applicable to the searching multimedia content than text search, will be widely used based on the multimedia retrieval technology of content of multimedia feature or semantic information of multimedia feature.Based on such background, the present invention proposes a kind of collecting multi-medium content method, this method can realize multimedia retrieval technology and personalized multimedia service are combined, and proposes to be used to realize the device and the system of described method.
The present invention program's substance is: in digital broadcasting, Web TV or similar Digital Media operation system, the user sends user's request by terminal to server, comprise user's interest multimedia characteristic information in this user's request, can further include the scope of retrieval, the source of the Media Stream that is retrieved as needs, described Media Stream source may be the set that the program channel of at least one is formed; And the starting and ending time of retrieving; Server is retrieved the Media Stream that belongs to range of search according to the multimedia characteristic information that user's request provides, and intercepting is also preserved user's interest Media Stream segment, and described Media Stream fragment may be video clips, audio-frequency fragments or static images etc.; Create and safeguard the personal program information table that is used to describe described Media Stream segment; The information that the user provides by the personal program information table can receive own customized individualized content.
For making the purpose, technical solutions and advantages of the present invention clearer, the present invention is further elaborated below in conjunction with accompanying drawing.For convenience of description, the user that below will customize the personalized multi-media business is called the individual character user, will not have the multimedia service user of customized personal multimedia service to be called domestic consumer, and the user then comprises individual character user and domestic consumer.
Figure 1 shows that the structural drawing of the collecting multi-medium content system that the present invention proposes, described system comprises following ingredient:
Described programme information comprises two parts, a part is that the user normally uses the required electronic program guides of multimedia service (Electronic Program Guide, EPG), this part programme information all is identical for all users, is not the emphasis considered of the present invention and does not also have shown in Figure 1; Another part system is the personal program information that each individual character user creates and safeguards specially, and personal program information comprises: whether customized individual business is available, specifically has which individual business or content to use.Personal program information is created by programme information maintenance module 150 and is safeguarded.It is that EPG carries out obtaining of general service information and professional subscription that individual character user utilizes general programme information, utilizes personal program information to obtain the information of individual business.
Described programme content also comprises two parts, and a part is the media stream from content play server 130, and this part is same as the prior art; Another part is the personalized multi-media content from content managing module 160.
User's request processing module 120 is used to receive the service request from user terminal 110, and service request is analyzed, and generates the driving incident of retrieval tasks as retrieval module 140; Notice program maintenance of information module 150 is created the personal program information table when creating retrieval tasks.
Programme information maintenance module 150, be used for creating and safeguarding the personal program information table, comprise according to the notification message of sending after establishment of user's request processing module or the renewal retrieval tasks and creating or renewal personal program information table, after retrieval module 140 retrieves related content, carry out the input or the renewal of personal program information, realize maintenance the personal program information table; Also be used for issuing the personal program information table to user terminal 110.
The content of multimedia that content managing module 160 is stored might not belong to some users separately, and is likely what a plurality of users shared, and this situation mainly is that different service request causes identical retrieval tasks to cause.
Described user's request processing module 120 can be divided into following three ingredients:
Request receiving element 121 is responsible for receiving the service request that user terminal 110 is sent, and the service request that is received is transmitted to requirement analysis unit 122.Described service request normally user is edited please seeking template of providing among the EPG that is obtained, form after the adding multimedia feature description information, the multimedia feature description information of carrying in the service request is normally understandable at user perspective, could be after need changing as search condition, needing in the business in addition provides some additional informations to include but not limited to user ID, range of search etc., described range of search comprises the start and end time of retrieval, the source of media that need be retrieved promptly needs to retrieve the content of multimedia which program channel is play.
More particularly, requirement analysis unit 122 needs to extract user ID, multimedia feature description information and the range of search in the service request; The multimedia feature of existing retrieval tasks judges whether it is identical with the multimedia feature of extracting in the query task formation 123 from the current business request; According to the result who judges, to create new retrieval tasks or upgrade existing retrieval tasks, the new retrieval tasks of creating also will be distributed corresponding task identification; And relevant informations such as user ID, task identification and range of search are sent to programme information maintenance module 150, programme information maintenance module 150 will or upgrade the personal program information table according to these information creatings of being received.Specific practice will partly be elaborated in method.
The retrieval tasks of requirement analysis unit input is deposited in task queue 123, if the service request that a plurality of user sends has caused identical retrieval tasks, then leaves in the task queue as a task.Figure 2 shows that the synoptic diagram of task queue 123, comprise a plurality of retrieval tasks in the task queue, be followed successively by task A, task B, task C or the like, each retrieval tasks has a plurality of attributes, comprise: task identification, multimedia feature, retrieval start time and retrieval concluding time, the program channel that need be retrieved also comprises the expansion content of reservation in addition, can expand according to actual needs.
Described retrieval module 140 comprises retrieval control module 141 and at least one search function unit 142.The structure of retrieval module 140 as shown in Figure 3, it only is a kind of signal that three search function unit 142 have been shown among Fig. 3, the number of actual retrieval functional unit is not limited thereto.The function of wherein retrieving control module 141 comprises:
Retrieval tasks in the task queue 123 of reception user request processing module 120 is analyzed the multimedia characteristic attribute of retrieval tasks, and then determines to adopt which search function unit 142 to carry out retrieval tasks;
Content of multimedia feature or semantic feature that the multimedia Feature Conversion that user perspective in the retrieval tasks is understood becomes search function unit 142 to discern; The present invention program does not comprise how carrying out the conversion to content of multimedia feature or semantic feature of multimedia feature that the user understands, as long as utilize the existing content of multimedia recognition technology that maybe will occur can realize this conversion;
Distribute retrieval tasks to give suitable search function unit 142; Receive the result for retrieval feedback of search function unit 142;
According to received result for retrieval feedback, the content of multimedia that obtains for retrieval distributes a content identification, whether query contents administration module 160 is available then, if it is available, content identification is sent to search function unit 142, notifies content of multimedia and the content identification of search function unit 142 to be sent to content managing module 160 simultaneously retrieving;
The response message that returns according to content managing module 160, content identification, contents attribute information, the task identification that retrieves this content of multimedia are sent to programme information maintenance module 150, trigger 150 pairs of personal program information tables of programme information maintenance module and create or upgrade.
Search function unit 142 is used for according to retrieving the retrieval tasks that control module 141 is distributed, retrieval meets the content of multimedia of the service request of service terminal 110 in from content play server Media Stream, retrieve behind the content of multimedia to retrieval control module 141 feedback searching results, comprise the attribute information of the content of multimedia that is retrieved in the described result for retrieval; And content of multimedia and the content identification that retrieves be sent to content managing module 160.
The retrieval technique that search function unit 142 uses comprises the searching algorithm that all are available, can realize multiple search function, and each search function shows as a search function unit.Searching algorithm itself is not a content of the present invention.
Described search function unit 142 has following characteristics:
1, a certain class retrieval tasks can be finished in each search function unit;
2, the content of multimedia of intercepting and capturing can be kept in the search function unit in retrieving;
3, each search function unit can the more than one retrieval tasks of executed in parallel, comprises that the search function unit can be to a plurality of retrieval tasks of same Media Stream executed in parallel and to different Media Stream parallel searches.
Need to prove that above-mentioned search function unit can be the set of a class retrieval example, for example retrieve content of multimedia and can be a search function with some particular shape characteristics.Be exemplified below:
Some retrieval examples are: the picture of a basketball of input, and require in the range of search of specifying or giving tacit consent to, to retrieve all and contain the basketball content of multimedia, comprise picture or video; Another retrieval example is: import an apple picture, requirement retrieves the content of multimedia that all contain apple in the range of search of specifying or giving tacit consent to, finish these two retrieval tasks and can be to use same search function to reach, that is to say that this search function unit can retrieve the static images with certain given shape, color.Similarly, another kind of search function may be the search function that realizes the complicated camera lens of certain class, can use same search function to finish as retrieval act of shooting, shooting action; Another kind of typical search function may be to realize the search function of similar recognition of face, and this search function can retrieve all pictures, video or the video clips that contains a certain individual face in the range of search of specifying or giving tacit consent to.The search function that search function of the present invention unit has includes but not limited to above-mentioned search function.
The personal program information description that described programme information maintenance module 150 is safeguarded have a content of multimedia feature in user's request.Retrieve the content of multimedia of user terminal 110 needs when retrieval module 140 after, except described content of multimedia is sent to the content managing module 160, also, comprise that the source of the task identification that retrieves this content of multimedia, the time that retrieves this content of multimedia, this content of multimedia and other descriptors are sent to programme information maintenance module 150 with the relevant information of described content of multimedia.After programme information maintenance module 150 is received every information from retrieval module 140, according to wherein task identification and retrieve the time of this content of multimedia, the personal program information table that is complementary is found in the source of this content of multimedia, and the personal program information table that the input of the relevant information of described content of multimedia is found, the programme information in the personal program information table is used for informing user terminal 110 and has retrieved and preserved which content of multimedia.
In programme information maintenance module 150, each individual character user who sends service request has corresponding personal program information table.The user's that programme information maintenance module 150 is safeguarded personal program information table has form as shown in table 1:
| Task identification 1 | Content identification 11 | Content identification 12 | ...... | Content identification N 1 | |
| Retrieval time 1 | Descriptor 11 | Descriptor 12 | ...... | Descriptor N 1 | |
| Other range describes 1 | Other information 11 | Other information 12 | ...... | Other information N 1 | |
| Task identification 2 | Content identification 21 | Content identification 22 | ...... | Content identification N 2 |
| User ID | Retrieval time 2 | Descriptor 21 | Descriptor 22 | ...... | Descriptor N 2 |
| Other range describes 2 | Other information 21 | Other information 22 | ...... | Other information N 2 | |
| ...... | ...... | ...... | ...... | ...... | |
| Task identification m | Content identification m1 | Content identification m2 | ...... | Content identification N m | |
| Retrieval time m | Descriptor m1 | Descriptor m2 | ...... | Descriptor N m | |
| Other range describes m | Other information m1 | Other information m2 | ...... | Other information N m |
Table 1
The personal program information table comprises that this shows pairing individual character user's user ID, and the task identification of each retrieval tasks that service request generated of submitting to according to described individual character user, in table 1, use respectively task identification 1, task identification 2 ... task identification m represents, the retrieval tasks number that m had submitted to for this user continues to append in the back new list item if this user continues to submit retrieval tasks to; Corresponding to each task identification, also list the range information that this retrieval tasks is retrieved in the table 1, described range of search comprises time period and other range describe information of the Media Stream broadcast that is retrieved, and described other range describe information can comprise the multimedia programming channel that need be retrieved; Also list content identification, content description information and other additional informations of all content of multimedia that this retrieval tasks retrieves in the table 1.For example, the scope of listing the retrieval tasks of task identification 1 in the table 1 comprises retrieval time 1 and other range describes 2, retrieves N
1Content of multimedia, these content of multimedia use respectively content identification 11, content identification 12 ... content identification N
1Expression; Corresponding to content identification 11, also have descriptor 11, other information 11.
In the above collecting multi-medium content system, user terminal 110 and content play server 130 are the ingredient of existing Digital Media System, user's request management module 120, retrieval module 140, programme information maintenance module 150 and content managing module 160 are for realizing the present invention program's the newly-increased ingredient of collecting multi-medium content at server side, be referred to as the collecting multi-medium content parts, can be used as the functional module of content play server 130, perhaps wherein partly or entirely module be the functional module of server side miscellaneous equipment or server apparatus independently.
In above-mentioned collecting multi-medium content system, sending service request from user terminal 110 receives to this terminal the process of personalized multi-media content of the service request correspondence of being sent, intrasystem processing and Signalling exchange flow process comprise the steps: as shown in Figure 4
Step 401: user terminal 110 generates service request, and sends the service request that is generated to the request receiving element 121 of user's request management module 120 of server side; At least comprise user ID and multimedia characteristic information in the described service request; Described multimedia characteristic information is the characteristic information that content of multimedia had that user's interest, hope can access; The prescribed information that can also comprise range of search in the service request, the prescribed information of described range of search comprise retrieval start time and concluding time; The program channel that need be retrieved etc.
In order to guarantee that service request has the discernible form of server side, a kind of template of business request information can be provided in being sent to the EPG of user terminal, when need sending service request, the user can edit described template, the input intelligible multimedia feature of user perspective and other information form the service request that comprises the multimedia feature then.Here the understandable multimedia feature of said user perspective is meant easily and is understood by domestic consumer, the multimedia characteristic information of expressing by literal or exemplary content of multimedia (picture, shape, audio-frequency fragments, video clips etc.); In the understandable multimedia feature of user that retrieval control module 141 can carry, extract searching algorithm could be discerned and be applied in search function unit 142 content of multimedia feature or semantic feature from service request.
Step 402: the 122 pairs of received service request in requirement analysis unit are analyzed, and extract necessary informations such as the user ID that comprises in the request message, multimedia characteristic information, range of search prescribed information; Requirement analysis unit 122 query task formations 123 then, if the multimedia characteristic information that comprises in the described request message is included in the retrieval tasks that has existed, the range of search of corresponding retrieval tasks in the updating task formation 123 then, updated search scope are the unions of range of search that the range of search in the original retrieval tasks and this service request are determined; Otherwise in task queue 123, create new retrieval tasks and the task attribute of retrieval tasks is set; At least comprise task identification, multimedia feature and range of search in the task attribute; If comprise complete range of search prescribed information in the service request of being received, then range of search is the range of search of described prescribed information regulation; If the range of search prescribed information is imperfect in the service request of being received, then the range of search according to the server side acquiescence is additional complete with the range of search prescribed information, and according to the range of search prescribed information deterministic retrieval scope after replenishing; If there is not the range of search prescribed information in the service request, then the range of search that server side is given tacit consent to is as the range of search of described service request.
Step 403: create or the updating task formation in retrieval tasks after, user's request processing module 120 with the user ID that extracted, range of search and and the task identification of this retrieval tasks correspondence be sent to programme information maintenance module 150.
Step 404: every information that programme information maintenance module 150 is sent according to step 403, create or renewal personal program information table, the form of described personal program information table can for but be not limited to the form shown in the table 1, the detailed process of this step is described below:
The programme information maintenance module is according to after receiving user ID, range of search and task identification, inquire about existing personal program information table, if find to have created personal program information table with same subscriber sign, then no longer create new personal program information table, only the relevant information that changes need be upgraded in original personal program information table, for example: the program channel that increase new task identification, upgrade retrieval time, renewal need be retrieved or the combination in any of foregoing;
If find to create as yet personal program information table, then create the personal program information table of this user ID, and the incoming task sign reaches the range of search corresponding with task identification etc. with described user ID;
Step 405: the retrieval control module 141 in the retrieval module 140 reads or receives the retrieval tasks in the task queue 123; The described rule that reads or receive can be set flexibly, for example can be to read by certain time interval, also can be that task queue 123 is according to reminding the retrieval time of retrieval tasks the retrieval control module to read retrieval tasks.
Step 406: retrieval control module 141 is given suitable search function unit 142 according to the multimedia characteristic allocation retrieval tasks of retrieval tasks; In addition, content of multimedia feature or semantic feature that the multimedia Feature Conversion that retrieval control module 141 also needs the user perspective in the retrieval tasks is understood becomes search function unit 142 to discern, the specific implementation process of described conversion is not a content of the present invention; Retrieval tasks is carried out in search function unit 142, retrieval finishes the back to retrieval control module 141 feedback searching situations, described retrieval situation should comprise at least the task identification that retrieves this content of multimedia, the time that retrieves this content of multimedia, this content of multimedia from program channel and the attribute information of this content of multimedia; If retrieve content of multimedia, retrieval control module 141 is that each the bar content of multimedia that retrieves distributes a content identification according to the retrieval situation, and whether query contents administration module 160 is available then, if available, then execution in step 407; If it is unavailable then return the retrieval failed message not retrieve content of multimedia or content managing module 160, retrieval control module 141 returns user terminal 110 and withdraws from this flow process by the prompting message of user's request processing module 120 with service fail.
The precedence of described distribution retrieval tasks as a rule, is to distribute according to the retrieval start time and the retrieval concluding time of retrieval tasks, promptly distributes this retrieval tasks in the retrieval start time, finishes retrieval tasks in the time that retrieval finishes; In some cases, also can distribute, as the start time of more than one retrieval tasks identical situation or other situation according to the precedence of task queue storage.
If a plurality of retrieval tasks of same search function unit need concurrent carrying out, then need to use industry can with the switching carried out between the task of task call algorithm carry out, described task call algorithm itself does not belong to content of the present invention.
Step 407: retrieval control module 141 notice search function unit 142 will be retrieved the content of multimedia and the content identification that obtain and be sent to content managing module 160; Retrieval control module 141 is sent to programme information maintenance module 150 with content identification and multimedia content description information.
A retrieval tasks is retrieved the discrete content of multimedia that is likely that obtains, as discrete video clips, audio-frequency fragments, static picture etc., each content of multimedia that is retrieved must have corresponding descriptor, and described descriptor comprises the task identification that retrieves this content of multimedia; Retrieve the range of search information of this content of multimedia, described range of search information comprises and is used to show which program channel when retrieves time mark, this content of multimedia of obtaining this content of multimedia derives from; Also comprise the content of multimedia attribute information, as duration length, media formats; Described descriptor will be used to distinguish described content of multimedia by programme information maintenance module 150 and belong to which user and offer the user terminal that it belongs to.Search function unit 142 comprises described multimedia content description information to the retrieval situation of retrieval control module 141 feedbacks in the step 406.
Step 408: after programme information maintenance module 150 receives the descriptor and content identification of the content of multimedia sent of retrieval control module 141, judge that according to the task identification in the descriptor and range of search information described content of multimedia belongs to which or which user terminal, described judgement detailed process is as follows:
To mate from the task identification of retrieval control module 141 and the task identification in the personal program information table, find the personal program information table that contains the same task sign, whether the range of search information that reexamines from retrieval control module 141 conforms to the range information of corresponding retrieval tasks in the personal program information table, promptly obtain the time mark of this content of multimedia, whether the program channel that this content of multimedia derives from is in the range of search of personal program information table regulation, if, show that then this content of multimedia that retrieves meets user's request, with the descriptor of content of multimedia, this user's personal program information table is imported in content identification; Otherwise do not carry out the renewal of the personal program information table of user terminal.
In the practical application, this step judges task identification and range of search information may be complementary with more than one personal program information table simultaneously, then described task identification and range of search information is stored to the personal program information table that matches respectively.
Step 409: after content managing module 160 is successfully stored the content of multimedia of being received and content identification, return the response message that shows that storage is successful to retrieval control module 141.In addition, content managing module 160 need shine upon the memory location of content identification and content of multimedia, so that search corresponding content of multimedia according to content identification.
After the step 409, also can increase following optional step: retrieval control module 141 returns to user terminal 110 by user's request processing module and shows the reminder message that is ready to the personalized multi-media content.
Step 410～411: user terminal 110 sends the request that requires to obtain personal program information to programme information maintenance module 150, after programme information maintenance module 150 is received described request, in the personal program information table of user terminal 110, find relevant programme information and the programme information that is found is returned to user terminal 110.Described programme information shows currently have the programme content of what personalization to use to the user, and described programme information comprises content identification at least, can also comprise part or all of multimedia content description information.
Step 412～413: user terminal 110 is according to the programme information of being received, select the wherein listed content of multimedia more than or, send the request that requires to obtain selected content of multimedia to content managing module 160, comprise the content identification of the content of multimedia of its selection in the described request at least; Content managing module 160 finds corresponding content of multimedia and sends the content of multimedia that is found to user terminal 110 according to the content identification in the request of being received.
Lift a specific embodiment below and further specify how to use the solution of the present invention.A kind of applicable cases of the present invention program is to be applied in the Web TV.After the user obtains the EPG of Web TV, find that service provider provides a kind of individual business, as long as the request message template that provides among the EPG is provided edits, import some own interested sample picture, and to set range of search be regular hour section and program channel, and server just can be collected all picture or video clipss identical with content in the sample picture that these channels occur for him in setting-up time.
User A, user B, user C and user D have customized such individual business, provide the channel of this service to comprise channel 1 and channel 2.Section search time of server side regulation acquiescence is that the user submits two hours after asking to, and giving tacit consent to searched channel is channel 2.Then realize that according to the present invention program the process of individual business is as follows:
Step 1: the user submits service request to.
Above-mentioned user is request below server sends respectively:
User A: initiate service request at 8:00, provide a basketball picture as the multimedia characteristic information that is retrieved, request server is collected between the 9:00-12:00 and all video clipss of basketball occurred at channel 1;
User B: initiate request at 10:00, also provide a basketball picture, set request server and collect between the 11:00-13:00 all video clipss that occur basketball at channel 1 and channel 2 as the multimedia characteristic information that is retrieved;
User C: initiate request at 10:00, a football picture is provided, set request server and be collected in all video clipss that football appears in channel 1;
User D: initiate request at 11:00, the photo of star's first head portrait is provided, set request server and collect all video clipss that occur star's first between the 12:00-14:00.
Step 2: analyze service request and create retrieval tasks.
After above-mentioned each user initiates service request, at first come analysis request, and create corresponding retrieval tasks by user's request processing module.Because user A and user B select to collect the video clips of basketball, be that content of multimedia feature in their service request submitted to is identical, and the request of user B after, then user's request processing module can be according to the newly-built retrieval tasks of the service request of user B, but the search mission of user A is upgraded, its range of search is the union of the range of search stipulated of range of search and the service request of user B of the service request regulation of user A.Do not stipulate search time in the service request of user C that server side is according to determining that be 10:00 to 12:00 its search time the search time of acquiescence.User D does not stipulate searched channel, and server determines that according to the searched channel of acquiescence its channel searching is a channel 2.When 11:00, possible task queue is as shown in table 2:
| Task identification | Task 1 | Task 2 | Task 3 |
| The multimedia characteristic information | The basketball picture | The football picture | The picture of star's first |
| The retrieval zero-time | 9:00 | 10:00 | 12:00 |
| The retrieval concluding time | 13:00 | 12:00 | 14:00 |
| Need searched channel | Channel 1 and channel 2 | Channel 1 | Channel 2 |
Table 2
Step 3: create the personal program information table.
After each retrieval tasks is created, user's request processing module will send task identification, user ID, and range of search is given the programme information maintenance module, after the programme information maintenance module receives the information of sending from user's processing module, for corresponding user creates the personal program information table; And when retrieval tasks is upgraded, user's request processing module also will send the task identification of the retrieval tasks of upgrading, user ID, range of search is given the programme information maintenance module, and the programme information maintenance module is according to information creating or renewal personal program information table from user's processing module.For example after the service request updating task 1 according to user B, task identification, user ID, the range of search of the task 1 after user's request processing module will be upgraded are sent to the programme information maintenance module, it is emphasized that, the range of search here is not the union of the range of search of user A and user B, but the range of search corresponding with user ID separately; User's request processing module is checked existing personal program information table according to user ID, find to have created the personal program information table of user A, and task identification and range of search do not change, and then do not upgrade the personal program information table of user A; Find not create the personal program information table of user B, then create the personal program information table of user B.During to 11:00, the personal program information table in the programme information maintenance module is as shown in table 3:
| User A | Task 1 | ||||
| 9:00-12:00 | |||||
| Channel 1 | |||||
| User B | Task 1 | ||||
| 11:00-13:00 | |||||
| Channel 1 and channel 2 | |||||
| User C | Task 2 | ||||
| 10:00-12:00 | |||||
| Channel 1 | |||||
| User D | Task 3 | ||||
| 12:00-14:00 | |||||
| Channel 2 |
Table 3
Each user's personal program information table is form shown in the table 1 in the table 3, supposes that here each retrieval tasks does not retrieve content of multimedia as yet, in the table 3 about program content information be sky.And in fact since this moment user A and user C retrieval tasks begun, in the personal program information table of user A and user C corresponding program content information may have been arranged.
Step 4: retrieving multimedia contents, memory scan to content of multimedia and relevant information and safeguard the personal program information table.
After retrieval tasks and personal program information table establishment end, retrieval module wait retrieval tasks drives carries out retrieval work.
May comprise a plurality of search functions unit in the retrieval module, different search functions is realized in each search function unit, for example, the retrieval that search function unit 1 is realized the content of multimedia with some shape facility, the retrieval that search function unit 2 is realized specific action, the retrieval that search function unit 3 is realized audio content, search function unit 4 has the Identification of Images function, realizes retrieval of portrait or the like.
The retrieval control module reads the retrieval tasks in the task queue, and the multimedia feature of analysis retrieval tasks, retrieval is after control module analyzes three tasks in the present embodiment, uses search function unit 1 to execute the task 1 and task 2, uses search function unit 4 to carry out retrieval tasks 3.
Arrive 9:00 when the time, the retrieval control module is distributed to search function unit 1 with retrieval tasks 1 and is carried out retrieval tasks, and the retrieval control module converts the basketball picture to can discern the search function unit low layer multimedia feature as search condition;
Arrive 10:00 when the time, the retrieval control module is also distributed to search function unit 1 with retrieval tasks 2 and is carried out retrieval tasks, and the retrieval control module converts the football picture to can discern the search function unit low layer multimedia feature as search condition;
Arrive 12:00 when the time, the retrieval control module is distributed to search function unit 4 with retrieval tasks 3 and is carried out retrieval tasks, and the retrieval control module converts the photo of star's first to can discern the search function unit low layer multimedia retrieval feature as search condition.
Along with the execution of retrieval, the video clips of multimedia feature will be found to satisfy in the search function unit.As, a video clips that contains basketball shot is found at the channel 1 of 9:30 in search function unit 1, when retrieving this segment, in time to retrieval control module 2 feedbacks, report retrieval control module has been found a segment because carry out " task 1 " at " 9:30 " in search function unit 1.The retrieval control module is that this video clips that retrieves distributes a content identification " basketball 001 ", whether retrieve control module inquiry content managing module then available, for example inquire whether storer is enough, content managing module returns response message and represents that operation is normal, prepares to receive the content that the search function unit is sent at any time.The retrieval control module is issued search function unit 1 with the content identification that is distributed, and content managing module is issued with this video clips and content identification in notice search function unit 1.Video clips and content identification that the content managing module storage is received, and stored position information is related with content identification " basketball 001 "; Storage finishes to the successfully storage of retrieval control module feedback.
After the retrieval control module receives feedback message from content managing module, " task 1 ", " 9:30 ", " basketball 001 ", " channel 1 ", contents attribute information such as (as 1.5 minutes duration, media formatss etc.) are sent to the programme information maintenance module.After programme information is safeguarded and is received above-mentioned information, the existing personal program information table of inquiry, the record that task 1 is all arranged in the personal program information table of discovery user A and user B, and all require retrieval channel 1, so check temporal information again, be from 9:00-12:00 the retrieval time of finding the task 1 of user A, and be from 11:00-13:00 the retrieval time of the task 1 of user B, therefore, the video clips that retrieves can only belong to user A, so with " task 1 ", " basketball 001 ", " channel 1 ", in the personal program information table of contents attribute input user A, the retrieval of described video clips obtains that the time " 9:30 " also can be used as a descriptor of content and the personal program information table of importing user A.
Task 1 continues to carry out, and retrieves a video clips that contains basketball shot again at the channel 1 of 11:30, carried out with the similar flow process of above-mentioned processing after, information such as " basketballs 002 " has been imported in the program information table of user A and user B.Then when 11:30, the personal program information table of user A and user B is as shown in table 4:
| User A | Task 1 | Basketball 001 | Basketball 002 | ||
| 9:00-12:00 | 1.5 minute | 2 minutes | |||
| Channel 1 | 9:30 | 11:30 | |||
| User B | Task 1 | Basketball 002 | |||
| 11:00-13:00 | 2 minutes | ||||
| Channel 1 and channel 2 | 11:30 |
Table 4
Task 1 retrieves a video clips that contains basketball shot again at the channel 2 of 11:40, owing to do not comprise channel 2 in the range of search of user A, and comprised channel 2 in the range of search of user B, then carried out with the similar flow process of above-mentioned processing after, information such as " basketballs 003 " has been imported in the program information table of user B.When 11:40, the personal program information table of user A and user B is as shown in table 5:
| User A | Task 1 | Basketball 001 | Basketball 002 | ||
| 9:00-12:00 | 1.5 minute | 2 minutes | |||
| Channel 1 | 9:30 | 11:30 |
| User B | Task 1 | Basketball 002 | Basketball 003 | ||
| 11:00-13:00 | 2 minutes | 1 minute | |||
| Channel 1, channel 2 | 11:30 | 11:40 |
Table 5
All the other two tasks are carried out similar process, and after 14:00 task 3 was also finished, these four users' personal program information table was as shown in table 6:
| User A | Task 1 | Basketball 001 | Basketball 002 | ||
| 9:00-12:00 | 1.5 minute | 2 minutes | |||
| Channel 1 | 9:30 | 11:30 | |||
| User B | Task 1 | Basketball 002 | Basketball 003 | ||
| 11:00-13:00 | 2 minutes | 1 minute | |||
| Channel 1, channel 2 | 11:30 | 11:40 | |||
| User C | Task 2 | Football 001 | Football 002 | Football 003 | |
| 10:00-12:00 | 1.5 minute | 2 minutes | 1 minute | ||
| Channel 1 | 10:15 | 10:55 | 11:30 | ||
| User D | Task 3 | Star's first 001 | Star's first 002 | Star's first 003 | |
| 12:00-14:00 | 30 seconds | 20 seconds | 15 seconds | ||
| Channel 2 | 12:25 | 12:50 | 13:30 |
Table 6
Step 5: the user checks the individualized content that is customized.
When the user wants to check own customized content, then this user obtains customized personal program information to the request of user's request processing module, the personal program maintenance of information module personal program information table that will belong to this user is sent to described user then, the form of personal program information table with EPG can be sent.For example, user A receives the personal program information table shown in the table 7 after sending request:
| User A | Task 1 | Basketball 001 | Basketball 002 | ||
| 9:00-12:00 | 1.5 minute | 2 minutes |
| Channel 1 | 9:30 | 11:30 |
Table 7
Then user A according to the personal program information request that receives obtain customized content of multimedia, for example require to receive the video clips that is designated basketball 1.Other users also can use similar flow process to obtain own customized content.
The above only is preferred embodiment of the present invention, not in order to restriction the present invention, all any modifications of being done within the spirit and principles in the present invention, is equal to and replaces and improvement etc., all should be included within protection scope of the present invention.
Claims (36)
1, a kind of collecting multi-medium content parts is characterized in that, these parts comprise as the lower part:
The retrieval control module is used to receive the retrieval tasks that comprises the multimedia feature, the content of multimedia feature or the semantic feature that become the search function unit to discern the multimedia Feature Conversion that is received, and retrieval tasks distributed to the search function unit;
At least one search function unit is used for retrieving the content of multimedia with the multimedia feature that is comprised in the retrieval tasks that is assigned with at the Media Stream that needs are retrieved.
2, collecting multi-medium content parts according to claim 1 is characterized in that, described parts further comprise:
The programme information maintenance module is used to create and safeguards the content identification that is used to preserve the content of multimedia that the search function unit retrieves and the personal program information table of content description information;
The function of then described search function unit further comprises: the multimedia content description information that retrieves is fed back to the retrieval control module;
The function of described retrieval control module further comprises: the content description information allocation contents according to search function unit feedback identifies, and content identification and the multimedia content description information that is distributed is sent to the programme information maintenance module.
3, collecting multi-medium content parts according to claim 2 is characterized in that, described parts further comprise:
Content managing module is used for content of multimedia and content identification that the memory scan functional unit is retrieved, and carries out related with the content corresponding sign content of multimedia of being stored; Send to such an extent that content identification sends content of multimedia associated therewith to user terminal according to user terminal;
The function of then described retrieval control module further comprises: the content identification that is distributed is sent to corresponding search function unit;
The function of search function unit further comprises: the content identification of being received and the content of multimedia corresponding with described content identification are sent to content managing module.
4, collecting multi-medium content parts according to claim 3 is characterized in that, described parts further comprise:
User's request processing module, be used to receive the service request that comprises user ID and multimedia feature at least from user terminal, multimedia feature in the service request is analyzed, created or the renewal retrieval tasks, with retrieval tasks input retrieval control module according to the result who analyzes; Notify program maintenance of information module creation or upgrade corresponding personal program information table in the time of establishment or renewal retrieval tasks.
5, collecting multi-medium content parts according to claim 4 is characterized in that, described user's request processing module further comprises:
The request receiving element is used to receive the service request that user terminal is sent, and the service request that is received is transmitted to the requirement analysis unit;
The requirement analysis unit, be used for analyzing from the service request of request receiving element, generate retrieval tasks and deterministic retrieval scope according to multimedia feature of carrying in the service request and user ID, and for retrieval tasks allocating task sign, with the retrieval tasks incoming task formation that is generated; Notice program maintenance of information module creation personal program information table;
Task queue is deposited the retrieval tasks of requirement analysis unit input, and is extracted stored retrieval tasks and be sent to the retrieval control module.
6, according to the described collecting multi-medium content parts of claim 1 to 5, it is characterized in that, describedly retrieval tasks is distributed to the search function unit be: described retrieval tasks is distributed to search function unit with function of retrieving according to described multimedia feature.
7, a kind of collecting multi-medium content system comprises the Play Server that is used to provide content of multimedia, it is characterized in that this system also comprises:
The collecting multi-medium content parts, be used for multimedia characteristic information according to the service request of user's submission, from the Media Stream that the content of multimedia Play Server is play, retrieve corresponding content of multimedia, and the content of multimedia that retrieves is offered user terminal;
User terminal is used for submitting the service request that comprises the multimedia characteristic information at least to the collecting multi-medium content parts, also is used to receive the content of multimedia from the collecting multi-medium content parts.
8, collecting multi-medium content according to claim 7 system is characterized in that described collecting multi-medium content parts further comprise:
User's request processing module is used to receive the service request from user terminal, and service request is analyzed, and generates the driving incident of retrieval tasks as retrieval module; Notice program maintenance of information module creation personal program information table when creating retrieval tasks;
Retrieval module is used to carry out the retrieval tasks that user's request processing module is generated, and the content of multimedia that the content of multimedia Play Server is play is retrieved; And the content of multimedia that is retrieved is sent to content managing module; Notice program maintenance of information module is upgraded the personal program information of its maintenance;
The programme information maintenance module is used to create and safeguards the personal program information table of the relevant information that is used to preserve the content of multimedia that retrieval module retrieves issue the personal program information table to user terminal;
Content managing module is used for the content of multimedia that the memory scan module is retrieved, and sends the content of multimedia of being stored to user terminal.
9, collecting multi-medium content according to claim 8 system is characterized in that described user's request processing module further comprises:
The request receiving element is used to receive the service request that user terminal is sent, and the service request that is received is transmitted to the requirement analysis unit;
The requirement analysis unit, be used for analyzing from the service request of request receiving element, generate retrieval tasks and deterministic retrieval scope according to multimedia feature of carrying in the service request and user ID, and for retrieval tasks allocating task sign, with the retrieval tasks incoming task formation that is generated; Notice program maintenance of information module creation personal program information table;
Task queue is deposited the retrieval tasks of requirement analysis unit input, and is extracted stored retrieval tasks and be sent to retrieval module.
10, collecting multi-medium content according to claim 9 system is characterized in that described range of search comprises the start and end time of retrieval at least;
Range of search may further include: the program channel that need be retrieved.
11, collecting multi-medium content according to claim 9 system is characterized in that, comprises task identification, multimedia feature and range of search in the retrieval tasks of depositing in the described task queue at least.
12, collecting multi-medium content according to claim 9 system is characterized in that described retrieval module further comprises:
The retrieval control module, be used to receive retrieval tasks from user's request processing module, analyze the multimedia characteristic attribute of retrieval tasks, content of multimedia feature or semantic feature that the multimedia Feature Conversion that user perspective in the retrieval tasks is understood becomes the search function unit to discern are distributed to suitable search function unit according to the result who analyzes with retrieval tasks; The relevant information of the content of multimedia that the search function unit is retrieved is sent to the programme information maintenance module;
The search function unit of at least one, be used for according to the retrieval retrieval tasks that control module distributed, the content of multimedia that retrieval has the multimedia feature in the retrieval tasks in from the Media Stream of content of multimedia Play Server, to comprise that the content of multimedia that retrieves and the Search Results of content description information feed back to the retrieval control module, and the content of multimedia that retrieves will be sent to content managing module.
13, collecting multi-medium content according to claim 12 system is characterized in that, the relevant information of the content of multimedia that described retrieval control module retrieves the search function unit is sent to the programme information maintenance module and comprises:
The retrieval control module be to identify from the content of multimedia allocation contents of search function unit, and content description information and the content identification that distributed are sent to the programme information maintenance module;
The function of search function unit further comprises: will retrieve the content identification that control module distributes and be sent to content managing module.
14, collecting multi-medium content according to claim 12 system is characterized in that described search function unit comprises one of following feature at least:
A certain class retrieval tasks can be finished in each search function unit;
The content of multimedia of intercepting and capturing can be kept in the search function unit in retrieving;
Each search function unit can the more than one retrieval tasks of executed in parallel.
15, collecting multi-medium content according to claim 13 system, it is characterized in that described programme information maintenance module is created and safeguarded that the personal program information table comprises: create or renewal personal program information table according to the notification message of sending after establishment of user's request processing module or the renewal retrieval tasks; Retrieve the content identification and the content description information that send after the related content according to retrieval module and safeguard the personal program information table.
16, collecting multi-medium content according to claim 15 system is characterized in that described personal program information table comprises following content at least: user ID; The task identification of the retrieval tasks that the service request of being submitted to by described user ID causes; Also has corresponding range of search information for each task identification; For each content of multimedia, comprise content identification and content description information.
17, according to each described collecting multi-medium content system of claim 12 to 16, it is characterized in that described content description information comprises: retrieve the range describe information of described content of multimedia, the task identification of retrieval tasks that retrieves described content of multimedia and the attribute information of described content of multimedia.
18, collecting multi-medium content according to claim 17 system is characterized in that the range describe information of described content of multimedia comprises the time that retrieves described content of multimedia at least; Can further include the program channel that described content of multimedia belongs to;
The attribute information of described content of multimedia comprises following a kind of at least: the time span of content of multimedia, media formats.
19, according to each described collecting multi-medium content system of claim 7 to 16, it is characterized in that the part or all of module of described collecting multi-medium content parts is: the functional module of the functional module of content of multimedia Play Server, other equipment of server side or server apparatus independently.
20, a kind of collecting multi-medium content method is characterized in that, this method comprises the steps:
A, user terminal generate and comprise to the collecting multi-medium content parts transmission of server side the service request of multimedia feature and user ID;
B, collecting multi-medium content parts are according to the multimedia characteristic information in the service request of user's submission, the corresponding content of multimedia of retrieval from the Media Stream that the content of multimedia Play Server is play, the content of multimedia that preservation is retrieved and the relevant information of content of multimedia.
21, collecting multi-medium content method according to claim 20 is characterized in that, the described user terminal of steps A generates service request and is: default business request information template is edited, generate business request information; Described editor comprises the intelligible multimedia characteristic information of interpolation user at least, can also comprise the prescribed information of hunting zone.
22, collecting multi-medium content method according to claim 21 is characterized in that, the prescribed information of described range of search comprises following a kind of information at least: retrieval starting and ending time, the program channel that is retrieved.
23, collecting multi-medium content method according to claim 20 is characterized in that step B comprises:
B1, collecting multi-medium content parts are set up according to the service request of being received or are upgraded retrieval tasks, and create or upgrade the personal program information table of relative users;
B2, execution retrieval tasks are stored the content of multimedia that is retrieved, and the relevant information of described content of multimedia are deposited in the personal program information table of relative users.
24, collecting multi-medium content method according to claim 23 is characterized in that, the described collecting multi-medium content parts of step B1 are set up according to the service request of being received or upgraded retrieval tasks and comprise:
B11, received service request is analyzed, extract necessary informations such as the user ID that comprises in the request message, multimedia characteristic information, range of search prescribed information, according to the range of search deterministic retrieval scope of range of search prescribed information and server side acquiescence;
The retrieval tasks that B12, inquiry have existed judges whether the multimedia characteristic information in the described service request is included in the retrieval tasks that has existed, if then upgrade the task attribute of the described retrieval tasks that has existed; Otherwise set up new retrieval tasks and the task attribute of the retrieval tasks of being set up is set, described task attribute comprises the multimedia feature at least, task identification and range of search.
25, collecting multi-medium content method according to claim 24 is characterized in that, the described deterministic retrieval scope of step B11 comprises:
Check whether the range of search information in the service request is complete, if, then according to the range of search information deterministic retrieval scope of service request; Otherwise if the range of search information in the service request is imperfect, then the range of search according to acquiescence is additional complete with the range of search information of service request, and according to the range of search information deterministic retrieval scope after replenishing; If do not have range of search information in the service request, then the range of search with acquiescence is defined as range of search.
26, collecting multi-medium content method according to claim 24 is characterized in that, the personal program information table of described establishment of step B1 or renewal relative users comprises:
User ID, range of search and task identification that B13, basis extract from described service request, inquire about existing personal program information table, if find to have created personal program information table, then in described original personal program information table with same subscriber sign, upgrade the relevant information that changes or increase new task identification and relevant information with same subscriber sign; If find not create as yet personal program information table with described user ID, then create the personal program information table of this user ID, and incoming task sign and range of search.
27, collecting multi-medium content method according to claim 26, it is characterized in that, describedly in described original personal program information table with same subscriber sign, upgrade the relevant information that changes, perhaps increasing new task identification and relevant information is: judge the task identification that whether extracts to some extent in the customized information table of described user ID, if have, then upgrade the corresponding range of search of described task identification; Otherwise in described personal program information table, increase task identification and the corresponding range of search extracted.
28, collecting multi-medium content method according to claim 23 is characterized in that, the described execution retrieval tasks of step B2 is:
B21, be the discernible multimedia feature in search function unit, and described retrieval tasks is distributed to the search function unit with function of retrieving according to described multimedia feature the multimedia Feature Conversion in the retrieval tasks;
B22, begin to carry out this retrieval tasks, stop this retrieval tasks in the retrieval concluding time in the retrieval start time of described retrieval tasks;
B23, content identification of each bar content of multimedia distribution for retrieving.
29, collecting multi-medium content method according to claim 28 is characterized in that, further comprises after the step B23:
Whether B24, query contents administration module be available, if then continue to carry out subsequent step, otherwise returns the service fail prompting message and withdraw from this flow process to user terminal.
30, collecting multi-medium content method according to claim 29 is characterized in that, the content of multimedia that the described storage of step B2 is retrieved is:
Content managing module receives from the content of multimedia of search function unit and content identification, stores described content of multimedia and the memory location of content identification and content of multimedia is shone upon, and returns the response message that shows that storage is successful to the retrieval control module.
31, according to each described collecting multi-medium content method of claim 23 to 30, it is characterized in that the relevant information of the described content of multimedia of step B2 comprises: the descriptor of content of multimedia and content identification.
32, collecting multi-medium content method according to claim 31, it is characterized in that described content description information comprises: retrieve the range describe information of described content of multimedia, the task identification of retrieval tasks that retrieves described content of multimedia and the attribute information of described content of multimedia.
33, collecting multi-medium content according to claim 32 system is characterized in that the range describe information of described content of multimedia comprises the time that retrieves described content of multimedia at least; Can further include the program channel that described content of multimedia belongs to;
The attribute information of described content of multimedia comprises following a kind of at least: the time span of content of multimedia, media formats.
According to each described collecting multi-medium content method of claim 23 to 30, it is characterized in that 34, further comprise after the described B2: the collecting multi-medium content parts return to user terminal and show the response message that is ready to the personalized multi-media content.
35, according to each described collecting multi-medium content method of claim 20 to 30, it is characterized in that, further comprise after the described step B:
C, user terminal be to the relevant information of collecting multi-medium content component request content of multimedia, and according to the corresponding content of multimedia of being received of relevant information selective reception.
36, collecting multi-medium content method according to claim 35 is characterized in that, described step C comprises:
C1, user terminal send the request that requires to obtain personal program information to the collecting multi-medium content parts;
After C2, collecting multi-medium content parts are received step C1 described request, in the personal program information table of described user terminal, find relevant programme information and the programme information that is found is back to described user terminal;
C3, user terminal are selected the wherein listed content of multimedia more than or according to the programme information of being received, send the request that requires to obtain selected content of multimedia to the collecting multi-medium content parts;
C4, collecting multi-medium content parts send corresponding content of multimedia to user terminal after receiving step C3 described request.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2006100805701A CN101075233B (en) | 2006-05-17 | 2006-05-17 | Member, system and method for collecting multi-medium content |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2006100805701A CN101075233B (en) | 2006-05-17 | 2006-05-17 | Member, system and method for collecting multi-medium content |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101075233A true CN101075233A (en) | 2007-11-21 |
| CN101075233B CN101075233B (en) | 2012-05-02 |
Family
ID=38976287
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2006100805701A Active CN101075233B (en) | 2006-05-17 | 2006-05-17 | Member, system and method for collecting multi-medium content |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101075233B (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101360114A (en) * | 2008-08-22 | 2009-02-04 | 中兴通讯股份有限公司 | Multimedia system providing real-time scene and implementing method thereof |
| CN101316147B (en) * | 2008-07-02 | 2010-04-07 | 深圳华为通信技术有限公司 | Apparatus and method for presenting multimedia contents on terminal |
| WO2010054576A1 (en) * | 2008-11-11 | 2010-05-20 | 深圳华为通信技术有限公司 | Media information acquirement method of user equipment and user equipment |
| CN102625156A (en) * | 2011-01-27 | 2012-08-01 | 天脉聚源(北京)传媒科技有限公司 | information synchronization method and system |
| CN102883194A (en) * | 2011-02-11 | 2013-01-16 | 微软公司 | Presentation of customized digital media programming |
| CN106489150A (en) * | 2015-03-30 | 2017-03-08 | 乐威指南公司 | For recognize and preserve media asset a part system and method |
| CN107291542A (en) * | 2017-06-27 | 2017-10-24 | 北京优特捷信息技术有限公司 | A kind of intelligence performs the method and device of retrieval tasks |
| CN110263212A (en) * | 2019-06-26 | 2019-09-20 | 银河水滴科技（北京）有限公司 | The shared method and device of search result |
| WO2020057229A1 (en) * | 2018-09-21 | 2020-03-26 | 华为技术有限公司 | Data retrieval method and device |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6785429B1 (en) * | 1998-07-08 | 2004-08-31 | Matsushita Electric Industrial Co., Ltd. | Multimedia data retrieval device and method |
| FI108278B (en) * | 1999-10-29 | 2001-12-31 | Marioff Corp Oy | Power source for delivery of water-based liquid to a system, as well as fire extinguishing installation |
| CN1662053A (en) * | 2004-02-24 | 2005-08-31 | 皇家飞利浦电子股份有限公司 | Program content positioning method and device |
-
2006
- 2006-05-17 CN CN2006100805701A patent/CN101075233B/en active Active
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101316147B (en) * | 2008-07-02 | 2010-04-07 | 深圳华为通信技术有限公司 | Apparatus and method for presenting multimedia contents on terminal |
| CN101360114A (en) * | 2008-08-22 | 2009-02-04 | 中兴通讯股份有限公司 | Multimedia system providing real-time scene and implementing method thereof |
| WO2010054576A1 (en) * | 2008-11-11 | 2010-05-20 | 深圳华为通信技术有限公司 | Media information acquirement method of user equipment and user equipment |
| CN102625156A (en) * | 2011-01-27 | 2012-08-01 | 天脉聚源(北京)传媒科技有限公司 | information synchronization method and system |
| CN102625156B (en) * | 2011-01-27 | 2014-08-13 | 天脉聚源(北京)传媒科技有限公司 | information synchronization method and system |
| CN102883194A (en) * | 2011-02-11 | 2013-01-16 | 微软公司 | Presentation of customized digital media programming |
| CN106489150A (en) * | 2015-03-30 | 2017-03-08 | 乐威指南公司 | For recognize and preserve media asset a part system and method |
| CN107291542A (en) * | 2017-06-27 | 2017-10-24 | 北京优特捷信息技术有限公司 | A kind of intelligence performs the method and device of retrieval tasks |
| CN107291542B (en) * | 2017-06-27 | 2020-09-15 | 北京优特捷信息技术有限公司 | Method and device for intelligently executing retrieval task |
| WO2020057229A1 (en) * | 2018-09-21 | 2020-03-26 | 华为技术有限公司 | Data retrieval method and device |
| US11620082B2 (en) | 2018-09-21 | 2023-04-04 | Huawei Technologies Co., Ltd. | Data retrieval method and apparatus |
| CN110263212A (en) * | 2019-06-26 | 2019-09-20 | 银河水滴科技（北京）有限公司 | The shared method and device of search result |
| CN110263212B (en) * | 2019-06-26 | 2021-04-27 | 银河水滴科技(宁波)有限公司 | Method and device for sharing search results |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101075233B (en) | 2012-05-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1231042C (en) | Method and system for delivering media services and application over networks | |
| CN101075233A (en) | Member, system and method for collecting multi-medium content | |
| CN1161991C (en) | TV performance recording-keeping device | |
| CN1194538C (en) | Advanced television system | |
| CN1118196C (en) | Method and apparatus for producing program information and receiving apparatus for processing program information | |
| CN1530926A (en) | Phonetic recognizing dictionary producer and information search device | |
| CN1757020A (en) | Information processing device, information processing method, and computer program | |
| CN1624684A (en) | Information processor, information processing method and computer program | |
| CN1853407A (en) | Systems and methods for exporting digital content using an interactive television application | |
| CN1754159A (en) | Information processing apparatus and content information processing method | |
| CN1606295A (en) | Metadata distribution management system, apparatus, and method, and computer program therefore | |
| CN1625740A (en) | Index structure of metadata, method for providing indices of metadata, and metadata searching method and apparatus using the indices of metadata | |
| CN101047826A (en) | Electronic apparatus, information browsing method thereof, and storage medium | |
| CN1579092A (en) | Information processing system, information processing device and method, recording medium, and program | |
| CN1728144A (en) | Content providing system, content providing server, information processing apparatus, and computer program | |
| CN1663269A (en) | Recording and playback system | |
| CN1323007A (en) | System and method for searching and providing content and software storing medium | |
| CN1335719A (en) | Image content providing reproducting method, system, equipment and its storage media | |
| CN1567310A (en) | Metadata searching method and apparatus using the indices of metadata | |
| CN1662057A (en) | Memorandum file creation and management method,meeting server and network meeting system | |
| CN1822643A (en) | Information processing apparatus, information processing method, and information processing system | |
| CN1286017C (en) | Recording/reproduction device, recording management method, recording medium, and program | |
| CN1905455A (en) | Open type multimedia transmission system based on internet and streaming media technique | |
| CN1798328A (en) | Implement system and method for customizing content of TV program | |
| CN1756337A (en) | Method, apparatus and program for recording and playing back content data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20180427 Address after: California, USA Patentee after: Global innovation polymerization LLC Address before: London, England Patentee before: GW partnership Co.,Ltd. Effective date of registration: 20180427 Address after: London, England Patentee after: GW partnership Co.,Ltd. Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen Patentee before: HUAWEI TECHNOLOGIES Co.,Ltd. |
|
| TR01 | Transfer of patent right |