CN103533383A - Service triggering method, device and system - Google Patents

Service triggering method, device and system Download PDF

Info

Publication number
CN103533383A
CN103533383A CN201310447296.7A CN201310447296A CN103533383A CN 103533383 A CN103533383 A CN 103533383A CN 201310447296 A CN201310447296 A CN 201310447296A CN 103533383 A CN103533383 A CN 103533383A
Authority
CN
China
Prior art keywords
appointed object
service
appointed
identification
target video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201310447296.7A
Other languages
Chinese (zh)
Other versions
CN103533383B (en
Inventor
石鑫鹏
石腾
张仁宙
张园园
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201310447296.7A priority Critical patent/CN103533383B/en
Publication of CN103533383A publication Critical patent/CN103533383A/en
Application granted granted Critical
Publication of CN103533383B publication Critical patent/CN103533383B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The embodiment of the invention discloses a service triggering method, device and system, which are used for reducing the processing overhead of a terminal and increasing the service triggering response speed. The method in the embodiment of the invention comprises the following steps: receiving a service triggering request sent by a user terminal, wherein the service triggering request comprises a media logo, a service logo and specified object time; extracting media contents from a target video which corresponds to the media logo according to a content extraction strategy and the specified object time; determining specified object information; determining a specified object in the media contents according to the specified object information; triggering a service which corresponds to the service logo by using the specified object.

Description

A kind of service trigger method, Apparatus and system
Technical field
The present invention relates to the communications field, relate in particular to a kind of service trigger method, Apparatus and system.
Background technology
Along with the development of Digital Media and the Internet, increasing video starts to enrich people's life.
User, in watching the process of video, when paying close attention to video content plot, also can become interested to video content object, and then the demand that can know about.For example, user is when watching video, finding has a automobile of liking in video pictures, want this automobile further understand or buy this automobile, but owing to not knowing the information such as concrete model of this automobile, therefore, user can only carry out key value search to this automobile occurring in this video by the Internet, waste time and energy, and the success rate of search is lower.
In the prior art, when user watches video, user can be by selected appointed object in video clip, trigger and the corresponding business of described appointed object again, still, after user selects to see appointed object, user terminal need to user's appointed object carry out loaded down with trivial details pretreatment operation (as, the analysis of image and identification), cause the expense of user terminal larger, and the response time that business triggers is longer.
Summary of the invention
The embodiment of the present invention provides a kind of service trigger method, Apparatus and system, and for reducing the processing expenditure of terminal, raising business triggers response speed.
The service trigger method that embodiment of the present invention first aspect provides, comprising:
Receive the service trigger request that user terminal sends, described service trigger request comprises: media identification, service identification and appointed object time; According to contents extraction strategy and described appointed object time, in target video corresponding to described media identification, extract media content; Determine appointed object information; According to described appointed object information, in described media content, determine appointed object; Use described appointed object to trigger the business that described service identification is corresponding.
In the possible implementation of the first of first aspect, described service trigger request also comprises: appointed object information; Described definite appointed object information comprises: in described service trigger request, extract described appointed object information;
In the possible implementation of the second of first aspect, described according to contents extraction strategy and described appointed object time, in target video corresponding to described media identification, extract media content before, comprising:
According to described service identification at the first business contents extraction strategy corresponding with inquiring about described service identification in tactful relation table;
Accordingly, described definite appointed object information comprises: according to described contents extraction strategy, determine appointed object information.
May implementation in conjunction with the first of first aspect, in the third possible implementation of first aspect, described according to contents extraction strategy and described appointed object time, in target video corresponding to described media identification, extract media content before, comprising:
According to described service identification at the first business contents extraction strategy corresponding with inquiring about described service identification in tactful relation table;
Or, according to described appointed object information at the object contents extraction strategy corresponding with inquiring about described appointed object information in tactful relation table;
Or, obtain the strategy sign of carrying in described service trigger request; According to described strategy sign, select the contents extraction strategy of described target video.
In conjunction with first to three any one possibility implementation of first aspect and first aspect, in the 4th kind of possible implementation of first aspect, described appointed object information comprises: the area information of appointed object;
If the area information that described appointed object information is appointed object is described according to described appointed object information definite appointed object in described media content, comprising:
Described media content is converted to characteristic, and described characteristic comprises: matrix, and in described matrix, each vector represents each pixel of frame of video; The pixel that extracts target area according to the area information of described appointed object in described characteristic is as appointed object, and described target area is the specified region of described area information.
In conjunction with first to three any one possibility implementation of first aspect and first aspect, in the 5th kind of possible implementation of first aspect, described appointed object information also comprises: the characteristic attribute of appointed object;
If the characteristic attribute that described appointed object information is appointed object is described according to described appointed object information definite appointed object in described media content, comprising:
Described media content is converted to characteristic, and described characteristic comprises: matrix, and in described matrix, each vector represents each pixel of frame of video; According to described appointed object characteristic attribute, in described characteristic, extract meet described characteristic attribute data message as appointed object.
In conjunction with first aspect the 4th or five any one may implementations, in the 6th kind of possible implementation of first aspect, described described media content is converted to characteristic after, specifically also comprise:
According to described media identification and described service identification, in media data storage, obtain the characteristic that can trigger the business that described service identification is corresponding in described target video, and compare with the characteristic that described media content is converted to;
Under the scene of the area information that is appointed object in described appointed object information, if the calculated difference of two characteristics is less than a threshold value, trigger the described pixel that extracts target area according to the area information of appointed object in described characteristic as appointed object;
Under the scene of the characteristic attribute that is appointed object in described appointed object information, if the calculated difference of two characteristics is less than a threshold value, trigger according to described appointed object characteristic attribute, in described characteristic, extract meet described characteristic attribute data message as appointed object.
First to three any one possibility implementation in conjunction with first aspect and first aspect, in the 7th kind of possible implementation of first aspect, according to described service identification at the second business content analysis strategy corresponding with inquiring about described service identification in tactful relation table;
Described according to described appointed object information definite appointed object in described media content, comprising:
According to described content analysis strategy and described appointed object information, in described media content, determine appointed object.
In conjunction with first to seven any one possibility implementation of first aspect and first aspect, in the 8th kind of possible implementation of first aspect, described contents extraction strategy comprises:
Described appointed object time place at described target video extracts a two field picture;
Or, at the described appointed object of described target video some durations before or after the time, extract at least one two field picture;
Or, in a period of time interval before and after the described appointed object time of described target video, extract at least one two field picture;
Or, in the some durations at the described appointed object of described target video before or after the time, extract a section audio;
Or, in a period of time interval before and after the described appointed object time of described target video, extract a section audio;
Or, at the described appointed object time place of described target video, extract captions;
Or, in the some durations at the described appointed object of described target video before or after the time, extract one section of captions;
Or, in a period of time interval before and after the described appointed object time of described target video, extract one section of captions.
The service trigger method that embodiment of the present invention second aspect provides, comprising:
Receive the first service trigger request that user terminal sends, described the first service trigger request comprises media identification and appointed object time; According to contents extraction strategy and described appointed object time, in target video corresponding to described media identification, extract contents of object; To described user terminal, return to described contents of object, make described user terminal determine appointed object information according to described contents of object; Receive the second service trigger request that described user terminal sends, described the second service trigger request comprises: appointed object information; According to described appointed object information, determine appointed object; Obtain the service identification that described user terminal sends; Use described appointed object to trigger the business that described service identification is corresponding.
In the possible implementation of the first of second aspect, described the first service trigger request also comprises: service identification;
Accordingly, described in obtain the service identification that user terminal sends, comprising:
In described the first service trigger request, obtain described service identification.
In the possible implementation of the second of second aspect, described the second service trigger request also comprises: service identification;
Accordingly, described in obtain the service identification that user terminal sends, comprising:
In described the second service trigger request, obtain described service identification.
First to two any one possibility implementation in conjunction with second aspect and second aspect, in the third possible implementation of first aspect, describedly according to contents extraction strategy and described appointed object time, in target video corresponding to described media identification, extract contents of object, specifically comprise:
According to the described appointed object time, in described target video, extract at least one two field picture;
According to different characteristic attributes, respectively the contents of object occurring in described at least one two field picture is extracted, obtained the appointed object group to be selected that comprises a plurality of described contents of object.
In conjunction with first to two any one possibility implementation of second aspect and second aspect, in the 4th kind of possible implementation of first aspect, described service trigger request also comprises: strategy sign;
Accordingly, described according to contents extraction strategy and described appointed object time, in target video corresponding to described media identification, extract contents of object before, comprising:
According to described strategy sign, select the contents extraction strategy of described target video.
In conjunction with first to three any one possibility implementation of second aspect and second aspect, in the nothing of first aspect, to plant in possible implementation, described contents extraction strategy comprises:
Described appointed object time place at described target video extracts a two field picture;
Or, at the described appointed object of described target video some durations before or after the time, extract at least one two field picture;
Or, in a period of time interval before and after the described appointed object time of described target video, extract at least one two field picture.
The Service Process Server that the embodiment of the present invention third aspect provides, comprising:
Receiving element, the service trigger request sending for receiving user terminal, described service trigger request comprises: media identification, service identification and appointed object time;
Extraction unit, for extracting media content according to contents extraction strategy and described appointed object time at target video corresponding to described media identification;
Object determining unit for determining appointed object information, is determined appointed object in described media content according to described appointed object information;
Service trigger unit, for being used described appointed object to trigger the business that described service identification is corresponding.
In the possible implementation of the first of the third aspect, described service trigger request also comprises: appointed object information;
Described object determining unit specifically for: in described service trigger request, extract described appointed object information.
In the possible implementation of the second of the third aspect, described object determining unit specifically for: according to described service identification at the first business contents extraction strategy corresponding with inquiring about described service identification in tactful relation table; According to described contents extraction strategy, determine appointed object information.
In conjunction with the first possibility implementation of the third aspect, in the third possible implementation of the third aspect, described Service Process Server also comprises:
Fetch strategy determining unit, for inquiring about at the first business and tactful relation table the contents extraction strategy that described service identification is corresponding according to described service identification; Or, according to described appointed object information at the object contents extraction strategy corresponding with inquiring about described appointed object information in tactful relation table; Or, obtain the strategy sign of carrying in described service trigger request; According to described strategy sign, select the contents extraction strategy of described target video.
In conjunction with first to three any one possibility implementation of the third aspect and the third aspect, in the 4th kind of possible implementation of the third aspect, described appointed object information comprises: the area information of appointed object;
Described object determining unit specifically for: if the area information that described appointed object information is appointed object, described media content is converted to characteristic, described characteristic comprises: matrix, and in described matrix, each vector represents each pixel of frame of video; The pixel that extracts target area according to the area information of described appointed object in described characteristic is as appointed object, and described target area is the specified region of described area information.
In conjunction with first to three any one possibility implementation of the third aspect and the third aspect, in the 5th kind of possible implementation of the third aspect, described appointed object information comprises: the characteristic attribute of appointed object;
Described object determining unit specifically also for: if the characteristic attribute that described appointed object information is appointed object, described media content is converted to characteristic, described characteristic comprises: matrix, and in described matrix, each vector represents each pixel of frame of video; According to described appointed object characteristic attribute, in described characteristic, extract meet described characteristic attribute data message as appointed object.
The 4th or five any one possibility implementations in conjunction with the third aspect, in the 6th kind of possible implementation of the third aspect, described object determining unit specifically also for: after described media content is converted to characteristic, according to described media identification and described service identification in media data storage, obtain the characteristic that can trigger the business that described service identification is corresponding in described target video, and compare with the characteristic that described media content is converted to; Under the scene of the area information that is appointed object in described appointed object information, if the calculated difference of two characteristics is less than a threshold value, trigger the described pixel that extracts target area according to the area information of appointed object in described characteristic as appointed object; Under the scene of the characteristic attribute that is appointed object in described appointed object information, if the calculated difference of two characteristics is less than a threshold value, trigger according to described appointed object characteristic attribute, in described characteristic, extract meet described characteristic attribute data message as appointed object.
In conjunction with first to three any one possibility implementation of the third aspect and the third aspect, in the 7th kind of possible implementation of the third aspect, described Service Process Server also comprises:
Analysis strategy determining unit, for inquiring about at the second business and tactful relation table the content analysis strategy that described service identification is corresponding according to described service identification.
In conjunction with first to seven any one possibility implementation of the third aspect and the third aspect, in the 8th kind of possible implementation of the third aspect, described contents extraction strategy comprises:
Described appointed object time place at described target video extracts a two field picture;
Or, at the described appointed object of described target video some durations before or after the time, extract at least one two field picture;
Or, in a period of time interval before and after the described appointed object time of described target video, extract at least one two field picture;
Or, in the some durations at the described appointed object of described target video before or after the time, extract a section audio;
Or, in a period of time interval before and after the described appointed object time of described target video, extract a section audio;
Or, at the described appointed object time place of described target video, extract captions;
Or, in the some durations at the described appointed object of described target video before or after the time, extract one section of captions;
Or, in a period of time interval before and after the described appointed object time of described target video, extract one section of captions.
The Service Process Server that embodiment of the present invention fourth aspect provides, comprising:
The first receiving element, the first service trigger request sending for receiving user terminal, described the first service trigger request comprises: media identification and appointed object time;
Contents extraction unit, for extracting contents of object according to contents extraction strategy and described appointed object time at target video corresponding to described media identification;
Information feedback unit, for returning to described contents of object to described user terminal, makes described user terminal determine appointed object information according to described contents of object;
The second receiving element, the second service trigger request sending for receiving described user terminal, described the second service trigger request comprises: appointed object information;
Object determining unit, for determining appointed object according to described appointed object information;
Sign acquiring unit, the service identification sending for obtaining described user terminal;
Service trigger unit, for being used described appointed object to trigger the business that described service identification is corresponding.
Described sign acquiring unit specifically for: in described the first service trigger request, obtain described service identification, or, in described the second service trigger request, obtain described service identification.
In the possible implementation of the first of fourth aspect, described sign acquiring unit specifically for: in described the first service trigger request, obtain described service identification, or, in described the second service trigger request, obtain described service identification.
In conjunction with the possible implementation of the first of fourth aspect or fourth aspect, in the possible realization of the second, described contents extraction unit specifically for: according to the described appointed object time, in described target video, extract at least one two field picture; According to different characteristic attributes, respectively the contents of object occurring in described at least one two field picture is extracted, obtained the appointed object group to be selected that comprises a plurality of described contents of object.
In conjunction with first to two any one possible implementation of fourth aspect or fourth aspect, in the third possible realization, described service trigger request also comprises: strategy sign;
Described Service Process Server also comprises:
Strategy determining unit, for selecting the contents extraction strategy of described target video according to described strategy sign.
In conjunction with first to three any one possible implementation of fourth aspect or fourth aspect, in the 4th kind of possible realization, described contents extraction strategy comprises:
Described appointed object time place at described target video extracts a two field picture;
Or, at the described appointed object of described target video some durations before or after the time, extract at least one two field picture;
Or, in a period of time interval before and after the described appointed object time of described target video, extract at least one two field picture.
The transaction processing system that the embodiment of the present invention the 5th aspect provides, comprising:
User terminal and Service Process Server;
The business that described user terminal triggers for the needs of selecting according to user generates service trigger request, and sends described service trigger request to described Service Process Server, and described service trigger request comprises: media identification, service identification and appointed object time;
The service trigger request that described Service Process Server sends for receiving user terminal is extracted media content according to contents extraction strategy and described appointed object time in target video corresponding to described media identification; Determine appointed object information; According to described appointed object information, in described media content, determine appointed object; Use described appointed object to trigger the business that described service identification is corresponding.
The transaction processing system that the embodiment of the present invention the 6th aspect provides, comprising:
User terminal and Service Process Server;
Described user terminal is used for generating the first service trigger request, and sends described the first service trigger request to described Service Process Server, and described the first service trigger request comprises: media identification and appointed object time; Receive described Service Process Server and return to described contents of object, make described user terminal determine appointed object information according to described contents of object; To Service Process Server, send the second service trigger request, described the second service trigger request comprises: appointed object information;
The first service trigger request that described Service Process Server sends for receiving user terminal is extracted contents of object according to contents extraction strategy and described appointed object time in target video corresponding to described media identification; To described user terminal, return to described contents of object, receive the second service trigger request that user terminal sends, according to described appointed object information, determine appointed object; Obtain the service identification that user terminal sends; Use described appointed object to trigger the business that described service identification is corresponding.
As can be seen from the above technical solutions, in embodiments of the present invention, when user watches video at operation user terminal, if interested in certain appointed object in video, can to the demand of this appointed object, select to trigger corresponding business according to own, to Service Process Server, send service trigger request; Service Process Server carries media identification receiving, appointed object information, after the described service trigger request of service identification and appointed object time, according to contents extraction strategy and described appointed object time, target video corresponding to described media identification carried out to media content extraction, and according to described appointed object information, in described media content, determine appointed object, and then use described appointed object to trigger the business that described service identification is corresponding.User can select the business that this appointed object is triggered in operating process, and, business triggers needed information exchange and crosses service trigger request unification and send to Service Process Server to operate, thereby has reduced the processing expenditure of terminal, and raising business triggers response speed.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, to the accompanying drawing of required use in embodiment be briefly described below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skills, do not paying under the prerequisite of creative work, can also obtain according to these accompanying drawings other accompanying drawing.
Fig. 1 is a schematic flow sheet of embodiment of the present invention service trigger method;
Fig. 2 is another schematic flow sheet of embodiment of the present invention service trigger method;
Fig. 3 is another schematic flow sheet of embodiment of the present invention service trigger method;
Fig. 4 is another schematic flow sheet of embodiment of the present invention service trigger method;
Fig. 5 is another schematic flow sheet of embodiment of the present invention service trigger method;
Fig. 6 is the Signalling exchange schematic diagram of embodiment of the present invention service trigger method;
Fig. 7 is a logical construction schematic diagram of embodiment of the present invention Service Process Server;
Fig. 8 is another logical construction schematic diagram of embodiment of the present invention Service Process Server;
Fig. 9 is the structural representation of the Service Process Server based on computer system in the embodiment of the present invention;
Figure 10 is the structural representation of embodiment of the present invention service triggering system.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is only the present invention's part embodiment, rather than whole embodiment.Embodiment based in the present invention, those of ordinary skills, not making the every other embodiment obtaining under creative work prerequisite, belong to the scope of protection of the invention.
The embodiment of the present invention provides a kind of service trigger method, Apparatus and system, is used to user that convenient, business trigger action is flexibly provided.
Refer to Fig. 1, in the embodiment of the present invention, service trigger method embodiment comprises:
101, receive the service trigger request that user terminal sends;
Service Process Server receives the service trigger request that user terminal sends, and described service trigger request comprises: media identification, service identification and appointed object time.
The expression information of the video that described media identification is watched for user, the corresponding video of this media identification is target video.
Described service identification refers to the identification information of the required business that this appointed object is triggered of user, and the type of service that can trigger has multiple, as information inquiry, and content analysis, recognition of face etc.
The described appointed object time is a time point before and after user's described appointed object of appointment in this target video occurs.
Exemplary, in actual applications, when user user terminal is watched video, if found interested appointed object in video, can in user terminal, select corresponding business to trigger; Concrete, user can suspend video, the business that selection will trigger, and user terminal is according to current media identification, and the time that user suspends and user-selected business generate service trigger request, and to Service Process Server, this service trigger request occur.
Optionally, described user terminal can be the equipment such as mobile terminal, panel computer.
102, according to contents extraction strategy and described appointed object time, in target video corresponding to described media identification, extract media content;
Service Process Server extracts media content according to contents extraction strategy and described appointed object time in target video corresponding to described media identification.
Optionally, described contents extraction strategy can be the contents extraction strategy of acquiescence, also can determine corresponding contents extraction strategy according to service identification or appointed object information, can also by service trigger request, send specific indication information by user and determine corresponding contents extraction strategy, be understandable that, definite method of contents extraction strategy can have multiple, is specifically not construed as limiting herein.
Optionally, described media content can be video image, audio frequency or Word message.
103, determine appointed object information;
Service Process Server is determined appointed object information; Optionally, if described service trigger request includes appointed object information, in described service trigger request, extract described appointed object information; If there is no appointed object information in described service trigger request, can be according to described service identification at the first business contents extraction strategy corresponding with inquiring about described service identification in tactful relation table, then determine appointed object information according to described contents extraction strategy; In service trigger request, do not carry in the scene of appointed object information, Service Process Server can be determined appointed object information according to the type of service of wanting user to trigger, as, recognition of face business, the corresponding appointed object information of this recognition of face business is face characteristic.
The expression information that described appointed object information is appointed object in target video, is specifically as follows the image coordinate in video, can be also the authentication code of specific matters, as, the authentication code of people or car; Be understandable that, appointed object information can also, for other information that represents appointed object, specifically be not construed as limiting herein.
104, according to described appointed object information, in described media content, determine appointed object;
Service Process Server is determined appointed object in described media content according to described appointed object information.Described appointed object for user trigger corresponding service for object.
105, use described appointed object to trigger the business that described service identification is corresponding.
After determining appointed object, Service Process Server is used described appointed object to trigger the business that described service identification is corresponding.
Exemplary, if the information inquiry that the business triggering is appointed object, suppose that this appointed object is car icon, user wants to inquire about the automobile what plate is car icon represent, Service Process Server is used this car icon (appointed object) trigger message inquiry business, on network, use this car icon to carry out information matches, after inquiry obtains result, Service Process Server feeds back the result of this information inquiry to this user terminal.
Only with some examples, the application scenarios in the embodiment of the present invention is illustrated below, is understandable that, in actual applications, can also have more application scenarios, be specifically not construed as limiting herein.
In embodiments of the present invention, when user watches video at operation user terminal, if interested in certain appointed object in video, can to the demand of this appointed object, select to trigger corresponding business according to own, to Service Process Server, send service trigger request, Service Process Server carries media identification receiving, appointed object information, after the described service trigger request of service identification and appointed object time, according to contents extraction strategy and described appointed object time, target video corresponding to described media identification carried out to media content extraction, and according to described appointed object information definite appointed object in described media content, and then use described appointed object to trigger the business that described service identification is corresponding, user can select flexibly the business that this appointed object is triggered in operating process, and, business triggers needed information exchange and crosses service trigger request unification and send to Service Process Server to operate, the flow process that business triggers is simple and convenient.
In actual applications, the selected instrument of object that user can provide by user terminal (as, content is selected window) selection appointed object, select again to want the business for this appointed object triggering, specifically refer to Fig. 2, in the embodiment of the present invention, another embodiment of service trigger method comprises:
201, user terminal generates appointed object information;
When user is when watching target video, if interested in certain things in this target video, the selected instrument of object that user's terminal provides is selected appointed object; After user has selected appointed object, user terminal generates the appointed object information of this appointed object.
Optionally, the selected instrument of described object can be selected window for the content of " circle " or " rectangle ", also can be understandable that for simple mouse instructs cursor, and the form of expression of the selected instrument of object can have multiple, is specifically not construed as limiting herein.
In embodiments of the present invention, appointed object information can be the area information of appointed object, concrete, this area information is that appointed object is in the positional information of frame of video, use coordinate to represent that (as: use the selected appointed object of the selected window of rectangle content, area information can be the rectangle upper left corner and lower right corner abscissa and ordinate separately; Use the selected appointed object of the selected window of circular content, area information can be centre coordinate and radius);
202, user terminal is determined service identification;
After user has selected appointed object, user also needs to select to trigger what business for this appointed object, and after user has selected certain business, user terminal determines based on the selected business of user the service identification that this business is corresponding.
Exemplary, user sees that in target video certain icon is very interesting, want to share this icon with friend, user is after fixing this icon, the video clip of user terminal just there will be a plurality of selections of service selection, user just can select " sharing business " wherein, and this icon is shared in the specific social networks of this user.
203, user terminal generates service trigger request;
After user has selected certain business, user terminal can be determined the appointed object time that business triggers according to the time of selected this appointed object of this user; Obtain again this target video for media identification, generate service trigger request, described service trigger request comprises: media identification, appointed object information, service identification and appointed object time.
Optionally, before generating service trigger request, according to actual applicable cases, the contents extraction strategy of all right select target video of user, the corresponding generation strategy sign of user terminal.
After generating service trigger request, user terminal sends this service trigger request to Service Process Server.
204, Service Process Server receives the service trigger request that user terminal sends;
Service Process Server receives the service trigger request that user terminal sends, and described service trigger request comprises: media identification, appointed object information, service identification and appointed object time.
The expression information of the video that described media identification is watched for user, the corresponding video of this media identification is target video.
The expression information that described appointed object information is appointed object in target video, is specifically as follows the image coordinate in video, can be also the authentication code of specific matters, as, the authentication code of people or car; Be understandable that, appointed object information can also, for other information that represents appointed object, specifically be not construed as limiting herein.
Described service identification refers to the identification information of the required business that this appointed object is triggered of user, and the type of service that can trigger has multiple, as information inquiry, and content analysis, recognition of face etc.
The described appointed object time is a time point before and after user's described appointed object of appointment in this target video occurs.
Optionally, described service trigger request also further comprises: strategy sign, described strategy sign is used to specify corresponding contents extraction strategy.
205, Service Process Server is determined contents extraction strategy;
Optionally, it is multiple that Service Process Server determines that the method for contents extraction strategy has, and specifically can comprise:
One, according to described service identification at the first business contents extraction strategy corresponding with inquiring about described service identification in tactful relation table.In actual applications, certain business may adaptation have corresponding contents extraction strategy, and in Service Process Server, can store the fitting relation table (being described the first business and tactful relation table) of service identification and contents extraction strategy, so Service Process Server can be inquired about corresponding contents extraction strategy according to service identification.
Two, according to described appointed object information at the object contents extraction strategy corresponding with inquiring about described appointed object information in tactful relation table.In actual applications, certain appointed object may adaptation have corresponding contents extraction strategy, and in Service Process Server, can store the fitting relation table (being described object and tactful relation table) of appointed object information and contents extraction strategy, so Service Process Server can be according to the corresponding contents extraction strategy of appointed object information inquiry.
Three, according to described strategy sign, select the contents extraction strategy of described target video.In actual applications, user can also select specific contents extraction strategy according to the demand of self, the strategy carrying by service trigger request sign indicating services processing server chosen content fetch strategy.
Be understandable that, Service Process Server determines that the method for contents extraction strategy has and multiplely can have multiplely, is specifically not construed as limiting herein.
206, Service Process Server extracts media content according to contents extraction strategy and described appointed object time in target video corresponding to described media identification;
Service Process Server extracts media content according to contents extraction strategy and described appointed object time in target video corresponding to described media identification.
Concrete, described contents extraction strategy can comprise:
Described appointed object time place at described target video extracts a two field picture;
Or, at the described appointed object of described target video some durations before or after the time, extract at least one two field picture;
Or, in a period of time interval before and after the described appointed object time of described target video, extract at least one two field picture;
Or, in the some durations at the described appointed object of described target video before or after the time, extract a section audio;
Or, in a period of time interval before and after the described appointed object time of described target video, extract a section audio;
Or, at the described appointed object time place of described target video, extract captions;
Or, in the some durations at the described appointed object of described target video before or after the time, extract one section of captions;
Or, in a period of time interval before and after the described appointed object time of described target video, extract one section of captions.
207, Service Process Server is determined appointed object in described media content according to described appointed object information;
Service Process Server is determined appointed object in described media content according to described appointed object information.
Concrete, if the area information that described appointed object information is appointed object, the method of determining appointed object can be: described media content is converted to characteristic, and described characteristic comprises: matrix, and in described matrix, each vector represents each pixel of frame of video; The pixel that extracts target area according to the area information of described appointed object in described characteristic is as appointed object, and described target area is the specified region of described area information.
Optionally, before determining appointed object according to described appointed object information in described media content, Service Process Server can be according to described service identification at the second business content analysis strategy corresponding with inquiring about described service identification in tactful relation table.In actual applications, in Service Process Server, can store multiple content analysis strategy, adapt to respectively different business, because these content analysis strategies are aimed at, different business customizes, therefore, determine that the efficiency of appointed object and success rate are all higher; And the fitting relation of business and content analysis strategy can be stored in described the second business and tactful relation table.
208, Service Process Server is further determined appointed object;
Optionally, after tentatively having determined appointed object, Service Process Server can also be according to media identification and service identification in media data storage, obtain the characteristic that can trigger the business that described service identification is corresponding in described target video, and compare with the characteristic that described media content is converted to, if the calculated difference of two characteristics is less than a threshold value, determine that described appointed object is for triggering the appointed object of described business; Exemplary, can calculate the Euclidean distance of described two characteristics, if the Euclidean distance of two characteristics is less than a threshold value, determine that described appointed object is for triggering the appointed object of described business.
209, Service Process Server is used described appointed object to trigger the business that described service identification is corresponding.
After determining appointed object, Service Process Server is used described appointed object to trigger the business that described service identification is corresponding.
Exemplary, if what the business triggering was appointed object shares, suppose that this appointed object is icon, user wants this icon to share on specific social networks, Service Process Server is reserved in the authentication information of local social networks by user, open the link of corresponding social network sites, this icon is published on this social network sites.
In actual applications, some business is not need user to select appointed object in triggering, selected this business to give tacit consent to appointed object afterwards for which content, user is after having selected the business that needs to trigger, can send service trigger request, specifically refer to Fig. 3, in the embodiment of the present invention, another embodiment of service trigger method comprises:
301, user terminal is determined service identification;
User selects the business of required triggering, and after user has selected certain business, user terminal determines based on the selected business of user the service identification that this business is corresponding.
In embodiments of the present invention, because user-selected business has been given tacit consent to specific appointed object information, therefore, in service trigger request without carrying appointed object information, service server lateral root can identify corresponding appointed object information automatically according to this service identification, and appointed object information can be the characteristic attribute of appointed object; As: people's face, automobile or audio frequency etc.Optional according to actual conditions, the form of expression of characteristic attribute also can have multiple, supposes appointed object behaviour face, and the characteristic attribute of people's face is the profile information of people's face.
Exemplary, suppose that the selected business of user is for " recognition of face ", user terminal is first determined the service identification that " recognition of face " is corresponding, then determines the characteristic attribute of appointed object information behaviour face.
302, user terminal generates service trigger request;
After user has selected certain business, user terminal can be determined the appointed object time that business triggers according to the time of selected this appointed object of this user; Obtain again this target video for media identification, generate service trigger request, described service trigger request comprises: media identification, service identification and appointed object time.
Optionally, before generating service trigger request, according to actual applicable cases, the contents extraction strategy of all right select target video of user, the corresponding generation strategy sign of user terminal.
Optionally, the extraction duration information before and after the appointed object time of all right select target video of user, extracts appointed object so that more effective.In actual applications, due to the cause that video playback is being carried out always, the current picture that has likely missed its interested appointed object of user, thus user can select one specific extraction time section carry out the extraction of appointed object.
After generating service trigger request, user terminal sends this service trigger request to Service Process Server.
303, Service Process Server receives the service trigger request that user terminal sends;
Service Process Server receives the service trigger request that user terminal sends, and described service trigger request comprises: media identification, service identification and appointed object time.
The expression information of the video that described media identification is watched for user, the corresponding video of this media identification is target video.
Described service identification refers to the identification information of the required business that this appointed object is triggered of user, and the type of service that can trigger has multiple, as information inquiry, and content analysis, recognition of face etc.
The described appointed object time is a time point before and after user's described appointed object of appointment in this target video occurs.
Optionally, described service trigger request also further comprises: strategy sign and extraction duration information, and described strategy sign is used to specify corresponding contents extraction strategy; Described extraction duration information is used to indicate the duration at the video that carries out intercepting when media content extracts.
304, Service Process Server is determined contents extraction strategy;
Service Process Server is determined contents extraction strategy, and in embodiments of the present invention, after having determined corresponding contents extraction strategy, Business Processing service can be extracted content according to the target in contents extraction strategy and be determined appointed object information.
Optionally, it is multiple that Service Process Server determines that the method for contents extraction strategy has, and specifically can comprise:
One, according to described service identification at the first business contents extraction strategy corresponding with inquiring about described service identification in tactful relation table.In actual applications, certain business may adaptation have corresponding contents extraction strategy, and in Service Process Server, can store the fitting relation table (being described the first business and tactful relation table) of service identification and contents extraction strategy, so Service Process Server can be inquired about corresponding contents extraction strategy according to service identification.
Two, according to described strategy sign, select the contents extraction strategy of described target video.In actual applications, user can also select specific contents extraction strategy according to the demand of self, the strategy carrying by service trigger request sign indicating services processing server chosen content fetch strategy.
Three, according to described extraction duration information, determine the contents extraction strategy of described target video.In actual applications, due to the cause that video playback is being carried out always, the current picture that has likely missed its interested appointed object of user, thus user can select one specific extraction time section carry out the extraction of appointed object; Therefore,, after having determined the contents extraction strategy of the video in selective extraction a period of time, can also determine described " a period of time " is specially how many by this extraction duration information.Optionally, in actual applications, if this does not extract duration information, the extraction duration of giving tacit consent in Service Process Server raw content fetch strategy extracts.
Be understandable that, Service Process Server determines that the method for contents extraction strategy has and multiplely can have multiplely, is specifically not construed as limiting herein.
305, Service Process Server extracts media content according to contents extraction strategy and described appointed object time in target video corresponding to described media identification;
Service Process Server extracts media content according to contents extraction strategy and described appointed object time in target video corresponding to described media identification.
Concrete, described contents extraction strategy can comprise:
Described appointed object time place at described target video extracts a two field picture;
Or, at the described appointed object of described target video some durations before or after the time, extract at least one two field picture;
Or, in a period of time interval before and after the described appointed object time of described target video, extract at least one two field picture;
Or, in the some durations at the described appointed object of described target video before or after the time, extract a section audio;
Or, in a period of time interval before and after the described appointed object time of described target video, extract a section audio;
Or, at the described appointed object time place of described target video, extract captions.
306, Service Process Server is determined appointed object in described media content according to described appointed object information;
Service Process Server is determined appointed object in described media content according to described appointed object information.
Concrete, in embodiments of the present invention, the characteristic attribute that described appointed object information is appointed object, the method of determining appointed object can be: described media content is converted to characteristic, described characteristic comprises: matrix, and in described matrix, each vector represents each pixel of frame of video; According to described appointed object characteristic attribute, in described characteristic, extract meet described characteristic attribute data message as appointed object.Exemplary, suppose the characteristic attribute of this appointed object behaviour face, in described characteristic, intercept coordinate information or the Pixel Information of facial contour.
Optionally, before determining appointed object according to described appointed object information in described media content, Service Process Server can be according to described service identification at the second business content analysis strategy corresponding with inquiring about described service identification in tactful relation table.In actual applications, in Service Process Server, can store multiple content analysis strategy, adapt to respectively different business, because these content analysis strategies are aimed at, different business customizes, therefore, determine that the efficiency of appointed object and success rate are all higher; And the fitting relation of business and content analysis strategy can be stored in described the second business and tactful relation table.
307, Service Process Server is further determined appointed object;
Optionally, after tentatively having determined appointed object, Service Process Server can also be according to media identification and service identification in media data storage, obtain the characteristic that can trigger the business that described service identification is corresponding in described target video, and compare with the characteristic that described media content is converted to, if the calculated difference of two characteristics is less than a threshold value, determine that described appointed object is for triggering the appointed object of described business; Exemplary, can calculate the Euclidean distance of described two characteristics, if the Euclidean distance of two characteristics is less than a threshold value, determine that described appointed object is for triggering the appointed object of described business.
Optionally, described media data storage can be the internal element module of described Service Process Server, also can be for being independent of a database of described Service Process Server, concrete implementation can be determined according to the actual requirements, is specifically not construed as limiting herein.
308, Service Process Server is used described appointed object to trigger the business that described service identification is corresponding.
After determining appointed object, Service Process Server is used described appointed object to trigger the business that described service identification is corresponding.
Exemplary, if the business triggering is recognition of face, to get this appointed object (be the pixel of facial contour to Service Process Server, or the coordinate of facial contour) afterwards, at database or network is upper inquires about comparison, determine the identity of described people's face, more associated this personage's relevant information, finally by the result feedback of inquiry to user terminal.
In actual applications, in order to make user can determine more accurately appointed object, can first to target video, carry out the analysis of contents of object, specifically refer to Fig. 4, in the embodiment of the present invention, another embodiment of service trigger method comprises:
401, user terminal initiates to trigger service request;
User is when watching video, if this video is live signal, user cannot get the image information of appointed object for the moment accurately, therefore, can first to service process terminal, send the first service trigger request, requested service processing terminal carries out the analysis of contents of object to target video, period returning an object value content analysis result so that user can be clear, exactly appointed object is selected.
Concrete, when user initiates the first service trigger request, user terminal can be defined as the appointed object time by the playing duration of current goal video.
402, Service Process Server receives the first service trigger request that user terminal sends;
Service Process Server receives the first service trigger request that user terminal sends, and described the first service trigger request comprises: media identification and appointed object time.
The expression information of the video that described media identification is watched for user, the corresponding video of this media identification is target video.
The described appointed object time is a time point before and after user's described appointed object of appointment in this target video occurs.
Optionally, described the first service trigger request also further comprises: strategy sign and extraction duration information, and described strategy sign is used to specify corresponding contents extraction strategy; Described extraction duration information is used to indicate the duration at the video that carries out intercepting when media content extracts.
403, Service Process Server extracts contents of object according to contents extraction strategy and described appointed object time in target video corresponding to described media identification;
Service Process Server carries out contents of object extraction according to contents extraction strategy and described appointed object time to target video corresponding to described media identification, concrete, Service Process Server extracts at least one two field picture in described target video according to the described appointed object time; The contents of object respectively described at least one two field picture being occurred according to different characteristic attributes is extracted, and obtains the appointed object group to be selected that comprises a plurality of described contents of object.
404, Service Process Server returns to described contents of object to described user terminal;
Service Process Server returns to described contents of object to described user terminal, makes described user terminal determine appointed object information according to described contents of object.
Exemplary, Service Process Server can be to teleservice triggered response message, and in this business triggered response message, carries described group of objects to be selected; Concrete, described group of objects to be selected includes a plurality of contents of object, the things occurring at least one two field picture that the plurality of contents of object is extracted in described target video, as: " people ", " desk ", " teacup ", " potted plant " etc.
405, user terminal is determined appointed object information;
After receiving the contents of object that Service Process Server returns, user checks the contents of object of described appointed object group to be selected, therefrom selects appointed object.
After user has selected appointed object, user terminal is determined the appointed object information that this appointed object is corresponding, in embodiments of the present invention, described appointed object information can, for indicating an authentication code of described appointed object, can be also the area information of appointed object.
Optionally, in embodiments of the present invention, after user has selected appointed object, can also select the required business triggering for this appointed object, corresponding, user terminal is determined the service identification that this business is corresponding.
After user terminal is determined appointed object information and service identification, user terminal sends the second service trigger request to described Service Process Server.
406, Service Process Server receives the second service trigger request that user terminal sends;
Service Process Server receives the second service trigger request that user terminal sends, and described the second service trigger request comprises: appointed object information.
Further, in embodiments of the present invention, described the second service trigger request can also comprise: service identification.
407, Service Process Server is used described appointed object to trigger the business that described service identification is corresponding.
After receiving described the second service trigger request, Service Process Server is determined appointed object according to described appointed object information, obtain again the service identification carrying in described the second service trigger request, re-use described appointed object and trigger the business that described service identification is corresponding.
In actual applications, if the business that user selects does not have the appointed object information indication (as sharing business) of acquiescence, and user is not easy to directly at the target video of playing, select appointed object, can use the described scheme of Fig. 5 embodiment, specifically refer to Fig. 5, in the embodiment of the present invention, another embodiment of service trigger method comprises:
501, user terminal is determined service identification;
User selects the business of required triggering, and after user has selected certain business, user terminal determines based on the selected business of user the service identification that this business is corresponding.
502, user terminal initiates to trigger service request;
User is when watching video, if this video is live signal, user cannot get the image information of appointed object for the moment accurately, therefore, can first to service process terminal, send the first service trigger request, requested service processing terminal carries out the analysis of contents of object to target video, period returning an object value content analysis result so that user can be clear, exactly appointed object is selected.
Concrete, when user initiates the first service trigger request, user terminal can be defined as the appointed object time by the playing duration of current goal video.In embodiments of the present invention, the first service trigger request carries service identification.
503, Service Process Server receives the first service trigger request that user terminal sends;
Service Process Server receives the first service trigger request that user terminal sends, and described the first service trigger request comprises: service identification, media identification and appointed object time.
The expression information of the video that described media identification is watched for user, the corresponding video of this media identification is target video.
The described appointed object time is a time point before and after user's described appointed object of appointment in this target video occurs.
Optionally, described the first service trigger request also further comprises: strategy sign and extraction duration information, and described strategy sign is used to specify corresponding contents extraction strategy; Described extraction duration information is used to indicate the duration at the video that carries out intercepting when media content extracts.
504, Service Process Server extracts contents of object according to contents extraction strategy and described appointed object time in target video corresponding to described media identification;
Optionally, it is multiple that Service Process Server determines that the method for contents extraction strategy has, and specifically can comprise:
One, according to described service identification at the first business contents extraction strategy corresponding with inquiring about described service identification in tactful relation table.In actual applications, certain business may adaptation have corresponding contents extraction strategy, and in Service Process Server, can store the fitting relation table (being described the first business and tactful relation table) of service identification and contents extraction strategy, so Service Process Server can be inquired about corresponding contents extraction strategy according to service identification.
Two, according to described strategy sign, select the contents extraction strategy of described target video.In actual applications, user can also select specific contents extraction strategy according to the demand of self, the strategy carrying by service trigger request sign indicating services processing server chosen content fetch strategy.
Three, according to described extraction duration information, determine the contents extraction strategy of described target video.In actual applications, due to the cause that video playback is being carried out always, the current picture that has likely missed its interested appointed object of user, thus user can select one specific extraction time section carry out the extraction of appointed object; Therefore,, after having determined the contents extraction strategy of the video in selective extraction a period of time, can also determine described " a period of time " is specially how many by this extraction duration information.Optionally, in actual applications, if this does not extract duration information, the extraction duration of giving tacit consent in Service Process Server raw content fetch strategy extracts.
Be understandable that, Service Process Server determines that the method for contents extraction strategy has and multiplely can have multiplely, is specifically not construed as limiting herein.
Concrete, described contents extraction strategy can comprise:
Described appointed object time place at described target video extracts a two field picture; Or, at the described appointed object of described target video some durations before or after the time, extract at least one two field picture; Or, in a period of time interval before and after the described appointed object time of described target video, extract at least one two field picture.
After having extracted at least one two field picture, the contents of object respectively described at least one two field picture being occurred according to different characteristic attributes is extracted, and obtains the appointed object group to be selected that comprises a plurality of described contents of object.
505, Service Process Server returns to described contents of object to described user terminal;
Service Process Server returns to described contents of object to described user terminal, makes described user terminal determine appointed object information according to described contents of object.
Exemplary, Service Process Server can be to teleservice triggered response message, and in this business triggered response message, carries described group of objects to be selected; Concrete, described group of objects to be selected includes a plurality of contents of object, the things occurring at least one two field picture that the plurality of contents of object is extracted in described target video, as: " people ", " desk ", " teacup ", " potted plant " etc.
506, user terminal is determined appointed object information;
After receiving the contents of object that Service Process Server returns, user checks the contents of object of described appointed object group to be selected, therefrom selects appointed object.
After user has selected appointed object, user terminal is determined the appointed object information that this appointed object is corresponding, in embodiments of the present invention, described appointed object information can, for indicating an authentication code of described appointed object, can be also the area information of appointed object.
After user terminal is determined appointed object information, user terminal sends the second service trigger request to described Service Process Server.
507, Service Process Server receives the second service trigger request that user terminal sends;
Service Process Server receives the second service trigger request that user terminal sends, and described the second service trigger request comprises: appointed object information.
508, Service Process Server is used described appointed object to trigger the business that described service identification is corresponding.
After receiving described the second service trigger request, Service Process Server is determined appointed object according to described appointed object information, obtain again the service identification carrying in described the first service trigger request, re-use described appointed object and trigger the business that described service identification is corresponding.
For the ease of understanding, the concrete application scenarios that obtains business with reward voucher is below described in detail the service trigger method of describing in the above embodiments again, please refer to Fig. 6, is specially:
601, Service Process Server interpolation reward voucher obtains business information;
When needs obtain business for video increases reward voucher, Business Processing service is added the information of the default business of obtaining for triggering reward voucher to media data storage.
Concrete, can be when service provider need to increase a business newly for video, service provider is by the default information for business of obtaining for triggering reward voucher of web interface input.Specifically can comprise media identification, video address, service identification, business description, business application module, appointed object sign, appointed object is described, appointed object characteristic, appointed object transforms information, contents extraction strategy sign, contents extraction strategy, content analysis strategy sign, the information such as content analysis strategy.
Media data storage comprises following tables of data, when adding a business for video, to tables of data, adds corresponding data.
1.video_service_object table
Recorded media identification, the service identification that video has been expanded, and the appointed object sign that can trigger business in video.It is empty just having started table, and structure is as follows:
videoID serviceID objectID
? ? ?
Upgrade later table as follows:
videoID serviceID objectID
contentl servicel Logol
Wherein:
VideoID: media identification.In the present embodiment, media identification is contentl;
ServiceID: service identification.In the present embodiment, service identification is servicel;
ObjectID: appointed object sign.In the present embodiment, appointed object is designated objectl;
In the invention process, media identification is that the video of contentl is not expanded any business in advance, now for it increases the reward voucher that service identification is servicel, obtain business, and in video, have an appointed object that can trigger this business to be designated the commodity icon of Logo1.
2.business_extract table
Recorded the service identification of all business, and the contents extraction strategy of business sign.It is empty just having started table, and structure is as follows:
serviceID extractID
? ?
Upgrade later table as follows:
serviceID extractID
servicel extractl
ExtractID: contents extraction strategy sign.In the present embodiment, contents extraction strategy is designated extractl;
3.business_analysis table
Recorded the service identification of all business, and the content analysis strategy of business sign.It is empty just having started table, and structure is as follows:
serviceID analysisID
? ?
Upgrade later table as follows:
serviceID analysisID
servicel analysisl
AnalysisID: content analysis strategy sign.In the present embodiment, content analysis strategy is designated analysisl;
4.business table
Recorded the service identification of all business, business description, business application module address.It is empty just having started table, and structure is as follows:
serviceID service_description service_url
? ? ?
Upgrade later table as follows:
serviceID service_description service_url
servicel Reward voucher obtains business Reward voucher obtains business
? Textual description Application module address
Service_description: business description, introduce the basic use information of business etc.;
Service_url: the address of business application module, realize the server address of business function;
5.object table
Recorded the sign of all appointed objects, appointed object is described, appointed object characteristic, and appointed object transforms information.It is empty just having started table, and structure is as follows:
objectID object_media object_characteristics object_convert_data
? ? ? ?
Upgrade later table as follows:
Figure BDA0000388272130000271
In base:
ObjectID: appointed object sign.In the present embodiment, appointed object is designated icon 1;
Object_media: appointed object is described, as picture, audio frequency, text etc.For picture and audio frequency, can deposit local store path;
Object_characteristics: appointed object characteristic, the i.e. characteristic of picture, audio frequency etc.
Object_convert_data: the conversion information of appointed object.
In embodiment mono-, the commodity figure that appointed object is designated Logo1 indicates corresponding picture, has characteristic of correspondence data, and the information of conversion Logo ID.
Extract table
All contents extraction strategy signs have been recorded, the local store path of contents extraction strategy.It is empty just having started table, and structure is as follows:
extracteID extract_file
? ?
Upgrade later table as follows:
Figure BDA0000388272130000272
Extract_file: contents extraction strategy can be local store path;
Wherein, the form of contents extraction strategy can be script etc.
7.analysis table
All content analysis strategy signs have been recorded, the local store path of content analysis strategy.Just started list structure as follows:
analysisID analysis_file
? ?
Upgrade later table as follows:
Figure BDA0000388272130000281
Analysis_file: content analysis strategy can be local store path;
Wherein, content analysis strategy form can be script etc.
8.video table
Recorded the media identification of all videos, and video address.It is empty just having started table, and structure is as follows:
videoed video_url
? ?
Upgrade later table as follows:
Figure BDA0000388272130000282
VideoID: media identification.In the present embodiment, be contentl;
Video_url: video address;
602, Service Process Server injects business information to video server;
In this step, Service Process Server obtains service identification servicel by reward voucher, reward voucher obtains business textual description, and appointed object is designated the commodity icon of logol, and the metadata of the video that is contentl as media identification is sent to video server; Video server is kept at these metadata informations and video corresponding relation in local database.
Exemplary, in actual applications, video server can be electric program menu (EPG, Electronic Program Guide) server.
603, the video traffic of user terminal broadcast video server;
When user opens user terminal, user terminal requests video server issues the main interface of EPG.User can navigate to video details interface.In this interface, user except checking the details of video own, also can check that the reward voucher of this Video Expansion obtains business information, comprises that reward voucher obtains business textual description, and in this video, triggers the commodity icon etc. that reward voucher obtains business.
In embodiments of the present invention, user terminal requests displaying video, according to media identification contentl, request video server issues video flowing, for user provides video playback service.
604, user terminal sends service trigger request to Service Process Server;
When user is when watching target video, if interested in certain things in this target video, the selected instrument of object that user's terminal provides is selected appointed object; After user has selected appointed object, user terminal generates the appointed object information (can be the area information of commodity icon in embodiments of the present invention) of this appointed object.
Optionally, the selected instrument of described object can be selected window for the content of " circle " or " rectangle ", also can be understandable that for simple mouse instructs cursor, and the form of expression of the selected instrument of object can have multiple, is specifically not construed as limiting herein.
User selects " reward voucher obtains business ", triggers reward voucher and obtains business.The service trigger request message sending to Service Process Server, comprise (media identification contentl, reward voucher obtains the service identification servicel of business, commodity icon time of occurrence 23 seconds, commodity icon area information ((200,300), 30));
Trigger action is complete, and user terminal continues displaying video or continue to suspend video, and latency services processing server returns to the execution result that reward voucher obtains business.
605, Service Process Server carries out video content extraction to target video, and uses described appointed object to trigger the business that described service identification is corresponding;
After Service Process Server receives the service trigger request of user terminal transmission, extract the media identification of carrying in service trigger request, appointed object information, service identification and appointed object time; And determine contents extraction strategy according to service identification.Optionally, according to described service identification at the first business contents extraction strategy corresponding with inquiring about described service identification in tactful relation table.In actual applications, certain business may adaptation have corresponding contents extraction strategy, and in Service Process Server, can store the fitting relation table of service identification and contents extraction strategy, so Service Process Server can be inquired about corresponding contents extraction strategy according to service identification.
Service Process Server carries out media content extraction according to contents extraction strategy and described appointed object time to target video corresponding to described media identification.As, at the described appointed object time place of described target video, extract a two field picture.Extracted after media content, then in described media content, determined appointed object according to described appointed object information; As, with (200,300), 30) be parameter, in the video image extracting, cut apart this region, extract commodity icon.
Optionally, after tentatively having determined appointed object, Service Process Server can also be according to media identification and service identification in media data storage, obtain the view data that can trigger the commodity icon of the corresponding business of described service identification in described target video, and with (200,300), 30) for parameter extraction to the view data of commodity icon compare, if the calculated difference of two characteristics is less than a threshold value, determine that described appointed object is for triggering the appointed object of described business, the flow process can continuation business triggering; If the calculated difference of two characteristics is more than or equal to a threshold value, determine that the commodity icon extracting not can trigger the icon that obtains coupon business, Service Process Server can return to corresponding error message to user terminal.
Exemplary, can calculate the Euclidean distance of described two characteristics, if the Euclidean distance of two characteristics is less than a threshold value, determine that described appointed object is for triggering the appointed object of described business.
After determining appointed object, Service Process Server is used described appointed object to trigger the business that described service identification is corresponding.In embodiments of the present invention, what user triggered is that reward voucher obtains business, if determine, the selected commodity icon of user can trigger corresponding business, and Service Process Server can be shared the selected commodity icon of user on specific social networks, and obtains corresponding reward voucher from this social networks.
606, user terminal receives the service processing result that Service Process Server returns.
If the selected commodity icon of user can trigger corresponding business, Service Process Server gets after corresponding reward voucher, and this reward voucher is sent to described user terminal.
If the selected commodity icon of user can not trigger corresponding business, Service Process Server can return to corresponding error message to user terminal.
Only with some examples, the application scenarios in the embodiment of the present invention is illustrated above, is understandable that, in actual applications, can also have more application scenarios, be specifically not construed as limiting herein.
To describing for carrying out the embodiment of the Service Process Server of the present invention of above-mentioned service trigger method, its logical construction please refer to Fig. 7 below, and the embodiment of Service Process Server in the embodiment of the present invention comprises:
Receiving element 701, the service trigger request sending for receiving user terminal, described service trigger request comprises: media identification, service identification and appointed object time;
Extraction unit 702, for extracting media content according to contents extraction strategy and described appointed object time at target video corresponding to described media identification;
Object determining unit 703 for determining appointed object information, is determined appointed object in described media content according to described appointed object information;
Service trigger unit 704, for being used described appointed object to trigger the business that described service identification is corresponding.
Further, described service trigger request also comprises: appointed object information;
Described object determining unit 703 specifically for: in described service trigger request, extract described appointed object information.
Further, described object determining unit specifically for: according to described service identification at the first business contents extraction strategy corresponding with inquiring about described service identification in tactful relation table; According to described contents extraction strategy, determine appointed object information.
Further, described Service Process Server also comprises:
Fetch strategy determining unit 705, for inquiring about at the first business and tactful relation table the contents extraction strategy that described service identification is corresponding according to described service identification; Or, according to described appointed object information at the object contents extraction strategy corresponding with inquiring about described appointed object information in tactful relation table; Or, obtain the strategy sign of carrying in described service trigger request; According to described strategy sign, select the contents extraction strategy of described target video.
Further, described contents extraction strategy comprises:
Described appointed object time place at described target video extracts a two field picture;
Or, at the described appointed object of described target video some durations before or after the time, extract at least one two field picture;
Or, in a period of time interval before and after the described appointed object time of described target video, extract at least one two field picture;
Or, in the some durations at the described appointed object of described target video before or after the time, extract a section audio;
Or, in a period of time interval before and after the described appointed object time of described target video, extract a section audio;
Or, at the described appointed object time place of described target video, extract captions;
Or, in the some durations at the described appointed object of described target video before or after the time, extract one section of captions;
Or, in a period of time interval before and after the described appointed object time of described target video, extract one section of captions.
Further, described appointed object information comprises:
The area information of appointed object, or the characteristic attribute of appointed object.
Further, described object determining unit 703 specifically for: if the area information that described appointed object information is appointed object, described media content is converted to characteristic, described characteristic comprises: matrix, and in described matrix, each vector represents each pixel of frame of video; The pixel that extracts target area according to the area information of described appointed object in described characteristic is as appointed object, and described target area is the specified region of described area information;
Or if the characteristic attribute that described appointed object information is appointed object is converted to characteristic by described media content, described characteristic comprises: matrix, in described matrix, each vector represents each pixel of frame of video; According to described appointed object characteristic attribute, in described characteristic, extract meet described characteristic attribute data message as appointed object.
Further, described object determining unit specifically also for: after described media content is converted to characteristic, according to described media identification and described service identification in media data storage, obtain the characteristic that can trigger the business that described service identification is corresponding in described target video, and compare with the characteristic that described media content is converted to; Under the scene of the area information that is appointed object in described appointed object information, if the calculated difference of two characteristics is less than a threshold value, trigger the described pixel that extracts target area according to the area information of appointed object in described characteristic as appointed object; Under the scene of the characteristic attribute that is appointed object in described appointed object information, if the calculated difference of two characteristics is less than a threshold value, trigger according to described appointed object characteristic attribute, in described characteristic, extract meet described characteristic attribute data message as appointed object.
Further, described Service Process Server also comprises:
Analysis strategy determining unit 706, for inquiring about at the second business and tactful relation table the content analysis strategy that described service identification is corresponding according to described service identification.
The specific operation process of above-mentioned unit/module, comprising:
In actual applications, when user user terminal is watched video, if found interested appointed object in video, can in user terminal, select corresponding business to trigger; Concrete, user can suspend video, the business that selection will trigger, and user terminal is according to current media identification, and the time that user suspends and user-selected business generate service trigger request, and to Service Process Server, this service trigger request occur.
Receiving element 701 receives the service trigger request that user terminal sends, and described service trigger request comprises: media identification, appointed object information, service identification and appointed object time.
The expression information of the video that described media identification is watched for user, the corresponding video of this media identification is target video.The expression information that described appointed object information is appointed object in target video, is specifically as follows the image coordinate in video, can be also the authentication code of specific matters, as, the authentication code of people or car; Be understandable that, appointed object information can also, for other information that represents appointed object, specifically be not construed as limiting herein.Described service identification refers to the identification information of the required business that this appointed object is triggered of user, and the type of service that can trigger has multiple, as information inquiry, and content analysis, recognition of face etc.The described appointed object time is a time point before and after user's described appointed object of appointment in this target video occurs.
Optionally, described service trigger request also further comprises: strategy sign, described strategy sign is used to specify corresponding contents extraction strategy.
After receiving service trigger request, extraction unit 702 extracts media content according to contents extraction strategy and described appointed object time in target video corresponding to described media identification.
Optionally, before carrying out media content extraction, fetch strategy determining unit 705 can be according to described service identification at the first business contents extraction strategy corresponding with inquiring about described service identification in tactful relation table; Or, according to described appointed object information at the object contents extraction strategy corresponding with inquiring about described appointed object information in tactful relation table; Or, obtain the strategy sign of carrying in described service trigger request; According to described strategy sign, select the contents extraction strategy of described target video.
Optionally, it is multiple that Service Process Server determines that the method for contents extraction strategy has, and specifically can comprise:
One, according to described service identification at the first business contents extraction strategy corresponding with inquiring about described service identification in tactful relation table.In actual applications, certain business may adaptation have corresponding contents extraction strategy, and in Service Process Server, can store the fitting relation table (being described the first business and tactful relation table) of service identification and contents extraction strategy, so Service Process Server can be inquired about corresponding contents extraction strategy according to service identification.
Two, according to described appointed object information at the object contents extraction strategy corresponding with inquiring about described appointed object information in tactful relation table.In actual applications, certain appointed object may adaptation have corresponding contents extraction strategy, and in Service Process Server, can store the fitting relation table (being described object and tactful relation table) of appointed object information and contents extraction strategy, so Service Process Server can be according to the corresponding contents extraction strategy of appointed object information inquiry.
Three, according to described strategy sign, select the contents extraction strategy of described target video.In actual applications, user can also select specific contents extraction strategy according to the demand of self, the strategy carrying by service trigger request sign indicating services processing server chosen content fetch strategy.
Concrete, described contents extraction strategy can comprise: the described appointed object time place at described target video extracts a two field picture; Or, at the described appointed object of described target video some durations before or after the time, extract at least one two field picture; Or, in a period of time interval before and after the described appointed object time of described target video, extract at least one two field picture; Or, in the some durations at the described appointed object of described target video before or after the time, extract a section audio; Or, in a period of time interval before and after the described appointed object time of described target video, extract a section audio; Or, at the described appointed object time place of described target video, extract captions; Or, in the some durations at the described appointed object of described target video before or after the time, extract one section of captions; Or, in a period of time interval before and after the described appointed object time of described target video, extract one section of captions.
Be understandable that, Service Process Server determines that the method for contents extraction strategy has and multiplely can have multiplely, is specifically not construed as limiting herein.
Optionally, before determining appointed object, analysis strategy determining unit 706 according to described service identification at the second business content analysis strategy corresponding with inquiring about described service identification in tactful relation table.In actual applications, in Service Process Server, can store multiple content analysis strategy, adapt to respectively different business, because these content analysis strategies are aimed at, different business customizes, therefore, determine that the efficiency of appointed object and success rate are all higher; And the fitting relation of business and content analysis strategy can be stored in described the second business and tactful relation table.
Object determining unit 703 is determined appointed object in described media content according to described appointed object information.Concrete, if the area information that described appointed object information is appointed object, the method of determining appointed object can be: described media content is converted to characteristic, and described characteristic comprises: matrix, and in described matrix, each vector represents each pixel of frame of video; The pixel that extracts target area according to the area information of described appointed object in described characteristic is as appointed object, and described target area is the specified region of described area information.Optionally, before determining appointed object according to described appointed object information in described media content, Service Process Server can be according to described service identification at the second business content analysis strategy corresponding with inquiring about described service identification in tactful relation table.In actual applications, in Service Process Server, can store multiple content analysis strategy, adapt to respectively different business, because these content analysis strategies are aimed at, different business customizes, therefore, determine that the efficiency of appointed object and success rate are all higher; And the fitting relation of business and content analysis strategy can be stored in described the second business and tactful relation table.
After determining appointed object, service trigger unit 704 is used described appointed object to trigger the business that described service identification is corresponding.Exemplary, if what the business triggering was appointed object shares, suppose that this appointed object is icon, user wants this icon to share on specific social networks, Service Process Server is reserved in the authentication information of local social networks by user, open the link of corresponding social network sites, this icon is published on this social network sites.
Refer to Fig. 9, the embodiment of the present invention also provides a kind of Service Process Server, can comprise:
Input unit 901, output device 902, (quantity of the processor in Service Process Server can be for one or more for memory 903 and processor 904, the processor of take in Fig. 9 is example) in some embodiments of the invention, input unit 901, output device 902, memory 903 can be connected by bus or alternate manner with processor 904, wherein, in Fig. 9, by bus, be connected to example.
Wherein, described processor 904 is carried out following steps:
After input unit 901 receives the service trigger request of user terminal transmission, processor 904 extracts media content according to contents extraction strategy and described appointed object time in target video corresponding to described media identification; Determine appointed object information; According to described appointed object information, in described media content, determine appointed object; Use described appointed object to trigger the business that described service identification is corresponding.After having triggered related service, output device 902 returns to user terminal the result that described business triggers.
Wherein, the content of memory 903 storages comprises:
Described service trigger request comprises: media identification, service identification and appointed object time;
Optionally, described service trigger request also comprises: appointed object information;
Described appointed object information comprises: the area information of appointed object, or the characteristic attribute of appointed object;
Optionally, described contents extraction strategy comprises:
Described appointed object time place at described target video extracts a two field picture;
Or, at the described appointed object of described target video some durations before or after the time, extract at least one two field picture;
Or, in a period of time interval before and after the described appointed object time of described target video, extract at least one two field picture;
Or, in the some durations at the described appointed object of described target video before or after the time, extract a section audio;
Or, in a period of time interval before and after the described appointed object time of described target video, extract a section audio;
Or, at the described appointed object time place of described target video, extract captions;
Or, in the some durations at the described appointed object of described target video before or after the time, extract one section of captions;
Or, in a period of time interval before and after the described appointed object time of described target video, extract one section of captions.
To describing for carrying out the embodiment of the Service Process Server of the present invention of above-mentioned service trigger method, its logical construction please refer to Fig. 8 below, and another embodiment of the Service Process Server in the embodiment of the present invention comprises:
The first receiving element 801, the first service trigger request sending for receiving user terminal, described the first service trigger request comprises: media identification and appointed object time;
Contents extraction unit 802, for extracting contents of object according to contents extraction strategy and described appointed object time at target video corresponding to described media identification;
Information feedback unit 803, the result of extracting for return to described contents of object to described user terminal, the result that described user terminal is extracted according to described media content is determined appointed object information;
The second receiving element 804, the second service trigger request sending for receiving described user terminal, described the second service trigger request comprises: appointed object information;
Object determining unit 805, for determining appointed object according to described appointed object information;
Sign acquiring unit 806, the service identification sending for obtaining described user terminal;
Service trigger unit 807, for being used described appointed object to trigger the business that described service identification is corresponding.
Further, described sign acquiring unit 806 specifically for: in described the first service trigger request, obtain described service identification, or, in described the second service trigger request, obtain described service identification.
Further, described contents extraction unit 802 specifically for: according to the described appointed object time, in described target video, extract at least one two field picture; The contents of object respectively described at least one two field picture being occurred according to different characteristic attributes is extracted, and obtains the appointed object group to be selected that comprises a plurality of described contents of object.
Further, described service trigger request also comprises: strategy sign;
Described Service Process Server also comprises:
Strategy determining unit 808, for selecting the contents extraction strategy of described target video according to described strategy sign.
Further, described contents extraction strategy comprises:
Described appointed object time place at described target video extracts a two field picture;
Or, at the described appointed object of described target video some durations before or after the time, extract at least one two field picture;
Or, in a period of time interval before and after the described appointed object time of described target video, extract at least one two field picture.
The specific operation process of above-mentioned unit/module, comprising:
In actual applications, when user user terminal is watched video, if found interested appointed object in video, can in user terminal, select corresponding business to trigger; Concrete, user can suspend video, the business that selection will trigger, and user terminal is according to current media identification, and the time that user suspends and user-selected business generate service trigger request, and to Service Process Server, this service trigger request occur.
The first receiving element 801 receives the first service trigger request that user terminal sends, and described the first service trigger request comprises: media identification and appointed object time.
The expression information of the video that described media identification is watched for user, the corresponding video of this media identification is target video.
The described appointed object time is a time point before and after user's described appointed object of appointment in this target video occurs.
Optionally, described the first service trigger request also further comprises: strategy sign and extraction duration information, and described strategy sign is used to specify corresponding contents extraction strategy; Described extraction duration information is used to indicate the duration at the video that carries out intercepting when media content extracts.
After having obtained the first service trigger request, contents extraction unit 802 carries out contents of object extraction according to contents extraction strategy and described appointed object time to target video corresponding to described media identification, concrete, Service Process Server extracts at least one two field picture in described target video according to the described appointed object time; The contents of object respectively described at least one two field picture being occurred according to different characteristic attributes is extracted, and obtains the appointed object group to be selected that comprises a plurality of described contents of object.
After having obtained described contents of object, information feedback unit 803 returns to described contents of object to described user terminal, makes described user terminal determine appointed object information according to described contents of object.
Exemplary, Service Process Server can be to teleservice triggered response message, and in this business triggered response message, carries described group of objects to be selected; Concrete, described group of objects to be selected includes a plurality of contents of object, the things occurring at least one two field picture that the plurality of contents of object is extracted in described target video, as: " people ", " desk ", " teacup ", " potted plant " etc.
After receiving the contents of object that Service Process Server returns, user checks the contents of object of described appointed object group to be selected, therefrom selects appointed object.
After user has selected appointed object, user terminal is determined the appointed object information that this appointed object is corresponding, in embodiments of the present invention, described appointed object information can, for indicating an authentication code of described appointed object, can be also the area information of appointed object.
Optionally, in embodiments of the present invention, after user has selected appointed object, can also select the required business triggering for this appointed object, corresponding, user terminal is determined the service identification that this business is corresponding.
After receiving the contents of object that Service Process Server returns, the second receiving element 804 receives the second service trigger request that user terminal sends, and described the second service trigger request comprises: appointed object information.Further, in embodiments of the present invention, described the second service trigger request can also comprise: service identification.
After receiving described the second service trigger request, object determining unit 805 is determined appointed object according to described appointed object information, by sign acquiring unit 806, obtain the service identification carrying in described the second service trigger request again, finally, service trigger unit 807 is used described appointed object to trigger the business that described service identification is corresponding.
Same referring to Fig. 9, the embodiment of the present invention also provides a kind of Service Process Server, can comprise:
Input unit 901, output device 902, (quantity of the processor in Service Process Server can be for one or more for memory 903 and processor 904, the processor of take in Fig. 9 is example) in some embodiments of the invention, input unit 901, output device 902, memory 903 can be connected by bus or alternate manner with processor 904, wherein, in Fig. 9, by bus, be connected to example.
Wherein, described processor 904 is carried out following steps:
At input unit 901, refer to Fig. 9, the embodiment of the present invention also provides a kind of Service Process Server, can comprise:
Input unit 901, output device 902, (quantity of the processor in Service Process Server can be for one or more for memory 903 and processor 904, the processor of take in Fig. 9 is example) in some embodiments of the invention, input unit 901, output device 902, memory 903 can be connected by bus or alternate manner with processor 904, wherein, in Fig. 9, by bus, be connected to example.
Wherein, described processor 904 is carried out following steps:
After input unit 901 receives the service trigger request of user terminal transmission, processor 904 extracts contents of object according to contents extraction strategy and described appointed object time in target video corresponding to described media identification; According to described appointed object information, determine appointed object; Obtain the service identification that described user terminal sends; Use described appointed object to trigger the business that described service identification is corresponding.
Output device 902, after described user terminal returns to described contents of object, makes described user terminal determine appointed object information according to described contents of object; Input unit 901 receives the second service trigger request that described user terminal sends.
Wherein, the content of memory 903 storages comprises:
Described service trigger request comprises: media identification, service identification and appointed object time;
Optionally, described service trigger request also comprises: appointed object information;
Described appointed object information comprises: the area information of appointed object, or the characteristic attribute of appointed object;
Optionally, described contents extraction strategy comprises:
Described appointed object time place at described target video extracts a two field picture;
Or, at the described appointed object of described target video some durations before or after the time, extract at least one two field picture;
Or, in a period of time interval before and after the described appointed object time of described target video, extract at least one two field picture;
Or, in the some durations at the described appointed object of described target video before or after the time, extract a section audio;
Or, in a period of time interval before and after the described appointed object time of described target video, extract a section audio;
Or, at the described appointed object time place of described target video, extract captions;
Or, in the some durations at the described appointed object of described target video before or after the time, extract one section of captions;
Or, in a period of time interval before and after the described appointed object time of described target video, extract one section of captions.
To describing for carrying out the embodiment of the transaction processing system of the present invention of above-mentioned service trigger method, its logical construction please refer to Figure 10 below, and the embodiment of transaction processing system in the embodiment of the present invention comprises:
User terminal 1001 and Service Process Server 1002;
The business that described user terminal 1001 triggers for the needs of selecting according to user generates service trigger request, and send described service trigger request to described Service Process Server, described service trigger request comprises: media identification, service identification and appointed object time;
The service trigger request that described Service Process Server 1002 sends for receiving user terminal, carries out media content extraction according to contents extraction strategy and described appointed object time to target video corresponding to described media identification; Determine appointed object information; According to described appointed object information, in described media content, determine appointed object; Use described appointed object to trigger the business that described service identification is corresponding.
To describing for carrying out the embodiment of the transaction processing system of the present invention of above-mentioned service trigger method, same with reference to Figure 10, another embodiment of the transaction processing system in the embodiment of the present invention comprises below:
User terminal 1001 and Service Process Server 1002;
Described user terminal 1001 is for generating the first service trigger request, and sends described the first service trigger request to described Service Process Server, and described the first service trigger request comprises: media identification and appointed object time; Receive described Service Process Server and return to the result that described contents of object is extracted, the result that described user terminal is extracted according to described media content is determined appointed object information; To Service Process Server, send the second service trigger request, described the second service trigger request comprises: appointed object information;
The first service trigger request that described Service Process Server 1002 sends for receiving user terminal, carries out contents of object extraction according to contents extraction strategy and described appointed object time to target video corresponding to described media identification; To described user terminal, return to the result that described contents of object is extracted, receive the second service trigger request that user terminal sends, according to described appointed object information, determine appointed object; Obtain the service identification that user terminal sends; Use described appointed object to trigger the business that described service identification is corresponding.
In above-mentioned transaction processing system, the specific operation process of user terminal 1001 and Service Process Server 1002 refers to embodiment of the method, repeats no more herein.
In the several embodiment that provide in the application, should be understood that, disclosed apparatus and method can realize by another way.For example, device embodiment described above is only schematic, for example, the division of described unit, be only that a kind of logic function is divided, during actual realization, can have other dividing mode, for example a plurality of unit or assembly can in conjunction with or can be integrated into another system, or some features can ignore, or do not carry out.Another point, shown or discussed coupling each other or direct-coupling or communication connection can be by some interfaces, indirect coupling or the communication connection of device or unit can be electrically, machinery or other form.
The described unit as separating component explanation can or can not be also physically to separate, and the parts that show as unit can be or can not be also physical locations, can be positioned at a place, or also can be distributed in a plurality of network element.Can select according to the actual needs some or all of unit wherein to realize the object of the present embodiment scheme.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, can be also that the independent physics of unit exists, and also can be integrated in a unit two or more unit.Above-mentioned integrated unit both can adopt the form of hardware to realize, and also can adopt the form of SFU software functional unit to realize.
If the form of SFU software functional unit of usining described integrated unit realizes and during as production marketing independently or use, can be stored in a computer read/write memory medium.Understanding based on such, the all or part of of the part that technical scheme of the present invention contributes to prior art in essence in other words or this technical scheme can embody with the form of software product, this computer software product is stored in a storage medium, comprise that some instructions are with so that a computer equipment (can be personal computer, server, or the network equipment etc.) carry out all or part of step of method described in each embodiment of the present invention.And aforesaid storage medium comprises: USB flash disk, portable hard drive, read-only memory (ROM, Read-Only Memory), the various media that can be program code stored such as random access memory (RAM, Random Access Memory), magnetic disc or CD.
The above; be only the specific embodiment of the present invention, but protection scope of the present invention is not limited to this, is anyly familiar with those skilled in the art in the technical scope that the present invention discloses; can expect easily changing or replacing, within all should being encompassed in protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion by the described protection range with claim.

Claims (31)

1. a service trigger method, is characterized in that, comprising:
Receive the service trigger request that user terminal sends, described service trigger request comprises: media identification, service identification and appointed object time;
According to contents extraction strategy and described appointed object time, in target video corresponding to described media identification, extract media content;
Determine appointed object information;
According to described appointed object information, in described media content, determine appointed object;
Use described appointed object to trigger the business that described service identification is corresponding.
2. method according to claim 1, is characterized in that,
Described service trigger request also comprises: appointed object information;
Described definite appointed object information comprises: in described service trigger request, extract described appointed object information.
3. method according to claim 1, is characterized in that, described according to contents extraction strategy and described appointed object time, in target video corresponding to described media identification, extract media content before, comprising:
According to described service identification at the first business contents extraction strategy corresponding with inquiring about described service identification in tactful relation table;
Accordingly, described definite appointed object information comprises:
According to described contents extraction strategy, determine appointed object information.
4. method according to claim 2, is characterized in that, described according to contents extraction strategy and described appointed object time, in target video corresponding to described media identification, extract media content before, comprising:
According to described service identification at the first business contents extraction strategy corresponding with inquiring about described service identification in tactful relation table;
Or, according to described appointed object information at the object contents extraction strategy corresponding with inquiring about described appointed object information in tactful relation table;
Or, obtain the strategy sign of carrying in described service trigger request; According to described strategy sign, select the contents extraction strategy of described target video.
5. according to the method described in claim 1 to 4 any one, it is characterized in that, described appointed object information comprises: the area information of appointed object;
If the area information that described appointed object information is appointed object is described according to described appointed object information definite appointed object in described media content, comprising:
Described media content is converted to characteristic, and described characteristic comprises: matrix, and in described matrix, each vector represents each pixel of frame of video; The pixel that extracts target area according to the area information of described appointed object in described characteristic is as appointed object, and described target area is the specified region of described area information.
6. according to the method described in claim 1 to 4 any one, it is characterized in that, described appointed object information also comprises: the characteristic attribute of appointed object;
If the characteristic attribute that described appointed object information is appointed object is described according to described appointed object information definite appointed object in described media content, comprising:
Described media content is converted to characteristic, and described characteristic comprises: matrix, and in described matrix, each vector represents each pixel of frame of video; According to described appointed object characteristic attribute, in described characteristic, extract meet described characteristic attribute data message as appointed object.
7. according to the method described in claim 5 or 6, it is characterized in that,
Described described media content is converted to characteristic after, specifically also comprise:
According to described media identification and described service identification, in media data storage, obtain the characteristic that can trigger the business that described service identification is corresponding in described target video, and compare with the characteristic that described media content is converted to;
Under the scene of the area information that is appointed object in described appointed object information, if the calculated difference of two characteristics is less than a threshold value, trigger the described pixel that extracts target area according to the area information of appointed object in described characteristic as appointed object;
Under the scene of the characteristic attribute that is appointed object in described appointed object information, if the calculated difference of two characteristics is less than a threshold value, trigger according to described appointed object characteristic attribute, in described characteristic, extract meet described characteristic attribute data message as appointed object.
8. according to the method described in claim 1 to 4 any one, it is characterized in that, described according to described appointed object information, in described media content, determine appointed object before, comprising:
According to described service identification at the second business content analysis strategy corresponding with inquiring about described service identification in tactful relation table;
Described according to described appointed object information definite appointed object in described media content, comprising:
According to described content analysis strategy and described appointed object information, in described media content, determine appointed object.
9. according to the method described in claim 1 to 8 any one, it is characterized in that, described contents extraction strategy comprises:
Described appointed object time place at described target video extracts a two field picture;
Or, at the described appointed object of described target video some durations before or after the time, extract at least one two field picture;
Or, in a period of time interval before and after the described appointed object time of described target video, extract at least one two field picture;
Or, in the some durations at the described appointed object of described target video before or after the time, extract a section audio;
Or, in a period of time interval before and after the described appointed object time of described target video, extract a section audio;
Or, at the described appointed object time place of described target video, extract captions;
Or, in the some durations at the described appointed object of described target video before or after the time, extract one section of captions;
Or, in a period of time interval before and after the described appointed object time of described target video, extract one section of captions.
10. a service trigger method, is characterized in that, comprising:
Receive the first service trigger request that user terminal sends, described the first service trigger request comprises media identification and appointed object time;
According to contents extraction strategy and described appointed object time, in target video corresponding to described media identification, extract contents of object;
To described user terminal, return to described contents of object, make described user terminal determine appointed object information according to described contents of object;
Receive the second service trigger request that described user terminal sends, described the second service trigger request comprises: appointed object information;
According to described appointed object information, determine appointed object;
Obtain the service identification that described user terminal sends;
Use described appointed object to trigger the business that described service identification is corresponding.
11. methods according to claim 10, is characterized in that, described the first service trigger request also comprises: service identification;
Accordingly, described in obtain the service identification that user terminal sends, comprising:
In described the first service trigger request, obtain described service identification.
12. methods according to claim 10, is characterized in that, described the second service trigger request also comprises: service identification;
Accordingly, described in obtain the service identification that user terminal sends, comprising:
In described the second service trigger request, obtain described service identification.
13. according to claim 10 to the method described in 12 any one, it is characterized in that, describedly according to contents extraction strategy and described appointed object time, in target video corresponding to described media identification, extracts contents of object, specifically comprises:
According to the described appointed object time, in described target video, extract at least one two field picture;
According to different characteristic attributes, respectively the contents of object occurring in described at least one two field picture is extracted, obtained the appointed object group to be selected that comprises a plurality of described contents of object.
14. according to claim 10 to the method described in 12 any one, it is characterized in that, described service trigger request also comprises: strategy sign;
Accordingly, described according to contents extraction strategy and described appointed object time, in target video corresponding to described media identification, extract contents of object before, comprising:
According to described strategy sign, select the contents extraction strategy of described target video.
15. according to claim 10 to the method described in 14 any one, it is characterized in that, described contents extraction strategy comprises:
Described appointed object time place at described target video extracts a two field picture;
Or, at the described appointed object of described target video some durations before or after the time, extract at least one two field picture;
Or, in a period of time interval before and after the described appointed object time of described target video, extract at least one two field picture.
16. 1 kinds of Service Process Server, is characterized in that, comprising:
Receiving element, the service trigger request sending for receiving user terminal, described service trigger request comprises: media identification, service identification and appointed object time;
Extraction unit, for extracting media content according to contents extraction strategy and described appointed object time at target video corresponding to described media identification;
Object determining unit for determining appointed object information, is determined appointed object in described media content according to described appointed object information;
Service trigger unit, for being used described appointed object to trigger the business that described service identification is corresponding.
17. Service Process Server according to claim 16, is characterized in that,
Described service trigger request also comprises: appointed object information;
Described object determining unit specifically for: in described service trigger request, extract described appointed object information.
18. Service Process Server according to claim 16, is characterized in that, described object determining unit specifically for: according to described service identification at the first business contents extraction strategy corresponding with inquiring about described service identification in tactful relation table; According to described contents extraction strategy, determine appointed object information.
19. according to the Service Process Server described in claim 16 or 17, it is characterized in that, described Service Process Server also comprises:
Fetch strategy determining unit, for inquiring about at the first business and tactful relation table the contents extraction strategy that described service identification is corresponding according to described service identification; Or, according to described appointed object information at the object contents extraction strategy corresponding with inquiring about described appointed object information in tactful relation table; Or, obtain the strategy sign of carrying in described service trigger request; According to described strategy sign, select the contents extraction strategy of described target video.
20. according to claim 16 to the Service Process Server described in 19 any one, it is characterized in that, described appointed object information comprises: the area information of appointed object;
Described object determining unit specifically for: if the area information that described appointed object information is appointed object, described media content is converted to characteristic, described characteristic comprises: matrix, and in described matrix, each vector represents each pixel of frame of video; The pixel that extracts target area according to the area information of described appointed object in described characteristic is as appointed object, and described target area is the specified region of described area information.
21. according to claim 16 to the Service Process Server described in 19 any one, it is characterized in that, described appointed object information comprises: the characteristic attribute of appointed object;
Described object determining unit specifically also for: if the characteristic attribute that described appointed object information is appointed object, described media content is converted to characteristic, described characteristic comprises: matrix, and in described matrix, each vector represents each pixel of frame of video; According to described appointed object characteristic attribute, in described characteristic, extract meet described characteristic attribute data message as appointed object.
22. according to the Service Process Server described in claim 20 or 21, it is characterized in that, described object determining unit specifically also for: after described media content is converted to characteristic, according to described media identification and described service identification in media data storage, obtain the characteristic that can trigger the business that described service identification is corresponding in described target video, and compare with the characteristic that described media content is converted to; Under the scene of the area information that is appointed object in described appointed object information, if the calculated difference of two characteristics is less than a threshold value, trigger the described pixel that extracts target area according to the area information of appointed object in described characteristic as appointed object; Under the scene of the characteristic attribute that is appointed object in described appointed object information, if the calculated difference of two characteristics is less than a threshold value, trigger according to described appointed object characteristic attribute, in described characteristic, extract meet described characteristic attribute data message as appointed object.
23. according to claim 16 to the Service Process Server described in 19 any one, it is characterized in that, described Service Process Server also comprises:
Analysis strategy determining unit, for inquiring about at the second business and tactful relation table the content analysis strategy that described service identification is corresponding according to described service identification.
24. according to claim 16 to the Service Process Server described in 23 any one, it is characterized in that, described contents extraction strategy comprises:
Described appointed object time place at described target video extracts a two field picture;
Or, at the described appointed object of described target video some durations before or after the time, extract at least one two field picture;
Or, in a period of time interval before and after the described appointed object time of described target video, extract at least one two field picture;
Or, in the some durations at the described appointed object of described target video before or after the time, extract a section audio;
Or, in a period of time interval before and after the described appointed object time of described target video, extract a section audio;
Or, at the described appointed object time place of described target video, extract captions;
Or, in the some durations at the described appointed object of described target video before or after the time, extract one section of captions;
Or, in a period of time interval before and after the described appointed object time of described target video, extract one section of captions.
25. 1 kinds of Service Process Server, is characterized in that, comprising:
The first receiving element, the first service trigger request sending for receiving user terminal, described the first service trigger request comprises: media identification and appointed object time;
Contents extraction unit, for extracting contents of object according to contents extraction strategy and described appointed object time at target video corresponding to described media identification;
Information feedback unit, for returning to described contents of object to described user terminal, makes described user terminal determine appointed object information according to described contents of object;
The second receiving element, the second service trigger request sending for receiving described user terminal, described the second service trigger request comprises: appointed object information;
Object determining unit, for determining appointed object according to described appointed object information;
Sign acquiring unit, the service identification sending for obtaining described user terminal;
Service trigger unit, for being used described appointed object to trigger the business that described service identification is corresponding.
26. Service Process Server according to claim 25, it is characterized in that, described sign acquiring unit specifically for: in described the first service trigger request, obtain described service identification, or, in described the second service trigger request, obtain described service identification.
27. according to the Service Process Server described in claim 25 or 26, it is characterized in that, described contents extraction unit specifically for: according to the described appointed object time, in described target video, extract at least one two field picture; According to different characteristic attributes, respectively the contents of object occurring in described at least one two field picture is extracted, obtained the appointed object group to be selected that comprises a plurality of described contents of object.
28. according to the Service Process Server described in claim 25 to 27 any one, it is characterized in that, described service trigger request also comprises: strategy sign;
Described Service Process Server also comprises:
Strategy determining unit, for selecting the contents extraction strategy of described target video according to described strategy sign.
29. according to the Service Process Server described in claim 25 to 27 any one, it is characterized in that, described contents extraction strategy comprises:
Described appointed object time place at described target video extracts a two field picture;
Or, at the described appointed object of described target video some durations before or after the time, extract at least one two field picture;
Or, in a period of time interval before and after the described appointed object time of described target video, extract at least one two field picture.
30. 1 kinds of transaction processing systems, is characterized in that, comprising:
User terminal and Service Process Server;
The business that described user terminal triggers for the needs of selecting according to user generates service trigger request, and sends described service trigger request to described Service Process Server, and described service trigger request comprises: media identification, service identification and appointed object time;
The service trigger request that described Service Process Server sends for receiving user terminal is extracted media content according to contents extraction strategy and described appointed object time in target video corresponding to described media identification; Determine appointed object information; According to described appointed object information, in described media content, determine appointed object; Use described appointed object to trigger the business that described service identification is corresponding.
31. 1 kinds of transaction processing systems, is characterized in that, comprising:
User terminal and Service Process Server;
Described user terminal is used for generating the first service trigger request, and sends described the first service trigger request to described Service Process Server, and described the first service trigger request comprises: media identification and appointed object time; Receive described Service Process Server and return to described contents of object, make described user terminal determine appointed object information according to described contents of object; To Service Process Server, send the second service trigger request, described the second service trigger request comprises: appointed object information;
The first service trigger request that described Service Process Server sends for receiving user terminal is extracted contents of object according to contents extraction strategy and described appointed object time in target video corresponding to described media identification; To described user terminal, return to described contents of object, receive the second service trigger request that user terminal sends, according to described appointed object information, determine appointed object; Obtain the service identification that user terminal sends; Use described appointed object to trigger the business that described service identification is corresponding.
CN201310447296.7A 2013-09-26 2013-09-26 A kind of service trigger method, apparatus and system Active CN103533383B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310447296.7A CN103533383B (en) 2013-09-26 2013-09-26 A kind of service trigger method, apparatus and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310447296.7A CN103533383B (en) 2013-09-26 2013-09-26 A kind of service trigger method, apparatus and system

Publications (2)

Publication Number Publication Date
CN103533383A true CN103533383A (en) 2014-01-22
CN103533383B CN103533383B (en) 2017-06-13

Family

ID=49934992

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310447296.7A Active CN103533383B (en) 2013-09-26 2013-09-26 A kind of service trigger method, apparatus and system

Country Status (1)

Country Link
CN (1) CN103533383B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104951971A (en) * 2015-05-22 2015-09-30 腾讯科技(北京)有限公司 Information displaying system, method and device
WO2016029796A1 (en) * 2014-08-27 2016-03-03 阿里巴巴集团控股有限公司 Method, device and system for identifying commodity in video image and presenting information thereof
CN111988656A (en) * 2020-07-28 2020-11-24 烽火通信科技股份有限公司 Method and system for transmitting streaming media video user touch information

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7240075B1 (en) * 2002-09-24 2007-07-03 Exphand, Inc. Interactive generating query related to telestrator data designating at least a portion of the still image frame and data identifying a user is generated from the user designating a selected region on the display screen, transmitting the query to the remote information system
CN102349048A (en) * 2009-03-11 2012-02-08 索尼公司 Accessing item information for item selected from a displayed image
CN102576365A (en) * 2009-10-06 2012-07-11 高通股份有限公司 Systems and methods for merchandising transactions via image matching in a content delivery system
CN102880634A (en) * 2012-07-30 2013-01-16 成都西可科技有限公司 Intelligent face recognition and retrieval method based on cloud
CN103294744A (en) * 2012-01-09 2013-09-11 三星电子株式会社 Display apparatus, remote control apparatus, and searching methods thereof

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7240075B1 (en) * 2002-09-24 2007-07-03 Exphand, Inc. Interactive generating query related to telestrator data designating at least a portion of the still image frame and data identifying a user is generated from the user designating a selected region on the display screen, transmitting the query to the remote information system
CN102349048A (en) * 2009-03-11 2012-02-08 索尼公司 Accessing item information for item selected from a displayed image
CN102576365A (en) * 2009-10-06 2012-07-11 高通股份有限公司 Systems and methods for merchandising transactions via image matching in a content delivery system
CN103294744A (en) * 2012-01-09 2013-09-11 三星电子株式会社 Display apparatus, remote control apparatus, and searching methods thereof
CN102880634A (en) * 2012-07-30 2013-01-16 成都西可科技有限公司 Intelligent face recognition and retrieval method based on cloud

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016029796A1 (en) * 2014-08-27 2016-03-03 阿里巴巴集团控股有限公司 Method, device and system for identifying commodity in video image and presenting information thereof
US10395120B2 (en) 2014-08-27 2019-08-27 Alibaba Group Holding Limited Method, apparatus, and system for identifying objects in video images and displaying information of same
CN104951971A (en) * 2015-05-22 2015-09-30 腾讯科技(北京)有限公司 Information displaying system, method and device
CN104951971B (en) * 2015-05-22 2018-12-04 腾讯科技(北京)有限公司 information display system, method and device
CN111988656A (en) * 2020-07-28 2020-11-24 烽火通信科技股份有限公司 Method and system for transmitting streaming media video user touch information

Also Published As

Publication number Publication date
CN103533383B (en) 2017-06-13

Similar Documents

Publication Publication Date Title
US10448082B2 (en) Information exchanging method and device, audio terminal and computer-readable storage medium
CN104065979A (en) Method for dynamically displaying information related with video content and system thereof
US8840014B2 (en) Identification code processing system, identification code processing method thereof, and apparatus for supporting same
CN102724327B (en) For Real-time Network page browsing service provider system and the method for browser
CN104378331A (en) Network medium information playing and response processing method, device and system
CN103327021B (en) Method, devices and system of multi-device interaction
CN105025319A (en) Video pushing method and device
CN103368947A (en) Media information control method, related equipment and system
US10506263B2 (en) Extending data records based on device classes
US20100154012A1 (en) Television bookmarking with multiplatform distribution
CN102984558B (en) The method of broadcasting pictures in Set Top Box and channel switch procedure thereof
CN105872602A (en) Advertisement data obtaining method, device and related system
CN103531218A (en) Online multimedia file editing method and system
CN103034704A (en) Multimedia file search method, device and system
CN104363484A (en) Advertisement pushing method and device based on video picture
CN104125140B (en) A kind of message method and device
CN103744912A (en) Video file scanning method and electronic device
CN103559194A (en) Searching method, server and system
CN103533383A (en) Service triggering method, device and system
US10368143B2 (en) Apparatus and method for transceiving scene composition information in multimedia communication system
CN103747284A (en) Video pushing method and server
CN101483751A (en) Digital television opening presenting method and system
CN110971983B (en) Video question answering method, equipment and storage medium
CN103747342A (en) Program list arranging method and device
CN102984676A (en) Method and terminal for processing message session

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20200211

Address after: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen

Patentee after: HUAWEI TECHNOLOGIES Co.,Ltd.

Address before: 210012 HUAWEI Nanjing base, 101 software Avenue, Yuhuatai District, Jiangsu, Nanjing

Patentee before: Huawei Technologies Co.,Ltd.